This research introduces an advanced attention-driven model designed to optimize mobile shelf warehouse order-picking. Our model incorporates an enhanced masking mechanism and context-aware decoder, streamlining the order-picking process. In essence, our model presents an attention model based heuristic solution to the long-standing problem of order-picking optimization, leveraging the latest in attention-based deep learning techniques. The attention model is combined with Apriori and the Adaptive Large Neighborhood Search (ALNS) algorithm to solve the bilevel combinatorial optimization model for mobile shelves. Compared to existing methods, our innovative model shows superior performance, offering significant potential in warehousing solutions.