The Multi-load Automated Guided Vehicle (M-AGV) has emerged as a key enabling technology for intelligent and sustainable workshop logistics owing to its potential to enhance transportation efficiency and reduce system costs. To address the limitations in energy optimization caused by simplified AGV speed and payload modeling in existing scheduling models, this study develops a multi-factor coupled energy consumption model—integrating vehicle speed, travel distance, and dynamic payload—to minimize the total energy consumption of M-AGV systems. To effectively solve the model, a hybrid optimization algorithm that combines the State–Action–Reward–State–Action (SARSA) learning algorithm with the Triangulation Topology Aggregation Optimizer (TTAO), complemented by a similarity-based individual generation strategy, is designed to jointly enhance the algorithm’s exploration and exploitation capabilities. Comparative experiments were conducted across task scenarios involving three different handling task scales and three levels of M-AGV fleet heterogeneity, demonstrating that the proposed SARSA-TTAO algorithm outperforms Genetic Algorithm (GA), Particle Swarm Optimization (PSO), and the Hybrid Genetic Algorithm with Large Neighborhood Search (GA-LNS) in terms of solution accuracy and convergence performance. The study also reveals the differences between homogeneous and heterogeneous M-AGV fleets in task allocation and resource utilization under energy-optimal conditions.