7 December 2022 in IEEE Access
While electric vehicles (EVs) continue to draw more attention as an alternative to traditional fossil fuel vehicles, the relatively short driving range of EVs is often pointed out as their biggest drawback. In terms of energy consumption, one of the most energy-intensive systems in EVs is the heating, ventilation, and air conditioning (HVAC) system. Most HVAC systems use On/Off or PID control for the actuators, but these control methods have low efficiency and are difficult to apply in multiple-input multiple-output systems. In this paper, we propose a novel multi-agent deep reinforcement learning (MADRL) method to directly control actuators such as the compressor and electric expansion valve to reach the setpoint temperature while minimizing the work. The proposed method is evaluated with an industrial vehicle simulator and compared with conventional PID control. The experimental results show that the MADRL-based method improves the efficiency of the HVAC system compared to PID control while achieving comparable target convergence performance.