18 June 2024 in IEEE Transactions on Vehicular Technology
With the development of automatic driving technology and the Internet of Vehicles, platooning based on control of Connected and Autonomous Vehicles (CAVs) has become one of the most promising approach to improve traffic efficiency and safety. However, CAVs and Human-Driven Vehicles (HDVs) will coexist for a long period, and the inherent randomness of HDVs may cause traffic flow oscillations within the mixed platoon. This paper proposes a mixed platoon control strategy, Relative Position Encoding Multi Actor Attention Critic (RPE-MAAC), for CAVs operating in mixed platoons with HDVs. To be more specific, RPE-MAAC integrates relative position encoding into the MAAC framework, enhancing the model's capability to handle spatial relationships among platoon members and improve platooning control effectiveness. By incorporating HDV reaction delays in the reward function, RPE-MAAC ensures the stability of the mixed platoon, reducing disruptions and enhancing driving comfort. In particular, the more accurate HDV trajectory generation model, IDM-Informer, is incorporated into the problem formulation to provide feedback that more closely resembles real-world mixed platoon scenarios. Lastly, the effectiveness and stability of the proposed RPE-MAAC-based controller is verified through numerical simulations under various conditions. The superior performance of the proposed algorithm is shown by comparing with existing traditional algorithms and state-of-the-art optimization algorithms.
3 August 2023 in Computer Networks
4 December 2024 in IEEE Internet of Things Journal
Cellular vehicle-to-everything (C-V2X) communication is essential for supporting diverse vehicle applications in Cooperative Vehicle-Infrastructure Systems (CVIS). However, various factors such as building obstructions, signal blockages, and network conditions severely affect the latency and reliability of V2V communication. To address this challenge, we propose a novel dynamic method for communication Mode Selection and Resource Allocation in C-V2X, termed MSRA, which enables vehicles to dynamically select and utilize different communication modes such as V2V, Vehicle-to-Infrastructure (V2I), and Vehicle-to-Network (V2N) for direct, relay, or forwarding communication, based on real-time conditions. To this end, we formulate the joint optimization problem of mode selection and resource allocation as a Markov Decision Process (MDP) and propose a solution based on Multi-Agent Reinforcement Learning (MARL) with centralized training and decentralized execution. Specifically, each vehicle acts as an agent, independently selecting communication modes and resources based on real-time network status and communication link quality, aiming to satisfy the latency and reliability requirements of V2V communication while maximizing the capacity of V2N communication based on heterogeneous Quality of Service (QoS) requirements. Simulation results indicate that the proposed algorithm significantly outperforms other decentralized baselines and demonstrates superior performance under various conditions.
1 June 2026 in Computer Networks