1 December 2021 in Physica A: Statistical Mechanics and its Applications
1 November 2021 in Physica A: Statistical Mechanics and its Applications
4 May 2022 in IEEE Transactions on Intelligent Transportation Systems
With the development of Connected Autonomous Vehicle (CAV) technology, different information flow topologies (IFTs) have been applied to CAV Ad Hoc Networks. Firstly, from the perspective of the controller, a general model is proposed to directly reflect the actual communication effect on the controller instead of simply abstracting it into the optimal time interval, which is more feasible. Secondly, linear stability analysis is carried out based on the general model where different time delays are considered, and stability criterion is obtained for subsequent analysis. Finally, we compare the three main IFTs through numerical simulations and analyze the difference in stability region, robustness, traffic safety, and Eco-driving between platoon Cooperative Adaptive Cruise Control (CACC) controllers based on different IFTs. It is found that adopting CACCs can notably improve the traffic capacity and traffic safety relative to Manual Vehicle (MV) no matter what IFT is adopted. As for the difference between the three IFTs, predecessor-leader following (PLF) and multiple-predecessor-leader following (MPLF) are significantly superior to predecessor following (PF), while the choice between PLF and MPLF depends on the communication bandwidth. With higher communication bandwidth or fewer communication vehicles, MPLF will be a better option; on the contrary, PLF is more suitable.
1 December 2021 in Physica A: Statistical Mechanics and its Applications
22 September 2023 in IEEE Transactions on Intelligent Transportation Systems
This paper proposes an adversarial reinforcement learning (RL)-based traffic control strategy to improve the traffic efficiency of an integrated network with expressway and adjacent surface streets. The proposed adversarial RL integrates adversarial learning into a multi-agent RL model, namely the multi-agent advantage actor-critic (MA2C), so as to enhance the generalization of the control strategy against the mismatch between an offline-training environment and the real traffic process. In the adversarial RL, the RL model is trained to maximize the network throughput, while the adversarial network, which produces disturbances to observed traffic states, is trained based on the opposite reward of the RL model. The proposed control strategy is tested using the microscopic traffic simulation software, SUMO. To reproduce the difference between an offline-training environment and the real traffic process, two different traffic models in SUMO are used for offline-training and online-testing purposes, respectively. Simulation results demonstrate that the proposed approach performs better in reducing total time spent than the original MA2C approach, as well as a conventional feedback based controller.
13 November 2024 in Transportation Research Part C: Emerging Technologies