In the field of multi-intersection signal control, Reinforcement Learning (RL) has demonstrated significant technical benefits in terms of optimization speed, stability, and scalability. Moreover, Graph Neural Networks (GNN) exhibit strong functional abilities in capturing multi-agent and multi-task relationships within non-Euclidean spaces, surpassing other models in these regards. However, existing algorithms based on homogeneous graph neural networks struggle to encapsulate the heterogeneous nature of traffic object. Therefore, this paper proposes a novel algorithm, termed the Heterogeneous Graph Attention Network (HGAT) and Multi-Agent RL (MARL)-based Method for Multi-Intersection Traffic Signal Control. HGAT-MARL establishes a heterogeneous graph model to explicitly represent the states of various traffic objects in the road network. Leveraging a graph attention model, it learns and aggregates traffic state data within intersections and their proximate adjacent intersections, thereby capturing the mechanism of information transfer among diverse object such as vehicles and intersections. Subsequently, within the multi-agent RL framework, agents collaborate by sharing global states and rewards among multi-intersection, actively exploring and refining the optimal control policy to achieve optimized control of global traffic flow. Experimental results on real-world traffic datasets demonstrate that HGAT-MARL exhibits significant advantages in reducing vehicle travel time.
25 August 2023 in IEEE Transactions on Intelligent Transportation Systems
Urged by a close future perspective of a traffic flow made of a mix of human-driven vehicles and automated vehicles (AVs), research has recently focused on studying the traffic flow characteristics of Adaptive Cruise Controls (ACCs), the most typical AV. However, in most works, the ACC system is studied under a simplifying and unrealistic assumption, or the ACC system modeled is inaccurate. This paper proposes a general hierarchical control system to model ACC systems with several assumptions based on the deficiencies above. Moreover, a field experiment was conducted, and the corresponding experimental data was used to verify the proposed hierarchical control system and assumptions. In addition, string stability is explored along with sensitivity analyses of control parameters based on an example under the constant time gap policy. The results show that different upper-level controller parameters have different delays, where the delay of the speed is negligible; the introduction of actuator delay and lag in the lower-level controller can significantly improve the model goodness of fit. Furthermore, optimizing the delay and lag in the lower-level controller can significantly enhance the string stability of ACCs than optimizing the control parameters.
In traditional traffic simulation studies, vehicle behavior has typically been modeled using complex analytical frameworks, which often struggle to encompass the full range of variables affecting vehicle operations. Addressing this gap, our research introduces an innovative data-driven framework for traffic simulation that incorporates human driving data into its decision-making processes. This enables the modeling of diverse vehicle behaviors by taking into account both vehicle-specific characteristics and environmental factors. At the core of this framework are two advanced deep neural networks, convolutional long short-term memory and convolutional gated recurrent unit, which underpin our vehicle traffic simulation model. Utilizing datasets from the Next Generation Simulation project, specifically the I-80 and US-101 road sections, our study further evaluates the framework’s performance through single-step continuous prediction, as well as transferability tests, employing the TransMSEloss function to optimize prediction accuracy. Our findings reveal that the proposed data-driven model significantly outperforms traditional models, achieving an exceptional accuracy of 97.22% in training and 95.76% in testing. Notably, in continuous prediction, our model maintains an 89.57% accuracy up to the fifth step, exceeding the traditional framework’s 82.82% by 5% to 10% at each step. Time cost analysis indicates that while the data-driven framework’s advantages are more pronounced in large-scale simulations, it also demonstrates strong transferability, with a 93.48% accuracy on diverse datasets, showcasing its applicability across different traffic scenarios. This study not only highlights the potential of deep learning in traffic simulation, but also sets a new benchmark for accuracy and scalability in the field.