21 May 2024 in IEEE Transactions on Vehicular Technology
Traffic congestion is a persistent problem in urban areas, which calls for the development of effective traffic signal control (TSC) systems. While existing Reinforcement Learning (RL)-based methods have shown promising performance in optimizing TSC, it is challenging to generalize these methods across intersections of different structures. In this paper, we introduce UniTSA, a universal RL framework tailored for Vehicle-to-Everything (V2X) environments, aimed at overcoming these generalization hurdles. Our framework is equipped with a novel agent architecture that utilizes a junction matrix to uniformly represent intersection states, making it applicable to a variety of intersection designs. Additionally, UniTSA incorporates traffic state augmentation techniques specifically developed for TSC systems. These techniques leverage the rotational symmetry inherent to intersections and emphasize the relative positioning of vehicles over simple vehicle counts, enhancing the model's adaptability to changing traffic conditions and unfamiliar scenarios. We also integrate the Low-Rank Adaptation (LoRA) method, allowing for efficient model customization to specific intersections with minimal additional training. Extensive evaluations conducted on the Simulation of Urban MObility (SUMO) platform, featuring a range of intersection layouts, confirm UniTSA's robust performance. Our results indicate a significant advancement in the development of scalable TSC solutions suitable for diverse V2X applications. The source code in this work is available at https://github.com/wmn7/Universal-Light .
26 September 2024 in IEEE Transactions on Intelligent Transportation Systems
Traffic congestion in urban areas is a significant problem, leading to prolonged travel times, reduced efficiency, and increased environmental concerns. Effective traffic signal control (TSC) is a key strategy for reducing congestion. Unlike most TSC systems that rely on high-frequency control, this study introduces an innovative joint phase traffic signal cycle control method that operates effectively with varying control intervals. Our method features an adjust all phases action design, enabling simultaneous phase changes within the signal cycle, which fosters both immediate stability and sustained TSC effectiveness, especially at lower frequencies. The approach also integrates decentralized actors to handle the complexity of the action space, with a centralized critic to ensure coordinated phase adjusting. Extensive testing on both synthetic and real-world data across different intersection types and signal setups shows that our method significantly outperforms other popular techniques, particularly at high control intervals. Case studies of policies derived from traffic data further illustrate the robustness and reliability of our proposed method.
17 June 2020 in IEEE Transactions on Intelligent Transportation Systems
A freeway stretch with even one pair of unmeasured on/off-ramps is not fully observable in traffic states. Flow observability is essential for freeway traffic modeling, surveillance, and control. It is a longstanding and tricky issue to estimate flows for unmeasured ramp pairs. This problem seems to be hardly tractable in conventional approaches, and this paper intends to handle it based on machine learning. The work was partially inspired by transfer learning. Consider that no measurements are available for a target ramp pair, and the knowledge about ramp flow estimation may be drawn from other (measured) ramp pairs, provided that measured and unmeasured ramp pairs would share similarities in some key traffic flow patterns. Two simple machine learning algorithms, random forest (RF) and gradient boosting machine (GBM), were employed to this end. RF and GBM were driven by real measurement data to establish models that relate ramp flows to adjacent mainstream traffic conditions. The models were then applied for our task. The estimation performance was evaluated using real measurement data from the Shanghai Urban Expressway and the Intercity Highway in California, with satisfactory results obtained.
4 September 2021 in Transportmetrica A: Transport Science
An accurate heavy-duty truck (HDT) fuel consumption model is essential for estimating the truck energy consumption and evaluating energy-saving strategies. However, based on recent truck field tests, we noticed that the estimation discrepancies of several published models were considerable since they were only developed for light-duty vehicles and cannot accurately estimate the HDT engine operation states. This inspired us to develop a generic approach for HDT engine-power estimation with a deep learning approach based on numerous tests. The results show that the proposed approach enables a more accurate estimation of HDT engine power, and when applied as the input to the fuel consumption models (e.g. Virginia-Tech model), the average estimation error is reduced to 13.71% from 28.9%. Besides, once calibrated, the proposed model could be applied to various scenarios without re-calibration. In addition, it can depict the fuel consumption during engine braking, which is largely missing in conventional HDT models.
19 April 2022 in Applied Intelligence