28 November 2022 in IEEE Transactions on Intelligent Vehicles
Computation offloading is considered as a promising method to improve computation performance of Intelligent Vehicles (IVs), where IVs can offload resource-hungry applications to Mobile Edge Computing (MEC) servers. However, due to the dynamic environment of Intelligent Transportation Systems, it's challenging to develop an effective offloading scheme that ensures stable operation of the system. Furthermore, IVs only offload tasks to MEC servers or parked vehicles, how to take full advantage of resources in a random traffic flow is a main challenge. In this paper, we propose a vehicular-cloud-assisted MEC network in urban cities to fully explore the idle resources and ensure the stability of task queue. Specifically, we develop a novel virtual platform based on deep neural network that predicts vehicles trajectory and creates vehicular cloud to integrate computation resources. We then design a vehicular-cloud-assisted offloading scheme that aims to maximize task throughput in continuous time slots subject to multi-constraint. To address the coupling among multiple variables and different time slots, we put forward a lightweight framework to apply the Lyapunov optimization in combination with deep reinforcement learning. In particular, we apply Lyapunov drift-plus-penalty approach to decompose the initial problem into per-slot subproblems and control the long-term task queue stability. To further reduce the computation complexity, we decouple the subproblem into three processes, and the deep Q-network is put forward to solve it. Extensive simulations demonstrate that under different task arrivals, our proposed scheme can achieve the task queue stability within 10 time slots with a low transmission power.
6 July 2020 in IEEE Access
Road network control is challenging but critical in enhancing urban traffic. This paper proposes a management method for a road network with non-signalized intersections in the connected-vehicle environment, which coordinates connected and automated vehicles’ movements to make the non-signalized intersections conflict-free and efficient. Firstly, the proposed method projects vehicles in road networks into virtual platoons and builds the road-network-wide conflict-free geometric topology considering the vehicles’ conflicting relationships, which describes the geometry car-following relationship in virtual platoons. Then, a distributed linear controller is designed considering vehicle dynamics and communication topology to organize vehicles’ movements with the desired geometric topology. Finally, simulations are conducted to verify the proposed method with different traffic demands. Simulation results show the proposed method can significantly improve traffic efficiency, as well as traffic safety.
21 July 2022 in Physica A: Statistical Mechanics and its Applications
28 January 2019 in Journal of Intelligent Transportation Systems
Speed profiles affect fuel economy tremendously, especially, when vehicles running on an urban road with numerous signalized intersections. To improve fuel economy, in this study, we propose a double-layer speed optimization method with real-time computation that considers traffic signal information collected via vehicle-to-infrastructure communication and traffic conditions. In the first layer, we use a Dijkstra algorithm to optimize the average eco-speed between adjacent intersections with full-horizon traffic signal information, and in the second layer, we use an optimal control method to plan a real-time speed profile with average speed constraints. We conduct numerous field tests using a test bed and an experimental vehicle platform. The test results demonstrate that by computing optimal solutions in real time, the proposed double-layer speed optimization method has the potential to improve fuel economy and decrease trip time.
15 August 2024 in IEEE/CAA Journal of Automatica Sinica
Unsignalized intersections pose a challenge for autonomous vehicles that must decide how to navigate them safely and efficiently. This paper proposes a reinforcement learning (RL) method for autonomous vehicles to navigate unsignalized intersections safely and efficiently. The method uses a semantic scene representation to handle variable numbers of vehicles and a universal reward function to facilitate stable learning. A collision risk function is designed to penalize unsafe actions and guide the agent to avoid them. A scalable policy optimization algorithm is introduced to improve data efficiency and safety for vehicle learning at intersections. The algorithm employs experience replay to overcome the on-policy limitation of proximal policy optimization and incorporates the collision risk constraint into the policy optimization problem. The proposed safe RL algorithm can balance the trade-off between vehicle traffic safety and policy learning efficiency. Simulated intersection scenarios with different traffic situations are used to test the algorithm and demonstrate its high success rates and low collision rates under different traffic conditions. The algorithm shows the potential of RL for enhancing the safety and reliability of autonomous driving systems at unsignalized intersections.
14 February 2021 in Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering
Considering that when a vehicle travels on a low friction coefficient road with high speed, the path tracking ability declines. To keep the performance of path tracking and improve the stabilization under that situation, this article presents approaches to estimate the parameters and control the vehicle. First, the key states of the vehicle and the road adhesion coefficient are estimated by the unscented Kalman filter. This is followed by applying the linear time-varying model-based predictive controller to achieve path tracking control, and the initial tire steering angle control rate is obtained. Finally, the steering angle compensation controller is simultaneously designed by a simple receding horizon corrector algorithm to improve vehicle stability when the path is tracked on a low-adhesion coefficient or at high speed. The performance of the proposed approach is evaluated by software CarSim and MATLAB/Simulink. Simulation results show that an improvement in the performance of path tracking and stabilization can be achieved by the integrated controller under the variable road adhesion coefficient condition and high speed with 110 km/h.