This study presents the first investigation into the problem of autonomous vehicle (AV) merging into existing platoons, proposing a multi-agent deep reinforcement learning (MA-DRL)-based cooperative control framework. The developed MA-DRL architecture enables coordinated learning among multiple autonomous agents to address the multi-objective coordination challenge through synchronized control of platoon longitudinal acceleration, AV steering and acceleration. To enhance training efficiency, we develop a dual-layer multi-agent maximum Q-value proximal policy optimization (MAMQPPO) method, which extends the multi-agent PPO algorithm (a policy gradient method ensuring stable policy updates) by incorporating maximum Q-value action selection for platoon gap control and discrete command generation. This method simplifies the training process by using maximum Q-value action policy optimization to learn platoon gap selection and discrete action commands. Furthermore, a partially decoupled reward function (PD-Reward) is designed to properly guide the behavioral actions of both AVs and platoons while accelerating network convergence. Comprehensive highway simulation experiments show the proposed method reduces merging time by 37.69% (12.4 s vs. 19.9 s) and energy consumption by 58% (3.56 kWh vs. 8.47 kWh) compared to existing methods (the quintic polynomial-based + PID (Proportional–Integral–Differential)).
25 January 2022 in Iranian Journal of Science and Technology, Transactions of Civil Engineering
In recent years, e-bikes have rapidly gained popularity in China. However, riders frequently engage in aberrant behaviors, posing significant traffic safety concerns. Field observation combined with traffic conflict techniques offer an effective approach for identifying risky riding behaviors that significantly affect traffic safety. This study aims to address two major limitations in existing research that can lead to estimation biases: the unsystematic and incomplete inclusion of potential risky riding behaviors, and the insufficient consideration of unobserved heterogeneity in conflict data. Data on 437 e-bike–motor vehicle conflicts were collected at four signalized intersections in Hefei, covering 21 variables including illegal, negligent, and error-prone riding behaviors, as well as sociodemographic factors. Appropriate conflict risk indicators were selected for straight-line and angle conflicts, respectively. A random parameters binary logit model with heterogeneity in means and variances (RPBL-HMV) was developed and compared against binary logistic and mixed logit models. The results indicate that the RPBL-HMV model provides a significantly better goodness-of-fit than the other two models. Six factors with fixed parameters are positively associated with high-risk conflicts, while two factors exhibit random parameters—one of which decreases in mean when riders fail to slow down before turning. The identified risky behaviors and the corresponding targeted countermeasures offer practical insights for regulating unsafe e-bike riding and improving intersection safety.
Landfill seismic instability often leads to disastrous consequences of accidents, which makes it particularly important to the stability analysis of landfills in the landfill engineering. The seismic stability analysis of this paper focused on the composite failure mode of landfills. In order to study the seismic stability of the landfill against composite failure mode, the log-spiral slip surfaces were introduced into the internal failure of the landfill body. In the combination of log-spiral method and wedge method, this paper developed a new method to analyze the seismic stability of the landfill against composite failure mode based on the limit equilibrium principle. Through analysis for the safety factors from the landfill against translational failure mode and against composite failure mode, the critical failure mode would be found in specific working conditions.