10 November 2020 in IEEE Transactions on Cybernetics
Through vehicle-to-vehicle (V2V) communication, both human-driven and autonomous vehicles can actively exchange data, such as velocities and bumper-to-bumper distances. Employing the shared data, control laws with improved performance can be designed for connected and autonomous vehicles (CAVs). In this article, taking into account human-vehicle interaction and heterogeneous driver behavior, an adaptive optimal control design method is proposed for a platoon mixed with multiple preceding human-driven vehicles and one CAV at the tail. It is shown that by using reinforcement learning and adaptive dynamic programming techniques, a near-optimal controller can be learned from real-time data for the CAV with V2V communications, but without the precise knowledge of the accurate car-following parameters of any driver in the platoon. The proposed method allows the CAV controller to adapt to different platoon dynamics caused by the unknown and heterogeneous driver-dependent parameters. To improve the safety performance during the learning process, our off-policy learning algorithm can leverage both the historical data and the data collected in real time, which leads to considerably reduced learning time duration. The effectiveness and efficiency of our proposed method is demonstrated by rigorous proofs and microscopic traffic simulations.
8 March 2019 in IEEE Transactions on Human-Machine Systems
This paper presents a cooperative/shared framework of the driver and his/her semi-autonomous vehicle in order to achieve desired steering performance. In particular, a copilot controller and the driver together operate and control the vehicle. Exploiting the classical small-gain theory, our proposed shared steering controller is developed independent of the unmeasurable internal states of the human driver, and only relies on his/her steering torque. Furthermore, by adopting data-driven adaptive dynamic programming and an iterative learning scheme, the shared steering controller is studied from the measurable data of the driver and the vehicle. Meanwhile, the accurate knowledge of the driver and the vehicle dynamics is unnecessary, which settles the problem of their potential parametric variations/uncertainties in practice. The effectiveness of the proposed method is validated by rigorous analysis and demonstrated by numerical simulations.
27 October 2017 in International Journal of Adaptive Control and Signal Processing
9 May 2022 in IEEE Transactions on Control Systems Technology
This article presents a learning-based adaptive optimal control approach for flotation processes subject to input constraints and disturbances using adaptive dynamic programming (ADP) along with double-loop iteration. First, the principle of the operational pattern is adopted to preset reagents’ addition based on the feeding condition. Then, this article leverages a deep learning model, which is composed of multiple neural layers to detect flotation indexes directly from the raw froth images. After that, the tracking error between the detected flotation indexes and the reference values can be minimized by using ADP-based double-loop iteration. Particularly, a policy-iteration (PI) method is utilized for the proposed learning-based ADP algorithm. In the inner loop, the optimal control problem is formulated as a linear quadratic regulator (LQR) problem using the low-gain feedback design method. In the outer loop, the design parameters, i.e., weighting matrices, are tuned automatically to satisfy the input constraints. Finally, the analytical results demonstrate that the proposed scheme can guarantee asymptotic tracking in the presence of actuator saturation and disturbances.
8 November 2019 in IEEE Access