23 February 2021 in IEEE Robotics and Automation Letters
One of the challenges to reduce the gap between the machine and the human level driving is how to endow the system with the learning capacity to deal with the coupled complexity of environments, intentions, and dynamics. In this letter, we propose a hierarchical driving model with explicit models of continuous intention and continuous dynamics, which decouples the complexity in the observation-to-action reasoning in the human driving data. Specifically, the continuous intention module takes perception to generate a potential map encoded with obstacles and intentions. Then, the potential map is regarded as a condition, together with the current dynamics, to generate a continuous trajectory as output by a continuous function approximator network, whose derivatives can be used for supervision without additional parameters. Finally, our method is validated by both datasets and stimulation, demonstrating that our method has higher prediction accuracy of displacement and velocity and generates smoother trajectories. Our method is also deployed on the real vehicle with loop latency, validating its effectiveness. To the best of our knowledge, this is the first work to produce the driving trajectory using a continuous function approximator network. Our code is available at https://github.com/ZJU-Robotics-Lab/CICT.
1 June 2018 in Electrochimica Acta
24 July 2024 in IEEE Robotics and Automation Letters
This letter introduces an innovative vehicle motion planning method that leverages the integration of rule-based insights to significantly improve closed-loop performance within a learning-based framework. We first employ rule-based methods to heuristically search and generate a diverse set of trajectory proposals. Then, we filter these trajectories using prediction and kinematic constraints, and subsequently select the highest-scoring trajectory based on metrics such as similarity to ground truth trajectories. We utilize a model to learn the mapping from observations to selected trajectories. Finally, we optimize the model's output trajectories using the lane centerlines. Validated through closed-loop simulations in Highway-Env and nuPlan, our method demonstrates a higher success rate and reduced computation time relative to the rule-based method we used, achieving competitive performance with the state-of-the-art method in nuPlan.
11 November 2024 in IEEE Robotics and Automation Letters
Trajectory planning in highly constrained environments is crucial for robotic navigation. Classical algorithms are widely used for their interpretability, generalization, and system robustness. However, these algorithms often require parameter retuning when adapting to new scenarios. To address this issue, we propose a demonstration data-driven reinforcement learning (RL) method for automatic parameter adjustment. Our approach includes two main components: a front-end policy network and a back-end asynchronous controller. The policy network selects appropriate parameters for the trajectory planner, while a discriminator in a Conditional Generative Adversarial Network (CGAN) evaluates the planned trajectory, using this evaluation as an imitation reward in RL. The asynchronous controller is employed for high-frequency trajectory tracking. Experiments conducted in both simulation and real-world demonstrate that our proposed method significantly enhances the performance of classical algorithms.