Autonomous driving with artificial intelligence technology has been viewed as promising for autonomous vehicles hitting the road in the near future. In recent years, considerable progress has been made with Deep Reinforcement Learnings (DRLs) for realizing end-to-end autonomous driving. Still, driving safely and comfortably in real dynamic scenarios with DRL is nontrivial due to the reward functions being typically pre-defined with expertise. This paper proposes a human-in-the-loop DRL algorithm for learning personalized autonomous driving behavior in a progressive learning way. Specifically, a progressively optimized reward function (PORF) learning model is built and integrated into the Deep Deterministic Policy Gradient (DDPG) framework, which is called PORF-DDPG in this paper. PORF consists of two parts: the first part of the PORF is a pre-defined typical reward function on the system state, the second part is modeled as a Deep Neural Network (DNN) for representing driving adjusting intention by the human observer, which is the main contribution of this paper. The DNN-based reward model is progressively learned using the front-view images as the input and via active human supervision and intervention. The proposed approach is potentially useful for driving in dynamic constrained scenarios when dangerous collision events might occur frequently with classic DRLs. The experimental results show that the proposed autonomous driving behavior learning method exhibits online learning capability and environmental adaptability.
In extensive outdoor collaborative exploration tasks, multiple robots require efficient path planning methods to ensure rapid and comprehensive map construction. However, current collaborative mapping algorithms often integrate poorly with path planning, especially under limited communication conditions. Such conditions can complicate data exchange, leading to inefficiencies and missed areas in real-world environments. This paper introduces a path planning approach specifically designed for distributed collaborative mapping tasks, aimed at enhancing map completeness, mapping efficiency, and communication robustness under communication constraints. We frame the entire task as a k-Chinese Postman Problem (k-CPP) and optimize it using a genetic algorithm (GA). This method fully leverages topology maps to efficiently plan subpaths for multiple robots, ensuring thorough coverage of the mapping area without the need for prior navigation maps. Additionally, we incorporate communication constraints into our path planning to ensure stable data exchange among robots in environments with only short-range communication capabilities. Field experiment results highlight the superior performance of our method in terms of stability, efficiency, and robust inter-robot communication.