Motion planning of autonomous vehicles is still challenging in urban road environments with occlusions. In this work, with the view of safety, comfort and efficiency, we present a motion planning framework that enables autonomous vehicles to navigate safely in urban road with occlusions. Our solution mainly includes three parts: local path planning, trajectory planning and speed planning. First, based on the improved Artificial Potential Field to generate the local path, then the optimal trajectory is solved in the S-L coordinate with the local path as the reference line. Finally, the potential risk probability of the occluded area is incorporated into the incomplete information static game framework and implement speed planning based on the game results and the proposed vehicle "safe driving" to complete the collision avoidance between the autonomous vehicle and visible or obscured dynamic traffic participants. Through simulation verification in common traffic scenarios and a comparison with some existing methods, the proposed method is proven to enable autonomous vehicles to navigate safely in traffic scenarios with occlusions and improve the driving efficiency and comfort of autonomous vehicles.
The rapid advancement of artificial intelligence has significantly expanded the role of service robots in everyday life. This expansion necessitates the accurate recognition and prediction of human intentions to provide timely and appropriate services. However, existing methods often struggle to perform effectively in complex and unstructured environments. To address this challenge, we propose the Large language model and Knowledge graph based Intention Recognition Framework (LKIRF), which combines large language model (LLM) with knowledge graphs (KG) to enhance the intention recognition capabilities of service robots. Our approach constructs an offline KG from human motion and environmental data and builds an online reasoning graph through real-time interaction, utilizing LLM for interpretation. Experimental results indicate that compared to traditional methods, LKIRF not only improves prediction accuracy across various scenarios but also enhances the transparency and interpretability of the intention reasoning process.
29 November 2023 in IET Intelligent Transport Systems
With the development of deep learning technology, the problem of data‐driven trajectory prediction and intention recognition has been widely studied. However, the pedestrian trajectory prediction and intention recognition methods based solely on data‐driven have weak data description ability and black‐box characteristics, which cannot reason about pedestrian crossing intention and predict pedestrian crossing trajectory as humans do. To address the above problems, the authors proposed a data and knowledge‐driven pedestrian intention estimation and trajectory prediction method by imitating human cognitive mechanisms. In the pedestrian intention inference process, the authors adopted the knowledge‐driven method. As a first step, the authors built a knowledge graph of pedestrian crossing scenes, and then paired it with a Bayesian network to estimate pedestrian crossing intentions. In the pedestrian trajectory prediction process, the authors used a data‐driven approach, combining pedestrian crossing trajectory features and knowledge‐based pedestrian intentions. Experiments show that all evaluation metrics of pedestrian trajectory prediction were improved after adding pedestrian intentions obtained by knowledge‐driven.
Pedestrians who suddenly cross the street from within the blind spot of a vehicle’s field of view can pose a significant threat to traffic safety. The dangerous pedestrian crossing intentions in view-obscured scenarios have not received as much attention as the prediction of pedestrian crossing intentions. In this paper, we present a method for recognizing and predicting the dangerous crossing intention of pedestrians in a view-obscured region based on the interference, pose, velocity observation–long short-term memory (IPVO-LSTM) algorithm from a road-based view. In the first step, the road-based camera captures the pedestrian’s image. Then, we construct a pedestrian interference state feature module, pedestrian three-dimensional pose feature module, pedestrian velocity feature module, and pedestrian blind observation state feature module and extract the corresponding features of the studied pedestrians. Finally, the pedestrian hazard crossing intention prediction module based on a feature-fused LSTM (ff-LSTM) and attention mechanism is used to fuse and process the above features in a cell state process to recognize and predict the pedestrian hazard crossing intention in the blind visual area. Experiments are compared with current common algorithms in terms of the input parameter selection, intention recognition algorithm, and intention prediction time range, and the experimental results validate our state-of-the-art method.
9 July 2024 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
In recent years, the steady-state visual evoked potentials (SSVEP) based brain control method has been employed to help people with disabilities because of its advantages of high information transmission rate and low training time. However, the existing SSVEP brain control methods cannot adapt to dynamic or unstructured environments. Moreover, the recognition accuracy from the conventional decoding algorithm still needs to improve. To address the above problems, this study proposed a steady-state hybrid visual evoked potentials (SSHVEP) paradigm using the grasping targets in their environment to improve the connection between the subjects’ and their dynamic environments. Moreover, a novel EEG decoding method, using the multivariate variational mode decomposition (MVMD) algorithm for adaptive sub-band division and convolutional neural network (CNN) for target recognition, was applied to improve the decoding accuracy of the SSHVEPs. 18 subjects participated in the offline and online experiments. The offline accuracy across 18 subjects by the 9-target SSHVEP paradigm was up to 95.41 ± 2.70%, which is a 5.80% improvement compared to the conventional algorithm. To further validate the performance of the proposed method, the brain-controlled grasping robot system using the SSHVEP paradigm was built. The average accuracy reached 93.21 ± 10.18% for the online experiment. All the experimental results demonstrated the effectiveness of the brain computer interaction method based on the SSHVEP paradigm and the MVMD combined CNN algorithm studied in this paper.
15 December 2025 in IEEE Transactions on Intelligent Transportation Systems
The potential risks associated with various visual occlusion scenarios (VOS) vary greatly. For autonomous vehicles to make informed collision avoidance decisions, it is crucial to accurately assess the potential risk of each type of visual obstruction. However, this problem remains unresolved. In this paper, we simulate the data and knowledge driven cognitive mechanisms of human drivers and propose a human-like potential risk assessment method for VOS. During the perception phase, we move beyond the traditional image feature-based perception paradigm. Instead, we use natural language processing (NLP) to obtain textual semantic features of the scene as the perception result. Specifically, we utilize NLP techniques to construct a data driven VOS description model that generates textual descriptions of visible information in VOS as the perception result. In the risk assessment phase, inspired by human inductive and analogical reasoning, we develop a knowledge driven risk assessment model. Experimental results show that the proposed method can accurately assess the potential risks associated with different types of VOS, and in some cases, even identify risks up to 0.5 seconds earlier than human drivers.