This paper presents an object classification method for vision and light detection and ranging (LIDAR) fusion of autonomous vehicles in the environment. This method is based on convolutional neural network (CNN) and image upsampling theory. By creating a point cloud of LIDAR data upsampling and converting into pixel-level depth information, depth information is connected with Red Green Blue data and fed into a deep CNN. The proposed method can obtain informative feature representation for object classification in autonomous vehicle environment using the integrated vision and LIDAR data. This method is also adopted to guarantee both object classification accuracy and minimal loss. Experimental results are presented and show the effectiveness and efficiency of object classification strategies.

Vehicle trajectory prediction helps automated vehicles and advanced driver-assistance systems have a better understanding of traffic environment and perform tasks such as criticality assessment in advance. In this study, an integrated vehicle trajectory prediction method is proposed by combining physics- and maneuver-based approaches. These two methods were combined for the reason that the physics-based trajectory prediction method could ensure accuracy in the short term with the consideration of vehicle running dynamic parameters, and the maneuver-based prediction approach has a long-term insight into future trajectories with maneuver estimation. In this study, the interactive multiple model trajectory prediction (IMMTP) method is proposed by combining the two predicting models. The probability of each model in the interactive multiple models could recursively adjust according to the predicting variance of each model. In addition, prediction uncertainty is considered by employing unscented Kalman filters in the physics-based prediction model. To the maneuver-based method, random elements for uncertainty are introduced to the trajectory of each maneuver inferred by using the dynamic Bayesian network. The approach is applied and analyzed in the lane-changing scenario by using naturalistic driving data. Comparison results indicate that IMMTP could achieve a more accurate prediction trajectory with a long prediction horizon.

Radar and camera information fusion sensing methods are used to solve the inherent shortcomings of the single sensor in severe weather. Our fusion scheme uses radar as the main hardware and camera as the auxiliary hardware framework. At the same time, the Mahalanobis distance is used to match the observed values of the target sequence. Data fusion based on the joint probability function method. Moreover, the algorithm was tested using actual sensor data collected from a vehicle, performing real-time environment perception. The test results show that radar and camera fusion algorithms perform better than single sensor environmental perception in severe weather, which can effectively reduce the missed detection rate of autonomous vehicle environment perception in severe weather. The fusion algorithm improves the robustness of the environment perception system and provides accurate environment perception information for the decision-making system and control system of autonomous vehicles.

The use of object detection algorithms has become extremely important in autonomous vehicles. Object detection at high accuracy and a fast inference speed is essential for safe autonomous driving. Therefore, the balance between the effectiveness and efficiency of the object detector must be considered. This article proposes a one-stage object detection framework for improving the detection accuracy while supporting a true real-time operation based on the YOLOv4. The backbone network in the proposed framework is the CSPDarknet53_dcn(P). The last output layer in the CSPDarknet53 is replaced with deformable convolution to improve the detection accuracy. In order to perform feature fusion, a new feature fusion module PAN++ is designed and five scales detection layers are used to improve the detection accuracy of small objects. In addition, this article proposes an optimized network pruning algorithm to solve the problem that the real-time performance of the algorithm cannot be satisfied due to the limited computing resources of the vehicle-mounted computing platform. The method of sparse scaling factor is used to improve the existing channel pruning algorithm. Compared to the YOLOv4, the YOLOV4-5D improves the mean average precision by 4.23% on the BDD data sets and 1.68% on the KITTI data sets. Finally, by pruning the model, the inference speed of YOLOV4-5D is increased 31.3% and the memory is only 98.1 MB when the detection accuracy is almost unchanged. Nevertheless, the proposed algorithm is capable of real-time detection at faster than 66 frames/s (fps) and shows higher accuracy than the previous approaches with a similar fps.

With the aims of safe, smart and sustainable future mobility, a personalized approach of trajectory planning and control based on user preferences is developed for lane-change of autonomous vehicles in this paper. First, a safe area during the lane change process is identified by using constraint Delaunay triangulation. Then, an improved rapidly-exploring Random Trees (i-RRT) is developed with B-spline to generate the feasible trajectory cluster, which is subject to the safe area boundaries and the vehicle dynamics. To extract a personalized trajectory from this cluster, we firstly adopt the fuzzy linguistic preference relation (FLPR) method to identify users' preferences on driving, which can be reflected by their subjective objectives including driving safety, ride comfort and vehicle stability. Then, the technique for order preference by similarity to ideal situation (TOPSIS) is utilized to solve the multi-objective optimisation problem formulated by considering the user preferences. The algorithms proposed above are integrated, and both simulation and experimental validation are conducted under lane-change scenarios of autonomous driving. Simulation and experiment results show that proposed approach is able to successfully realize personalized trajectory planning and lane-change control, satisfying users' various preferences and simultaneously ensure vehicle safety, demonstrating its feasibility and effectiveness.

This article presents a trajectory following control solution for the lateral motion of an unmanned vehicle. The proposed solution is based on model predictive lateral control. The lateral motion is hard to control since it is nonlinear with large dynamics and uncertainties. By making a small angle approximation, the dynamic model can be linearized. A new bounded equivalent function based on the vehicle kinematic model and the Taylor series expansion is presented for trajectory following control solution for the lateral motion problem. The model predictive lateral control is used to ensure both strong robustness and control accuracy. Experiment results in a real environment are presented to show the effectiveness of the proposed method.