A hard issue in the field of microrobots is path planning in complicated situations with dense obstacle distribution. Although the Dynamic Window Approach (DWA) is a good obstacle avoidance planning algorithm, it struggles to adapt to complex situations and has a low success rate when planning in densely populated obstacle locations. This paper suggests a multi-module enhanced DWA (MEDWA) obstacle avoidance planning algorithm to address the aforementioned issues. An obstacle-dense area judgment approach is initially presented by combining Mahalanobis distance, Frobenius norm, and covariance matrix on the basis of a multi-obstacle coverage model. Second, MEDWA is a hybrid of enhanced DWA (EDWA) algorithms in non-dense areas with a class of two-dimensional analytic vector field methods developed in dense areas. The vector field methods are used instead of the DWA algorithms with poor planning performance in dense areas, which greatly improves the passing ability of microrobots over dense obstacles. The core of EDWA is to extend the new navigation function by modifying the original evaluation function and dynamically adjusting the weights of the trajectory evaluation function in different modules using the improved immune algorithm (IIA), thus improving the adaptability of the algorithm to different scenarios and achieving trajectory optimization. Finally, two scenarios with different obstacle-dense area locations were constructed to test the proposed method 1000 times, and the performance of the algorithm was verified in terms of step number, trajectory length, heading angle deviation, and path deviation. The findings indicate that the method has a smaller planning deviation and that the length of the trajectory and the number of steps can both be reduced by about 15%. This improves the ability of the microrobot to pass through obstacle-dense areas while successfully preventing the phenomenon of microrobots going around or even colliding with obstacles outside of dense areas.

Environmental perception is a crucial subsystem in autonomous vehicles. In order to build safe and efficient traffic transportation, several researches have been proposed to build accurate, robust and real-time perception systems. Camera and LiDAR are widely equipped on autonomous self-driving cars and developed with many algorithms in recent years. The fusion system of camera and LiDAR provides state-of the-art methods for environmental perception due to the defects of single vehicular sensor. Extrinsic parameter calibration is able to align the coordinate systems of sensors and has been drawing enormous attention. However, differ from spatial alignment of two sensors’ data, joint calibration of multi-sensors (more than two sensors) should balance the degree of alignment between each two sensors. In this paper, we assemble a test platform which is made up of dual LiDARs and one monocular camera and use the same sensing hardware architecture as intelligent sweeper designed by our laboratory. Meanwhile, we propose the related joint calibration method using a circular chessboard. The center of circular chessboard is respectively detected in camera image to get pixel coordinates and in point cloud of LiDAR to get 3D coordinates. The calibration problem is then converted into a 3D-2D PnP matching problem and the center of the chessboard is set as corresponding points to construct the geometric constraints to get initial calibration values. Further, a proper global loss function is elaborately designed for Levenberg-Marquardt nonlinear optimization to obtain the final calibration parameters, and then the extrinsic parameters between any two sensors are estimated simultaneously. Experimental results show that the proposed method is suitable for the joint calibration of fusion system composed of LiDARs and camera, and the calibration results have high accuracy and stability.

Tracking vehicle trajectories is essential for autonomous vehicles and advanced driver-assistance systems to understand traffic environment and evaluate collision risk. In order to reduce the position deviation and fluctuation of tracking on-road vehicle by millimeter-wave radar (MMWR), an interactive multi-model Kalman filter (IMM-KF) tracking algorithm including data association and track management is proposed. In general, it is difficult to model the target vehicle accurately due to lack of vehicle kinematics parameters, like wheel base, uncertainty of driving behavior and limitation of sensor’s field of view. To handle the uncertainty problem, an interacting multiple model (IMM) approach using Kalman filters is employed to estimate multitarget’s states. Then the compensation of radar ego motion is achieved, since the original measurement is under the radar polar coordinate system. Taking into account the real-time performance of the algorithm and the distinguishability of vehicles involved in traffic, the nearest neighbor data association (NNDA) is used to associate observation with trajectory, which is fast and stable. And after the process of track establishment, confirmation, continuous updating, supplement and extinction, the multi-track management of vehicle targets is realized. Finally, two normal traffic scenarios including lane changing on straight freeway and turning on intersection are designed to test the feasibility and validate the tracking algorithm on PreScan simulation platform. Compared with the original radar data and UKF filtering results, the tracking algorithm in this paper achieves good stability and accuracy.

The automated driving of agricultural machinery is of great significance for the agricultural production efficiency, yet is still challenging due to the significantly varied environmental conditions through day and night. To address operation safety for pedestrians in farmland, this paper proposes a 3D person sensing approach based on monocular RGB and Far-Infrared (FIR) images. Since public available datasets for agricultural 3D pedestrian detection are scarce, a new dataset is proposed, named as “FieldSafePedestrian”, which includes field images in both day and night. The implemented data augmentations of night images and semi-automatic labeling approach are also elaborated to facilitate the 3D annotation of pedestrians. To fuse heterogeneous images of sensors with non-parallel optical axis, the Dual-Input Depth-Guided Dynamic-Depthwise-Dilated Fusion network (D5F) is proposed, which assists the pixel alignment between FIR and RGB images with estimated depth information and deploys a dynamic filtering to guide the heterogeneous information fusion. Experiments on field images in both daytime and nighttime demonstrate that compared with the state-of-the-arts, the dynamic aligned image fusion achieves an accuracy gain of 3.9% and 4.5% in terms of center distance and BEV-IOU, respectively, without affecting the run-time efficiency.

Perception of road structures especially the traffic intersections by visual sensors is an essential task for automated driving. However, compared with intersection detection or visual place recognition, intersection re-identification (intersection re-ID) strongly affects driving behavior decisions with given routes, yet has long been neglected by researchers. This paper strives to explore intersection re-ID by a monocular camera sensor. We propose a Hybrid Double-Level re-identification approach which exploits two branches of Deep Convolutional Neural Network to accomplish multi-task including classification of intersection and its fine attributes, and global localization in topological maps. Furthermore, we propose a mixed loss training for the network to learn the similarity of two intersection images. As no public datasets are available for the intersection re-ID task, based on the work of RobotCar, we propose a new dataset with carefully-labeled intersection attributes, which is called “RobotCar Intersection” and covers more than 30,000 images of eight intersections in different seasons and day time. Additionally, we provide another dataset, called “Campus Intersection” consisting of panoramic images of eight intersections in a university campus to verify our updating strategy of topology map. Experimental results demonstrate that our proposed approach can achieve promising results in re-ID of both coarse road intersections and its global pose, and is well suited for updating and completion of topological maps.