Radar and camera information fusion sensing methods are used to solve the inherent shortcomings of the single sensor in severe weather. Our fusion scheme uses radar as the main hardware and camera as the auxiliary hardware framework. At the same time, the Mahalanobis distance is used to match the observed values of the target sequence. Data fusion based on the joint probability function method. Moreover, the algorithm was tested using actual sensor data collected from a vehicle, performing real-time environment perception. The test results show that radar and camera fusion algorithms perform better than single sensor environmental perception in severe weather, which can effectively reduce the missed detection rate of autonomous vehicle environment perception in severe weather. The fusion algorithm improves the robustness of the environment perception system and provides accurate environment perception information for the decision-making system and control system of autonomous vehicles.
10 March 2021 in IEEE Transactions on Instrumentation and Measurement
The use of object detection algorithms has become extremely important in autonomous vehicles. Object detection at high accuracy and a fast inference speed is essential for safe autonomous driving. Therefore, the balance between the effectiveness and efficiency of the object detector must be considered. This article proposes a one-stage object detection framework for improving the detection accuracy while supporting a true real-time operation based on the YOLOv4. The backbone network in the proposed framework is the CSPDarknet53_dcn(P). The last output layer in the CSPDarknet53 is replaced with deformable convolution to improve the detection accuracy. In order to perform feature fusion, a new feature fusion module PAN++ is designed and five scales detection layers are used to improve the detection accuracy of small objects. In addition, this article proposes an optimized network pruning algorithm to solve the problem that the real-time performance of the algorithm cannot be satisfied due to the limited computing resources of the vehicle-mounted computing platform. The method of sparse scaling factor is used to improve the existing channel pruning algorithm. Compared to the YOLOv4, the YOLOV4-5D improves the mean average precision by 4.23% on the BDD data sets and 1.68% on the KITTI data sets. Finally, by pruning the model, the inference speed of YOLOV4-5D is increased 31.3% and the memory is only 98.1 MB when the detection accuracy is almost unchanged. Nevertheless, the proposed algorithm is capable of real-time detection at faster than 66 frames/s (fps) and shows higher accuracy than the previous approaches with a similar fps.
30 May 2022 in IEEE Transactions on Intelligent Transportation Systems
In recent years, considerable progress has been made in semantic segmentation of images with favorable environments. However, the environmental perception of autonomous driving under adverse weather conditions is still very challenging. In particular, the low visibility at nighttime greatly affects driving safety. In this paper, we aim to explore image segmentation in low-light scenarios, thereby expanding the application range of autonomous vehicles. The segmentation algorithms for road scenes based on deep learning are highly dependent on the volume of images with pixel-level annotations. Considering the scarcity of labeled large-scale nighttime data, we performed synthetic data collection and data style transfer using images acquired in daytime based on the autonomous driving simulation platform and generative adversarial network, respectively. In addition, we also proposed a novel nighttime segmentation framework (SFNET-N) to effectively recognize objects in dark environments, aiming at the boundary blurring caused by low semantic contrast in low-illumination images. Specifically, the framework comprises a light enhancement network which introduces semantic information for the first time and a segmentation network with strong feature extraction capability. Extensive experiments with Dark Zurich-test and Nighttime Driving-test datasets show the effectiveness of our method compared with existing state-of-the art approaches, with 56.9% and 57.4% mIoU (mean of category-wise intersection-over-union) respectively. Finally, we also performed real-vehicle verification of the proposed models in road scenes of Zhenjiang city with poor lighting. The datasets are available at https://github.com/pupu-chenyanyan/semantic-segmentation-on-nightime.
18 March 2024 in IEEE Transactions on Instrumentation and Measurement
As self-driving vehicles become more prevalent, the speed and accuracy of detecting surrounding objects through onboard sensing technology have become increasingly important. The YOLOv8-QSD network is a novel anchor-free driving scene detection network that builds on YOLOv8 and ensures detection accuracy while maintaining efficiency. The network’s backbone employs structural reparameterization techniques to transform the Diverse Branch Block based model. To accurately detect small objects, it integrates features of different scales and implements a bifpn-based feature pyramid after the backbone. To address the challenge of long-range detection in driving scenarios, a query-based model with a new pipeline structure is introduced. The test results demonstrate that this algorithm outperforms YOLOv8 on the soda-a dataset in terms of both speed and accuracy. With an accuracy rate of 64.5% and reduced computational requirements of 7.1 GFLOPs, it satisfies the speed, precision, and cost-effectiveness requirements for commercial vehicles in high-speed road driving scenarios.
25 April 2019 in IEEE Transactions on Vehicular Technology
This paper investigates the design principles and performance optimization for segmented-rotor switched reluctance motors (SRSRMs) with different rotor pole numbers for belt-driven starter generators of hybrid electric vehicles. For the design principles, several constraints are derived for the numbers of stator and rotor poles, the dimensions and the number of winding turns. Two SRSRMs with 16/10 and 16/14 stator/rotor poles are presented according to these principles. For the performance optimization, the two motors are optimized individually for maximizing the torque. To evaluate the effect of different segmented-rotor numbers, the overall performances of the two SRSRMs are investigated and compared. It is found that the 16/14 SRSRM has higher flux linkage and static torque. The 16/14 SRSRM exhibits higher torque and lower torque ripple at low speed operation. While at high speed, the 16/10 SRSRM performs better in torque and power densities. Compared with the 16/14 SRSRM, the 16/10 SRSRM has higher final steady speed under the same startup condition. The 16/10 SRSRM can achieve higher steady speed under starter mode, and provide higher generated power under braking mode. Moreover, the 16/10 SRSRM exhibits higher efficiency in the most feasible speed range, especially in high speed range, and it has wider high-efficiency area. Finally, a 16/10 SRSRM is prototyped and tested to validate the simulation results.
In order to solve the problem of high fuel consumption and poor emission performance in high horsepower tractors, a parallel hybrid tractor system was designed using a dual power source of an engine and motor matched with a hydro-mechanical continuously variable transmission (HMCVT). An equivalent fuel consumption minimization strategy (ECMS) was used for power distribution of this hybrid system. To address the problem of poor adaptability of the equivalence factor to different working cycles in the conventional ECMS, a fuzzy adaptive equivalent fuel consumption minimization strategy (FA-ECMS) was proposed. A fuzzy PI controller based on battery SOC (State of Charge) feedback was designed to adjust the equivalence factor in real time, so as to achieve adaptive control of the equivalence factor. The physical model of the system was built by SimulationX, and the model of the control strategy was built using Matlab/Simulink. Two typical cycles of tractor plowing and road transportation were simulated. Under ECMS, the fuel consumption of the hybrid agricultural tractor was 14.3 L and 1.19 L in one plowing cycle and one transport cycle, respectively, with final battery SOC values of 60.75% and 60.32%, respectively. Under FA-ECMS, the hybrid farm tractor consumed 13.34 L and 1.13 L in one plowing cycle and one transport cycle, respectively, with final battery SOC values of 60.27% and 60.17%, respectively. The results showed that, with the introduction of a fuzzy PI controller to dynamically adjust the equivalence factor, the overall fuel consumption was reduced by 6.71% and 5.04%, respectively, and the battery power maintenance performance was improved. The designed control strategy could achieve a more reasonable power distribution between the engine and motor while maintaining the balance of the battery SOC.