Unmanned aerial vehicles (UAVs) equipped with lightweight sensors, such as RGB cameras and LiDAR, have significant potential in precision agriculture, including object detection. Tassel detection in maize is an essential trait given its relevance as the beginning of the reproductive stage of growth and development of the plants. However, compared with general object detection, tassel detection based on RGB imagery acquired by UAVs is more challenging due to the small size, time-dependent variable shape, and complexity of the objects of interest. A novel algorithm referred to as YOLOv5-tassel is proposed to detect tassels in UAV-based RGB imagery. A bidirectional feature pyramid network is adopted for the path-aggregation neck to effectively fuse cross-scale features. The robust attention module of SimAM is introduced to extract the features of interest before each detection head. An additional detection head is also introduced to improve small-size tassel detection based on the original YOLOv5. Annotation is performed with guidance from center points derived from CenterNet to improve the selection of the bounding boxes for tassels. Finally, to address the issue of limited reference data, transfer learning based on the VisDrone dataset is adopted. Testing results for our proposed YOLOv5-tassel method achieved the mAP value of 44.7%, which is better than well-known object detection approaches, such as FCOS, RetinaNet, and YOLOv5.
Vehicle control is one of the most critical challenges in autonomous vehicles (AVs) and connected and automated vehicles (CAVs), and it is paramount in vehicle safety, passenger comfort, transportation efficiency, and energy saving. This survey attempts to provide a comprehensive and thorough overview of the current state of vehicle control technology, focusing on the evolution from vehicle state estimation and trajectory tracking control in AVs at the microscopic level to collaborative control in CAVs at the macroscopic level. First, this review starts with vehicle key state estimation, specifically vehicle sideslip angle, which is the most pivotal state for vehicle trajectory control, to discuss representative approaches. Then, we present symbolic vehicle trajectory tracking control approaches for AVs. On top of that, we further review the collaborative control frameworks for CAVs and corresponding applications. Finally, this survey concludes with a discussion of future research directions and the challenges. This survey aims to provide a contextualized and in-depth look at the state of the art in vehicle control for AVs and CAVs, identifying critical areas of focus and pointing out the potential areas for further exploration.
12 June 2023 in IEEE Transactions on Intelligent Vehicles
3D-LiDAR-based cooperative perception has been generating significant interest for its ability to tackle challenges such as occlusion, sparse point clouds, and out-of-range issues that can be problematic for single-vehicle perception. Despite its effectiveness in overcoming various challenges, cooperative per-ception's performance can still be affected by the aforementioned issues when Connected Automated Vehicles (CAVs) operate at the edges of their sensing range. Our proposed approach called HYDRO-3D aims to improve object detection performance by explicitly incorporating historical object tracking information. Specifically, HYDRO-3D combines object detection features from a state-of-the-art object detection algorithm (V2X-ViT) with historical information from the object tracking algorithm to infer objects. Afterward, a novel spatial-temporal 3D neural network performing global and local manipulations of object-tracking historical data is applied to generate the feature map to enhance object detection. The proposed HYDRO-3D method is comprehensively evaluated on the state-of-the-art V2XSet. The qualitative and quantitative experiment results demonstrate that the HYDRO-3D can effectively utilize the object tracking information and achieve robust object detection performance. It outperforms the SOTA V2X-ViT by 3.7% in AP@0.7 of object detection for CAVs and can also be generalized to single-vehicle object detection with 4.5% improvement in AP@0.7.
26 January 2024 in Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering
Maintaining both path-tracking accuracy and yaw stability of distributed drive electric vehicles (DDEVs) under various driving conditions presents a significant challenge in the field of vehicle control. To address this limitation, a coordinated control strategy that integrates adaptive model predictive control (AMPC) path-tracking control and direct yaw moment control (DYC) is proposed for DDEVs. The proposed strategy, inspired by a hierarchical framework, is coordinated by the upper layer of path-tracking control and the lower layer of direct yaw moment control. Based on the linear time-varying model predictive control (LTV MPC) algorithm, the effects of prediction horizon and weight coefficients on the path-tracking accuracy and yaw stability of the vehicle are compared and analyzed first. According to the aforementioned analysis, an AMPC path-tracking controller with variable prediction horizon and weight coefficients is designed considering the change of vehicle speed in the upper layer. The lower layer involves DYC based on the linear quadratic regulator (LQR) technique. Specifically, the intervention rule of DYC is determined by the threshold of the yaw rate error and the phase diagram of the sideslip angle. Extensive simulation experiments are conducted to evaluate the proposed coordinated control strategy under different driving conditions. The results show that, under variable speed and low adhesion conditions, the vehicle yaw stability and path-tracking accuracy have been improved by 21.58% and 14.43%, respectively, compared to AMPC. Similarly, under high speed and low adhesion conditions, the vehicle yaw stability and path-tracking accuracy have been improved by 44.30% and 14.25%, respectively, compared to the coordination of LTV MPC and DYC. The results indicate that the proposed adaptive path-tracking controller is effective across different speeds. Furthermore, the proposed coordinated control strategy successfully enhances the vehicle stability while maintaining good path-tracking accuracy even under extreme conditions.
20 September 2023 in Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering
Full drive-by-wire electric vehicles (FDWEV) equipped with X-by-wire technology can enable independent driving, braking, and steering of each wheel, making them an ideal platform for developing autonomous driving technology. However, designing a robust control algorithm that comprehensively integrates vehicle path planning in a complex and unstructured scenario is a challenging task for FDWEV. To address this issue, this paper (1) proposes the artificial potential field (APF) method for path planning in the prescribed park with different static obstacles to generate the reference path information, where speed planning is incorporated considering kinematics and dynamic constraints; (2) designs curvature calculation (CC-based) and model predictive control (MPC-based) tracking methods with the lateral dynamics model to track the desired path under different driving conditions, in which a forward-looking behavior model of the driver with variable preview distance is designed based on the fuzzy control theory; (3) conducts CarSim-AMESim-Simulink co-simulation with the existence of obstacles. The simulation results show that the proposed two control approaches are practical for classical driving scenarios. Especially the MPC-based path-tracking controller enhances dynamic tracking performance and ensures good maneuverability under high-dynamic driving conditions.
For multi-axle distributed drive (MADD) vehicles, the complexity of the longitudinal dynamics control system increases with the number of driven wheels, which presents a huge challenge to control the multi-motor drive vehicle with more than four wheels. To reduce the control system complexity, this paper proposes a coordinated slip control algorithm using the hierarchical linear quadratic regulator (HLQR) scheme for a 12 × 12 MADD vehicle. The 12-wheel driving system is decoupled based on the wheel load and simplified to a double local subsystem. First, the 12 × 12 MADD vehicle dynamics model is established. Then, the optimal slip ratio is obtained on the basis of the road friction coefficient estimation through a fuzzy control algorithm when the wheel slips. Afterwards, the wheel slip ratio is controlled based on the HLQR program for anti-slip regulation. Furthermore, the driving torque control allocation based on quadratic programming (QR) is coordinated with the anti-slip control. Simulink results show that the proposed coordinated slip control based on HLQR can improve slip control accuracy by more than 30% and greatly reduce the calculation load. The torque control allocation is also limited by the slip control results to ensure wheel dynamic stability and smoothly satisfy the driver’s demand.