Detection of interest features is a fundamental pre-processing task for visual odometry and visual simultaneous localization and mapping. The combination of line segments and corners is a trend for those applications, and it is challenging to meet real-time constraints. To pursue this goal, this letter presents a novel points and line points feature detection (PLPD) algorithm designed to be highly efficient and accurate for real-time VO-based systems. The proposed algorithm adopts a novel Multi-level Edge Detector (MED) based on gradient intensity and structure tensor that is not confined solely to extracting corners, but rather, it exploits feature-line points properties to extract long-line segments directly without merging collinear fragment segments. The main focus of this work is to fulfill the real-time and embeddability constraints of our proposed method by adopting the GPU-aware software design for a suitable implementation in GPU-based embedded heterogeneous architecture. Based on this, we exhibit extensive benchmarking with other state-of-the-art algorithms for feature-line segment extraction and corner detection, showing the efficiency of the proposed algorithm and ensuring a real-time performance up to 33 FPS using our dataset.
In this paper, we present a complete and efficient solution of guidance, navigation and control for a quadrotor platform to accomplish 3D coverage flight missions in mapped vineyard terrains. Firstly, an occupancy grid map of the terrain is used to generate a safe guiding coverage path using an Iterative Structured Orientation planning algorithm. Secondly, way-points are extracted from the generated path and added to them trajectory’s velocities and accelerations constraints. The constrained way-points are fed into a Linear Quadratic Regulator algorithm so as to generate global minimum snap optimal trajectory while satisfying both the pointing and the corridor constraints. Then, when facing unexpected obstacles, the quadrotor tends to re-plan its path in real-time locally using an Improved Artificial Potential Field algorithm. Finally, a geometric trajectory tracking controller is developed on the Special Euclidean group . The aim of this controller is to track the generated trajectory while pointing towards predetermined direction using the vector measurements provided by the inertial unit. The performance of the proposed method is demonstrated through several simulation results. In particular, safe guiding paths are achieved. Obstacle-free optimal trajectories that satisfy the way-point position, the pointing direction, and the corridor constraints, are successfully generated with optimized platform snap. Besides, the implemented geometric controller can achieve higher trajectory tracking accuracy with an absolute value of the maximum error in the order of m.
Edge detection is a fundamental aspect of computer vision, facilitating the extraction of crucial features such as corners, edges, and line segments, which are vital for Visual Odometry-based applications. While adding more stages to an edge detector can enhance feature precision, it also increases time consumption and resource requirements, necessitating hardware optimizations. To address these challenges, this paper presents a hardware/software co-design for an efficient pipeline implementation of a Multi-level Edge Detector (MED) on a low-cost FPGA-based heterogeneous architecture. Leveraging this framework, we developed cascading duplicate shift registers based on the Single-Task (ST) mode of OpenCL, which achieves an efficient pipeline execution model for conventional cascade filters. Our ST implementation of the MED significantly outperforms the traditional NDRange implementation in both execution time and resource utilization on the targeted FPGA platform. This allows for effective deployment on the low-cost embedded DE1-SoC, with results validated through comparisons to the NVIDIA Jetson Nano GPU.
Visual–Inertial Odometry (VIO) has become a key technology for motion estimation in robotics and autonomous systems. However, deploying accurate VIO pipelines on embedded platforms remains challenging due to the trade-off between estimation accuracy, real-time performance, and energy consumption. This paper presents a hardware-aware Feature-PLPD VIO framework that integrates a point-and-line visual front-end with a loosely coupled Error-State Extended Kalman Filter (ESEKF) back-end. The proposed approach follows Algorithm Architecture Adequacy (A3) principles to preserve estimation robustness while limiting computational and memory requirements. To investigate its scalability across the considered resource constraints, two end-to-end embedded implementations are developed: a performance-oriented stereo VIO system on a GPU-based platform using GPU-aware software design, and a frugality-oriented low-cost RGB-D-assisted monocular VIO system on an FPGA-based architecture using hardware–software co-design with depth scale correction. The stereo GPU-based implementation is evaluated offline in both outdoor and indoor environments and is additionally validated through real-time on-the-fly deployment on a Scout Mini robot, whereas the FPGA-based implementation is evaluated offline using the indoor VICON dataset. Experimental results demonstrate meter-level trajectory accuracy and real-time performance under strict resource constraints. Averaged over four KITTI sequences, the proposed ESEKF-based fusion reduces the translation and rotation ATE by approximately 25% and 18%, respectively, compared with the corresponding VO-only configuration, while a 10% reduction in translation ATE is achieved in the indoor VICON environment, resulting in a normalized ATE of over the m trajectory. Both embedded implementations sustain around 20 fps, and the architectural evaluation highlights complementary accuracy–runtime–energy trade-offs between the GPU- and FPGA-based solutions. These results demonstrate the feasibility of scaling the proposed embedded VIO framework toward resource- and energy-constrained robotic applications under the investigated experimental and hardware configurations.