11 May 2023 in IEEE Sensors Journal
The development of autonomous vehicles has prompted an interest in exploring various techniques in navigation. One such technique is simultaneous localization and mapping (SLAM), which enables a vehicle to comprehend its surroundings, build a map of the environment in real-time, and locate itself within that map. Although traditional techniques have been used to perform SLAM for a long time, recent advancements have seen the incorporation of neural network techniques into various stages of the SLAM pipeline. This review paper provides a focused analysis of the recent developments in neural network techniques for SLAM-based localization of autonomous ground vehicles. In contrast to the previous review studies that covered general navigation and SLAM techniques, this work specifically addresses the unique challenges and opportunities presented by the integration of neural networks in this context. Existing review studies have highlighted the limitations of conventional visual SLAM, and this paper aims to explore the potential of deep learning methods. The paper discusses the functions required for localization, as well as several neural network-based techniques proposed by researchers to carry out such functions, are discussed. Firstly, it presents a general background of the issue, the relevant review studies that have already been done, and the adopted methodology in this review. Then, it provides a thorough review of the findings regarding localization and odometry. Finally, it presents our analysis of the findings, open research questions in the field, and a conclusion. A semi-systematic approach is used to carry out the review.
26 May 2021 in IEEE Access
Unintentional lane departure accidents are one of the biggest reasons for the causalities that occur due to human errors. By incorporating lane-keeping features in vehicles, many accidents can be avoided. The lane-keeping system operates by auto-steering the vehicle in order to keep it within the desired lane, despite of changes in road conditions and other interferences. Accurate steering angle prediction is crucial to keep the vehicle within the road boundaries, which is a challenging task. The main difficulty in this regard is to identify the drivable road area on heterogeneous road types varying in color, texture, illumination conditions, and lane marking types. This strenuous problem can be addressed by two approaches, namely, ‘computer-vision-based approach’ and ‘imitation-learning-based approach’. To the best of our knowledge, at present, there is no such detailed review study covering both the approaches and their related optimization techniques. This comprehensive review attempts to provide a clear picture of both approaches of steering angle prediction in the form of step by step procedures. The taxonomy of steering angle prediction has been presented in the paper for a better comprehension of the problem. We have also discussed open research problems at the end of the paper to help the researchers of this area to discover new research horizons.
1 January 2022 in Computers, Materials & Continua
Deep learning techniques, particularly convolutional neural networks (CNNs), have exhibited remarkable performance in solving vision-related problems, especially in unpredictable, dynamic, and challenging environments. In autonomous vehicles, imitation-learning-based steering angle prediction is viable due to the visual imagery comprehension of CNNs. In this regard, globally, researchers are currently focusing on the architectural design and optimization of the hyperparameters of CNNs to achieve the best results. Literature has proven the superiority of metaheuristic algorithms over the manual-tuning of CNNs. However, to the best of our knowledge, these techniques are yet to be applied to address the problem of imitation-learning-based steering angle prediction. Thus, in this study, we examine the application of the bat algorithm and particle swarm optimization algorithm for the optimization of the CNN model and its hyperparameters, which are employed to solve the steering angle prediction problem. To validate the performance of each hyperparameters’ set and architectural parameters’ set, we utilized the Udacity steering angle dataset and obtained the best results at the following hyperparameter set: optimizer, Adagrad; learning rate, 0.0052; and nonlinear activation function, exponential linear unit. As per our findings, we determined that the deep learning models show better results but require more training epochs and time as compared to shallower ones. Results show the superiority of our approach in optimizing CNNs through metaheuristic algorithms as compared with the manual-tuning approach. Infield testing was also performed using the model trained with the optimal architecture, which we developed using our approach.
21 August 2025 in IEEE Journal of Selected Areas in Sensors
This study introduces a novel Stereo Attentionbased Visual Inertial Odometry model, namely SATVIO, aiming to enhance odometry performance by leveraging deep learning techniques for sensor fusion. The research evaluates the SATVIO model against existing Visual Odometry methods using the KITTI odometry dataset, focusing on translational and rotational accuracy enhancements through innovative attention mechanisms and early fusion strategies. The proposed model integrates Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) networks to process and fuse data from stereo image inputs and inertial measurements effectively. SATVIO model particularly employs Triplet Attention (TA) and early fusion techniques with the aim of addressing the challenges posed by scale ambiguity and environmental changes. The results demonstrates that our proposed model outperforms traditional methods in specific configurations, thus demonstrating competitive or superior performance on key challenging sequences.