20 November 2018 in IEEE Transactions on Industrial Informatics
The autonomous operation of industrial robots with minimal human supervision has always been in high demand. To prepare the autonomous operation of a car part spray painting robot, novel object detection, and pose estimation algorithms have been developed in this paper. The object detection part used principal components analysis (PCA) to reduce the dimension of three-dimensional (3-D) point cloud to 2-D binary image. Distance measure between the auto and cross correlation of the binary features was established to find out the similarity between them. Resultantly, the type of auto part was successfully obtained. Furthermore, iterative closest point (ICP) algorithm was used to estimate the pose difference of the auto part with respect to the camera reference frame, which was mounted on the robot. An issue with ICP's lack of robustness to local minimum was solved by the combination of ICP and genetic algorithm (GA). This allowed the optimization of pose error and addressed the problem of local minimum entrapment in ICP. For experimental validation: the proposed object recognition pipeline was implemented in both serial and parallel programming paradigms. The results were obtained for the acquired point clouds of side body car parts and compared with the major 3-D object detection systems in terms of computational cost. Pose estimation error was calculated with both ICP and the modified point set registration schemes, and it was shown to be decreasing in the case of later. All shown results supported the research claims.
22 May 2025 in Ocean Engineering
22 November 2018 in IEEE Transactions on Industrial Electronics
The problem of quality inspection of remote radio unit (RRU) has been approached using the image based visual servo (IBVS) control. A novel computer vision pipeline has been designed which recognized the power port of RRU and tracked it from the stream of images. For control part, a new depth independent interaction matrix was designed which related the depth information with the area of the region of interest (ROI) surrounding the power port. Based on this, an acceleration command was generated to drive the robot's trajectories. Furthermore, a PD type controller was designed based on the idea of sliding surface in variable structure control. This reduced the number of design parameters to a single parameter. The designed controllers were proven to be stable using the Lyapunov stability analysis. Simulation results and experimental validations are provided to support the research arguments.
24 May 2023 in Computers & Chemical Engineering
26 September 2024 in IEEE Access
Collaborative perception exploits exchanging perception data across multiple agents to enhance situational awareness. To overcome the constraints created by limited network resources, it is necessary to have a reliable collaborative perception that can sustain the trade-off between performance and bandwidth. This research proposes a method to address this issue through the development of a graph attention network (GAT) for intermediate collaborative perception. The proposed approach aims to enhance object detection accuracy by exchanging information among multiple agents, addressing issues such as sensor limitations, and occluded objects, and expanding the sensing range. Additionally, the proposed approach addresses the challenges caused by limited communication bandwidth and inconsistencies in the data shared by different agents by maintaining a balance between performance and bandwidth, fitting real-life application requirements. Our approach aggregates the intermediate features obtained from multiple neighboring agents and introduces a novel attention mechanism to selectively emphasize significant regions within the intermediate feature maps. This attention mechanism operates on both the channel and spatial levels to direct the data aggregation process. This research presents a new method for aggregating features utilizing various attention architectures. We perform quantitative and qualitative assessments of the final results of this method and compare them to other state-of-the-art collaborative perception techniques. The results of this work are evaluated using the V2XSim and OPV2V datasets, and our quantitative and qualitative experiments in multi-agent object detection show that our approach achieves a better performance than the state-of-the-art collaborative perception methods.
1 April 2025 in IEEE Open Journal of Vehicular Technology
Multi-agent collaborative perception has gained significant attention due to its ability to overcome the challenges stemming from the limited line-of-sight visibility of individual agents that raised safety concerns for autonomous navigation. Despite notable progress in collaborative perception, several persistent challenges hinder optimal performance, such as the size of data being shared, communication delays, computationally expensive collaboration mechanisms, and spatial misalignment. To address these challenges, we propose DelAwareCol, a versatile collaborative perception framework that tackles the transmission delay between connected agents in real-life autonomous driving. Our framework introduces three key modules designed to balance perception performance with communication bandwidth and delay. Firstly, an intra-agent information aggregation module captures valuable semantic cues within the temporal context to enhance the local representation of each ego agent. Secondly, an inter-agent information aggregation module manages inter-agent interactions and spatial relationships, addressing common vehicle-to-vehicle (V2V) and vehicle-to-everything (V2X) issues, such as spatial misalignment, asynchronous information sharing, and pose errors. Thirdly, an adaptive fusion mechanism integrates multi-source representations based on dynamic contributions from different agents. The proposed framework is validated on large-scale simulated and real-life collaborative perception datasets OPV2V, V2XSet, and V2VReal. Our experimental results demonstrate that DelAwareCol achieved state-of-the-art performance in collaborative object detection, maintaining robust performance in the presence of high latency and localization error.