An algorithm has been developed for fusing 3D LIDAR (Light Detection and Ranging) systems that receive objects detected in deep learning-based image sensors and object data in the form of 3D point clouds. 3D LIDAR represents 3D point data in a planar rectangular coordinate system with a 360° representation of the detected object surface, including the front face. However, only the direction and distance data of the object can be obtained, and point cloud data cannot be used to create a specific definition of the object. Therefore, only the movement of the point cloud data can be tracked using probability and classification algorithms based on image processing. To overcome this limitation, the study matches 3D LIDAR data with 2D image data through the fusion of hybrid level multi-sensors. First, because 3D LIDAR data represents all objects in the sensor’s detection range as dots, all unnecessary data, including ground data, is filtered out. The 3D Random Sample Consensus (RANSAC) algorithm enables the extraction of ground data perpendicular to the reference estimation 3D plane and data at both ends through ground estimation. Classified environmental data facilitates the labeling of all objects within the viewing angle of 3D LIDAR based on the presence or absence of movement. The path of motion of the platform can be established by detecting whether objects within the region of interest are movable or static. Because LIDAR is based on 8- and 16-channel rotation mechanisms, real-time data cannot be used to define objects. Instead, point clouds can be used to detect obstacles in the image through deep learning in the preliminary processing phase of the classification algorithm. By matching the labeling information of defined objects with the classified object cloud data obtained using 3D LIDAR, the exact dynamic trajectory and position of the defined objects can be calculated. Consequently, to process the acquired object data efficiently, we devised an active-region-of-interest technique to ensure a fast processing speed while maintaining a high detection rate.
22 January 2020 in International Journal of Control, Automation, and Systems
In this study, we developed a robotic walker that actively controls its speed and direction of movement according to the user's gait intention. Sensor fusion between a low‐cost light detection and ranging (LiDAR) sensor and inertia measurement units (IMUs) helps determine the user's gait intention. The LiDAR determines the walking direction by detecting both knees, and the IMUs attached on each foot obtain the angular rate of the gait. The user's gait intention is given as the directional angle and the speed of movement. The two motors in the robotic walker are controlled with these two variables, which represent the user's gait intention. The estimated direction angle is verified by comparison with a Kinect sensor that detects the centroid trajectory of both the user's feet. We validated the robotic walker with an experiment by controlling it using the estimated gait intention.
The integration of Internet of Things (IoT) systems with social networking concepts has opened new business and social opportunities, particularly by allowing smart objects to autonomously establish social relationships with each other and exchange information. However, these relations must be properly quantified and integrated with trust in order to proliferate the provisioning of IoT composite services. Therefore, this proposed work focuses on quantitatively computing social strength and trust among smart objects in IoT for the purpose of aiding efficient service composition with reasonable accuracy. In particular, we propose a trust-augmented social strength (TASS) management protocol that can cope with the heterogeneity of IoT and demonstrate high scalability and resiliency against various malicious attacks. Afterward, we show how the TASS measurements can be applied to service planning in IoT service composition. Based on the experimental results, we conclude that the proposed protocol is, in fact, capable of exhibiting the above-mentioned characteristics in real-world settings.
This paper presents a study on aircraft engine identification using real-time 3D LiDAR point cloud segmentation technology, a key element for the development of automated docking systems in airport boarding facilities, known as jetbridges. To achieve this, 3D LiDAR sensors utilizing a spinning method were employed to gather surrounding environmental 3D point cloud data. The raw 3D environmental data were then filtered using the 3D RANSAC technique, excluding ground data and irrelevant apron areas. Segmentation was subsequently conducted based on the filtered data, focusing on aircraft sections. For the segmented aircraft engine parts, the centroid of the grouped data was computed to determine the 3D position of the aircraft engine. Additionally, PointNet was applied to identify aircraft engines from the segmented data. Dynamic tests were conducted in various weather and environmental conditions, evaluating the detection performance across different jetbridge movement speeds and object-to-object distances. The study achieved a mean intersection over union (mIoU) of 81.25% in detecting aircraft engines, despite experiencing challenging conditions such as low-frequency vibrations and changes in the field of view during jetbridge maneuvers. This research provides a strong foundation for enhancing the robustness of jetbridge autonomous docking systems by reducing the sensor noise and distortion in real-time applications. Our future research will focus on optimizing sensor configurations, especially in environments where sea fog, snow, and rain are frequent, by combining RGB image data with 3D LiDAR information. The ultimate goal is to further improve the system’s reliability and efficiency, not only in jetbridge operations but also in broader autonomous vehicle and robotics applications, where precision and reliability are critical. The methodologies and findings of this study hold the potential to significantly advance the development of autonomous technologies across various industrial sectors.