The automatic inspection of surface defects is an essential task for quality control in the computers, communications, and consumer electronics (3C) industry. Traditional inspection mechanisms (viz. line-scan sensors) have a limited field of view, thus, prompting the necessity for a multifaceted robotic inspection system capable of comprehensive scanning. Optimally selecting the robot’s viewpoints and planning a path is regarded as coverage path planning (CPP), a problem that enables inspecting the object’s complete surface while reducing the scanning time and avoiding misdetection of defects. In this paper, we present a new approach for robotic line scanners to detect surface defects of 3C free-form objects automatically. A two-stage region segmentation method defines the local scanning based on the random sample consensus (RANSAC) and K-means clustering to improve the inspection coverage. The proposed method also consists of an adaptive region-of-interest (ROI) algorithm to define the local scanning paths. Besides, a Particle Swarm Optimization (PSO)-based method is used for global inspection path generation to minimize the inspection time. The developed method is validated by simulation-based and experimental studies on various free-form workpieces, and its performance is compared with that of two state-of-the-art solutions. The reported results demonstrate the feasibility and effectiveness of our proposed method.
In this paper, we present a novel sensor-based system to perform defect inspection tasks automatically over free-form specular surfaces. The inspection procedure is performed by a robotic manipulator equipped with a line scanner system. Taking the geometric and optical parameters into consideration, our algorithm computes a flexible scanning path. Based on a mesh model, the system segments the convex surface into areas with similar curvatures, then adaptively adjusts the line sensor’s scanning range to ensure the complete coverage of the surface. We consider the scanning efficiency through constrained optimization. To align the computed scanning path with the specular object, a real-time workpiece localization algorithm in a coarse-to-fine manner is developed. Our control framework synchronizes the motion of the manipulator and the acquisition of the line scanner for robotic inspection. We also provide an image processing pipeline for automatic defect detection. To validate the proposed formal methodology, we report a detailed experimental study with the developed robotic inspection prototype.
22 January 2022 in Computer Methods and Programs in Biomedicine
This paper presents the development of a 3D physics-based numerical model of skin capable of representing the laser-skin photo-thermal interactions occurring in skin photorejuvenation treatment procedures. The aim of this model was to provide a rational and quantitative basis to control and predict temperature distribution within the layered structure of skin. Ultimately, this mathematical and numerical modelling platform will guide the design of an automatic robotic controller to precisely regulate skin temperature at desired depths and for specific durations. The Pennes bioheat equation was used to account for heat transfer in a 3D multi-layer model of skin. The effects of blood perfusion, skin pigmentation and various convection conditions are also incorporated in the proposed model. The photo-thermal effect due to pulsed laser light on skin is computed using light diffusion theory. The physics-based constitutive model was numerically implemented using a combination of finite volume and finite difference techniques. Direct sensitivity routines were also implemented to assess the influence of constitutive parameters on temperature. A stability analysis of the numerical model was conducted. Finally, the numerical model was exploited to assess its ability to predict temperature distribution and thermal damage via a multi-parametric study which accounted for a wide array of biophysical parameters such as light coefficients of absorption for individual skin layers and melanin levels (correlated with ethnicity). It was shown how critical is the link between melanin content, laser light characteristics and potential thermal damage to skin. The developed photo-thermal model of skin-laser interactions paves the way for the design of an automated simulation-driven photorejuvenation robot, thus alleviating the need for inconsistent and error-prone human operators.
23 April 2021 in IEEE/ASME Transactions on Mechatronics
In this article, we present a novel robotic system for skin photo-rejuvenation, which uniformly delivers laser thermal stimulation to a subject’s facial skin tissue. The robotized treatment is performed by a customized manipulator instrumented with a cosmetic laser generator, a depth sensor, and a thermal camera. To plan the optimal trajectory of the manipulator, our system computes the surface model of the face and segments it into seven regions, then automatically fills these regions with uniform laser irradiation. Finally, we report the detailed results of experiments on multiple human subjects to validate the performance of the system. To the best of the author’s knowledge, this is the first time that facial skin rejuvenation has been automated by robot manipulators.
18 March 2025 in IEEE Transactions on Instrumentation and Measurement
Event-based visual odometry excels in high dynamic range scenarios but struggles in extremely low-light or low-contrast conditions, motivating the integration of thermal imaging. This paper presents TEVIO, a multi-modal system that fuses thermal imaging, event-based vision, and inertial measurements to address the challenges of visual-inertial odometry in low-light, high-dynamic-range, and low-texture environments. An enhanced time surface map (ETSM) improves feature extraction for high-motion and low-texture scenes. A parallel frequency-varied tracking framework then estimates the pose stably and in high precision. Extensive tests on public event camera datasets and real-world outdoor vehicle experiments show TEVIO’s superior tracking accuracy and robustness compared to state-of-the-art monocular methods like EVIO, enabling reliable pose estimation in conditions where conventional approaches fail. A video demonstration is available at https://youtu.be/RfWYU15WwsU.
17 February 2021 in Journal of Cosmetic Dermatology