In the current steel production process, occasional flaws within the billet are somewhat inevitable. Overlooking these flaws can compromise the quality of the resulting steel products. To address and mark these flaws for further handling, Magnetic Particle Testing (MT) in conjunction with machine vision is commonly utilized. This method identifies flaws on the billet’s surface and subsequently marks them via a device, eliminating the need for manual intervention. However, certain processes, such as magnetic particle cleaning, require substantial spacing between the vision system and the marking device. This extended distance can lead to shifts in the billet position, thereby potentially affecting the precision of flaw marking. In response to this challenge, we developed a detection-marking system consisting of 2D cameras, a manipulator, and an integrated 3D camera to accurately pinpoint the flaw’s location. Importantly, this system can be integrated into active production lines without causing disruptions. Experimental assessments on dynamic billets substantiated the system’s efficacy and feasibility.
Indoor service robots often face challenges in target localization and robotic grasping under cluttered backgrounds, partial occlusion, and viewpoint variations. To address these issues, this study proposes a vision-guided robotic grasping framework based on an improved feature matching algorithm termed Mahalanobis-accelerated Scale-Invariant Feature Transform Plus (MSIFT+). The proposed method integrates Mahalanobis distance metric reconstruction with a dynamic Best-Bin-First (BBF) search strategy to improve matching robustness and computational efficiency. A multi-scenario indoor dataset was constructed to evaluate the proposed method under rotational variation, weak-texture, and partial occlusion conditions. The results demonstrate that the MSIFT+ algorithm significantly outperforms other methods in cross-scenario consistency and adaptability to weakly textured targets. Furthermore, a binocular vision-guided robotic grasping system was developed and validated through practical robotic experiments. Experimental results confirm that the MSIFT+ algorithm enhances detection performance for small and clustered targets in complex environments. The proposed framework provides an effective and reliable solution for robotic object localization and grasping in complex indoor environments.