The drone-based multi-modal inspection of industrial structures is a relatively new field of research gaining interest among companies. Multi-modal inspection can significantly enhance data analysis and provide a more accurate assessment of the components’ operability and structural integrity, which can assist in avoiding data misinterpretation and providing a more comprehensive evaluation, which is one of the NDT4.0 objectives. This paper investigates the use of coupled thermal and visible images to enhance abnormality detection accuracy in drone-based multi-modal inspections. Four use cases are presented, introducing novel process pipelines for enhancing defect detection in different scenarios. The first use case presents a process pipeline to enhance the feature visibility on visible images using thermal images in pavement crack detection. The second use case proposes an abnormality classification method for surface and subsurface defects using both modalities and texture segmentation for piping inspections. The third use case introduces a process pipeline for road inspection using both modalities. A texture segmentation method is proposed to extract the pavement regions in thermal and visible images. Further, the combination of both modalities is used to detect surface and subsurface defects. The texture segmentation approach is employed for bridge inspection in the fourth use case to extract concrete surfaces in both modalities.
Process automation utilizes specialized technology and equipment to automate and enhance production processes, leading to higher manufacturing efficiency, higher productivity, and cost savings. The aluminum die casting industry has significantly gained from the implementation of process automation solutions in manufacturing, serving safety-critical sectors such as automotive and aerospace industries. However, this method of component fabrication is very susceptible to generating manufacturing flaws, hence necessitating adequate non-destructive testing (NDT) to ascertain the fitness for use of such components. Machine learning has taken the center stage in recent years as a tool for developing automated solutions for detecting and classifying flaws in digital X-ray radiography. These machine learning-based solutions have increasingly been developed and deployed for component inspection, to keep pace with the high production throughput in manufacturing industries. This work focuses on the development of a defect grading algorithm that assesses detected flaws to ascertain if they constitute a defect that could render a component unfit for use. Guided by ASTM 2973-15; Standard Digital Reference Images for Inspection of Aluminum and Magnesium Die Castings, a grading pipeline utilizing K-D (k-dimensional) trees was developed to effectively structure detected flaws, enabling the system to make decisions based on acceptable grading terms. This solution is dynamic in terms of its conformity to different grading criteria and offers the possibility to achieve automated decision making (Accept/Reject) in digital X-ray radiography applications.