Surface defect detection with machine learning has become an important tool in industries and a large field of study for researchers or workers in recent years. It is necessary to have a simplified source of information that helps us to better focus on one type of surface. In this systematic review, we present a classification for surface defect detection based on convolutional neural networks (CNNs) focused on surface types. Findings: Out of 253 records identified, 59 primary studies were eligible. Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we analyzed the structures of each study and the concepts related to defects and their types on surfaces. The presented review is mainly focused on finding a classification for the types of surfaces most used in industry (metal, building, ceramic, wood, and special). We delve into the specifics of each surface category, offering illustrative examples of their applications within both industrial and laboratory settings. Furthermore, we propose a new taxonomy of machine learning based on the obtained results and collected information. We summarized the studies and extracted the main characteristics such as type of surface, problem types, timeline, type of network, techniques, and datasets. Among the most relevant results of our analysis, we found that the metallic surface is the most used, as it is the one found in 62.71% of the studies, and the most prevalent problem type is classification, accounting for 49.15% of the total. Furthermore, we observe that transfer learning was employed in 83.05% of the studies, while data augmentation was utilized in 59.32%. Our findings also provide insights into the cameras most frequently employed, along with the strategies adopted to address illumination challenges present in certain articles and the approach to creating datasets for real-world applications. The main results presented in this review allow for a quick and efficient search of information for researchers and professionals interested in improving the results of their defect detection projects. Finally, we analyzed the trends that could open new fields of study for future research in the area of surface defect detection.
Defect detection is a key element of quality control in today’s industries, and the process requires the incorporation of automated methods, including image sensors, to detect any potential defects that may occur during the manufacturing process. While there are various methods that can be used for inspecting surfaces, such as those of metal and building materials, there are only a limited number of techniques that are specifically designed to analyze specialized surfaces, such as ceramics, which can potentially reveal distinctive anomalies or characteristics that require a more precise and focused approach. This article describes a study and proposes an extended solution for defect detection on ceramic pieces within an industrial environment, utilizing a computer vision system with deep learning models. The solution includes an image acquisition process and a labeling platform to create training datasets, as well as an image preprocessing technique, to feed a machine learning algorithm based on convolutional neural networks (CNNs) capable of running in real time within a manufacturing environment. The developed solution was implemented and evaluated at a leading Portuguese company that specializes in the manufacturing of tableware and fine stoneware. The collaboration between the research team and the company resulted in the development of an automated and effective system for detecting defects in ceramic pieces, achieving an accuracy of 98.00% and an F1-Score of 97.29%.
Assistive technology enables people to achieve independence when performing daily tasks and it enhances their overall quality of life. Visual information is the basis for most navigational tasks, so visually impaired individuals are at disadvantage due to the lack of sufficient information about their surrounding environment. With recent advances in inclusive technology it is possible to extend the support given to people with visual disabilities in terms of their mobility. In this context we propose and describe the Blavigator project, whose global objective is to assist visually impaired people in their navigation on indoor and outdoor environments. This paper is focused mainly on the Computer Vision module of the Blavigator prototype. We propose an object collision detection algorithm based on disparity images. The proposed algorithm uses a 2D Ensemble Empirical Mode Decomposition image optimization algorithm and a two layer disparity image segmentation to detect nearby objects.
14 January 2025 in Engineering Applications of Artificial Intelligence
Wildfires have become increasingly critical, affecting forests, air and water quality, soil health, and contributing to climate change. Unmanned aerial vehicle (UAV) have emerged as an effective solution for monitoring and managing wildfires, due to their rapid deployment, low cost, and reduced environmental impact. This study presents a digital twin (DT) system for UAVs that enables users to interact with virtual simulations and real UAVs for wildfire prevention and detection through a smartphone or a tablet. The proposed DT-based system leverages virtual reality and augmented reality (AR) and includes four key services: UAV flight data generator (UAV-FDG), visualization, control, and retrieval. Also, these services allow users to test and train UAV control with a virtual one before moving to real scenarios, reducing risks and costs. The integration of mobile devices increases accessibility and flexibility, enabling real-time monitoring and control of UAVs for wildfire management and facilitating deployment in diverse environments. The main contributions of this research include the proposal, implementation, and validation of a DT-based mobile system for visualization, control, and retrieval using AR, autonomous flight data attribution and movement, and the deployment of DTs of UAVs in real environments. The assessment results showcase the successful implementation of the proposed system, with positive participant feedback, supported by a positive system usability scale score of 79.75.
21 August 2012 in EURASIP Journal on Advances in Signal Processing
Empirical mode decomposition (EMD) is a fully unsupervised and data-driven approach to the class of nonlinear and non-stationary signals. A new approach is proposed, namely PHEEMD, to image analysis by using Peano–Hilbert space filling curves to transform 2D data (image) into 1D data, followed by ensemble EMD (EEMD) analysis, i.e., a more robust realization of EMD based on white noise excitation. Tests’ results have shown that PHEEMD exhibits a substantially reduced computational cost compared to other 2D-EMD approaches, preserving, simultaneously, the information lying at the EMD domain; hence, new perspectives for its use in low computational power devices, like portable applications, are feasible.