Surface defect identification is a crucial task in many manufacturing systems, including automotive, aircraft, steel rolling, and precast concrete. Although image-based surface defect identification methods have been proposed, these methods usually have two limitations: images may lose partial information, such as depths of surface defects, and their precision is vulnerable to many factors, such as the inspection angle, light, color, noise, etc. Given that a three-dimensional (3D) point cloud can precisely represent the multidimensional structure of surface defects, we aim to detect and classify surface defects using a 3D point cloud. This has two major challenges: (i) the defects are often sparsely distributed over the surface, which makes their features prone to be hidden by the normal surface and (ii) different permutations and transformations of 3D point cloud may represent the same surface, so the proposed model needs to be permutation and transformation invariant. In this paper, a two-step surface defect identification approach is developed to investigate the defects’ patterns in 3D point cloud data. The proposed approach consists of an unsupervised method for defect detection and a multi-view deep learning model for defect classification, which can keep track of the features from both defective and non-defective regions. We prove that the proposed approach is invariant to different permutations and transformations. Two case studies are conducted for defect identification on the surfaces of synthetic aircraft fuselage and the real precast concrete specimen, respectively. The results show that our approach receives the best defect detection and classification accuracy compared with other benchmark methods.
31 October 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
The training and testing data for deep-neural-network-based classifiers are usually assumed to be sampled from the same distribution. When part of the testing samples are drawn from a distribution that is sufficiently far away from that of the training samples (a.k.a. out-of-distribution (OOD) samples), the trained neural network has a tendency to make high-confidence predictions for these OOD samples. Detection of the OOD samples is critical when training a neural network used for image classification, object detection, etc. It can enhance the classifier's robustness to irrelevant inputs, and improve the system's resilience and security under different forms of attacks. Detection of OOD samples has three main challenges: (i) the proposed OOD detection method should be compatible with various architectures of classifiers (e.g., DenseNet, ResNet) without significantly increasing the model complexity and requirements on computational resources; (ii) the OOD samples may come from multiple distributions, whose class labels are commonly unavailable; (iii) a score function needs to be defined to effectively separate OOD samples from in-distribution (InD) samples. To overcome these challenges, we propose a Wasserstein-based out-of-distribution detection (WOOD) method. The basic idea is to define a Wasserstein-based score that evaluates the dissimilarity between a test sample and the distribution of InD samples. An optimization problem is then formulated and solved based on the proposed score function. The statistical learning bound of the proposed method is investigated to guarantee that the loss value achieved by the empirical optimizer approximates the global optimum. The comparison study results demonstrate that the proposed WOOD consistently outperforms other existing OOD detection methods.
1 June 2022 in Computer Methods and Programs in Biomedicine
Quality assurance techniques are increasingly demanded in additive manufacturing. Going beyond most of the existing research that focuses on the melt pool temperature monitoring, we develop a new method that monitors the in situ optical emission spectra signals. Optical emission spectra signals have been showing a potential capability of detecting microscopic pores. The concept is to extract features from the optical emission spectra via deep auto-encoders and then cluster the features into two quality groups to consider both unlabeled and labeled samples in a semi-supervised manner. The method is integrated with multitask learning to make it adaptable for the samples collected from multiple processes. Both a simulation example and a case study are performed to demonstrate the effectiveness of the proposed method.
Objective: Using population-based simulations and machine-learning algorithms to develop an adaptive restraint system that accounts for occupant anthropometry variations to further enhance safety balance throughout the whole population.Methods: Two thousand MADYMO full frontal impact crash simulations at 35 mph using two validated vehicle/restraint models representing a sedan and an SUV along with a parametric occupant model were conducted based on the maximal projection design of experiments, which considers varying occupant covariates (sex, stature, and body mass index) and vehicle restraint design variables (three for airbag, three for safety belt, and one for knee bolster). A Gaussian-process-based surrogate model was trained to rapidly predict occupant injury risks and the associated uncertainties. An optimization framework was formulated to seek the optimal adaptive restraint design policy that minimizes the population injury risk across a wide range of occupant sizes and shapes while maintaining a low difference in injury risks among different occupant subgroups. The effectiveness of the proposed method was tested by comparing the population-wise injury risks under the adaptive design policy and the traditional state-of-the-art design.Results: Compared to the traditional state-of-the-art design for midsize males, the optimal design policy shows the potential to further reduce the joint injury risk (combining head, chest, and lower extremity injury risks) among the whole population in the sedan and SUV models. Specifically, the two subgroups of vulnerable occupants including tall obese males and short obese females had higher reductions in injury risks.Conclusions: This study lays out a method to adaptively adjust vehicle restraint systems to improve safety balance. This is the first study where population-based crash simulations and machine-learning methods are used to optimize adaptive restraint designs for a diverse population. Nevertheless, this study shows the high injury risks associated with obese and female occupants, which can be mitigated via restraint adaptability.