3 February 2021 in IEEE Transactions on Instrumentation and Measurement
Surface defects have an adverse effect on the quality of industrial products, and vision-based defect detection is widely researched due to its objective and stable performance. However, the task is still challenging due to diversified defect types and complex background texture. The robust principal component analysis (RPCA) has proven applicable in defect inspection by regarding nondefective background as the low-rank part and defective area as the sparse part. However, such methods cannot sufficiently detect defects due to complex cluttered background, noise interference, and limited features available. To address these issues, in this article, we proposed an unsupervised surface defect detection method based on nonconvex total variation (TV) regularized RPCA with kernelization, named KRPCA-NTV. Specifically, the kernel method is integrated into RPCA to better handle complex cluttered background lying in a nonstrict low-rank subspace. Furthermore, nonconvex TV regularization is introduced to prevent the noise pixel from being separated into the defect region; meanwhile, nonconvex optimization promotes higher solution accuracy. In addition, the kernel canonical correlation analysis (KCCA) is utilized to fuse complementary features for boosting feature representation ability. To demonstrate the superiority and robustness of the proposed method, we compare it with the state of the art on five defect data sets; the results show that the proposed method outperforms competing methods in terms of accuracy and generalizability.
19 December 2022 in IEEE Sensors Journal
Surface defect detection is extremely critical for quality control and routine maintenance, and computer vision-based methods have delivered promising performance in various industrial fields. However, there remains big challenges in region consistency and boundary localization, due to complicated appearance in defects, interference of artifacts, and low contrast. To overcome these issues, in this paper, we propose an enhanced encoder-decoder network with hierarchical supervision for surface defect detection, termed SDDet. Specifically, deformable convolution is adopted to enable feature learning in a free-form way, thus making the network more robust to various defect structures. Then a bridge module is applied to capture richer multi-level contextual information, which is conducive to distinguishing defects from the background artifacts. Next, the learned features from adjacent layers are adaptively combined by selective feature aggregation module to enhance discriminative features and suppress valueless features. Meanwhile, the bottleneck refinement module is added to further refine the boundary of defect region, resulting in a satisfying boundary details. Finally, a hybrid three-level loss is developed to guide the network to focus more on error-prone hard pixels. Additionally, a hardware system embedded with our SDDet is built to achieve automatic and accurate defect inspection. Experimental results over four datasets demonstrate the effectiveness and generalization of our method compared with state-of-the-art methods.
10 July 2013 in Photonic Sensors
For the health monitoring of the offshore drilling platform in the salt-fog environment, three nonmetallic materials, i.e., silica, FR-4 epoxy board and sheet molding compound (SMC), with the good anti-corrosion ability were chosen as the packaging materials for the fiber Bragg grating (FBG) strain sensors. By selecting a highly sensitive structure of the fiber Bragg grating strain sensor, the performances of the sensors with three materials were investigated both numerically and experimentally. The strain sensitivities were 3.76 pm/μɛ, 3.02 pm/μɛ and 3.03 pm/μɛ, respectively. The linearity was better than 0.998. It provides useful information for developing sensors for the marine engineering.
8 December 2022 in IEEE Geoscience and Remote Sensing Letters
For infrared small target detection, we propose a new spatial-temporal tensor decomposition model based on the tensor Schatten capped p norm (TSC p N) and total variation (TV) regularization. Firstly, to explore spatial and temporal information, we construct a spatial-temporal tensor and introduce the prior weight map. Then, replacing the nuclear norm used to define tensor nuclear norm (TNN) with the non-convex Schatten capped p (SC p ) norm, we propose the TSC p N to approximate tensor rank and thus recover the low-rank background tensor. Next, to effectively eliminate background clutter from the sparse component, TV regularization is applied to constrain the sparse term. Finally, the proposed model is solved by the alternating direction method of multipliers. Experimental results demonstrate the effectiveness and superiority of our proposed method in detecting infrared small targets from various challenging sequences.
1 January 2024 in Journal of Engineered Fibers and Fabrics
Fabric defect detection is a pivotal step in quality control in the textile manufacturing industry. Due to the diversity and complexity of defects, manual visual inspection and traditional fabric defect detection methods suffer from low efficiency and accuracy. To address the issues, a saliency model capable of mining local and global information from CNN and vision Transformer is proposed for fabric defect detection in this paper, named ACCTNet. Specifically, to enhance the feature interaction of different scales, an adjacent context coordination module composed of one local branch and two adjacent branches is proposed. Meanwhile, a contrast-aggregation module is proposed to highlight the defects from low contrast background using pooling and subtraction operations. In addition, vision Transformer is adopted to capture global contextual information with long-range dependencies, which can guide local information to further refines the defect detection results. Experimental results demonstrate that the proposed method can accurately inspect the defects from plain and patterned fabric surfaces, achieving Em values of 78.49% and 97.19% respectively, which significantly surpasses the existing state-of-the-art fabric defect detection methods.
30 November 2025 in Journal of Engineered Fibers and Fabrics
In the textile industry, surface defects can greatly damage the value of fabric, but the coexistence of subtle defects and elongated defects poses a significant challenge to the localization of them. Existing convolutional neural networks-deep learning methods, especially the YOLO series, can present promising fabric defect detection. However, their performance is limited in simultaneously learning local and global features, leading to inaccurate localization results. To address this issue, this paper proposes a Fabric Defect Detection Network (FDDNet) based on Spatial Depth-Transforming Convolution (SDTC) and Multiscale Dilated Self-attention Fusion Module (MDSFM). Firstly, to enhance the local feature characterization capability of the backbone network, our FDDNet proposes spatial depth-transforming convolutions to preserve more fine-grained information. Subsequently, to effectively integrate global and local information and enhance global-local modeling capability, the multiscale dilated self-attention fusion module is introduced by combining self-attention mechanisms and dilated convolutions, thus enabling the model to percept scale changes and achieving multi-scale defect localization. Experiment results conducted on the publicly available Tianchi fabric dataset and a self-made denim dataset show that, the proposed FDDNet can achieve the AP50 of 54% and 56.8% respectively, which outperforms mainstream state-of-the-art methods.