Kaiyou Song

Kaiyou Song

Auto-generated profile, based on publicly available information

Kaiyou Song

State Key Laboratory of Digital Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2019 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
HYHua Yang
Hua Yang
YCYifan Chen
Yifan Chen
KSKaiyou Song
Kaiyou Song
ZYZhouping Yin
Zhouping Yin
Visual inspection of texture surface defects is still a challenging task in the industrial automation field due to the tremendous changes in the appearance of various surface textures. Current visual inspection methods cannot simultaneously and efficiently inspect various types of texture defects due to either the low discriminative capabilities of handcrafted features or their time-consuming sliding-window strategy. In this paper, we present a novel unsupervised multiscale feature-clustering-based fully convolutional autoencoder (MS-FCAE) method that efficiently and accurately inspects various types of texture defects based on a small number of defect-free texture samples. The proposed MS-FCAE method utilizes multiple FCAE subnetworks at different scale levels to reconstruct several textured background images. The residual images are obtained by subtracting these texture backgrounds from the input image individually; then, they are fused into one defect image. To maximize the efficiency, each FCAE subnetwork utilizes fully convolutional neural networks to extract the original feature maps directly from the input images. Meanwhile, each FCAE subnetwork performs feature clustering to improve the discriminant power of the encoded feature maps. The proposed MS-FCAE method is evaluated on several texture surface inspection data sets both qualitatively and quantitatively. This method achieves a Precision of 92.0% while requiring only 82 ms for input images of 1920x 1080 pixels. The extensive experimental results demonstrate that MS-FCAE achieves highly efficient and state-of-the-art inspection accuracy.

11 August 2020 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
HYHua Yang
Hua Yang
QZQinyuan Zhou
Qinyuan Zhou
KSKaiyou Song
Kaiyou Song
ZYZhouping Yin
Zhouping Yin
Establishing a unified model for defect inspection remains a challenge in the industrial automation field due to the various texture surfaces. Current unsupervised methods cannot address anomalies, which causes these methods cannot inspect various texture defects. In this paper, we propose a novel unsupervised anomaly-feature-editing-based adversarial network (AFEAN) for accurate inspection of various texture defects. First, a paired input, consisting of defect-free image and its artificially defective image, is utilized to train AFEAN. Subsequently, a novel anomaly feature detection module is proposed to detect anomaly features in the latent space. Next, a global context feature editing module is proposed to suppress the reconstruction of defects. Finally, a feature decoding module utilizes the edited features to reconstruct the texture background. In the testing phase, the defects are segmented by the residuals between the input and the reconstructed texture background. The extensive experimental results demonstrate that AFEAN achieves state-of-the-art inspection accuracy.

11 October 2018 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
KSKaiyou Song
Kaiyou Song
HYHua Yang
Hua Yang
ZYZhouping Yin
Zhouping Yin
Object detection remains a challenging task in computer vision due to the tremendous extent of changes in the appearances of objects caused by clustered backgrounds, occlusion, truncation and scale change. Current deep neural network (DNN)-based object detection methods cannot simultaneously achieve a high accuracy and a high efficiency. To overcome this limitation, in this study, we propose a novel multi-scale attention deep neural network (MSA-DNN) for accurate object detection with high efficiency. The proposed MSA-DNN method utilizes a novel multi-scale feature fusion module (MSFFM) to construct high-level semantic features. Subsequently, a novel multi-scale attention module (MSAM) based on the fused layers of the MSFFM is introduced to exploit the global semantic information of image-level labels to guide detection. On the one hand, MSAM can capture global semantic information to further enhance the semantic feature representation of the fused layers constructed by the MSFFM, thereby improving the detection accuracy. On the other hand, the multi-scale attention maps generated by MSAM can be employed to rapidly and coarsely locate objects at different scales. In addition, an attention-based hard negative mining strategy (AHNM) is introduced to filter out negative samples to reduce the search space, dramatically alleviating the severe class imbalance problem. Extensive experimental results on the challenging PASCAL VOC 2007, PASCAL VOC 2012 and MS COCO datasets demonstrate that MSA-DNN achieves a stateof- the-art detection accuracy while maintaining a high efficiency. Furthermore, MSA-DNN significantly improves the small-object detection accuracy.

17 January 2019 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
HYHua Yang
Hua Yang
CHChenghui Huang
Chenghui Huang
FWFeiyue Wang
Feiyue Wang
KSKaiyou Song
Kaiyou Song
ZYZhouping Yin
Zhouping Yin
Almost all conventional template-matching methods employ low-level image features to measure the similarity between a template image and a scene image using similarity measures, such as pixel intensity and pixel gradient. Although these methods have been widely used in many applications, they cannot simultaneously address all types of robustness challenges. In this paper, with the goal of simultaneously addressing the various challenges, we present a robust semantic template-matching (RSTM) approach. Inspired by the local binary descriptor, we propose a novel superpixel region binary descriptor (SRBD) to construct a multilevel semantic fusion feature vector for RSTM. SRBD uses a new kernel-distance-based simple linear iterative clustering method to extract the stable superpixels from the template image. Then, based on the average intensity difference between each superpixel region and its neighbors, the dominant gradient orientation of each superpixel can be obtained, and the semantic features of each superpixel can be described as the dominant orientation difference vector, which is coded as the rotation-invariant SRBD. In the offline matching phase, the fusion semantic feature vector of RSTM combines the multilevel SRBD features with different numbers of superpixels. In the online matching phase, to cope with rotation invariance, a marginal probability model is proposed and applied to locate the positions of template images in the scene image. Moreover, to accelerate computation, an image pyramid is employed. We conduct a series of experiments on a large dataset randomly selected from the MS COCO dataset to fully analyze the robustness of this approach. The experimental results show that RSTM simultaneously addresses rotation changes, scale changes, noise, occlusions, blur, nonlinear illumination changes, and deformation with high time efficiency while also outperforming the previous state-of-the-art template-matching methods.

3 August 2022 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
KSKaiyou Song
Kaiyou Song
HYHua Yang
Hua Yang
ZYZhouping Yin
Zhouping Yin
Texture defect inspection remains challenging due to the extreme variations in various textures and defects. Current unsupervised-learning-based texture defect inspection methods cannot simultaneously inspect a wide variety of texture defects because they lack an explicit mechanism to encourage the model to create large anomaly scores for defects. In this study, we propose a novel anomaly composition and decomposition network (ACDN) for accurate inspection of various texture defects. In the proposed ACDN, a Gaussian-sampling-based anomaly composition (GSAC) method is proposed to perform the anomaly composition procedure, which composites a large number of defective images for training. Then, a novel anomaly decomposition network (ADN) is proposed to perform the anomaly decomposition procedure, which decomposes the defective images into texture background images and anomaly images by forcing the intrinsic texture features of abnormal images to share a common distribution with those of defect-free images. Through the GSAC and ADN, ACDN learns not only to accurately reconstruct texture background images to cause large reconstruction errors for defect regions but also accurately segment defects. In the testing phase, a defective image is decomposed into a texture background image and an anomaly image through the trained ADN. The residual image between the defective image and the texture background image is then fused with the anomaly image to obtain the defect inspection result. Extensive experimental results on mainstream texture defect datasets demonstrate that ACDN achieves the state-of-the-art texture defect inspection accuracy.

19 October 2020 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
HYHua Yang
Hua Yang
KSKaiyou Song
Kaiyou Song
FMFangqin Mao
Fangqin Mao
ZYZhouping Yin
Zhouping Yin
Active learning can reduce the human effort required for labeling training samples while preserving the performance of visual classifiers. However, existing active learning frameworks cannot be used to perform visual classification of industrial product surface defects because they still require intensive manual annotation efforts. In this study, we propose a cost-efficient autolabeling-enhanced active learning (ALEAL) framework to reduce the human annotation effort required for surface defect visual classification. The proposed ALEAL framework employs a deep convolutional neural network (CNN) as a visual classifier trained from an initial set of humanlabeled training samples. Then, the collected unlabeled training samples are input into the classifier for category confidence estimation. Next, a novel diverse cost-effective query strategy (DCEQS) is proposed to select some high-confidence samples for autolabeling and to select some informative samples for sample proposals that need labeling. Subsequently, to further reduce the human annotation effort, a novel autolabeling module is proposed and introduced in ALEAL that can automatically label a portion of the informative unlabeled training samples selected by the DCEQS. In this study, a novel attention-based similarity measurement network (ASMN) is proposed as an implementation of this autolabeling module by measuring the similarity between unlabeled and labeled samples. Finally, the remaining unlabeled samples are annotated by human experts, and all the newly labeled samples are used to retrain the classifier. Through the autolabeling process from the DCEQS and ASMN, ALEAL can automatically label additional training samples and achieve a competitive performance while requiring few humanlabeled training samples, which is highly important in industrial applications. Extensive experimental results show that compared with popular active learning methods, ALEAL can dramatically reduce the effort involved in human annotation and achieve stateof-the-art cost efficiency for the visual classification of industrial product surface defects.