Multiview subspace clustering aims to discover the inherent structure of data by fusing multiple views of complementary information. Most existing methods first extract multiple types of handcrafted features and then learn a joint affinity matrix for clustering. The disadvantage of this approach lies in two aspects: 1) multiview relations are not embedded into feature learning and 2) the end-to-end learning manner of deep learning is not suitable for multiview clustering. Even when deep features have been extracted, it is a nontrivial problem to choose a proper backbone for clustering on different datasets. To address these issues, we propose the multiview deep subspace clustering networks (MvDSCNs), which learns a multiview self-representation matrix in an end-to-end manner. The MvDSCN consists of two subnetworks, i.e., a diversity network (Dnet) and a universality network (Unet). A latent space is built using deep convolutional autoencoders, and a self-representation matrix is learned in the latent space using a fully connected layer. Dnet learns view-specific self-representation matrices, whereas Unet learns a common self-representation matrix for all views. To exploit the complementarity of multiview representations, the Hilbert–Schmidt independence criterion (HSIC) is introduced as a diversity regularizer that captures the nonlinear, high-order interview relations. Because different views share the same label space, the self-representation matrices of each view are aligned to the common one by universality regularization. The MvDSCN also unifies multiple backbones to boost clustering performance and avoid the need for model selection. Experiments demonstrate the superiority of the MvDSCN.
25 February 2022 in IEEE Transactions on Multimedia
Multi-view learning has progressed rapidly in recent years. Although many previous studies assume that each instance appears in all views, it is common in real-world applications for instances to be missing from some views, resulting in incomplete multi-view data. To tackle this problem, we propose a novel Latent Heterogeneous Graph Network (LHGN) for incomplete multi-view learning, which aims to use multiple incomplete views as fully as possible in a flexible manner. By learning a unified latent representation, a trade-off between consistency and complementarity among different views is implicitly realized. To explore and exploit the complex relationship between samples and samples in the latent space, a neighborhood constraint and a view-existence constraint are proposed, for the first time, to construct a heterogeneous graph, which is used to mine the the structural information of the samples. Finally, to avoid any inconsistencies between training and testing, a transductive learning technique is applied based on graph learning for classification tasks. Extensive experimental results on real-world datasets demonstrate the effectiveness of our model over existing state-of-the-art approaches.
Skin cancer is one of the most common cancers in humans in recent years, affecting people of all ages. If skin cancer is treated in time, the curative effect and prognosis are favorable. At present, dermoscopy is an effective way for the early diagnosis of skin cancer. However, manual detection is highly dependent on the clinical experience of doctors, and the complexity of the dermoscopy image itself poses a great challenge to the classification. Therefore, we propose a decision fusion method. Through transfer learning, based on multiple pre-trained convolutional neural networks (CNNs), we use the block to combine multiple CNNs and finally make decisions through multiple blocks. The method of decision fusion can solve the generalization capability of a individual convolutional neural network (CNN) model, and is more robust and stable than the traditional fusion strategy. Based on ISIC 2019 dataset, we use StyleGANs to generate high-quality images to alleviate the problem of less and uneven distribution of the dermoscopy image dataset and improve the classification effect of CNNs. Our proposed method can improve the accuracy of dermoscopy image classification and provide help for dermatologists.
24 April 2024 in International Journal of Computer Vision
Skin cancer is a common and deadly cancer. Dermoscopy is an effective tool for the observation of abnormal skin pigmentation. However, dermoscopy images are extremely complex and present great challenges for diagnosis. Therefore, we proposed a classification method based on the ensemble of individual advantage and group decision in dermoscopy images, including the ensemble strategy of group decision, the ensemble strategy of maximizing individual advantage, and the ensemble strategy of block-integrated voting. We used generative adversarial networks (GANs) to create a balanced sample space to better train convolutional neural networks (CNNs). Through transfer learning, the pretraining CNNs were used for fine-tuning, then the effects of different CNNs on the classification of different categories of dermoscopy images were compared, and the CNNs with better classification effect were selected for the ensemble of different strategies. This study is based on the ISIC 2018 dataset and ISIC 2019 dataset. Compared with the different individual CNNs and the frameworks, the proposed ensemble strategies achieve a better improvement in the evaluation criteria.