24 September 2024 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Hashing technology has exhibited great cross-modal retrieval potential due to its appealing retrieval efficiency and storage effectiveness. Most current supervised cross-modal retrieval methods heavily rely on accurate semantic supervision, which is intractable for annotations with ever-growing sample sizes. By comparison, the existing unsupervised methods rely on accurate sample similarity preservation strategies with intensive computational costs to compensate for the lack of semantic guidance, which causes these methods to lose the power to bridge the semantic gap. Furthermore, both kinds of approaches need to search for the nearest samples among all samples in a large search space, whose process is laborious. To address these issues, this paper proposes an unsupervised dual deep hashing (UDDH) method with semantic-index and content-code for cross-modal retrieval. Deep hashing networks are utilized to extract deep features and jointly encode the dual hashing codes in a collaborative manner with a common semantic index and modality content codes to simultaneously bridge the semantic and heterogeneous gaps for cross-modal retrieval. The dual deep hashing architecture, comprising the head code on semantic index and tail codes on modality content, enhances the efficiency for cross-modal retrieval. A query sample only needs to search for the retrieved samples with the same semantic index, thus greatly shrinking the search space and achieving superior retrieval efficiency. UDDH integrates the learning processes of deep feature extraction, binary optimization, common semantic index, and modality content code within a unified model, allowing for collaborative optimization to enhance the overall performance. Extensive experiments are conducted to demonstrate the retrieval superiority of the proposed approach over the state-of-the-art baselines
11 April 2022 in IEEE Transactions on Cybernetics
Unsupervised feature selection is a vital yet challenging topic for effective data learning. Recently, 2-D feature selection methods show good performance on image analysis by utilizing the structure information of image. Current 2-D methods usually adopt a sparse regularization to spotlight the key features. However, such scheme introduces additional hyperparameter needed for pruning, limiting the applicability of unsupervised algorithms. To overcome these challenges, we design a feature filter to estimate the weight of image features for unsupervised feature selection. Theoretical analysis shows that a sparse regularization can be derived from the feature filter by transformation, indicating that the filter plays the same role as the popular sparse regularization does. We deploy two distinct strategies in terms of feature selection, called multiple feature filters and single common feature filter. The former divides the optimization problem into multiple independent subproblems and selects features that meet the respective interests of each subproblem. The latter selects features that are in the interest of the overall optimization problem. Extensive experiments on seven benchmark datasets show that our unsupervised 2-D weight-based feature selection methods achieve superior performance over the state-of-the-art methods.
8 April 2024 in IEEE Transactions on Multimedia
Current cross-modal retrieval methods heavily rely on accurate semantic labels or sample similarity measurements, and need to search for the nearest samples among all samples in the huge search space, severely limiting the application in stratifying large-scale and high-dimensional multimodal data. To tackle with the issues, this paper proposes an unsupervised cross-modal retrieval method to bypass the semanticwise supervision and samplewise similarity from a standpoint of featurewise matching, named by unsupervised dual hashing coding (UDC). It jointly learns the dual hashing codes on semantic tagging and sample content through factorizing a feature matching potential, which is allowed to bridge the semantic and heterogeneous gaps among different modalities simultaneously through maintaining the inter-modality-consistent semantic information and cross-modality-correlated sample content. In this way, each sample is uniquely coded by a head code on semanticwise tags, and tail codes on samplewise content. The dual coding design makes it very efficient for sample retrieval, in which the query sample only need to search for the retrieved ones with the same semantic tag, greatly narrowing down the search space. The proposed model avoids the calculation of massive sample-wise similarity and works with dual hashing coding scheme, which achieves a twofold efficiency enhancement for analyzing the large-scale and high-dimensional multimodal data. Extensive experiments have been conducted to demonstrate that it achieved superiority on computational time and retrieval performance.
29 January 2024 in IEEE Transactions on Emerging Topics in Computational Intelligence
Multi-view clustering exploits the complementary information of different views for comprehensive data analysis. Recently, graph learning techniques with low-dimensional embedding have been developed to learn consensus affinity graph for multi-view clustering. However, projecting data into the low-dimensional space has often resulted in the compression of data information, which is insufficient for graph learning. To address this challenge, this paper proposes a Collaborative Embedding Learning via Tensor (CELT) method, which learns intra-view affinity graphs for each view from both the original space and the low-dimensional space jointly. Additionally, all intra-view affinity graphs are stacked into a tensor, allowing the learning of a consensus affinity to capture inter-view consistency. In this way, an enhanced consensus affinity is obtained to improve the performance of multi-view clustering. Extensive experimental results on eight real-world datasets demonstrate that the proposed collaborative learning framework is effective for graph learning and outperforms competitive multi-view clustering methods.
11 March 2024 in IEEE Transactions on Emerging Topics in Computational Intelligence
Unsupervised feature selection is vital in explanatory learning and remains challenging due to the difficulty of formulating a learnable model. Recently, graph embedding learning has gained widespread popularity in unsupervised learning, which extracts low-dimensional representation based on graph structure. Nevertheless, such an embedding scheme for unsupervised feature selection will distort original features due to the spatial transformation by extraction. To address this problem, this paper proposes a collaborative graph embedding model for unsupervised feature selection via jointly using soft-threshold and low-dimensional embedding learning. The former learns a threshold selection matrix for feature weighting in the original space. The latter extracts embedded representation in low-dimensional space to reveal the latent graph structure. By collaborative learning, the proposed method can simultaneously perform unsupervised feature selection in the original space and adaptive graph learning via dual embedding. Extensive experiments on five benchmark datasets demonstrate that the proposed method achieves superior performance compared to eight competing methods.
14 August 2024 in IEEE Transactions on Neural Networks and Learning Systems
Traditional clustering methods rely on pairwise affinity to divide samples into different subgroups. However, high-dimensional small-sample (HDLSS) data are affected by the concentration effects, rendering traditional pairwise metrics unable to accurately describe relationships between samples, leading to suboptimal clustering results. This article advances the proposition of employing high-order affinities to characterize multiple sample relationships as a strategic means to circumnavigate the concentration effects. We establish a nexus between different order affinities by constructing specialized decomposable high-order affinities, thereby formulating a uniform mathematical framework. Building upon this insight, a novel clustering method named uniform tensor clustering (UTC) is proposed, which learns a consensus low-dimensional embedding for clustering by the synergistic exploitation of multiple-order affinities. Extensive experiments on synthetic and real-world datasets demonstrate two findings: 1) high-order affinities are better suited for characterizing sample relationships in complex data and 2) reasonable use of different order affinities can enhance clustering effectiveness, especially in handling high-dimensional data.