18 March 2024 in IEEE Transactions on Knowledge and Data Engineering
Feature selection, an essential technique in data mining, is often confined to batch learning or online idealization of data scenarios despite its significance. Existing online feature selection methods have specific assumptions regarding the data stream, such as requiring a fixed feature space with an explicit pattern and complete labeling of samples. Unfortunately, data streams generated in many real scenarios commonly exhibit arbitrarily incomplete feature spaces and scarcity labels, making existing approaches unsuitable for real applications. To fill these gaps, this study proposes a new problem called Online Feature Selection with Varying Features Spaces (OFSVF). OFSVF has a three-fold main idea: 1) it leverages Gaussian Copula to model the incomplete feature correlation in a complete latent space, encoded by continuous variables, 2) it employs a novel tree-ensemble-based approach to select the most informative features on-the-fly, and 3) it develops the underlying geometric structure of instances to establish the relationship between unlabeled and labels. Experimental results are documented to demonstrate the feasibility and effectiveness of our proposed method.
19 June 2025 in ACM Transactions on Knowledge Discovery From Data
Online learning, characterized by its feature space’s adaptability over time, has emerged as a flexible learning paradigm that has attracted widespread attention. However, existing online learning methods often overlook the distributional differences between instances and the presence of label noise in streaming data, thus significantly hindering the effectiveness and robustness of these algorithms. To overcome these challenges, we propose an online confidence learning algorithm for noisy labeled features, which aims to achieve robustness against arbitrary data streams and noisy labels. It employs two new strategies: online confidence inference, which applies the principle of empirical risk minimization to identify inconsistencies in spatial distributions, and geometric structure learning, which utilizes dynamic instance confidence to compute disparities between instances and their labels. Empirical findings demonstrate that our label correction mechanism enhances classification accuracy more effectively across various types of noisy labels (i.e., symmetric, asymmetric, and flipped). Additionally, a case study on image datasets was conducted to illustrate in detail the effectiveness of our OLNLS algorithm. Code is released in https://github.com/Zhuosd/OLNLS .