Feature selection aims to remove irrelevant or redundant features and thereby remain relevant or informative features so that it is often preferred for alleviating the dimensionality curse, enhancing learning performance, providing better readability and interpretability, and so on. Data that contain numerical and categorical representations are called heterogeneous data, and they exist widely in many real-world applications. Neighborhood rough set (NRS) can effectively deal with heterogeneous data by using neighborhood binary relation, which has been successfully applied to heterogeneous feature selection. In this article, the NRS model as a unified framework is used to design a feature selection method to handle categorical, numerical, and heterogeneous data. First, the concept of neighborhood combination entropy (NCE) is presented. It can reflect the probability of pairs of the neighborhood granules that are probably distinguishable from each other. Then, the conditional neighborhood combination entropy (cNCE) based on NCE is proposed under the condition of considering decision attributes. Moreover, some properties and relationships between cNCE and NCE are derived. Finally, the functions of inner and outer significances are constructed to design a feature selection algorithm based on cNCE (FScNCE). The experimental results show the effectiveness and superiority of the proposed algorithm.
Multi-modal Named Entity Recognition (MNER), which mainly focuses on enhancing text-only NER with visual information, has recently attracted considerable attention. Most current MNER models have made significant progress by jointly understanding visual and language modalities through layers of cross-modality attention. However, these approaches largely ignore the visual bias brought by the image contents and barely consider exploiting the multi-granularity representations and the interactions between visual objects, which are essential in recognizing ambiguous entities. In this paper, we propose a S cene graph driven M ulti-modal M ulti-granularity M ulti-task learning ( M3S ) framework to better exploit visual and textual information in MNER. Specifically, to explicitly alleviate visual bias, we present a novel multi-task approach by employing the task of Named Entity Segmentation (NES) cascade with Named Entity Categorization (NEC). To obtain detailed visual semantics by explicitly modeling objects and relationships between paired objects, we construct scene graphs as a structured representation of the visual contents. Furthermore, a well-designed Multi-granularity Gated Aggregation (MGA) mechanism is introduced to capture inter-modality interactions and extract critical features for named entity recognition. Extensive experiments on two real public datasets demonstrate the effectiveness of our proposed M3S.
13 March 2023 in IEEE Transactions on Fuzzy Systems
Feature selection, as an effective dimensionality reduction technique, is favored in preprocessing data. However, most existing algorithms are solely liable for labeled or unlabeled data, whereas a limited portion of real-world data is annotated with labels. In this paper, we therefore propose a novel scheme named SemiFREE, i.e., Semi-supervised feature selection with Fuzzy RElevance and rEdundancy. Firstly, both labeled and unlabeled samples are assigned with fuzzy decisions that allow class membership to naturally express the fuzziness or uncertainty in data labeling. Secondly, sample similarities in feature space and fuzzy decision are captured to induce fuzzy information measures for redefining the feature relevance and redundancy. Finally, adhering to the principle of relevance-maximization and redundancy-minimization, SemiFREE leverages the forward sequential searching strategy to identify qualified features progressively. Extensive experiments demonstrate the superiority of SemiFREE in the presence of partially labeled data against some other well-established feature selection algorithms.
7 March 2020 in International Journal of Machine Learning and Cybernetics