Objectives optimization and constraints satisfaction are two equally important goals to solve constrained many-objective optimization problems (CMaOPs). However, most existing studies for CMaOPs can be classified as feasibility-driven-constrained many-objective evolutionary algorithms (CMaOEAs), and they always give priority to satisfy constraints, while ignoring the maintenance of the population diversity for dealing with conflicting objectives. Consequently, the population may be pushed toward some locally feasible optimal or locally infeasible areas in the high-dimensional objective space. To alleviate this issue, this article presents a problem transformation technique, which transforms a CMaOP into a dynamic CMaOP (DCMaOP) for handling constraints and optimizing objectives simultaneously, to help the population cross the large and discrete infeasible regions. The well-known reference-point-based NSGA-III is tailored under the problem transformation model to solve CMaOPs, namely, DCNSGA-III. In this article, ε-feasible solutions play an important role in the proposed algorithm. To this end, in DCNSGA-III, a mating selection mechanism and an environmental selection operator are designed to generate and choose high-quality ε-feasible offspring solutions, respectively. The proposed algorithm is evaluated on a series of benchmark CMaOPs with three, five, eight, ten, and 15 objectives and compared against six state-of-the-art CMaOEAs. The experimental results indicate that the proposed algorithm is highly competitive for solving CMaOPs.
5 July 2023 in IEEE Transactions on Evolutionary Computation
Maximizing the classification accuracy and minimizing the number of selected features are two primary objectives in feature selection, which is inherently a multiobjective task. Multiobjective feature selection enables us to gain various insights from complex data in addition to dimensionality reduction and improved accuracy, which has attracted increasing attention from researchers and practitioners. Over the past two decades, significant advancements in multiobjective feature selection in classification have been achieved in both the methodologies and applications, but have not been well summarized and discussed. To fill this gap, this paper presents a broad survey on existing research on multiobjective feature selection in classification, focusing on up-to-date approaches, applications, current challenges, and future directions. To be specific, we categorize multiobjective feature selection in classification on the basis of different criteria, and provide detailed descriptions of representative methods in each category. Additionally, we summarize a list of successful real-world applications of multiobjective feature selection from different domains, to exemplify their significant practical value and demonstrate their abilities in providing a set of trade-off feature subsets to meet different requirements of decision makers. We also discuss key challenges and shed lights on emerging directions for future developments of multiobjective feature selection.
Constrained multiobjective optimization problems (CMOPs) pose great difficulties to the existing multiobjective evolutionary algorithms (MOEAs), in terms of constraint handling and the tradeoffs between diversity and convergence. The constraints divide the search space into feasible and infeasible regions. A key to solving CMOPs is how to effectively utilize the information of both feasible and infeasible solutions during the optimization process. In this article, we propose a multiform optimization framework to solve a CMOP task together with an auxiliary CMOP task in a multitask setting. The proposed framework is designed to conduct a search in different sizes of feasible space that is derived from the original CMOP task. The derived feasible space is easier to search and can provide a useful inductive bias to the search process of the original CMOP task, by leveraging the transferable knowledge shared between them, thereby helping the search to toward the Pareto optimal solutions from both the infeasible and feasible regions of the search space. The proposed framework is instantiated in three kinds of MOEAs: 1) dominance-based; 2) decomposition-based; and 3) indicator-based algorithms. Experiments on four sets of benchmark test problems demonstrate the superiority of the proposed method over four representative constraint-handling techniques. In addition, the comparison against five state-of-the-art-constrained MOEAs demonstrates that the proposed approach outperforms these contender algorithms. Finally, the proposed method is successfully applied to solve a real-world antenna array synthesis problem.
Reducing the number of selected features and improving the classification performance are two major objectives in feature selection, which can be viewed as a multi-objective optimization problem. Multi-objective feature selection in classification has its unique characteristics, such as it has a strong preference for the classification performance over the number of selected features. Besides, solution duplication often appears in both the search and the objective spaces, which degenerates the diversity and results in the premature convergence of the population. To deal with the above issues, in this paper, during the evolutionary training process, a multi-objective feature selection problem is reformulated and solved as a constrained multi-objective optimization problem, which adds a constraint on the classification performance for each solution (e.g., feature subset) according to the distribution of nondominated solutions, with the aim of selecting promising feature subsets that contain more informative and strongly relevant features, which are beneficial to improve the classification performance. Furthermore, based on the distribution of feature subsets in the objective space and their similarity in the search space, a duplication analysis and handling method is proposed to enhance the diversity of the population. Experimental results demonstrate that the proposed method outperforms six state-of-the-art algorithms and is computationally efficient on 18 classification datasets.
8 November 2022 in IEEE Transactions on Cybernetics
Evolutionary multiobjective feature selection (FS) has gained increasing attention in recent years. However, it still faces some challenges, for example, the frequently appeared duplicated solutions in either the search space or the objective space lead to the diversity loss of the population, and the huge search space results in the low search efficiency of the algorithm. Minimizing the number of selected features and maximizing the classification performance are two major objectives in FS. Usually, the fitness function of a single-objective FS problem linearly aggregates these two objectives through a weighted sum method. Given a predefined direction (weight) vector, the single-objective FS task can explore the specified direction or area extensively. Different direction vectors result in different search directions in the objective space. Motivated by this, this article proposes a multiform framework, which solves a multiobjective FS task combined with its auxiliary single-objective FS tasks in a multitask environment. By setting different direction vectors, promising feature subsets from single-objective FS tasks can be utilized, to boost the evolutionary search of the multiobjective FS task. By comparing with five classical and state-of-the-art multiobjective evolutionary algorithms, as well as four well-performing FS algorithms, the effectiveness and efficiency of the proposed method are verified via extensive experiments on 18 classification datasets. Furthermore, the effectiveness of the proposed method is also investigated in a noisy environment.