In brain storm optimization (BSO), the convergent operation utilizes a clustering strategy to group the population into multiple clusters, and the divergent operation uses this cluster information to generate new individuals. However, this mechanism is inefficient to regulate the exploration and exploitation search. This article first analyzes the main factors that influence the performance of BSO and then proposes an orthogonal learning framework to improve its learning mechanism. In this framework, two orthogonal design (OD) engines (i.e., exploration OD engine and exploitation OD engine) are introduced to discover and utilize useful search experiences for performance improvements. In addition, a pool of auxiliary transmission vectors with different features is maintained and their biases are also balanced by the OD decision mechanism. Finally, the proposed algorithm is verified on a set of benchmarks and is adopted to resolve the quantitative association rule mining problem considering the support, confidence, comprehensibility, and netconf. The experimental results show that the proposed approach is very powerful in optimizing complex functions. It not only outperforms previous versions of the BSO algorithm but also outperforms several famous OD-based algorithms.
8 October 2020 in IEEE Transactions on Aerospace and Electronic Systems
For multiple unmanned aerial vehicles (UAVs) performing aerial search-attack tasks, there is a tradeoff between maximizing total benefit and minimizing consumption under the validity of constraints. This article proposes a dynamic discrete pigeon-inspired optimization algorithm to handle cooperative search-attack mission planning for UAVs, which integrates the centralized task assignment and distributed path generation aspects of the problem. Besides, a solution acceptance strategy is proposed to avoid frequent task switching. To design a reasonable objective function, the probability map is constructed and updated by Bayes formula to guide the following search motion, and a response threshold sigmoid model is adopted for target allocation during executing attack. Moreover, the flyable trajectories are generated by B-spline curves based on the simplified waypoints. Finally, numerical experiments prove that the proposed methods can provide feasible solutions for multiple UAVs considering different scenarios, such as the absence or presence of threats and insufficient resources. The results also show that the solution acceptance strategy is effective to improve performance. Moreover, the extensible mission planning system also integrates with an interactive 3D visualization simulation module, where the multi-UAV coordinated flight processes are demonstrated dynamically.
Dynamic multiobjective optimization problems are challenging due to their fast convergence and diversity maintenance requirements. Prediction-based evolutionary algorithms currently gain much attention for meeting these requirements. However, it is not always the case that an elaborate predictor is suitable for different problems and the quality of historical solutions is sufficient to support prediction, which limits the availability of prediction-based methods over various problems. Faced with these issues, this article proposes a knowledge learning strategy for change response in the dynamic multiobjective optimization. Unlike prediction approaches that estimate the future optima from previously obtained solutions, in the proposed strategy, we react to changes via learning from the historical search process. We introduce a method to extract the knowledge within the previous search experience. The extracted knowledge can accelerate convergence as well as introduce diversity for the optimization of the future environment. We conduct a comprehensive experiment on comparing the proposed strategy with the state-of-the-art algorithms. Results demonstrate the better performance of the proposed strategy in terms of solution quality and computational efficiency.
Particle swarm optimization (PSO) is a population-based stochastic algorithm modeled on the social behaviors observed in flocking birds. Over the past quarter century, the particle swarm optimization algorithm has attracted many researchers’ attention. Through the convergent operation and divergent operation, individuals in PSO group and diverge in the search space/objective space. In this paper, the historical development, the state-of-the-art, and the applications of the PSO algorithms are reviewed. In addition, the characteristics and issues of the PSO algorithm are also discussed from the evolution and learning perspectives. Every individual in the PSO algorithm learns from itself and another particle with good fitness value. The search performance and convergence speed were affected by different learning strategies. The scheduling and data-mining problems are illustrated as two typical cases of PSO algorithm solving real-world application problems. With the analysis of different evolution and learning strategies, particle swarm optimization algorithm could be utilized on solving more real-world application problems effectively, and the strength and limitation of various PSO algorithms could be revealed.
Collaborative filtering (CF) based recommender systems are typically trained based on personal interaction data (e.g., clicks and purchases) that could be naturally represented as ego graphs. However, most existing recommendation methods collect these ego graphs from all users to compose a global graph to obtain high-order collaborative information between users and items, and these centralized CF recommendation methods inevitably lead to a high risk of user privacy leakage. Although recently proposed federated recommendation systems can mitigate the privacy problem, they either restrict the on-device local training to an isolated ego graph or rely on an additional third-party server to access other ego graphs resulting in a cumbersome pipeline, which is hard to work in practice. In addition, existing federated recommendation systems require resource-limited devices to maintain the entire embedding tables resulting in high communication costs. In light of this, we propose a semi-decentralized federated ego graph learning framework for on-device recommendations, named SemiDFEGL, which introduces new device-to-device collaborations to improve scalability and reduce communication costs and innovatively utilizes predicted interacted item nodes to connect isolated ego graphs to augment local subgraphs such that the high-order user-item collaborative information could be used in a privacy-preserving manner. Furthermore, the proposed framework is model-agnostic, meaning that it could be seamlessly integrated with existing graph neural network-based recommendation methods and privacy protection techniques. To validate the effectiveness of the proposed SemiDFEGL, extensive experiments are conducted on three public datasets, and the results demonstrate the superiority of the proposed SemiDFEGL compared to other federated recommendation methods.
1 July 2013 in International Journal of Swarm Intelligence Research
In recent years, many evolutionary algorithms and population-based algorithms have been developed for solving multi-objective optimization problems. In this paper, the authors propose a new multi-objective brain storm optimization algorithm in which the clustering strategy is applied in the objective space instead of in the solution space in the original brain storm optimization algorithm for solving single objective optimization problems. Two versions of multi-objective brain storm optimization algorithm with different characteristics of diverging operation were tested to validate the usefulness and effectiveness of the proposed algorithm. Experimental results show that the proposed multi-objective brain storm optimization algorithm is a very promising algorithm, at least for solving these tested multi-objective optimization problems.