A key parameter affecting the operation of differential evolution (DE) is the crossover rate Cr ϵ [0, 1]. While very low values are recommended for and used with separable problems, on non-separable problems, which include most real-world problems, Cr = 0.9 has become the de facto standard, working well across a large range of problem domains. Recent work on separable and non-separable problems has shown that lower-dimensional searches can play an important role in the performance of search techniques in higher-dimensional search spaces. However, the standard value of Cr = 0.9 implies a very high-dimensional search, which is not effective for other search techniques. An analysis of Cr across its range [0, 1] provides insight into how its value affects the performance of DE and suggests how low values may be used to improve the performance of DE. This new understanding of the operation of DE at high and low crossover rates is useful for analysing how adaptive parameters affect DE performance and leads to new suggestions for how adaptive DE techniques might be developed.
Finding good solutions on multi-modal optimization problems depends mainly on the efficacy of exploration. However, many search techniques applied to multi-modal problems were initially conceptualized with unimodal functions in mind, prioritizing exploitation over exploration. In this paper, we perform a study on the efficacy of exploration under random sampling, which leads to the identification of an important comparison bias that occurs when a solution which has benefited from local search is compared to the first (random) solution in a new search area. With the goal of eliminating this bias and improving the efficacy of exploration, we have developed a new search technique explicitly designed for multi-modal search spaces. “Leaders and Followers” aims to eliminate the negative effects of information accumulation and at the same time use the information from the best solutions in a way that they have controlled influence over the newly-sampled solutions. The proposed metaheuristic outperforms both Particle Swarm Optimization and Differential Evolution across a broad range of multi-modal optimization problems.
Locust swarms are a new multi-optima search technique explicitly designed for non-globally convex search spaces. They use ldquosmartrdquo start points to scout for promising new areas of the search space before using particle swarms and a greedy local search technique (e.g. gradient descent) to find a local optimum. These scouts start a minimum distance away from the previous optimum, and this gap is an important part of achieving a non-convergent search trajectory. Equally, the search for ldquosmartrdquo start points centers around the previous local optimum, and this provides the basis for also having a non-random search trajectory. Experiments on a 30-dimensional rotated Schwefel function demonstrate that the ability of locust swarms to successfully balance these two search characteristics is an important factor in its ability to effectively explore this non-globally convex search space.
Many heuristic search techniques have concurrent processes of exploration and exploitation. In particle swarm optimization, an improved pbest position can represent a new more promising region of the search space (exploration) or a better solution within the current region (exploitation). The latter can interfere with the former since the identification of a new more promising region depends on finding a (random) solution in that region which is better than the current pbest. Ideally, every sampled solution will have the same relative fitness with respect to its nearby local optimum - finding the best region to exploit then becomes the problem of finding the best random solution. However, a locally optimized solution from a poor region of the search space can be better than a random solution from a good region of the search space. Since exploitation can interfere with subsequent/concurrent exploration, it should be prevented during the early stages of the search process. In thresheld convergence, early exploitation is “held” back by a threshold function. Experiments show that the addition of thresheld convergence to particle swarm optimization can lead to large performance improvements in multi-modal search spaces.
One of the main disadvantages of population-based evolutionary algorithms (EAs) is their high computational cost due to the nature of evaluation, specially when the population size is large. The micro-algorithms employ a very small number of individuals, which can accelerate the convergence speed of algorithms dramatically, while it highly increases the stagnation risk. One approach to overcome the stagnation problem can be increasing the diversity of the population. To do so, a micro-differential evolution with vectorized random mutation factor (MDEVM) algorithm is proposed in this paper, which utilizes the small size population benefit while preventing stagnation through diversification of the population. The proposed algorithm is tested on the 28 benchmark functions provided at the IEEE congress on evolutionary computation 2013 (CEC-2013). Simulation results on the benchmark functions demonstrate that the proposed algorithm improves the convergence speed of its parent algorithm.