Hyperparameter optimization is a fundamental part of Auto Machine Learning (AutoML) and it has been widely researched in recent years; however, it still remains as one of the main challenges in this area. Motivated by the need of faster and more accurate hyperparameter optimization algorithms we developed HyperBRKGA, a new population-based approach for hyperparameter optimization. HyperBRKGA combines the Biased Random Key Genetic Algorithm with an Exploitation Method in order to search the hyperparameter space more efficiently than other commonly used hyperparameter optimization algorithms, such as Grid Search, Random Search, CMA-ES or Bayesian Optimization. We develop and test two different alternatives for this Exploitation Method: Random Walk and Bayesian Walk. We also discuss and implement other schemes, such as a Training Data Reduction Strategy and a Diversity Control strategy, in order to further improve the efficacy of our method. We performed several computational experiments on 8 different datasets to assess the effectiveness of the proposed approach. Results showed that HyperBRKGA could find hyperparameter configurations that outperformed in terms of predictive quality the baseline methods in 6 out of 8 datasets while showing a reasonable execution time. Lastly, we conducted an ablation study and showed that the addition of every component was relevant to achieving high quality results.
1 June 2016 in Electronic Notes in Discrete Mathematics
Most developing countries need to constantly work on the expansion of their electric transmission networks. This task needs to be carefully planned. Unlike several Network Design Problem, a transmission network may become more efficient after cutting-off some of its transmission lines. The version of the problem where the redesign is allowed when expanding is known in the literature as Transmission Expansion Planning Problem with Re-design, TEPr, and will be the focus of this paper. To solve TEPr, we propose a hybridization of Biased Random-Key Genetic Algorithm with Local Branching. Computational experiments showed the impact of the developed method in comparison to the straight forward application of the mathematical formulation.