Swarm robotics is a promising approach for the coordination of large numbers of robots. While previous studies have shown that evolutionary robotics techniques can be applied to obtain robust and efficient self-organized behaviors for robot swarms, most studies have been conducted in simulation, and the few that have been conducted on real robots have been confined to laboratory environments. In this paper, we demonstrate for the first time a swarm robotics system with evolved control successfully operating in a real and uncontrolled environment. We evolve neural network-based controllers in simulation for canonical swarm robotics tasks, namely homing, dispersion, clustering, and monitoring. We then assess the performance of the controllers on a real swarm of up to ten aquatic surface robots. Our results show that the evolved controllers transfer successfully to real robots and achieve a performance similar to the performance obtained in simulation. We validate that the evolved controllers display key properties of swarm intelligence-based control, namely scalability, flexibility, and robustness on the real swarm. We conclude with a proof-of-concept experiment in which the swarm performs a complete environmental monitoring task by combining multiple evolved controllers.

The evolution of task-oriented control for robots with complex locomotor systems is currently out of reach for traditional evolutionary computation techniques, as the coordination of a high number of locomotion parameters in response to the robot's sensory inputs is extremely challenging. Evolutionary techniques have therefore mainly been applied to the optimization of specific locomotion patterns, such as forward motion. In this paper, we explore the evolutionary repertoire-based control (EvoRBC) approach, which divides the synthesis of control into two steps: 1) the evolution of a repertoire of locomotion primitives using a quality diversity algorithm and 2) the evolution of a high-level arbitrator that leverages the locomotion primitives in the repertoire to solve a given task. We comprehensively study the main components of the EvoRBC approach using a four-wheel steering robot. We then conduct a set of experiments in simulation using a hexapod robot. Our results show that EvoRBC is robust to parameter variations, and for all the robots tested, it is able to evolve controllers for a maze navigation task and significantly outperforms the traditional evolutionary robotics approach.

Novelty search is a state-of-the-art evolutionary approach that promotes behavioural novelty instead of pursuing a static objective. Along with a large number of successful applications, many different variants of novelty search have been proposed. It is still unclear, however, how some key parameters and algorithmic components influence the evolutionary dynamics and performance of novelty search. In this paper, we conduct a comprehensive empirical study focused on novelty search's algorithmic components. We study the "k" parameter -- the number of nearest neighbours used in the computation of novelty scores; the use and function of an archive; how to combine novelty search with fitness-based evolution; and how to configure the mutation rate of the underlying evolutionary algorithm. Our study is conducted in a simulated maze navigation task. Our results show that the configuration of novelty search can have a significant impact on performance and behaviour space exploration. We conclude with a number of guidelines for the implementation and configuration of novelty search, which should help future practitioners to apply novelty search more effectively.

Automated environmental monitoring in marine environments is currently carried out either by small-scale robotic systems, composed of one or few robots, or static sensor networks. In this paper, we propose the use of swarm robotics systems to carry out marine environmental monitoring missions. In swarm robotics systems, each individual unit is relatively simple and inexpensive. The robots rely on decentralized control and local communication, allowing the swarm to scale to hundreds of units and to cover large areas. We study the application of a swarm of aquatic robots to environmental monitoring tasks. In the first part of the study, we synthesize swarm control for a temperature monitoring mission and validate our results with a real swarm robotics system. Then, we conduct a simulation-based evaluation of the robots' performance over large areas and with large swarm sizes, and demonstrate the swarm's robustness to faults. Our results show that swarm robotics systems are suited for environmental monitoring tasks by efficiently covering a target area, allowing for redundancy in the data collection process, and tolerating individual robot faults.

Novelty search has shown to be a promising approach for the evolution of controllers for swarm robotics. In existing studies, however, the experimenter had to craft a domain dependent behaviour similarity measure to use novelty search in swarm robotics applications. The reliance on hand-crafted similarity measures places an additional burden to the experimenter and introduces a bias in the evolutionary process. In this paper, we propose and compare two task-independent, generic behaviour similarity measures: combined state count and sampled average state. The proposed measures use the values of sensors and effectors recorded for each individual robot of the swarm. The characterisation of the group-level behaviour is then obtained by combining the sensor-effector values from all the robots. We evaluate the proposed measures in an aggregation task and in a resource sharing task. We show that the generic measures match the performance of domain dependent measures in terms of solution quality. Our results indicate that the proposed generic measures operate as effective behaviour similarity measures, and that it is possible to leverage the benefits of novelty search without having to craft domain specific similarity measures.Comment: Initial submission. Final version to appear in GECCO 2013 and dl.acm.or