Melvin Laux

Mr. Melvin Laux


Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 May 2025 in Engineering Proceedings
Verified
Conference Paper
Open access
PDF file
ASAmrita Suresh
Amrita Suresh
MLMelvin Laux
Melvin Laux
WBWiebke Brinkmann
Wiebke Brinkmann
LDLeon C. Danter
Leon C. Danter
FKFrank Kirchner
Frank Kirchner
Future space missions will include multi-robot systems, with greater autonomy and a large degree of heterogeneity for a wider range of task capabilities and redundancy. It is imperative that both software (learning models, parallelizing capabilities, resource distribution, etc.) and hardware factors must be considered during decentralized task negotiation to lead to better performance of the team. By utilizing the formalism of contextual Markov decision processes, team composition can be incorporated into the learning process and used for more meaningful and reliable evaluation using measures such as total time, overall consumed energy, performance feedback from tasks, or damage incurred. Improved team performance will in turn enhance the overall results of the mission. Planetary exploration tasks often involve time, communication and energy constraints. Such missions are also prone to noisy sensor data (e.g., camera images distorted by dust), as well as wear and tear on hardware (e.g., wheels, manipulators). To ensure that such factors do not jeopardize the mission, they must be taken into account. Therefore, this paper describes a software framework for the reliable execution of tasks in constrained and dynamic environments. Our work leverages the advantages of heterogeneity for more resilient planetary missions by addressing two aspects—first, the integration of hardware parameters into the negotiation process, and second the analysis of how the integration of team performance metrics, particularly adaptability and mutual support, in task negotiation plays a role in the overall mission success.

24 October 2020
Verified
Conference Paper
Open access
MLMelvin Laux
Melvin Laux
OAOleg Arenz
Oleg Arenz
Jan PetersJan Peters
Jan Peters
JPJoni Pajarinen
Joni Pajarinen
Deep learning in combination with improved training techniques and high computational power has led to recent advances in the field of reinforcement learning (RL) and to successful robotic RL applications such as in-hand manipulation. However, most robotic RL relies on a well known initial state distribution. In real-world tasks, this information is however often not available. For example, when disentangling waste objects the actual position of the robot w.r.t. the objects may not match the positions the RL policy was trained for. To solve this problem, we present a novel adversarial reinforcement learning (ARL) framework. The ARL framework utilizes an adversary, which is trained to steer the original agent, the protagonist, to challenging states. We train the protagonist and the adversary jointly to allow them to adapt to the changing policy of their opponent. We show that our method can generalize from training to test scenarios by training an end-to-end system for robot control to solve a challenging object disentangling task. Experiments with a KUKA LBR+ 7-DOF robot arm show that our approach outperforms the baseline method in disentangling when starting from different initial states than provided during training.

15 May 2026 in Engineering Proceedings
Verified
Conference Paper
Open access
PDF file
SPSteffen Planthaber
Steffen Planthaber
Udo FreseUdo Frese
Udo Frese
WBWiebke Brinkmann
Wiebke Brinkmann
RDRaúl Domínguez
Raúl Domínguez
MLMelvin Laux
Melvin Laux
FKFrank Kirchner
Frank Kirchner
Celestial bodies in the solar system have long been of particular interest in space science. Some questions, e.g., those concerning the origin of life, require on-site landing and exploration. Due to signal delay, some degree of autonomy provided by artificial intelligence (AI) is needed. Motivated by planetary exploration missions, the German Research Center for Artificial Intelligence (DFKI) has developed methods for (semi-)autonomous control of vehicles and robots on extraterrestrial bodies. To validate the software, we conduct extensive field tests in terrestrial analog environments. Field tests can be seen as an intermediate step between development and laboratory testing and real-world deployment in an extraterrestrial environment. This paper describes the challenges of testing AI and robotic systems in analog environments, with a focus on the additional dependencies that arise during the preparation and execution of such field tests. The robots and software tested in these field tests are based on more than a decade of development across various projects, covering a wide range of AI systems and applications, including geometric planning, probabilistic perception, deep learning, and robot construction for open challenges in planetary exploration.

21 August 2026
Verified
Book Chapter
Closed access
PDF file
MAMariela De Lucas Alvarez
Mariela De Lucas Alvarez
MLMelvin Laux
Melvin Laux
APArthur de Freitas Precht
Arthur de Freitas Precht
MMMaurice Martin
Maurice Martin
ECEdoardo Caroselli
Edoardo Caroselli
AFAlexander Fabisch
Alexander Fabisch