This work explores Beyond Visual Range (BVR) air combat simulations, focusing on two-versus-two scenarios involving autonomous agents. The engagement phase in BVR combat presents complex and unpredictable situations, as it is difficult to anticipate the behavior of opposing aircraft and the outcomes of tactical decisions, especially in multi-agent settings. A promising approach is the use of Deep Reinforcement Learning (DRL), which enables agents to learn from dynamic environments. According to fighter pilots, collective situational awareness, defined as understanding the spatial distribution and orientation of allies and opponents, is essential for executing coordinated tactical maneuvers. The main contribution of this work is AsaGym, a library for developing and training DRL-based fighter agents in BVR scenarios. A case study demonstrates its use, applying a reward function that promotes coordination based on collective situational awareness, and compares different DRL algorithms to assess their ability to foster cooperative behavior. The results highlight DRL’s potential to address the complexities of modern air combat and support the development of more adaptive and effective tactics in multi-agent BVR scenarios.
This work presents AsaFG, a human-in-the-loop integration module that connects the Aerospace Simulation Environment (ASA), a constructive simulation environment for military scenarios, with the FlightGear flight simulator. The module enables real-time interaction between human pilots and simulated entities in air combat scenarios, allowing pilots to assume roles within simulated missions and interact with autonomous agents. This integration enables direct interaction between constructive and virtual components, contributing to more realistic and immersive air combat simulations. The work also discusses key challenges during the integration process, including data exchange, control interfaces, and missile modeling differences between the platforms. A specific contribution involves adjusting the missile model in FlightGear to closely match ASA’s implementation, enabling consistent simulation behavior across systems. Validation includes performance metrics and experiments with Brazilian Air Force pilots across three operational scenarios. The results demonstrate the module’s applicability for training, operational analysis, and studies on human-autonomy teaming in simulated air combat scenarios.