18 February 2022 in IEEE Access
War game simulations are decision-making tools that may provide quantitative data about the scenario analyzed by stakeholders. They are widely used to develop tactics and doctrines in the military context. Recently, unmanned air vehicles (UAVs) have become a relevant element in these simulations because of their prominent role in contemporary conflicts, surveillance missions, and search and rescue missions. For instance, it is possible to admit aircraft losses from a tactical formation in favor of the victory of a squadron in a given combat scenario. The optimization of the position of UAVs in beyond visual range (BVR) combat has attracted attention in the literature, considering that the distribution of UAVs can be a determining factor in this scenario. This work aims to optimize UAV tactical formations considering enemy uncertainties such as firing distance and position using six metaheuristics and a high-fidelity simulator. A tactical formation often employed by air forces called line abreast was chosen for the RED swarm for a case study. The objective of the optimization is to obtain a tactical formation of the BLUE swarm that wins the BVR combat against the RED swarm. A procedure to confirm the robustness of the optimization is employed, varying the position of each UAV of the RED swarm up to 8 km from its initial configuration and using the war game approach. A tactical analysis is performed to confirm whether the formations found in the optimization are applicable.
23 April 2025 in IEEE Access
Beyond Visual Range (BVR) air combat is an essential part of modern aerial warfare, relying on advanced radar, missile systems, and decision-support technologies. This survey provides a comprehensive overview of how simulation and Machine Learning (ML) tools have been used to analyze BVR combat, covering key methodologies, applications, and challenges. We examine how ML enables adaptive tactics to improve behavior recognition and threat assessment to enhance situational awareness. The paper also traces the historical evolution of BVR combat, outlining key engagement phases such as detection, missile launch, and post-engagement assessment. A key focus is on the role of simulation environments in modeling realistic combat scenarios, supporting pilot training, and validating AI-driven decision-making strategies. We analyze state-of-the-art simulation tools, comparing their capabilities and limitations for studying multi-agent coordination and real-time adaptability. This survey’s main contributions include descriptions of ML applications in BVR air combat, evaluations of simulation tools, identifications of research gaps, and insights into future research directions. This work provides an overview of how traditional simulation approaches merge with artificial intelligence to enable advanced, effective human and autonomous decision-making systems in dynamic and contested environments.
1 January 2021 in Journal of Aerospace Technology and Management
11 August 2025 in IEEE Access
This work explores Beyond Visual Range (BVR) air combat simulations, focusing on two-versus-two scenarios involving autonomous agents. The engagement phase in BVR combat presents complex and unpredictable situations, as it is difficult to anticipate the behavior of opposing aircraft and the outcomes of tactical decisions, especially in multi-agent settings. A promising approach is the use of Deep Reinforcement Learning (DRL), which enables agents to learn from dynamic environments. According to fighter pilots, collective situational awareness, defined as understanding the spatial distribution and orientation of allies and opponents, is essential for executing coordinated tactical maneuvers. The main contribution of this work is AsaGym, a library for developing and training DRL-based fighter agents in BVR scenarios. A case study demonstrates its use, applying a reward function that promotes coordination based on collective situational awareness, and compares different DRL algorithms to assess their ability to foster cooperative behavior. The results highlight DRL’s potential to address the complexities of modern air combat and support the development of more adaptive and effective tactics in multi-agent BVR scenarios.
1 January 2024 in Journal of Aerospace Technology and Management
Computer simulations have been applied in several areas. Non-player characters in computer simulations are autonomous agents. An autonomous agent receives information from the simulated environment, processes this information, and estimates a situation awareness (state), makes a decision based on the estimated state, and performs an action related to the decision. The decision-making process of an autonomous agent can be efficiently modeled through behavior trees. However, teaching the construction of behavior trees for autonomous agents can be a very complex task, especially if students have little knowledge of computer programming. The objective of this work is to simplify this task. Therefore, I proposed the pyAutonomousAgent, an academic tool for modeling autonomous agent behaviors through behavior trees. The tool is an open-source set of computer routines, developed with the aim of being easy to use and learn. As a case study, the tool provides a simulation scenario with a swarm of drones. Results of the drone behavior modeling process are presented.