The automatic control of vehicle traffic in large urban networks constitutes one of the most serious challenges to modern societies, with an impact on improving the quality of human life and saving energy and time. Intersections are a special traffic structure of pivotal importance as they accumulate a large number of vehicles that should be served in an optimal manner. Constructing intelligent models that manage to automatically coordinate and steer vehicles through intersections is a key point in the fragmentation of traffic control, offering active solutions through the flexibility of automatically adapting to a variety of traffic conditions. Responding to this call, this work aims to propose an integrated active solution of automatic traffic management. We introduce a multi-agent reinforcement learning framework that effectively models traffic flow at individual unsignalized intersections. It relies on a compact agent definition, a rich information state space, and a learning process characterized not only by depth and quality, but also by substantial degrees of freedom and variability. The resulting driving profiles are further transferred to larger road networks to integrate their individual elements and compose an effective automatic traffic control platform. Experiments are conducted on simulated road networks of variable complexity, demonstrating the potential of the proposed method.
Complex microscopic simulation models of strategic Air Traffic Management (ATM) performance assessment and decision-making are hindered by several factors. One of the most important is the existence of hidden parameters—such as aircraft take-off weight (TOW) and the selected cost index (CI)—which, if known, would allow for more effective performance modeling methodologies for assessing Key Performance Indicators (KPIs) at various levels of abstraction/detail, e.g., system-wide, or at the level of individual flights. This research proposes a data-driven methodology for the estimation of flights’ hidden parameters combining mechanistic and advanced Artificial Intelligence/Machine Learning (AI/ML) models. Aiming at microsimulation models, our goal is to study the effect of these estimations on the prediction of flights’ KPIs. In so doing, we propose a novel methodology according to which data-driven methods are trained given optimal trajectories (produced by mechanistic models) corresponding to known hidden parameter values, with the aim of predicting hidden parameters’ values of unseen trajectories. The results show that estimations of hidden parameters support the accurate prediction of KPIs regarding the efficiency of flights: fuel consumption, gate-to-gate time and distance flown.