In this paper, platoons of autonomous vehicles operating in urban road networks are considered. From a methodological point of view, the problem of interest consists of formally characterizing vehicle state trajectory tubes by means of routing decisions complying with traffic congestion criteria. To this end, a novel distributed control architecture is conceived by taking advantage of two methodologies: deep reinforcement learning and model predictive control. On one hand, the routing decisions are obtained by using a distributed reinforcement learning algorithm that exploits available traffic data at each road junction. On the other hand, a bank of model predictive controllers is in charge of computing the more adequate control action for each involved vehicle. Such tasks are here combined into a single framework: the deep reinforcement learning output (action) is translated into a set-point to be tracked by the model predictive controller; conversely, the current vehicle position, resulting from the application of the control move, is exploited by the deep reinforcement learning unit for improving its reliability. The main novelty of the proposed solution lies in its hybrid nature: on one hand it fully exploits deep reinforcement learning capabilities for decision-making purposes; on the other hand, time-varying hard constraints are always satisfied during the dynamical platoon evolution imposed by the computed routing decisions. To efficiently evaluate the performance of the proposed control architecture, a co-design procedure, involving the SUMO and MATLAB platforms, is implemented so that complex operating environments can be used, and the information coming from road maps (links, junctions, obstacles, semaphores, etc.) and vehicle state trajectories can be shared and exchanged. Finally by considering as operating scenario a real entire city block and a platoon of eleven vehicles described by double-integrator models, several simulations have been performed with the aim to put in light the main features of the proposed approach. Moreover, it is important to underline that in different operating scenarios the proposed reinforcement learning scheme is capable of significantly reducing traffic congestion phenomena when compared with well-reputed competitors.
Education is experiencing a paradigm shift, evolving from traditional learning methods to computer-tool-based education, and now toward the integration of Generative Artificial Intelligence. While classical methods offer structured and standardized learning, they often do not fully address individual learner needs and accessibility. The rise of digital technologies introduced adaptive learning platforms, online classrooms, and interactive educational tools, expanding the reach and flexibility of educational systems. Today, Generative Artificial Intelligence tools are redefining the education landscape by personalized learning experiences, automating content generation, and providing real-time feedback. Intelligent tutoring systems and personalized assessments empower students with customized learning pathways that enhance engagement and academic performance. This paper presents a meta-survey that systematically examines the role of Generative Artificial Intelligence in education, following PRISMA guidelines to analyze trends, frameworks, and research outcomes across a curated body of academic literature. Special attention is given to the emergence of commercial Generative Artificial Intelligence tools, which are increasingly embedded in learning environments. A structured comparison framework and research questions guide the review, offering insights into how Generative Artificial Intelligence technologies are shaping pedagogical practices, influencing assessment, and raising new ethical and technical challenges. The paper also explores future directions, highlighting how Generative Artificial Intelligence is driving the emergence of new learning models.
23 August 2023 in IEEE Transactions on Intelligent Transportation Systems
In this paper, a sustainable routing algorithm for vehicle platoons operating in smart urban networks is presented. The proposed approach makes use of deep reinforcement learning (DRL) and set-theoretic model predictive control (MPC). In particular, the learning process aims at reducing traffic congestion and $CO_2$ emissions, whereas the MPC unit allows to adequately track the assigned path by using real-time traffic data. To adequately analyze the performance of the resulting control architecture, the SUMO and MATLAB environments are used to implement complex operating scenarios where road maps data and vehicle state trajectories can be shared and exchanged. Finally, numerical studies are provided by resorting to the SUMO environment and considering a platoon of five vehicles. The resulting simulation campaign puts in light the capability of the training process to significantly mitigate the $CO_2$ emissions of the whole platoon: from a minimum of $3.7 \%$ to a maximum of $13\%$ with respect to the use of the well-known Dijkstra algorithm.
In this paper, autonomous vehicles are considered for addressing logistic operations in manufacturing systems. The starting idea consists in organizing a given group of autonomous robots/vehicles in a finite set of platoons in charge to accomplish prescribed job(s) within the manufacturing system. Three aspects are then needed to be formally outlined: task scheduling, routing decisions and command inputs computations. Here, a new distributed multi-layer architecture has been conceived by using three methodologies: timed colored Petri nets, deep reinforcement learning and model predictive control. Roughly speaking, timed colored Petri nets are exploited to formally model the manufacturing system so that an optimal scheduling task complying with the required jobs and the available vehicles is derived; then, run-time routing decisions are obtained by using a distributed reinforcement learning algorithm which exploits the available information provided by the vehicle sensor module; finally, the distributed model predictive control algorithm is built by resorting to a set-theoretic approach where most of the computations are off-line performed. A flexible manufacturing system consisting of four machines and a Load/Unload station is used for simulation purposes. Specifically, five jobs are hypothesized and some scenarios with an increasing number of available vehicles are simulated. In order to evaluate the benefits of the proposed approach, a time criterion based on the completion of all the jobs is considered with the aim to put in light that increasing the number of vehicles improves the control performance until congestion phenomena become unavoidable. Note to Practitioners —This paper proposes an innovative methodology for addressing the logistic operations within flexible manufacturing systems (FMSs) by using a team of autonomous ground vehicles. Unlike existing approaches, the core of this framework consists in combining along a hierarchical structure the capabilities of timed colored Petri nets and the deep reinforcement learning techniques to determine a near-optimal scheduling and run-time routing decisions that are provided to the distributed model predictive units in charge to accomplish the prescribed task. This multi-layer architecture has two main merits: a single platoon, completely disconnected from the others, is devoted to perform its own job; computational burdens are affordable during the on-line operations because most of the computations are moved in the off-line phase.