Power transmission networks are vulnerable to natural or man-made disasters, and it is of critical importance to efficiently restore damaged power supply in disaster-affected areas. A large-scale damaged transmission network can contain many faults that are initially uninspected/unlocated. Using unmanned aerial vehicles (UAVs) to inspect these faults can significantly improve the efficiency of subsequent restoration performed by human operators. Such a cooperative human-UAV scheduling problem is highly complex due to the correlation between UAV schedules and human-team schedules. We propose a cooperative evolutionary algorithm that simultaneously evolves two populations, one of UAV scheduling solutions (U-solutions) and the other of human-team scheduling solutions (H-solutions), which cooperate by determining a best matching U-solution for each H-solution and evaluating U-solutions based on a surrogate objective function that is iteratively improved by feedback from H-solutions. Our algorithm exhibits superior performance on various test instances and an application to transmission network restoration in the 2017 Jiuzhaigou earthquake.
Ensuring safety in autonomous driving is crucial for effective motion planning and navigation. However, most end-to-end planning methodologies lack sufficient safety measures. This study tackles this issue by formulating the control optimization problem in autonomous driving as Constrained Markov Decision Processes (CMDPs). We introduce an innovative, model-based approach for policy optimization, employing a conditional Value-at-Risk (VaR)-based soft actor-critic (SAC) to handle constraints in complex, high-dimensional state spaces. Our method features a worst-case actor to ensure strict compliance with safety requirements, even in unpredictable scenarios. The policy optimization leverages the augmented Lagrangian method and leverages latent diffusion models to forecast and simulate future trajectories. This dual strategy ensures safe navigation through environments and enhances policy performance by incorporating distribution modeling to address environmental uncertainties. Empirical evaluations conducted in both simulated and real environments demonstrate that our approach surpasses existing methods in terms of safety, efficiency, and decision-making capabilities.
In a large-scale epidemic, such as the novel coronavirus pneumonia (COVID-19), there is huge demand for a variety of medical supplies, such as medical masks, ventilators, and sickbeds. Resources from civilian medical services are often not sufficient for fully satisfying all of these demands. Resources from military medical services, which are normally reserved for military use, can be an effective supplement to these demands. In this paper, we formulate a problem of integrated civilian-military scheduling of medical supplies for epidemic prevention and control, the aim of which is to simultaneously maximize the overall satisfaction rate of the medical supplies and minimize the total scheduling cost, while keeping a minimum ratio of medical supplies reservation for military use. We propose a multi-objective water wave optimization (WWO) algorithm in order to efficiently solve this problem. Computational results on a set of problem instances constructed based on real COVID-19 data demonstrate the effectiveness of the proposed method.
Unmanned aerial vehicles (UAVs) have been widely used for target detection in modern battlefields. From the viewpoint of the opponents, false target jamming is an effective approach to decrease the UAV detection ability or probability, but currently there are few research efforts devoted to this adversarial problem. This paper formulates an optimization problem of false target jamming based on a counterpart problem of UAV detection, where each false target jamming solution is evaluated according to its adversarial effects on a set of possible UAV detection solutions. To efficiently solve the problem, we propose an evolutionary framework, which is implemented with four popular evolutionary algorithms by designing/adapting their evolutionary operators for false target jamming solutions. Experimental results on 12 test instances with different search regions and numbers of UAVs and false targets demonstrate that the proposed approach can significantly reduce the UAV detection probability, and the water wave optimization (WWO) metaheuristic exhibits the best overall performance among the four evolutionary algorithms. To our knowledge, this is the first study on the optimization of false target jamming against UAV detection, and the proposed framework can be extended to more countermeasures against UAV operations.
Wildfires often spread rapidly and cause significant casualties and economic losses. Firefighting drones carrying water capsules provide an efficient way for wildfire extinguishing, but their operational capabilities are limited by their payloads. This weakness can be compensated by using ground vehicles to provide mobile water supply. To this end, this paper presents an optimization problem of scheduling multiple drones and water supply trucks for wildfire fighting, which allocates burning subareas to drones, routes drones to perform fire-extinguishing operations in burning subareas and reload water between every two consecutive operations, and routes trucks to provide timely water supply for drones. To solve the problem within the limited emergency response time, we propose a deep reinforcement learning method, which consists of an encoder for embedding the input instance features and a decoder for generating a solution by iteratively predicting the subarea selection decision through attention. Computational results on test instances constructed upon real-world wilderness areas demonstrate the performance advantages of the proposed method over a collection of heuristic and metaheuristic optimization methods.