It is an effective way to execute a complicated mission by cooperating unmanned vehicles. This paper focuses on a search- and-track (SAT) mission for an underwater target, and the mission is implemented by combining an unmanned aerial vehicle (UAV), an unmanned surface vehicle (USV) and an autonomous underwater vehicle (AUV). In the cooperative path planning model, the mission is divided into the search phase and the track phase, and the goals of the two phases are to maximize the search space and minimize the terminal error respectively. The constraints contain the maneuverability of vehicles and communication ranges between vehicles. Strategies based on random simulation experiments and asynchronous planning are developed to design the cooperative path planning algorithm in the two phases, and the paths are generated by an improved particle swarm optimization (IPSO) algorithm in a centralized or a distributed mode. Simulation results demonstrate that the proposed method can deal with different situations. The UAV&USV&AUV system is superior to the USV&AUV system in the SAT mission.

Increasing use of Unmanned Aerial Vehicle (UAV) in urban environments poses to an increased risk of fallen UAVs impacting people and vehicles on the ground, as well as colliding with manned aircraft in the vicinity of airports. Risk management of UAV flights for safe operations is essential. We proposed a comprehensive risk assessment model for UAV operation in urban environments. Three risk categories (people, vehicles, and manned aircraft) were considered and each risk cost was quantified using collision probability. We adjusted the risk costs in various magnitudes to a same scale and conducted a sensitivity analysis to determine the optimal coefficients of the three risk cost models. We then computed the total risk and generated a risk cost map for path planning. Modified path planning algorithms were used to produce a cost-effective path, and we compared their performances in terms of total risk cost and computational time. Lastly, we performed simulations to validate the feasibility and effectiveness of our proposed risk assessment model. The results show that the risk-cost-based path planning method can generate safer path for UAV operations than the traditional shortest-distance-based method. Our proposed model can be extended to complex urban environments by including more relevant parameters and data.

Drones have a wide range of applications in urban environments as they can both enhance people's daily activities and commercial activities through various operations and deployments. With the increasing number of drones, flight safety and efficiency become the main concern, and effective drone operations can make a difference. Accordingly, 4D path planning for drone operations is the focus of this paper, and the swarm-based method is proposed to solve this complicated optimization problem. Under the framework of `AirMatrix', the problem is solved in two levels, i.e., 3D path planning for a single drone and conflict resolution among drones. In the multi-path planning level, multiple alternative flight paths for each drone are generated to increase the acceptance rate of a flight request. The constraints on a single flight path and two different flight paths are considered. The goal is to obtain several different short flight paths as alternatives. A clustering improved ant colony optimization CIACO) algorithm is employed to solve the multi-path planning problem. The crowding mechanism is used in clustering, and some improvements are made to strengthen the global and local search ability in the early and later phases of iterations. In the task scheduling level, the conflicts between two drones are defined in two circumstances. One is for the time interval of passing the same path point, another one is for the right-angle collision between two drones. A three-layer fitness function is proposed to maximize the number of permitted flights according to the safety requirement, in which the airspace utilization and the operators' requests are both considered. A `cross-off' strategy is developed to calculate the fitness value, and a `distributed-centralized' strategy is applied considering the task priorities of drones. A genetic algorithm GA)-based task scheduling algorithm is also developed according to the characteristic of the established model. Simulation results demonstrate that 4D flight path of each drone can be generated by the proposed swarmed-based algorithms, and safe and efficient drone operations in a specific airspace can be ensured.

Multiple unmanned aerial vehicles (UAVs) are able to efficiently accomplish a variety of tasks in complex scenarios. However, developing a collision-avoiding flocking policy for multiple fixed-wing UAVs is still challenging, especially in obstacle-cluttered environments. In this article, we propose a novel curriculum-based multiagent deep reinforcement learning (MADRL) approach called task-specific curriculum-based MADRL (TSCAL) to learn the decentralized flocking with obstacle avoidance policy for multiple fixed-wing UAVs. The core idea is to decompose the collision-avoiding flocking task into multiple subtasks and progressively increase the number of subtasks to be solved in a staged manner. Meanwhile, TSCAL iteratively alternates between the procedures of online learning and offline transfer. For online learning, we propose a hierarchical recurrent attention multiagent actor–critic (HRAMA) algorithm to learn the policies for the corresponding subtask(s) in each learning stage. For offline transfer, we develop two transfer mechanisms, i.e., model reload and buffer reuse, to transfer knowledge between two neighboring stages. A series of numerical simulations demonstrate the significant advantages of TSCAL in terms of policy optimality, sample efficiency, and learning stability. Finally, the high-fidelity hardware-in-the-loop (HITL) simulation is conducted to verify the adaptability of TSCAL. A video about the numerical and HITL simulations is available at https://youtu.be/R9yLJNYRIqY.