In the past few decades, unmanned aerial vehicles (UAVs) have become promising mobile platforms capable of navigating semiautonomously or autonomously in uncertain environments. The level of autonomy and the flexible technology of these flying robots have rapidly evolved, making it possible to coordinate teams of UAVs in a wide spectrum of tasks. These applications include search and rescue missions; disaster relief operations, such as forest fires [1]; and environmental monitoring and surveillance. In some of these tasks, UAVs work in coordination with other robots, as in robot-assisted inspection at sea [2]. Recently, radio-controlled UAVs carrying radiation sensors and video cameras were used to monitor, diagnose, and evaluate the situation at Japans Fukushima Daiichi nuclear plant facility [3].

In this paper, we address the problem of agile swing-free trajectory tracking of a quadrotor with a suspended load. This problem has great practical significance in many UAV applications. However, it has received little attention in the literature so far. Flying with a suspended load can be a very challenging and sometimes hazardous task as the suspended load significantly alters the flight characteristics of the quadrotor. In order to deal with this problem, we propose a technique based on dynamic programming which ensures swing-free trajectory tracking. We start by presenting the mathematical model of a quadrotor with suspended load dynamics and kinematics. A high-level planner is used to provide desired waypoints, and then a dynamic programming approach is used to generate the swing-free trajectory for the quadrotor carrying a suspended load. Effectiveness of this method is demonstrated by numerical simulations and experiments.

Attaining autonomous flight is an important task in aerial robotics. Often flight trajectories are not only subject to unknown system dynamics, but also to specific task constraints. This paper presents a motion planning method for generating trajectories with minimal residual oscillations (swing-free) for rotorcraft carrying a suspended loads. We rely on a finite-sampling, batch reinforcement learning algorithm to train the system for a particular load. We find criteria that allow the trained agent to be transferred to a variety of models, state and action spaces and produce a number of different trajectories. Through a combination of simulations and experiments, we demonstrate that the inferred policy is robust to noise and the unmodeled dynamics of the system. The contributions of this work are 1) applying reinforcement learning to solve the problem of finding swing-free trajectories for rotorcraft, 2) designing a problem-specific feature vector for value function approximation, 3) giving sufficient conditions for successful learning transfer to different models, state and action spaces, and 4) verification of the resulting trajectories in both simulation and autonomous control of quadrotors with suspended loads.

With the rapid technological advancements and the ever-evolving complex systems, the identification and integration of the components and resources for the functioning of multi-agent systems (MAS) are crucial tasks. However, difficulties arise due to the complexity of not having reference frameworks that normalize their implementation. Therefore, in this survey, we propose the FC-MAS (Framework-Components in Multi-Agent System) model as a conceptual framework designed to simplify comprehension and standardization in incorporating the required functions and components for the deployment and operation of MAS in engineering applications. This model comprises five abstract layers, each of which serves a specific purpose and encompasses the details and resources required to operate MAS. Furthermore, we propose a structured workflow for centralized and distributed MAS schemes with a set of related activities that integrate the fundamental steps and stages for the successful implementation of MAS. Finally, this work discusses potential directions for future research, including a deeper exploration of essential components, the establishment of terminology standards across various domains, and the refinement of the proposed model to enhance its applicability and relevance across a broader spectrum of contexts.