A multi-unmanned surface vessel (USV) formation control system is established on a novel platform composed of three 1.2-m-long hydraulic jet propulsion surface vessels, a differential GPS reference station, and inter-vessel Zigbee communication modules. The system is also equipped with an upper level collective multi-USV protocol and a lower level vessel dynamics controller. The system is capable of chasing and surrounding a target vessel. The results are supported by rigorous theoretical analysis in terms of asymptotical surrounding behavior and trajectory regulation. Extensive experiments are conducted to demonstrate the effectiveness and efficiency of the proposed hardware and software architectures.
5 May 2021 in IEEE Transactions on Industrial Electronics
This article proposes a distributed bearing-only controller for multiple unmanned surface vessels (USVs) to encircle and rotate evenly around a motional target with inter-USV topologies. The distributed control law consists of three terms, i.e., a bearing-only estimation term to approximate the target state, an upper-level surrounding term to fulfill the target-surrounding mission, and a single-vessel regulation term to track the upper-level signal. Significantly, technical conditions are derived to guarantee the asymptotical stability of the closed-loop system. Finally, experimental results on a real platform composed of three HUSTER-0.3 USVs and a target vessel are conducted to substantiate the effectiveness of the proposed controller.
16 June 2022 in IEEE Transactions on Industrial Informatics
Residential energy consumption continues to climb steadily, requiring intelligent energy management strategies to reduce power system pressures and residential electricity bills. However, it is challenging to design such strategies due to the random nature of electricity pricing, appliance demand and user behavior. This paper presents a novel reward shaping (RS)-based actor-critic deep reinforcement learning (ACDRL) algorithm to manage the residential energy consumption profile with limited information about the uncertain factors. Specifically, the interaction between the energy management center and various residential loads is modeled as a Markov decision process that provides a fundamental mathematical framework to represent the decision making in situations where outcomes are partially random and partially influenced by the decision maker control signals, in which the key elements containing the agent, environment, state, action, and reward are carefully designed, and the electricity price is considered as a stochastic variable. An RS-ACDRL algorithm is then developed, incorporating both the actor and critic network and an RS mechanism, to learn the optimal energy consumption schedules. Several case studies involving real-world data are conducted to evaluate the performance of the proposed algorithm. Numerical results demonstrate that the proposed algorithm outperforms state-of-the-art RL methods in terms of learning speed, solution optimality and cost reduction.
5 March 2021 in IEEE Transactions on Control Systems Technology
In this brief, a distributed surrounding control problem is investigated for multiple unmanned surface vessels (USVs) with varying interconnection topologies. A distributed estimation-and-control hierarchical framework is developed, where an individual estimator is designed for a USV to predict the state of the target in an interconnection network with jointly dwellingly connected topologies. Thereby, the vessels could be governed to encircle the target in a convex hull, which evenly rotate around the target at the center. Moreover, asymptotical stability conditions are derived to guarantee the feasibility of the proposed surrounding controller. Finally, experiments are conducted for a real multi-USV system consisting of three 1.6 meters-long vessels and a differential GPS station, to verify the effectiveness of the proposed controller.
For scenarios to pass through narrow and irregular channels, we develop a pragmatic distributed flexible formation protocol for multiple unmanned surface vessel systems (Multi-USVs). Therein, for path tracking with two leaders USVs, we propose a model predictive trajectory tracking scheme. Specifically, we design a scanning-formation controller with a trajectory state estimator for the followers to follow the leaders in order to efficiently fulfill the passing-through mission. Asymptotic stability conditions are derived to guarantee the feasibility of the developed multi-USV controller. Finally, both numerical simulations and experiments are conducted to show the effectiveness of the proposed multi-USV control strategies.
2 September 2019 in IEEE Transactions on Smart Grid
This paper studies the problem of locating harmonic sources and estimating the distribution of harmonic voltages in unbalanced three-phase power distribution systems. We develop an approach for harmonic state estimation utilizing two types of measurements from smart meters and distribution-level phasor measurement units (DPMUs). It involves regression analysis for power flow calculation, prediction of demands using recurrent neural networks, and sparse Bayesian learning for state estimation. The proposed approach requires fewer DPMUs than nodes, making it more applicable to existing distribution grids. We show the effectiveness of the proposed estimator through extensive numerical simulations on an IEEE test feeder. We also investigate how the increased penetration of distributed energy resources could affect the performance of our state estimator.