We propose an online framework to detect cyber attacks on Automatic Generation Control (AGC). A cyber attack detection algorithm is designed based on the approach of Dynamic Watermarking. The detection algorithm provides a theoretical guarantee of detection of cyber attacks launched by sophisticated attackers possessing extensive knowledge of the physical and statistical models of targeted power systems. The proposed framework is practically implementable, as it needs no hardware update on generation units. The efficacy of the proposed framework is validated in both four-area system and 140-bus system.
Lesions in the maxillary sinus area are usually treated with endoscopic interventional surgery. However, target lesions are often hardly accessible with conventional surgical tools. A new continuum module is proposed with a bending manipulator to perform maxillary sinus surgery. The developed manipulator has a NiTiNol tube embedded in its continuum module. It has a diameter of 4 mm and can be bent up to 270 degrees to reach the target position flexibly. In this paper, a kinematic model of the continuum module is presented. An external loading analysis of the robot was formulated to analyze payload capacity and tensions, taking into account friction, actuation, elastic effects and external loadings. Some experiments were carried out to validate the kinematics and to test the robot capabilities of scissoring, payload and manipulation.
Given the availability of more comprehensive measurement data in modern power systems, reinforcement learning (RL) has gained significant interest in operation and control. Conventional RL relies on trial-and-error interactions with the environment and reward feedback, which often leads to exploring unsafe operating regions and executing unsafe actions, especially when deployed in real-world power systems. To address these challenges, safe RL has been proposed to optimize operational objectives while ensuring safety constraints are met, keeping actions and states within safe regions throughout both training and deployment. Rather than relying solely on manually designed penalty terms for unsafe actions, as is common in conventional RL, safe RL methods reviewed here primarily leverage advanced and proactive mechanisms. These include techniques such as Lagrangian relaxation, safety layers, and theoretical guarantees like Lyapunov functions to rigorously enforce safety boundaries. This article provides a comprehensive review of safe RL methods and their applications across various power system operations and control domains, including security control, real-time operation, operational planning, and emerging areas. It summarizes existing safe RL techniques, evaluates their performance, analyzes suitable deployment scenarios, and examines algorithm benchmarks and application environments. This article also highlights real-world implementation cases and identifies critical challenges such as scalability in large-scale systems and robustness under uncertainty, providing potential solutions and outlining future directions to advance the reliable integration and deployment of safe RL in modern power systems.
29 November 2017 in IEEE Transactions on Smart Grid
This paper introduces a new computational framework to account for uncertainties in day-ahead electricity market clearing process in the presence of demand response providers. A central challenge when dealing with many demand response providers is the uncertainty of its realization. In this paper, a new economic dispatch framework that is based on the recent theoretical development of the scenario approach is introduced. By removing samples from a finite uncertainty set, this approach improves dispatch performance while guaranteeing a quantifiable risk level with respect to the probability of violating the constraints. The theoretical bound on the level of risk is shown to be a function of the number of scenarios removed. This is appealing to the system operator for the following reasons: (1) the improvement of performance comes at the cost of a quantifiable level of violation probability in the constraints; (2) the violation upper bound does not depend on the probability distribution assumption of the uncertainty in demand response. Numerical simulations on (1) 3-bus and (2) IEEE 14-bus system (3) IEEE 118-bus system suggest that this approach could be a promising alternative in future electricity markets with multiple demand response providers.