Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Grid emergency control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Multi-Agent Graph-Attention Deep Reinforcement Learning for Post-Contingency Grid Emergency Voltage Control

Grid emergency voltage control (GEVC) is paramount in electric power systems to improve voltage stability and prevent cascading outages and blackouts in case of contingencies. While most deep reinforcement learning (DRL)-based paradigms perform single agents in a static environment, real-world agents for GEVC are expected to cooperate in a dynamically shifting grid. Moreover, due to high uncertainties from combinatory natures of various contingencies and load consumption, along with the complexity of dynamic grid operation, the data efficiency and control performance of the existing DRL-based methods are challenged. To address these limitations, we propose a multi-agent graph-attention (GATT)-based DRL algorithm for GEVC in multi-area power systems. Here, we develop graph convolutional network (GCN)-based agents for feature representation of the graph-structured voltages to improve the decision accuracy in a data-efficient manner. Furthermore, a cutting-edge attention mechanism concentrates on effective information sharing among multiple agents, synergizing different-sized subnetworks in the grid for cooperative learning. We address several key challenges in the existing DRL-based GEVC approaches, including low scalability and poor stability against high uncertainties. Test results in the IEEE benchmark system verify the advantages of the proposed method over several recent multi-agent DRL-based algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Off-policy deep reinforcement learning with automatic entropy adjustment for adaptive online grid emergency control

Electric overloading conditions and contingencies put modern power systems at risk of voltage collapse and blackouts. Load shedding is crucial to maintain voltage stability for grid emergency control. However, the rule- or model-based schemes rely on accurate dynamic system models and face considerable challenges in adapting to various operating conditions and uncertain event occurrences. Here, to address these issues, this paper proposes a novel deep reinforcement learning (DRL)-based voltage stability control algorithm with automatic entropy adjustment (AEA) for grid emergency control. Various dynamic network components for complex system operations are modeled to construct the DRL environment. An off-policy soft actor-critic architecture is developed to maximize the expected reward and policy entropy simultaneously. The AEA mechanism is proposed to facilitate the policy maximum entropy procedure, and the proposed method can automatically provide effective discrete and continuous actions against various fault scenarios. Our approach accomplishes high sampling efficiency, scalability, and auto-adaptivity of the control policies under high uncertainties. Comparative studies with the existing DRL-based control methods in IEEE benchmarks indicate salient performance improvement of the proposed method for dynamic system emergency control.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency control to maintain system reliability and security. Towards this end, great progress has been made in developing deep reinforcement learning (DRL) based grid control solutions in recent years. However, existing DRL-based solutions have two main limitations: 1) they cannot handle well with a wide range of grid operation conditions, system parameters, and contingencies; 2) they generally lack the ability to fast adapt to new grid operation conditions, system parameters, and contingencies, limiting their applicability for real-world applications. Here, in this paper, we mitigate these limitations by developing a novel deep meta-reinforcement learning (DMRL) algorithm. The DMRL combines the meta strategy optimization together with DRL, and trains policies modulated by a latent space that can quickly adapt to new scenarios. We test the developed DMRL algorithm on the IEEE 300-bus system. We demonstrate fast adaptation of the meta-trained DRL polices with latent variables to new operating conditions and scenarios using the proposed method, which achieves superior performance compared to the state-of-the-art DRL and model predictive control (MPC) methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Adaptive Load Shedding for Grid Emergency Control via Deep Reinforcement Learning

Emergency control, typically such as under-voltage load shedding (UVLS), is broadly used to grapple with low voltage and voltage instability issues in real-world power systems under contingencies. However, existing emergency control schemes are rule-based and cannot be adaptively applied to uncertain and floating operating conditions. Here, we propose an adaptive UVLS algorithm for emergency control via deep reinforcement learning (DRL) and expert systems. We first construct dynamic components for picturing the power system operation as the environment. The transient voltage recovery criteria, which poses time-varying requirements to UVLS, is integrated into the states and reward function to advise the learning of deep neural networks. The proposed method has no tuning issue of coefficients in reward functions, and this issue was regarded as a deficiency in the existing DRL-based algorithms. Case studies illustrate that the proposed method outperforms the traditional UVLS relay in both the timeliness and efficacy for emergency control.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

High Performance Adaptive Deep-Reinforcement-Learning-based Real-time Emergency Control (HADREC) to Enhance Power Grid Resilience in Stochastic Environment (Final Report)

The HADREC technology developed in this project features real-time, validated, and predictive emergency control capabilities needed to effectively safeguard the grid against costly disturbances from extreme weather and other disruptive events. It has the potential to revolutionize the emergency control by providing faster and more effective solution for power grid emergency control. The technology can reduce the grid emergency control action time from minutes to seconds and mitigate the impact of outages and reduce system recovery time. The evaluation results using the models and data from PacifiCorp system have shown ~20% improvement in responding time and 70% improved in tripped generator output, comparing against today’s industrial application. This performance can help reduce preventive measurements and improve network utilization and market efficiency, and help lead to a more reliable and resilient power grid with renewable integration. The project has generated significant interest from industry, academic and commercial companies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Securing Solar for the Grid: Extreme Control Whitepaper

Emerging standards outlining desired behaviors for Distributed Energy Resources (DER), such as IEEE 1547-2018, define several device-level control functions to regulate DER power injections/consumptions in response to locally sensed grid conditions. The ability to adjust settings of aggregations of DER with standardized embedded control functionality constitutes a mechanism which can, potentially, create undesirable or deleterious effects on the power grid. The purpose of this white paper is to highlight unintended effects stemming from improperly tuned embedded control functions in Distributed Energy Resources (DER), which could be exploited by a malicious entity as a means to attack the power grid.

14 SOLAR ENERGY↗
DOE OSTI2020

A Step Towards Machine Learning-based Coherent Generator Grouping for Emergency Control Applications in Modern Power Grid

A dynamic neural network (NN) based multi-class classifier is proposed for improving online prediction of coherent generator groups (CGGs), following the occurrences of various contingencies in the power grid. This is motivated by the increasing availability of the measurements from phasor measurement units (PMUs) and the number of grouping schemes is limited. The proposed method consists of three steps. First, by performing offline simulations, a library of system dynamic responses characterized by post-contingency rotor angles and speeds of individual generators is obtained. To generate sufficient data, up to N-2 contingencies and the uncertain parameters associated with the power grid including type and location of disturbance and fault clearing times are modeled. Secondly, the training data-set is produced by generating labels for individual contingencies using a hierarchical clustering method based on rotor angle and speed data. Lastly, the dynamic NN models are trained for online applications such as emergency controls and controlled islanding. The proposed method is tested on the standard 16-generator 68-bus system to demonstrate its performance. Furthermore, the impact of the sample data lengths on the CGG numbers is evaluated. It is interesting to observe that the time domain stability behaviors can be determined by examining the changes in the CGG numbers.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

pnnl/MBDRL

Model-based Deep Reinforcement Learning for Real-time Grid Emergency Voltage Control. A model-based Deep Reinforcement Learning (DRL) framework where a deep neural network (DNN)-based surrogate model is utilized within the control policy learning framework, making the learning process faster and more sample efficient

Yin, Tim↗
DOE OSTI2020

Adaptive Power System Emergency Control using Deep Reinforcement Learning

Power system emergency control is generally regarded as the final safety net for grid security and resiliency. Existing emergency control schemes are usually designed off-line based on either the conceived “worst” case scenarios or a few typical operation scenarios. These schemes are facing significant adaptiveness and robustness issues as increasing uncertainties and variations occur in modern electrical grids. To address these challenges, for the first time, this paper proposes a novel adaptive emergency control scheme using deep reinforcement learning (DRL), by leveraging the high-dimensional feature extraction and non-linear generalization capabilities DRL has for complex systems with high-dimensional variations. Furthermore, an open-source platform named DeepGrid has been designed for the first time to assist the DRL development and benchmarking processes in power system emergency control. Details of the platform, DRL, and emergency control schemes that use dynamic braking or under-voltage load shedding are presented. Extensive case studies performed in both two-area four-machine system and IEEE 39-Bus system have demonstrated the excellent performance and robustness of the proposed schemes.

Deep reinforcement learning, emergency control, lo↗
DOE OSTI2021

Safe Reinforcement Learning for Emergency Load Shedding of Power Systems

The paradigm shift in the electric power grid necessitates a revisit of existing control methods to ensure the grid’s security and resilience. In particular, the increased uncertainties and rapidly changing operational conditions in power systems have revealed outstanding issues in terms of either speed, adaptiveness, or scalability of the existing control methods for power systems. On the other hand, the availability of massive real-time data can provide a clearer picture of what is happening in the grid. Recently, deep reinforcement learning (RL) has been regarded and adopted as a promising approach leveraging massive data for fast and adaptive grid control. However, like most existing machine learning (ML)- based control techniques, RL control usually cannot guarantee the safety of the power systems. In this paper, we introduce a novel method for safe RL-based load shedding of power systems that can enhance the safe voltage recovery of the electric power grid after experiencing faults. Numerical simulation on the IEEE 39-bus testcase is performed to demonstrate the effectiveness of the proposed safe RL emergency control, as well as its adaptive capability to faults not seen in the training.

reinforcement learning, emergency control, power g↗
DOE OSTI2020

A Station-hybrid HVDC System Structure and Control Strategies for Cross-seam Power Transmission

Cross-seam high voltage DC (HVDC) transmission in the United States can provide an efficient and flexible bulk power delivery highway between the interconnections. Recent studies have shown significant economic benefits of cross-seam HVDC transmission systems by taking the advantages of load diversity, frequency response, renewable energy diversity, and energy arbitrage in the different interconnections. This paper introduces a station-hybrid system scheme for cross-seam interconnections. Here, the proposed station-hybrid system combines the advantages of line commutated converter (LCC) and voltage source converter (VSC) technologies, thus enabling reliable and flexible bidirectional power flows across the interconnections. Control strategies of the station-hybrid system are investigated with a focus on power flow reversal control under normal operation conditions and grid support control under emergency conditions. The feasibility and effectiveness of the proposed station-hybrid system and corresponding control strategies are verified by simulations in PSCAD/EMTDC.

Station-hybrid system↗
DOE OSTI2020

Improving power grid transient stability and transfer capability using HVDC emergency power controls

In the future, with high levels of renewable energy sources penetration, the transmission corridors will have to be flexible to operate under faster transients and variable power flows. Fast power ramping and overloading capabilities of HVDC system can be utilized to ensure transient stability of the interconnected power grid. In this paper, HVDC auxiliary controllers have been studied that can provide the power grid with additional synchronizing torques through fast DC power changes in response to arising system conditions. The effectiveness of the auxiliary controllers in improving transient stability is demonstrated by performing dynamic simulations on the detailed model of the Western Interconnection system (WECC).

Sundaresh, Lakshmi↗
DOE OSTI2025

BOPTest As a Platform for Building Controls and Grid-Interactive Buildings Workforce Training

Building automation and controls are becoming increasingly complex with the emergence of Grid Integrated Efficient Buildings (GEBs) as well as new highly efficient sequences of operation and data-driven control schemes. However, there remains a significant gap in hands-on training opportunities for building operators and technicians to gain practical experience with advanced control systems in a low-risk environment. This paper presents BOPTEST (Building Optimization Performance Test) as a suitable platform for workforce training in building controls and GEB technologies. BOPTEST provides a suite of standardized building simulation test cases with a REST API, real-time control interfaces through BACnet, semantic models connecting users to building data, and built-in calculation of control metrics and performance indicators. The platform enables trainees to interact with virtual buildings using industry-standard protocols while learning how to implement and innovate control strategies. The training platform is designed to offer a structured and interactive learning experience for building engineers, helping them effectively develop, learn, and retain skills in fault identification, troubleshooting, and correction. The workflow is divided into three main phases: 1) Setup, 2) Exercise, and 3) Review, each comprising specific activities performed by either the instructor or the student. Initial pilot training sessions have yielded positive feedback from instructors and participants and demonstrates that BOPTEST effectively fills an industry need for a low-risk training resource via simulation of real building control systems, allowing trainees to gain practical experience before working in the field. The platform's ability to provide immediate performance feedback while maintaining familiar industry interfaces makes it particularly suitable for workforce development programs. This work provides a replicable model for leveraging building simulation in control education and training.

Paul, Lazlo↗
DOE OSTI2025

BOPTEST as a Platform for Building Controls and Grid-Interactive Buildings Workforce Training

Building automation and controls are becoming increasingly complex with the emergence of Grid Integrated Efficient Buildings (GEBs) as well as new highly efficient sequences of operation and data-driven control schemes. However, there remains a significant gap in hands-on training opportunities for building operators and technicians to gain practical experience with advanced control systems in a low-risk environment. This paper presents BOPTEST (Building Optimization Performance Test) as a suitable platform for workforce training in building controls and GEB technologies. BOPTEST provides a suite of standardized building simulation test cases with a REST API, real-time control interfaces through BACnet, semantic models connecting users to building data, and built-in calculation of control metrics and performance indicators. The platform enables trainees to interact with virtual buildings using industry-standard protocols while learning how to implement and innovate control strategies. The training platform is designed to offer a structured and interactive learning experience for building engineers, helping them effectively develop, learn, and retain skills in fault identification, troubleshooting, and correction. The workflow is divided into three main phases: 1) Setup, 2) Exercise, and 3) Review, each comprising specific activities performed by either the instructor or the student. Initial pilot training sessions have yielded positive feedback from instructors and participants and demonstrates that BOPTEST effectively fills an industry need for a low-risk training resource via simulation of real building control systems, allowing trainees to gain practical experience before working in the field. The platform's ability to provide immediate performance feedback while maintaining familiar industry interfaces makes it particularly suitable for workforce development programs. This work provides a replicable model for leveraging building simulation in control education and training.

Paul, Lazlo↗
DOE OSTI2022

On Control Schemes for Grid-Forming Inverters

Grid-forming inverters can collaboratively regulate the voltage and frequency of a microgrid. These inverters are expected to be seen more in the future microgrid, undertaking the roles of the conventional power generators. Like conventional power generators, they must balance supply and demand, contribute to power-sharing between inverters and other power generators, and restore the voltage and frequency after any power changes. These technical challenges are typically achieved through different primary and secondary controllers. This article reviews some state-of-the-art primary and secondary control schemes for the emerging technology of grid-forming inverters. First, the typical control schemes for grid-following inverters are briefly presented for the continuity of the discussion on the roles of the grid-forming inverters in future power-grid, followed by two basic control schemes for the grid-forming inverters. Then, two decentralized power-sharing techniques, i.e., droop, and virtual inertia, are analyzed. The technical challenges for inverter synchronization and some control methods are discussed afterward. Finally, several secondary control methods for the voltage and frequency restoration in grid-forming inverters are reviewed.

Sadeque, Fahmid↗
DOE OSTI2022

Virtual Synchronous Generator Control of Multi-port Autonomous Reconfigurable Solar Plants (MARS)

Multi-port autonomous reconfigurable solar power plant (MARS) is an integrated concept for integration of solar photovoltaic (PV) and energy storage systems (ESS) to transmission alternating current (ac) grid and high-voltage direct current (HVdc) links. The integrated development incorporates advanced control methods to provide enhanced grid ancillary services such as fast frequency responses and dynamic voltage support. In this paper, the virtual synchronous generator (VSG) control algorithm of MARS is discussed. The proposed VSG-based control enables enhanced synthetic inertial response and flexible frequency response characteristics of hybrid PV and ESS power plants in accordance with grid ancillary service requirements. Multi-port power electronics interface allows controlled emergency power support from MARS to local transmission ac grid and remote grid through the HVdc link. The performance of VSG control is validated using a reduced-order model of MARS in Simulink. Methods for estimating grid ancillary service capabilities of MARS are also discussed.

Pan, Jiuping↗
DOE OSTI2021

Small-Signal Stability Analysis of Low-Inertia Power Grids with Inverter-Based Resources and Synchronous Condensers: Preprint

With the potential environmental impacts of conventional fossil fuels and the technology advances of grid interactive power electronics, inverter-based resources (IBRs) are playing a crucial role in modern power grids. However, due to the lack of physical inertia, IBRs are vulnerable to system disturbances. Further, conventional grid-following (GFL) inverters cannot actively establish the frequency and voltage, which could not be a appropriate solution for 100% inverter-based power grids. Grid-forming (GFM) control, as an emerging inverter control function, has drawn great attention in recent years, while it is still under development and pre-mature for large-scale field deployment. A potential solution for gradually transitioning into a 100% inverter-based power grid is to combine both IBRs and synchronous machines into a mixed generation portfolio. More importantly, synchronous machines can be operated as synchronous condensers (SCs) until they are retired. It is also worth mentioning that the stability analysis is of great importance to ensure the smooth transition from existing power grids to 100% inverter-based system, which is the main focus of this work with detailed modeling and modal analysis.

100% renewable↗