Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “power system control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Hybrid power system control and operating strategy based on power system state vector calculation

Controlling a hybrid power system includes calculating a power system state vector based on energy demand and a stored data array including a matrix defined by a power system hardware configuration. The control further includes producing a power request based on the power system state vector, and varying a flow of energy amongst energy devices using drive linkages in the hybrid power system based on the power request. Related apparatus, control logic and controller structure is disclosed.

Guo, Fang↗
DOE OSTI2023

Risk-Constrained Reinforcement Learning for Inverter-Dominated Power System Controls

Here, this paper develops a risk-aware controller for grid-forming inverters (GFMs) to minimize large frequency oscillations in GFM inverter-dominated power systems. To tackle the high variability from loads/renewables, we incorporate a mean-variance risk constraint into the classical linear quadratic regulator (LQR) formulation for this problem. The risk constraint aims to bound the time-averaged cost of state variability and thus can improve the worst-case performance for large disturbances. The resulting risk-constrained LQR problem is solved through the dual reformulation to a minimax problem, by using a reinforcement learning (RL) method termed as stochastic gradient-descent with max-oracle (SGDmax). In particular, the zero-order policy gradient (ZOPG) approach is used to simplify the gradient estimation using simulated system trajectories. Numerical tests conducted on the IEEE 68-bus system have validated the convergence of our proposed SGDmax for GFM model and corroborate the effectiveness of the risk constraint in improving the worst-case performance while reducing the variability of the overall control cost.

Frequency control↗
DOE OSTI2024

Implementation and Operation of Power Flow Control Solutions for Transmission Systems

Power-flow controls (PFCs) technologies provide a suite of alternatives to more-efficiently direct the flow of power on the grid, improving flexibility and enabling the grid to be more responsive and resilient. PFCs can be used in many cases to mitigate overloads and consequently defer the installation of grid-expansion projects. They can also be suitable options in situations where new transmission lines cannot be built because of environmental constraints, land use, or other types of restrictions. Other uses include mitigation of loop or unintended flows, forcing of contractual or scheduled flows, reduction of congestion, and mitigation solutions during large maintenance or construction projects. While many studies have demonstrated the potential economic benefits of PFC for different types of applications, the implementation implications of using multiple PFCs for system operation and reliability have not been analyzed in detail. The lack of information and practical experience on these aspects hinders adoption of this technology. One use case would be that multiple PFCs are required to coordinate congestion management. In such cases, multiple PFCs are deployed in a meshed power system to control power flows across a wide area. The challenges are associated with PFC interaction—namely, the self and mutual power-flow sensitivity of each PFC, which must be accounted for in the calculation of the respective operating setpoints. This report analyzes implementation and operation that must be considered in evaluating transmission solutions using PFCs. The report first analyzes attributes with which PFC-based solutions should comply, based on the objective and characteristics of each particular use case. It then describes different approaches for coordinated control of multiple PFC devices for different applications, including options to avoid adverse interactions and reduce risks due to inappropriate coordination. Control and operation are illustrated through case studies performed on both generic and actual power system models. This report provides insights for transmission planners and operation engineers about the implementation of PFC-based transmission solutions; consequently, it will help them make informed decisions about the adoption of the technology.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Laboratory Evaluation of Federated, Hierarchical Controls for Distribution Power System Management: Preprint

The connection of more loads and distributed energy resources (DERs) to the distribution power system brings both challenges and opportunities to system operators. There are opportunities to aggregate flexible loads and DERs to provide transmission grid services, but the coordinated actions of DERs being managed by independent, third-party DER aggregators to support transmission system operations can present challenges. We developed a federated DER management architecture and control framework that aims to manage heterogeneous DERs to deliver reliable transmission grid services while respecting distribution system constraints. The controls include stochastic day-ahead optimization, model predictive control, and a simple real-time management scheme. We present simulation results obtained from a realistic laboratory test bed of federated controls managing DERs within a substation service area to make the substation net power follow the optimal net power determined by the day-ahead optimization based on cost and limiting reverse power flow.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Assessment and Commissioning of Electrical Substation Grid Testbed with a Real-Time Simulator and Protective Relays/Power Meters in the Loop

Electrical utility substations are wired with intelligent electronic devices (IEDs), such as protective relays, power meters, and communication switches. Substation engineers commission these IEDs to assess the appropriate measurements for monitoring, control, power system protection, and communication applications. Like real electrical utility substations, complex electrical substation grid testbeds (ESGTs) need to be assessed for measuring current and voltage signals in monitoring, power system protection, control (synchro check), and communication applications that are limited by small measurement percentage errors. In the process of setting an ESGT with real-time simulators and IEDs in the loop, protective relays, power meters, and communication devices must be commissioned before running experiments. In this study, an ESGT with IEDs and distributed ledger technology was developed. The ESGT with a real-time simulator and IEDs in the loop was satisfactorily assessed and commissioned. The commissioning and problem-solving tasks of the testbed are described to define a method with flowcharts to assess possible trouble-shooting in ESGTs. This method was based on comparing the simulations versus IED measurements for the phase current and voltage magnitudes, three-phase phasor diagrams, breaker states, protective relay times with selectivity coordination at electrical faults, communication data points, and time-stamp sources.

Piesciorovsky, Emilio↗
DOE OSTI2022

Enhanced Oblique Decision Tree Enabled Policy Extraction for Deep Reinforcement Learning in Power System Emergency Control

Deep reinforcement learning (DRL) algorithms have successfully solved many challenging problems in various power system control scenarios. However, their decision-making process is usually regarded as black-boxes. Furthermore, how DRL models interact with human intelligence remains an open problem. Thus, this paper proposes a policy extraction framework to extract a complex DRL model into an explainable policy. This framework includes three parts: 1) DRL training and data generation. We train an agent for a specific control task and generate data, which contains the control policy of the agent. 2) Policy extraction. We propose an information gain rate based weighted oblique decision tree (IGR-WODT) for DRL policy extraction. 3) Policy evaluation. We define three metrics to evaluate the performance of the proposed approach. A case study for the under-voltage load shedding problem shows that the IGR-WODT presents a performance enhancement compared with DRL, weighted oblique decision tree, and univariate decision tree. The proposed policy extraction method could provide an intuitive explanation of the neural network decision-making process to the dispatchers when making final decisions on power grid operation. Also, the resulted rule-based controller could replace the deep neural network-based controller in many field edge devices with limited computing resources, providing comparable performance.

deep reinforcement learning↗
DOE OSTI2024

Holistic Small-Signal Stability Analysis for Large-Scale Inverter-Intensive Power Systems with Coupled and Full-Order Dynamics from Control Systems and Power Networks

The increasing penetration of inverter-based resources (IBRs) into the existing power systems introduces tremendous benefits for enhanced sustainability but also poses inevitable challenges in terms of insufficient inertia, potential instability, and complex network dynamics, among others. However, the additional coupling introduced by the interactions among gridfollowing (GFL) and grid-forming (GFM) IBRs and the other components (i.e., synchronous generators [SGs], loads, and network, etc.) has not been clearly explored. A holistic, scalable, and quantitative stability analysis framework with the control systems and power networks is still missing. Here, in this paper, to fill in the technical gaps, a holistic small-signal model of the entire system with both rotating generation units and IBRs is established. An extended power flow model with operation dynamics from both generator control schemes and power networks is proposed to provide the varying steady-state operating points for small-signal modeling. The proposed method is compared with MATLAB solvers, and the results show that the proposed approach has a minimum calculation time, which can be less than 12 seconds for a large-scale power system with up to 2,000 buses. Furthermore, a quantitative method is developed to identify the impacts of IBRs on system performance with emphases on the potential stability issues with GFL IBRs, additional benefits of employing GFM IBRs, the feasibility of replacing SGs with GFM IBRs, and the impact of penetration level of different kinds of generation units. Finally, a field island power system is used to verify the proposed approach, and hardware-in-the-loop (HIL) tests are provided to further demonstrate the effectiveness of the proposed analysis.

14 SOLAR ENERGY↗
DOE OSTI2025

Physics-informed Deep Reinforcement Learning-based Control in Power systems

Incorporating physics information into the deep reinforcement learning (DRL) process is a promising approach for addressing the challenges faced in learning-based control design problems for physical systems. Power grid dynamics, being a physical system, adheres to specific physical laws, constraints, as well as operational and control rules. Therefore, consideration of such physics-based law improves the learning process drastically. In general, traditional grid control schemes rely on rule-based mechanisms that cannot adapt to changing operating conditions. To improve the adaptability and computation time, recent research has seen a surge of DRL-based applications in power grid control. A generic DRL-based control design imposes the system performance requirements through the design of reward functions. In some cases, some of the important physics information is injected through this reward function. However, due to the complex dynamics and large state-action space, learning an optimal DRL policy often becomes challenging. Inspired by the latest developments in general machine learning (ML) research, power system researchers have been investigating more direct ways of incorporating physics knowledge into DRL training. This chapter specifically focuses on these aspects of physics-informed DRL designs in grid control. It discusses the significance, applications, research gaps, and open problems that need to be addressed in future research.

artificial intelligence, machine learning↗
DOE OSTI2024

Artificial Intelligence/Machine Learning Technology in Power System Applications

The primary purpose of this report is to provide an overview of the advancement in artificial intelligence and machine learning (AI/ML) technologies and their applications in power systems. It offers a foundation for understanding the transformative role of AI/ML in power systems and aims to stimulate further research and development in this area. This report begins with a historical perspective of AI/ML technologies, then explores their advancement to today’s prominence. The document highlights key contributors to the success of AI/ML technologies, including increased computational power, greater data availability, innovative algorithms, and advanced tools. It further introduces various AI/ML techniques, including supervised, unsupervised and reinforcement learning, graph neural networks, and generative AI. It also emphasizes the critical importance of ensuring the safety, security, and trustworthiness of these AI/ML techniques within this sector. The report reviews the recent representative advancements in various power system applications enhanced by AI/ML techniques, underscoring key developments and their transformative impact as evidenced by numerous studies. It also explores both the opportunities and challenges associated with the application of AI/ML technologies to improve power system applications. While the report extensively covers AI/ML applications in power systems, focusing primarily on the technical and operational aspects, it may not thoroughly explore the sociopolitical, economic, and broader regulatory implications of AI/ML integration in power systems. AI/ML techniques hold significant potential for enhancing power system applications; however, they are not omnipotent. It is crucial to acknowledge their limitations and understand that they may not be able to address all challenges in the power system domain. Various factors must be considered that influence the implementation, adoption, and effectiveness of AI/ML solutions, including but not limited to safety, security, transparency, and trustworthiness. Additionally, the incorporation of advanced human–machine interfaces is essential, as it enables humans to validate the effectiveness of AI/ML solutions while remaining actively engaged, fostering trust in AI/ML deployment. Finally, the report summarizes AI/ML research activities supported by the Department of Energy (DOE) Office of Electricity (OE) through the Advanced Grid Modeling (AGM) program. The work aligns with the interests and mission of DOE-OE AGM, with the report serving as a resource for identifying existing progress and for pinpointing future applications within AI/ML that need further exploration and support.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Control of Low-Inertia Power Systems

Electric power systems are undergoing an unprecedented transition from fossil fuel–based power plants to low-inertia systems that rely predominantly on power electronics and renewable energy resources. This article reviews the resulting control challenges and modeling fallacies, at both the device and system level, and focuses on novel aspects or classical concepts that need to be revised in light of the transition to low-inertia systems. To this end, we survey the literature on modeling of low-inertia systems, review research on the control of grid-connected power converters, and discuss the frequency dynamics of low-inertia systems. Moreover, we discuss system-level services from a control perspective. Overall, we conclude that the system-theoretic mindset is essential to bridge different research communities and understand the complex interactions of power electronics, electric machines, and their controls in large-scale low-inertia power systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Apparatus and system for controlling power to an air conditioning compressor for a vehicle

A climate control system for vehicles includes an internal combustion engine that may be coupled to selectively power a first motor generator, and an air conditioning compressor that may be selectively powered by one or both of the first motor generator and a second motor generator, or by the internal combustion engine. The system may include a rechargeable battery, and a vehicle controller having a vehicle state circuit structured to determine a vehicle operating condition value and a state-of-charge value of the rechargeable battery, and a coupling determination circuit structured to provide an internal combustion engine-first motor generator coupling command in response to the vehicle operating condition value and the state-of-charge value. In response to the internal combustion engine-first motor generator coupling command being provided as coupled, the internal combustion engine may power the first motor generator.

Kumar, Mahesh Madurai↗
DOE OSTI2023

Reinforcement Learning-based Output Structured Feedback for Distributed Multi-Area Power System Frequency Control

Load frequency control (LFC) is a key factor to maintain the stable frequency in multi-area power systems. As the modern power systems evolve from centralized to decentralized paradigm, LFC needs to consider the decentralized scheme that considers limited information from the information-exchange graph for the generator control of each interconnected area. This paper aims to solve a data-driven constrained LQR problem with mean-variance risk constraints and output structured feedback, and applies this framework to solve the LFC problem in multi-area power systems. By reformulating the constrained optimization problem into a minimax problem, the stochastic gradient descent max-oracle (SGDmax) algorithm with zero-order policy gradient (ZOPG) is adopted to find the optimal feedback gain from the learning, while guaranteeing the convergence. In addition, to improve the adaptation of the proposed learning method to new or varying models, we construct an emulator grid that approximates the dynamics of a physical grid and performs training based on this model. Once the feedback gain is obtained from the emulator grid, it is applied to the physical grid with a robustness test to check whether the controller from the approximated emulator applies to the actual system. Numerical tests show that the obtained feedback controller can successfully control the frequency of each area, while mitigating the uncertainty from the loads, with reliable robustness that ensures the adaptability of the obtained feedback gain to the actual physical grid.

Kwon, Kyung-bin↗
DOE OSTI2023

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Here this article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results for model-free DRL-based methods in power systems control problems. But in power systems applications, these model-free methods have certain issues related to training time (clock time) and sample efficiency; both are critical for making state-of-the-art DRL algorithms practically applicable. DRL-agent learns an optimal policy via a trial-and-error method while interacting with the real-world environment. It is also desirable to minimize the direct interaction of the DRL agent with the real-world power grid due to its safety-critical nature. Additionally, the state-of-the-art DRL-based policies are mostly trained using a physics-based grid simulator where dynamic simulation is computationally intensive, lowering the training efficiency. We propose a novel model-based DRL framework where a deep neural network (DNN)-based dynamic surrogate model (SM), instead of a real-world power grid or physics-based simulation, is utilized within the policy learning framework, making the process faster and more sample efficient. However, having stable training in model-based DRL is challenging because of the complex system dynamics of large-scale power systems. We addressed these issues by incorporating imitation learning to have a warm start in policy learning, reward-shaping, and multi-step loss in surrogate model training. Finally, we achieved 97.5% reduction in samples and 87.7% reduction in training time for an application to the IEEE 300-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Optimal mitigation and control over power system dynamics for stochastic grid resilience

Optimal mitigation planning for highly disruptive contingencies to a transmission-level power system requires optimization with dynamic power system constraints, due to the key role of dynamics in system stability to major perturbations. We formulate a generalized disjunctive program to determine optimal grid component hardening choices for protecting against major failures, with differential algebraic constraints representing system dynamics (specifically, differential equations representing generator and load behavior and algebraic equations representing instantaneous power balance over the transmission system). We optionally allow stochastic optimal pre-positioning across all considered failure scenarios, and optimal emergency control within each scenario. This novel formulation allows, for the first time, analyzing the resilience interdependencies of mitigation planning, preventive control, and emergency control. Using all three strategies in concert is particularly effective at maintaining robust power system operation under severe contingencies, as we demonstrate on the western system coordinating council 9-bus test system using synthetic multi-device outage scenarios.

30 DIRECT ENERGY CONVERSION↗