Machine Learning for the Grid
Explore the source record for details and available documents.
Computer Science↗
SEARCH · Engineering Papers
Results for “Power Systems, Machine Learning, Optimization, Control”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Machine Learning-Based PV Reserve Determination Strategy for Frequency Control on the WECC System
Frequency control from photovoltaic (PV) power plants has great potential to address the frequency response challenge of the power system with high penetrations of renewable generation. Using model-based approaches to determine the optimal PV headroom reserve, however, requires significant online computation and is intractable for an interconnection level system. This paper proposes a machine learning based strategy, that is suitable for real-time operation, to determine the optimal PV reserve for frequency control. The proposed machine learning algorithm is trained and tested on 1,987 offline simulations of a 60% renewable penetration Western Electricity Coordinating Council (WECC) system. Furthermore, the proposed reserve determination strategy is applied on a realistic 1-day operation profile of the WECC system and demonstrates a savings of more than 40% PV headroom compared to a conservative approach. It is evident that the proposed strategy can efficiently and effectively determine the optimal PV frequency control reserve for realistic interconnection systems.
frequency control↗
Machine Learning-Based PV Reserve Determination Strategy for Frequency Control on the WECC System
This paper proposes a machine learning based strategy, that is suitable for real-time operation, to determine the optimal photovoltaic (PV) power plants reserve for frequency control. The proposed machine learning algorithm is trained and tested on 1,987 offline simulations of a 60% renewable penetration Western Electricity Coordinating Council (WECC) system. On a realistic 1-day operation profile of the WECC system, the ML model demonstrates a savings of more than 40% PV headroom compared to a conservative approach.
14 SOLAR ENERGY↗
Co-Simulation of Electric Power Distribution Systems and Buildings including Ultra-Fast HVAC Models and Optimal DER Control
Smart homes and virtual power plant (VPP) controls are growing fields of research with potential for improved electric power grid operation. A novel testbed for the co-simulation of electric power distribution systems and distributed energy resources (DERs) is employed to evaluate VPP scenarios and propose an optimization procedure. DERs of specific interest include behind-the-meter (BTM) solar photovoltaic (PV) systems as well as heating, ventilation, and air-conditioning (HVAC) systems. The simulation of HVAC systems is enabled by a machine learning procedure that produces ultra-fast models for electric power and indoor temperature of associated buildings that are up to 133 times faster than typical white-box implementations. Hundreds of these models, each with different properties, are randomly populated into a modified IEEE 123-bus test system to represent a typical U.S. community. Advanced VPP controls are developed based on the Consumer Technology Association (CTA) 2045 standard to leverage HVAC systems as generalized energy storage (GES) such that BTM solar PV is better utilized locally and occurrences of distribution system power peaks are reduced, while also maintaining occupant thermal comfort. An optimization is performed to determine the best control settings for targeted peak power and total daily energy increase minimization with example peak load reductions of 25+%.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Machine Learning-Based PV Reserve Determination Strategy for Frequency Control on the WECC System: Preprint
Frequency control from Photovoltaic (PV) plants has great potential to address the frequency response challenge of the power system with high renewable penetration. However, using model-based approaches to determine the optimal PV headroom reserve requires significant online computation and is intractable for an interconnection level system. This paper proposes a machine learning based strategy, that is suitable for real-time operation, to determine the optimal PV reserve for frequency control. The proposed machine learning algorithm is trained and tested on 1,987 offline simulations of a 60% renewable penetration Western Electricity Coordinating Council (WECC) system. Furthermore, the proposed reserve determination strategy is applied on a realistic one-day operation profile of the WECC system and demonstrates over 40% PV headroom saving compared to a conservative approach. It is evident that the proposed strategy can efficiently and effectively determine the optimal PV frequency control reserve for realistic interconnection systems.
41 EE - Solar Energy Technologies Office (EE-4S)↗
Dynamic systems modeling of the spallation neutron source cryogenic moderator system to optimize transient control and prepare for power upgrades
Through support of the US Department of Energy's Office of Basic Energy Sciences, Oak Ridge National Laboratory has begun applying machine learning methods to improve accelerator and target performance of the Spallation Neutron Source (SNS). These methods are being applied to the control optimization and power upgrade of the SNS Cryogenic Moderator System (CMS). A numerical model of the CMS has been developed to study these optimizations and system modifications using EcosimPro. This paper compares steady-state and transient numerical results with experimental data. Control optimization studies focused on dampening mass flow, temperature, and pressure fluctuations during sudden losses of accelerator beam power. This analysis was conducted by adjusting five proportional-integral-derivative controllers connected to four flow control valves and one heater. Future efforts include power uprate studies focused on increasing the CMS cooling capacity. The current accelerator power is 1.4 MW; the first target station is being upgraded to 2.0 MW as part of the Proton Power Upgrade effort. The CMS cooling capacity is sufficient for 2.0 MW operation.
47 OTHER INSTRUMENTATION↗
Statistical and machine learning models for optimizing energy in parallel applications
Rising power costs and constraints are driving a growing focus on the energy efficiency of high performance computing systems. The unique characteristics of a particular system and workload and their effect on performance and energy efficiency are typically difficult for application users to assess and to control. Settings for optimum performance and energy efficiency can also diverge, so we need to identify trade-off options that guide a suitable balance between energy use and performance. We present statistical and machine learning models that only require a small number of runs to make accurate Pareto-optimal trade-off predictions using parameters that users can control. We study model training and validation using several parallel kernels and more complex workloads, including Algebraic Multigrid (AMG), Large-scale Atomic Molecular Massively Parallel Simulator, and Livermore Unstructured Lagrangian Explicit Shock Hydrodynamics. Here, we demonstrate that we can train the models using as few as 12 runs, with prediction error of less than 10%. Our AMG results identify trade-off options that provide up to 45% improvement in energy efficiency for around 10% performance loss. We reduce the sample measurement time required for AMG by 90%, from 13 h to 74 min.
97 MATHEMATICS AND COMPUTING↗
Enabling off-highway diesel engine downsizing and performance improvement using electrically assisted turbocharging
Internal combustion engine (ICE) downsizing through various turbocharging configurations is generally known by the powertrain design community as an effective means to reduce frictional losses, increase waste heat recovery, and improve fuel efficiency while increasing engine power density. However, often is the case that turbocharging strategies, including variable geometry turbochargers, and regulated two-stage turbochargers, incur the performance tradeoff between transient response and fuel economy (pumping losses) at high engine speeds. For off-highway vehicles having particularly transient and high-powered duty cycles, efforts to improve this tradeoff and increase operational flexibility have turned to evaluating various electrified air system architectures. In this study, a 4.5 L diesel-ICE configured with an electrically driven compressor (eBooster ® ) is placed in series with a conventional turbocharger and integrated into a 48 V mild-hybrid powertrain architecture. The objective of this powertrain configuration is to enable engine downsizing by 34%, replacing the current 6.8 L ICE platform with the hybridized 4.5 L ICE concept. The commercial 1-D simulation software GT-SUITE is used for powertrain system development and system optimization. Development and validation of the GT-SUITE model and air system controls is concurrently supported through experimental data collection. The simulation model development includes using machine learning methods for optimizing exhaust gas dilution, injection timing, and eBooster ® power to improve steady-state and transient brake-specific fuel consumption while minimizing criteria pollutant emissions. It was found that total specific fluid consumption over the standardized non-road transient engine duty cycle could be reduced by 18% over the current 6.8 L engine by using an optimized eBoosted 4.5 L engine. The hybridized 4.5 L engine concept concurrently showed sufficient transient response capability and nearly an order of magnitude reduction in duty cycle total soot production.
25 ENERGY STORAGE↗
Physics-informed Deep Reinforcement Learning-based Control in Power systems
Incorporating physics information into the deep reinforcement learning (DRL) process is a promising approach for addressing the challenges faced in learning-based control design problems for physical systems. Power grid dynamics, being a physical system, adheres to specific physical laws, constraints, as well as operational and control rules. Therefore, consideration of such physics-based law improves the learning process drastically. In general, traditional grid control schemes rely on rule-based mechanisms that cannot adapt to changing operating conditions. To improve the adaptability and computation time, recent research has seen a surge of DRL-based applications in power grid control. A generic DRL-based control design imposes the system performance requirements through the design of reward functions. In some cases, some of the important physics information is injected through this reward function. However, due to the complex dynamics and large state-action space, learning an optimal DRL policy often becomes challenging. Inspired by the latest developments in general machine learning (ML) research, power system researchers have been investigating more direct ways of incorporating physics knowledge into DRL training. This chapter specifically focuses on these aspects of physics-informed DRL designs in grid control. It discusses the significance, applications, research gaps, and open problems that need to be addressed in future research.
artificial intelligence, machine learning↗
A review on the application of machine learning for combustion in power generation applications
Abstract Although the world is shifting toward using more renewable energy resources, combustion systems will still play an important role in the immediate future of global energy. To follow a sustainable path to the future and reduce global warming impacts, it is important to improve the efficiency and performance of combustion processes and minimize their emissions. Machine learning techniques are a cost-effective solution for improving the sustainability of combustion systems through modeling, prediction, forecasting, optimization, fault detection, and control of processes. The objective of this study is to provide a review and discussion regarding the current state of research on the applications of machine learning techniques in different combustion processes related to power generation. Depending on the type of combustion process, the applications of machine learning techniques are categorized into three main groups: (1) coal and natural gas power plants, (2) biomass combustion, and (3) carbon capture systems. This study discusses the potential benefits and challenges of machine learning in the combustion area and provides some research directions for future studies. Overall, the conducted review demonstrates that machine learning techniques can play a substantial role to shift combustion systems towards lower emission processes with improved operational flexibility and reduced operating cost.
Engineering↗
Short-Term State Forecasting-Based Optimal Voltage Regulation in Distribution Systems: Preprint
A novel short-term state forecasting-based optimal power flow (OPF) approach for distribution system voltage regulation is proposed in this paper. An extreme learning machine (ELM) based state forecaster is developed to accurately predict system states (voltage magnitudes and angles) in the near future. Based on the forecast system states, a dynamically weighted three-phase AC OPF problem is formulated to minimize the voltage violations with higher penalization on buses which are forecast to have higher voltage violations in the near future. By solving the proposed OPF problem, the controllable resources in the system are optimally coordinated to alleviate the potential severe voltage violations and improve the overall voltage profile. The proposed approach has been tested in a 12-bus distribution system and simulation results are presented to demonstrate the performance of the proposed approach.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Learning Optimal Power Flow Solutions using Linearized Models in Power Distribution Systems
Solving nonlinear optimal power flow (OPF) problem is computationally expensive, and poses scalability challenges for power distribution networks. An alternative to solving the original nonlinear OPF is the linear approximated OPF models. Although, these linear approximated OPF models are fast, the resulting solutions may result in significant optimality gap. Lately, the application of machine learning (ML) methods in successfully solving the nonlinear OPF has been reported. These methods learn and estimate the nonlinear control policies using a purely data-driven approach. In this paper, we propose an approach to complements the ML based approach to solving OPF using solutions from known linearized OPF model. Specifically, we use supervised learning to map the solutions of linear OPF to nonlinear control variables. Unlike, the traditional ML based methods for OPF that approximate the full distribution feeder model using function approximation, our approach uses a two-node approximation of radial networks. The proposed approach is validated using IEEE 123 bus test system for OPF solutions obtained using the nonlinear OPF models.
optimal power flow, power distribution systems, su↗
Quantum optimal control of superconducting qubits based on machine-learning characterization
Implementing fast and high-fidelity quantum operations using open-loop quantum optimal control relies on having an accurate model of the quantum dynamics. Any deviations between this model and the complete dynamics of the device, such as the presence of spurious modes or pulse distortions, can degrade the performance of optimal controls in practice. Here, we propose an experimentally simple approach to realize optimal quantum controls tailored to the device parameters and environment while specifically characterizing this quantum system. Concretely, we use physics-inspired machine learning to infer an accurate model of the dynamics from experimentally available data and then optimize our experimental controls on this trained model. We show the power and feasibility of this approach by optimizing arbitrary single-qubit operations in detailed numerical simulations of a superconducting transmon qubit. Furthermore, we demonstrate that this framework produces an accurate description of the device dynamics under arbitrary controls, together with the precise pulses achieving arbitrary single-qubit gates with a high fidelity of ∼99.99%.
Artificial neural networks↗
Real-Time Sea State Estimation for Wave Energy Converter Control via Machine Learning
Wave energy converters (WECs) harness the untapped power of ocean waves to generate renewable energy, offering a promising solution to sustainable energy. An optimal WEC control strategy is essential to maximize power capture that dynamically adjusts system parameters in response to rapidly changing sea states. This study presents a novel control approach that leverages neural networks to estimate sea states from onboard WEC measurements such as position, velocity, and force. Using a point absorber WEC device as a test platform, our proposed approach estimates sea states in real-time and subsequently adjusts PID controller gains to maximize energy extraction. Simulation results across diverse sea conditions demonstrate that our strategy eliminates the need for external wave monitoring equipment while maintaining power capture efficiency. The results show that our neural network-based control technique can improve power capture by 25.6% while significantly reducing system complexity. This approach offers a practical alternative for WEC deployments where direct wave measurements are either infeasible or cost prohibitive.
PIDcontrol↗
A Machine Learning Framework to Deconstruct the Primary Drivers for Electricity Market Price Events
As the electricity grid is moving towards a 100% Renewable Energy Source Bulk Power Grid, the overall operations of the power system operations and electricity markets are changing. The electricity markets are not only dispatching resources economically but also taking into account various controllable actions like renewable curtailment, transmission congestion mitigation, and energy storage optimization to make sure the grid is operating reliably. As a result, price formations in electricity markets have become quite complex. Traditional root cause analysis and statistical approaches are rendered inapplicable to analyze and infer the main drivers behind price formation in the modern grid and markets with variable renewable energy (VRE). In this paper, we propose a machine learning analysis framework to deconstruct some primary drivers for price formation in modern electricity markets with high renewable energy and the outcomes can be utilized for various critical aspects of market design, renewable dispatch and curtailment, operations, and cyber-security applications. The framework can be applied to any ISO or market data and in this paper it is applied to open-source publicly available datasets from California Independent System Operator (CAISO) and ISO New England.
machine learning (ML), electricity markets, Renewa↗
Development and assessment of a reactor system prognosis model with physics-guided machine learning
Autonomous control systems provide recommendations to help operators in decision-making during plant operations ranging from normal operation to accident management. An important step of autonomous control is prognosis. In nuclear engineering domain, prognosis is the process of predicting future conditions of a system or equipment based on present signs and symptoms of a fault. The prognosis model allows predicting future reactor states for possible candidate control strategies so that the outcomes can be evaluated to determine the best control strategy. The prognosis model requires representing direct relationships between the symptoms and the predictions. In nuclear engineering, computational simulations are approximate representations of the operation of the real system. However, prognosis with computational simulations requires high computation power and time due to possible large number of scenarios. Necessary computation resources can be reduced with machine learning (ML) approach for fast predictions by building a surrogate function using the simulation data. A critical issue is, ML models are ignorant of physical knowledge, and these models approximate statistical relationships between the system variables. This ignorance can produce results that are inconsistent with physical laws, even if an optimal result is achieved from a mathematical point of view. Physics-guided machine learning (PGML) is an approach to tackle this issue. Here, this work formulates and illustrates a framework to guide development and assessment of the ML-based prognosis model for autonomous control systems. The development of the prognosis model considers the training of a ML model which consists of optimizing many aspects of the ML approach. The assessment of the prognosis model considers training data limitations and uncertainties of the ML approach. Prognosis models with standalone ML and PGML are developed and assessed on the loss-of-flow scenario of Experimental Breeder Reactor II. The results indicate that PGML based prognosis model has the best performance compared to other prognosis models.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Protecting and Defending against Autonomous Control Systems and Digital Twin Cyber Attacks: Response Strategy for Hyperparameter attacks of Digital Twin Machine Learning Models in Nuclear Power Plants (Final)
Navigating through the complex tapestry of technological advancements, "Response Strategy for Hyperparameter attacks of Digital Twin Machine Learning Model in Nuclear Power Plants" stands at the intersection of cybersecurity and nuclear power plant operations, embarking on a journey through the intricacies of securing digital twins against malicious cyber activities. As nuclear power plants progressively integrate digital twin technology and machine learning models to optimize operations and ensure system reliability, they inadvertently expose themselves to a new spectrum of vulnerabilities, notably in the realm of hyperparameter attacks. Hyperparameters, integral in machine learning model tuning and optimal performance of digital twins, have emerged as a target for adversaries aiming to destabilize the predictive capabilities and therefore, the operational accuracy of these digital entities within critical infrastructures like nuclear plants. This paper, therefore, meticulously threads the needle through the development of a robust response strategy, poised to shield these digital reflections against calculated hyperparameter manipulations, ensuring that the digital twin can effectively and securely function as a reliable proxy for its physical counterpart. The ensuing sections delve into the orchestrated maelstrom of multi-rate time-changing intelligent coordinated hyperparameter attacks and the implementation of event-triggered predictive control, laying down a structured, predictive, and responsive framework that safeguards the nexus where the digital and physical realms of nuclear power plants coalesce. The operational integrity of digital twins in nuclear power plants depends critically on the security of machine learning hyperparameters. This study makes two different contributions. First, a decision-based idea known as a multi-rate time changing intelligent coordinated hyperparameter attack is put forth. In this attack, many hyperparameters are repeatedly changed using both random and intelligent optimal techniques by the attacker. These assaults introduce varied rates at different attack steps, compromise various amounts of hyperparameters, and improve stealth and flexibility. Second, a technique is developed for event triggered predictive control to rapidly respond to potential hyperparameter attacks. This control integrates a sliding window framework, retaining a history of previous data points and employing linear regression to predict the next data point from the current dataset. The control gain K is determined using the Lyapunov-Krasovskii method, and subsequently, an action is developed. Finally, the outcome of the simulation demonstrates the viability of the proposed method for defending nuclear power plant digital twins from hyperparameter attacks.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Cyber risk assessment and investment optimization using game theory and ML-based anomaly detection and mitigation for wide-area control in smart grids
The electric power grid is increasingly becoming susceptible to cyber attacks that exploit vulnerabilities in the smart grid control, information, and physical layers. Successful cyber attacks can have catastrophic impacts on the social and economic well-being of any nation all over the globe. It has, thus, become imperative to secure the smart grid against such adversarial actions to ensure stable, secure, and reliable operation of the grid. The existing research and industry practices prove to be inadequate in terms of providing pragmatic and effective defense methodologies and measures for long-term cybersecurity planning and real-time cybersecurity for grid operation. For example, existing works lack models that incorporate uncertain behavior of cyber-attackers and pragmatic defense measures for cyber risk assessment and cybersecurity investment optimization which often provide unreliable and strictly qualitative solutions to these problems. At the same time, with the growing number of cyber incidents in the grid, there still exists a need to develop attack-resilient algorithms for wide-area monitoring, protection, and control (WAMPAC) applications like the wide-area voltage control systems (WAVCS) for Flexible AC Transmissions Systems (FACTS) that lack in scalable and feasible solutions from the cybersecurity perspective. This dissertation proposes novel models and methodologies for: (1) Cybersecurity planning, and (2) Cybersecurity for system operation. The cybersecurity planning is achieved through cyber risk assessment and cybersecurity resource investment optimization for long-term cybersecurity of the grid using game theory and attack-defense trees. Cybersecurity for system operation consists of development of cyber anomaly detection and mitigation algorithms for flexible AC transmission system (FACTS) controller-based wide-area voltage control systems (WAVCS) using machine learning (ML), and software defined networking-based moving target defense network routing for achieving real-time cyber-physical security for grid operations. This is followed by hardware-in-the-loop (HIL) implementation and evaluation of these attack prevention, detection, and mitigation algorithms and methodologies showcasing their feasibility in a close to real-world environment. For cybersecurity planning, a novel approach involving a combination of game theory and attack defense trees (ADT) for optimal cybersecurity resource allocation in the smart grid is proposed. This methodology involves modeling of the cyber-physical smart grid substations as ADTs, defining attacker costs, defense costs, and attack probabilities for attack access points. Using game theoretical formulation, optimal defense strategies for the defender of the system to invest cybersecurity resources in the grid are obtained. Additionally, a game-theoretic framework is developed for quantitative cyber-physical risk assessment of the grid under a dynamically changing cyber threat space and uncertain behavior of cyber attackers which is further used to optimize investments in the smart grid's cybersecurity resources. The attacker, defender, and the smart grid system are modeled while incorporating attacker-stochasticity and federal guidelines for smart grid cybersecurity. This allows quantification of threat, vulnerabilities, and attack impact of the grid for quantitative risk assessment. The defender's budget to invest in the security resources in the grid is optimized based on the strategies leading to minimum system risk. The evaluation of the proposed solutions highlight the feasibility for practical implementation of these methodologies and algorithms in the smart grid, while taking the federal requirements and guidelines for smart grid security into consideration. For achieving cybersecurity for system operation, attack prevention, detection, and mitigation algorithms and methodologies are developed specifically for FACTS-based WAVCS. Anomaly detection and mitigation in the WAVCS are achieved using algorithms based on machine learning which involves offline training and testing of ML models with CPS datasets incorporating physics-based features that allow accurate distinction between system faults and cyber attacks. For attack prevention, a methodology based on software defined network (SDN)-based moving target defense (MTD) network routing is proposed that enables prevention of Denial of Service (DoS) type attacks on the smart grid communication system. Subsequently, these methodologies and algorithms are implemented and evaluated on an HIL testbed that allows for real-time attack prevention, detection, and mitigation of emulated cyber attacks on the WAVCS in a close to real-world environment. The results show highly accurate and efficient performance of the implemented algorithms and methodologies with the smart grid system operating within the NERC's system operation limits even in the presence of DoS and data integrity cyber attacks. This work opens up future research opportunities in other directions such as (1) Expanding cybersecurity planning methodologies to real-time cyber contingency analysis with different game formulations; and (2) Applying the cybersecurity for system operation algorithms to broader categories of wide-area control applications.
24 POWER TRANSMISSION AND DISTRIBUTION↗