Results for “load uncertainty” — Page 18

DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗

NASA NTRS2019

Testing of Heat Flux Sensors at Cryogenic Temperatures

Normally, in order to characterize multilayer insulation installed onto a test tank, the boil-off of the tank is measured and then heat loads from structural and fluid penetrations are calculated from temperature measurements throughout the system. For the Structural Heat Intercept, Insulation, and Vibration Evaluation Rig testing, it was determined that this approach would have significant uncertainties (over 50%) and that another method was needed to characterize the heat load through the blanket. Heat flux sensors are widely used to measure heat loads and characterize insulation systems at room temperature, however, the heat fluxes measured are usually two orders of magnitude higher than high performance MLI. Three different heat flux sensors were initially checked out on a liquid hydrogen calorimeter. One was chosen for actual implementation and 20 sensors were ordered. Of those sensors, calibration was attempted on 7 of the sensors. The results from testing and calibration are discussed.

cryogenic fluid management↗

DOE OSTI2020

Time-of-Use and Demand Charge Battery Controller Using Stochastic Model Predictive Control

Stationary batteries in residential and commercial buildings are often used to smooth customer load profiles and to lower customer electricity bills. Controllers for these battery systems should account for customer energy consumption, rate structures, and high internal battery temperatures, which can lead to reduced performance over the battery lifetime. It is important to consider the uncertainty in forecasting energy consumption and temperature, especially for customers with highly variable and uncertain loads. We propose a novel battery controller using stochastic model predictive control that accounts for these uncertainties and can handle complex rate structures, including demand charges. We show that the controller performs better than standard model predictive control when there is significant uncertainty in the forecast. We also show improvements in the performance with more accurate forecasts and with a more aggressive control strategy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

Time-of-Use and Demand Charge Battery Controller Using Stochastic Model Predictive Control: Preprint

Stationary batteries in residential and commercial buildings are often used to smooth customer load profiles and to lower customer electricity bills. Controllers for these battery systems should account for customer energy consumption, rate structures, and high internal battery temperatures, which can lead to reduced performance over the battery lifetime. It is important to consider the uncertainty in forecasting energy consumption and temperature, especially for customers with highly variable and uncertain loads. We propose a novel battery controller using stochastic model predictive control that accounts for these uncertainties and can handle complex rate structures, including demand charges. We show that the controller performs better than standard model predictive control when there is significant uncertainty in the forecast. We also show improvements in the performance with more accurate forecasts and with a more aggressive control strategy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2021

Battery Control Using Stochastic Model Predictive Control

Stationary batteries in residential and commercial buildings are often used to smooth customer load profiles and to lower customer electricity bills. Controllers for these battery systems should account for customer energy consumption, rate structures, and high internal battery temperatures, which can lead to reduced performance over the battery lifetime. It is important to consider the uncertainty in forecasting energy consumption and temperature, especially for customers with highly variable and uncertain loads. We propose a novel battery controller using stochastic model predictive control that accounts for these uncertainties and can handle complex rate structures, including demand charges. We show that the controller performs better than standard model predictive control when there is significant uncertainty in the forecast. We also show improvements in the performance with more accurate forecasts and with a more aggressive control strategy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS2013

Evaluating Global Emission Inventories of Biogenic Bromocarbons

Emissions of halogenated very short-lived substances (VSLS) are poorly constrained. However, their inclusion in global models is required to simulate a realistic inorganic bromine (Bry) loading in both the troposphere, where bromine chemistry perturbs global oxidizing capacity, and in the stratosphere, where it is a major sink for ozone (O3). We have performed simulations using a 3-D chemical transport model (CTM) including three top-down and a single bottom-up derived emission inventory of the major brominated VSLS bromoform (CHBr3) and dibromomethane (CH2Br2). We perform the first concerted evaluation of these inventories, comparing both the magnitude and spatial distribution of emissions. For a quantitative evaluation of each inventory, model output is compared with independent long-term observations at National Oceanic and Atmospheric Administration (NOAA) ground-based stations and with aircraft observations made during the NSF (National Science Foundation) HIAPER Pole-to-Pole Observations (HIPPO) project. For CHBr3, the mean absolute deviation between model and surface observation ranges from 0.22 (38 %) to 0.78 (115 %) parts per trillion (ppt) in the tropics, depending on emission inventory. For CH2Br2, the range is 0.17 (24 %) to 1.25 (167 %) ppt. We also use aircraft observations made during the 2011 Stratospheric Ozone: Halogen Impacts in a Varying Atmosphere (SHIVA) campaign, in the tropical western Pacific. Here, the performance of the various inventories also varies significantly, but overall the CTM is able to reproduce observed CHBr3 well in the free troposphere using an inventory based on observed sea-to-air fluxes. Finally, we identify the range of uncertainty associated with these VSLS emission inventories on stratospheric bromine loading due to VSLS (Br(VSLS/y)). Our simulations show Br(VSLS/y) ranges from approximately 4.0 to 8.0 ppt depending on the inventory. We report an optimized estimate at the lower end of this range (approximately 4 ppt) based on combining the CHBr3 and CH2Br2 inventories which give best agreement with the compilation of observations in the tropics.

bromocarbons↗

DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DERs) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline controller.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2021

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2026

Storing Affordability: Battery Storage as an Asset to Reduce Data Center Cost Shifts

This report examines how battery energy storage systems (BESS) can help utilities accommodate large load growth while protecting affordability for existing ratepayers. Rapid growth in electricity demand from artificial intelligence (AI) data centers is straining the U.S. grid. Furthermore, many new data centers are entering rural markets, which could offer economic benefits but may also pose implementation challenges for smaller utilities. At the same time, retail electricity prices are increasing faster than inflation, elevating customer affordability as a key challenge. While data centers have not been the primary driver of increases in residential prices to date, they have pushed wholesale energy and capacity prices higher in several markets. Fundamental utility cost-allocation principles show that data center growth can be rate-positive for existing customers only if new peak demand grows faster than the costs a utility must incur to serve it. Several factors, including a utility’s degree of wholesale market exposure, forecast uncertainty and stranded-asset risk, and tariff design can determine the outcome of load growth on retail rates. Energy storage can make several affordability contributions in the face of this landscape of uncertainty and market volatility, including deferral of higher-cost grid investments through improved utilization of existing assets and flexibility of new large loads, insulation from volatile wholesale prices through peak shaving, and reliability support to address grid risks stemming from the behavior of AI data center loads. Different potential BESS deployment pathways—utility-scale front-of-the-meter systems, aggregated small-scale storage installations, and data center-sited behind-the-meter storage—are compared against each other and against conventional capacity alternatives. This framework is intended as a conceptual resource to utilities, particularly smaller public utilities with rural service territories, who may be considering the role that energy storage can play in insulating existing ratepayers from data center cost shifts.

25 ENERGY STORAGE↗

DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning: Preprint

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2025

Fuel Property Effects on Stochastic Preignition Events During Engine Load Transitions

Stochastic preignition (SPI) is an abnormal combustion phenomenon that can cause catastrophic engine damage. There have been several proposed mechanisms of SPI, where a uniform source is still not certain, however, SPI tendencies have been shown to be influenced by engine operating conditions, oil composition, engine age, and fuel chemical and physical properties. Laboratory research and testing for SPI propensity is challenging given the stochastic nature of events, as well as the potential for significant degradation of the engine platform and measuring equipment over time. Thus, SPI specific experiments are generally conducted under either sustained or cyclic patterning of steady-state operating conditions to avoid the influence of transient engine boundary conditions on test parameters of interest (e.g. oil additive package, fuel properties, engine speed/load, etc.). In this work a cyclically varying SPI test sequence involves a 5 min engine warmup period at a low engine load of around 4 bar gross indicated mean effective pressure (IMEPg), followed by a transition to high load (~20 bar IMEPg) at a constant 2000 rev/min engine speed for a total of 25 min. This individual test sequence load schedule is then sequentially repeated 10 times to generate significant statistical data for analysis. This work examines the influence of fuel chemical and physical properties on SPI tendency during the unsteady portion of the 10-cycle sequence (the first 5 min of the high load operation in each sequence of the loading cycle) which has been discarded from previous analyses due to the uncertainty in engine operating and thermal boundary conditions. Results from this analysis suggest an increasing trend in the ratio of SPI events during the unsteady test period relative to the steady test period with increasing fuel Reid Vapor Pressure (RVP), implying differences in uncontrolled ignition source terms, possibly from, fuel wall interactions and retention during the load transition phase of the test.

Splitter, Derek [ORNL] (ORCID:0000000174044047)↗

DOE OSTI2022

Hybrid-RL-MPC4CLR (Hybird-Reinforcement-Learning-Model-Predictive-Control-for-Reserve-Policy-Assisted-Critical-Load-Restoration-in-Distribution-Grids)

Hybrid-RL-MPC4CLR was developed as a hybrid controller for active distribution grid critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. The RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while the MPC models grid operations incorporating the RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. The developers formulated the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The software is developed using various software packages in Python. The MPC's optimal power flow (OPF) model is implemented using the Pyomo package, the RL simulation environment is implemented using the MPC simulation with various scenarios of renewable energy and load demand profiles and power outage beginning times, based on the OpenAI Gym framework. The RL agent training is performed using the RLlib Ray package. The RL algorithm is trained offline using historical forecasts of renewable generation and load demand profiles. Simulation analysis and performance tests are conducted using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery.

Eseye, Abinet Tesfaye↗

DOE OSTI2021

Occupancy-Driven Stochastic Decision Framework for Ranking Commercial Building Loads

For effective integration of building operations into the evolving demand response programs of the power grid, real-time decisions concerning the use of building appliances for grid services must excel on multiple criteria, ranging from the added value to occupants' comfort to the quality of the grid services. In this paper, we present a data-driven stochastic decision-support framework to dynamically rank load control alternatives in a commercial building, addressing the needs of multiple decision criteria (e.g. occupant comfort, grid service quality) under uncertainties in occupancy patterns. We adopt a stochastic multi-criteria decision algorithm recently applied to prioritize residential on/off loads, and extend it to i) consider complex load control decisions (e.g. dimming of lights, changing zone temperature set-points) in a commercial building; and ii) systematically integrate zonal occupancy patterns to better identify short-term (and time-varying) opportunities for grid service participation. We evaluate the performance of the proposed framework for curtailment of air-conditioning, lighting, and plug-loads in a multi-zone commercial office building for a range of design choices. With the help of a prototype system that integrates an interactive \textit{Data Analytics and Visualization} frontend we demonstrate a way for the building operators to monitor and change in real-time the available flexibility in energy consumption and to develop trust in the decision recommendations by interpreting the rationale behind the ranking.

Jain, Milan↗

DOE OSTI2022

Field quality of the 4.5 m-long MQXFA pre-series magnets for the HL-LHC Upgrade as observed during magnet assembly

We report that the U.S. High-Luminosity LHC Accelerator Upgrade Project (HL-LHC AUP) is developing MQXFA magnets, a series of 4.5 m long 150 mm aperture high-field Nb 3 Sn quadrupole magnets for the HL-LHC upgrade at CERN. Five pre-series magnets, MQXFA03 through MQXFA07, have been developed. During the magnet assembly stage, we perform magnetic measurements on the coil-pack sub-assembly and magnets after loading to track the field quality for two purposes. First, it serves as a quality assurance tool to check if the magnetic field quality is on track to meet the acceptance criteria. Magnetic measurements are used to understand if magnetic shims are needed to compensate low-order field errors and to meet the field quality targets. Second, the measurements during the assembly stage can also help understand the field quality, especially the geometric field errors, for Nb 3 Sn accelerator magnets. Here we summarize the measurement results of the pre-series MQXFA magnets, including the magnetic axis and twist angle. The results will provide useful feedback for the series production of Nb 3 Sn magnets and on the optimization of field quality of accelerator magnets based on the wind-and-react Nb 3 Sn technology.

43 PARTICLE ACCELERATORS↗

DOE OSTI2021

Distributional Deep Reinforcement Learning-Based Emergency Frequency Control

Emergency frequency control is one of the most critical approaches to maintain power system stability after major disturbances. With the increasing number of grid-connected renewable energy sources, existing model-based methods of frequency control are facing up with challenges of computational speed and scalability for large-scale systems. In this paper, the emergency frequency control problem is formulated as a Markov Decision Process (MDP) and solved through a novel Distributional Deep Reinforcement Learning (DDRL) method, namely the distributional soft actor critic (DSAC) method. Compared with other RL methods that only estimate the mean value, the proposed DSAC model estimates the distribution of value function over returns. This advancement can lead to more insights and knowledge for the agent, with the benefit of a much faster and more stable learning process, and the improved frequency control performance. Here, the simulation results on IEEE 39-bus and IEEE 118-bus systems demonstrate the effectiveness and robustness of proposed models, as well as the advantage compared to other state-of-the-art DRL algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Impacts of EPA’s finalized power plant greenhouse gas standards

Emissions reductions may be met with relatively small costs.

Bistline, John↗

DOE OSTI2021

CSRI Summer Proceedings 2021

The Computer Science Research Institute (CSRI) brings university faculty and students to Sandia National Laboratories for focused collaborative research on Department of Energy (DOE) computer and computational science problems. The institute provides an opportunity for university researches to learn about problems in computer and computational science at DOE laboratories, and help transfer results of their research to programs at the labs. Some specific CSRI research interest areas are: scalable solvers, optimization, algebraic preconditioners, graph-based, discrete, and combinatorial algorithms, uncertainty estimation, validation and verification methods, mesh generation, dynamic load-balancing, virus and other malicious-code defense, visualization, scalable cluster computers, beyond Moore’s Law computing, exascale computing tools and application design, reduced order and multiscale modeling, parallel input/output, and theoretical computer science. The CSRI Summer Program is organized by CSRI and includes a weekly seminar series and the publication of a summer proceedings.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

CSRI Summer Proceedings 2021

The Computer Science Research Institute (CSRI) brings university faculty and students to Sandia National Laboratories for focused collaborative research on Department of Energy (DOE) computer and computational science problems. The institute provides an opportunity for university researches to learn about problems in computer and computational science at DOE laboratories, and help transfer results of their research to programs at the labs. Some specific CSRI research interest areas are: scalable solvers, optimization, algebraic preconditioners, graph-based, discrete, and combinatorial algorithms, uncertainty estimation, validation and verification methods, mesh generation, dynamic load-balancing, virus and other malicious-code defense, visualization, scalable cluster computers, beyond Moore’s Law computing, exascale computing tools and application design, reduced order and multiscale modeling, parallel input/output, and theoretical computer science. The CSRI Summer Program is organized by CSRI and includes a weekly seminar series and the publication of a summer proceedings.

97 MATHEMATICS AND COMPUTING↗