Learning optimization proxies for large-scale Security-Constrained Economic Dispatch
Not Available
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not Available
Solar industrial process heat (SIPH) technologies, such as concentrating solar power collectors, could economically replace the steam or heat needs at many industrial sites by providing high-temperature heat transfer fluids (HTFs) such as pressurized water, synthetic-oil, or direct steam. Renewable thermal energy systems (RTES) could be hybridized with different renewable options e.g., flat plate collectors with parabolic trough collectors, or combined with existing heat supplies (e.g., fossil fuels), to give options for targeted SIPH applications, industrial decarbonization and the reduction of fuel consumption. Hybrid solutions and thermal energy storage will be important for the dispatch of heat at optimal times needed by the demand side of the buildings and industrial applications. At present, there is no integrated modeling tool for hybrid RTES, and this paper highlights the development of a renewable thermal hybridization framework for IPH use that is built from existing tools like System Advisor Model. The long-term vision for the framework (through significant further research) is to develop a coupled hybrid energy generation and cost analysis tool, where the tool could help the user in determining the most suitable and cost-effective technologies for their applications. Ongoing work will look to add costs for RTES options and further refinement on the selection of suitable technologies. This future tool could calculate the levelized cost of heat of various RTES hybrid options, by taking the user's solar resource, fuel costs, industrial heat demand profile, available land, and other factors into account to determine the applicability into their process.
The Hydropower Flexibility Framework (HFF) tool focuses on providing the hydropower community with an effective means of assessing optimized hydropower plant outcomes. This tool combines both site specific characteristics, which act to constrain plant operation, and the hydrologic and grid characteristics which drive hydropower plant operation. The hydropower community faces a confluence of factors which drive the importance of developing such a capability, including an aging hydropower fleet subject to a range of modernization opportunities, a large number of hydropower plant relicensing activities which may affect operational requirements, an electrical grid with increasing levels of variable resources which must be balanced to maintain grid stability, and climate change influencing riverine hydrologic patterns outside of design characteristics. With support from the hydropower community, the project team developed the HFF tool and demonstrated the tool through a series of Use Cases. This guidance was developed as a part of the larger HFF tool User’s Manual (see Appendix B), a resource designed to inform other users and to empower community uptake of the tool. The HFF tool, hosted at https://hfftool.com/, was developed with the support of the U.S. Department of Energy (DOE) Water Power Technologies Office (WPTO). EPRI is currently exploring alternatives to support the continued maintenance and functionally of the online tool.
Renewable thermal energy systems (RTES) could be hybridized with different renewable options (e.g., flat plate collectors (FPCs) with parabolic collectors), or combined with existing heat supplies (e.g., fossil fuels), to give options for targeted solar IPH applications, industrial decarbonization and the reduction of fuel consumption. Buildings and industrial thermal energy applications require different temperature ranges, quantities, and rates of thermal energy, and as such require flexible, cost competitive solutions, able to provide heat over various temperature ranges. Hybrid solutions and thermal energy storage (TES) will be important for the dispatch of heat at optimal times needed by the demand side of the buildings and industrial applications. A variety of tools and platforms, such as the System Advisor Model (SAM), can provide hourly thermal yield simulations from single renewable energy (RE) technology options, including FPCs or CSP for solar IPH. We have investigated a variety of approaches to hybrid system modeling for RTES at different temperatures or combinations of technologies and developed an initial framework. The hybridization framework starts by creating a heat stream and raising the temperature of that heat stream by various combinations of RE technologies and other sources such as fossil fuels, new fuels or electric heating in multiple stages, with options for TES and/or waste heat recovery (WHR).
Integrated energy systems (IES) combine, in mutually beneficial ways, power from variable renewable energy sources and nuclear power plants (NPP) to improve economic viability under uncertain market and weather conditions. The open-source Framework for Optimization of Resources and Economics (FORCE) tool suite, developed at Idaho National Laboratory (INL), has enabled comprehensive modeling and simulation of IES. The capabilities within FORCE include grid portfolio optimization through the Holistic Energy Resource Optimization Network (HERON) and the transient process model analysis library HYBRID, among others. Continuous efforts and investments from the IES programs have been made to expand and improve the versatility of the FORCE toolset in fiscal year 2022. Code-coupling and cross-tool communication have been important methods for improving this versatility. This report focuses on an additional workflow in the HERON tool for capacity and dispatch stochastic optimization through integration with the external tool Design Integration and Synthesis Platform to Advance Tightly Coupled Hybrid Energy Systems (DISPATCHES). DISPATCHES was primarily developed by the National Energy Technology Laboratory, in collaboration with other national laboratories, which included INL, universities, and industry partners. It is coupled to a library of algebraic models for specific plant components, and to a framework for stochastic optimization different from that provided in the current Risk Analysis Virtual Environment (RAVEN)-running-RAVEN algorithm in HERON. HERON currently conducts stochastic optimization via an outer-inner loop: it optimizes over variable capacity on the outer loop, and at each step within the capacity parameter space, conducts an inner optimization over scenarios (of market signals, demand, and/or weather patterns) and hourly dispatch throughout a user-specified number of years. On the other hand, DISPATCHES conducts stochastic optimization via an “all-at-once” strategy in which capacity variables are optimized at the same level as dispatch variables, as all scenarios are considered at once. The latter method works especially well for projects of limited size and project length, as the necessary computational power and memory increases with the number of variables and scenarios. The new capability to use the DISPATCHES workflow in HERON enhances standalone simulations by leveraging FORCE tools—namely, the economic metrics from the Tool for Economic Analysis (TEAL) and reduced-order model (ROM) sampling from RAVEN. The initial demonstration of the DISPATCHES workflow simulates an existing nuclear-case flowsheet within the DISPATCHES repository—this models a NPP with a secondary revenue stream for hydrogen production. Electrical output from the plant is converted to hydrogen via a proton-exchange membrane (PEM) electrolyzer, hydrogen tanks are used for storage, and an additional turbine is added for hydrogen combustion. Continued work regarding this FORCE-DISPATCHES integration will include automatic generation of DISPATCHES models from HERON inputs, offering analysts the option of using either the RAVEN-runsRAVEN or DISPATCHES workflow to solve technoeconomic optimization problems.
Climate change, public health, and resilience to power outages are of critical concern to local governments, federal agencies, and the private sector, and are increasingly motivating investments in distributed energy resources (DERs). However, designing a solar-plus-storage system to co-optimize for climate, health, resilience, and energy bill benefits requires complex trade-offs. To address this need, the National Renewable Energy Laboratory has integrated climate and health impacts of grid-purchased electricity and on-site fuel consumption into the publicly-available REopt web tool and API - a techno-economic model that determines the cost-optimal DER system sizes and dispatch strategy. This presentation will provide an overview of the tool's methodology, datasets, and capabilities, including costing emissions into system sizing and dispatch and setting emissions reductions targets. Results of previous work will demonstrate the use of new emissions accounting capabilities by quantifying the impact of including climate and health costs on the optimal resilient microgrid configurations for a hospital, school, and warehouse across 14 U.S. cities.
Distributed energy resources (DERs), including rooftop solar, energy storage, and flexible loads, are gaining popularity as costs decline and as building owners and utilities realize their benefits. DERs can improve distribution system efficiency, help prevent the need for expensive grid upgrades, and increase the resilience of local communities. However, they can also cause difficulties in grid operations and can require controls to achieve their benefits. To address this challenge, NREL researchers have developed a community-scale solution that assesses the impacts of DERs and their control strategies on a distribution system. The framework has been shown to reduce solar photovoltaic (PV) curtailment to 0%, mitigate the adverse impact of solar variability on the distribution voltage, and provide up to 5-day critical load support during emergency events. Utilizing 5 different modules representing the feeder, buildings, home energy management systems, an aggregator, and a utility controller, NREL expects this simulation technology to play a critical role in the continued integration of DERs. According to the Energy Information Administration (EIA), solar curtailments accounted for 94% of the total energy curtailed in the California Independent System Operator (CAISO) in 2020. By enabling Independent System Operators (ISOs) and utility operators to bring solar curtailments to 0%, the electrical grid can become less dependent on fossil-fueled power generation sources. NREL's co-simulation framework contains five major components: Distribution Feeder Model: describes the distribution feeder topology using OpenDSS, including the locations of all DERs. Residential Building Model: simulates a large number of buildings at a high resolution using OCHRETM. The model is equipped to control equipment based on signals from an external module. The model includes major household appliances such as HVAC and a water heater, non-dispatchable load models, a distributed PV system, and a home battery system. Home Energy Management System: optimizes the controls for the devices in a home using foreseeTM. The control can adjust based on the user preferences including cost, comfort, and convenience. In hierarchical control scenarios, where the houses follow signals from an aggregator, the home energy management system provides a flexibility band with a range of power and follows the dispatch signals received from aggregator. Community-Level Aggregator: solves for optimal energy dispatch based on the flexibility bands received from each home and the grid service signal received from the utility controller. Utility-Level Controller: provides grid signals for voltage control using Distributed Energy Resources (DERs), such as solar systems, in the community.
Residential loads, especially heating, ventilation and air conditioners (HVACs) and electric vehicles (EVs), have great potentials to provide demand flexibility which is an attribute of grid-interactive efficient buildings (GEB). Under this new paradigm, first, EV and HVAC aggregator models are developed in this paper to represent the fleet of GEBs, in which the aggregated parameters are obtained based on a new approach of data generation and least squares parameter estimation (DG-LSPE), which can deal with heterogeneous HVACs. Then, a tri-level bidding and dispatching framework is established based on competitive distribution operation with distribution locational marginal price (DLMP). Furthermore, the first two levels form a bilevel model to optimize the aggregators’ payment and to represent the interdependency between load aggregators and the distribution system operator (DSO) using DLMP, and the third level is to dispatch the optimal load aggregation to all residents by the proposed priority list-based demand dispatching algorithm. Finally, case studies on a modified IEEE 33-Bus system illustrate three main technical reasons of payment reduction due to demand flexibility: load shift, DLMP step changes, and power losses. They can be used as general guidelines for better decision-making for future planning and operation of demand response programs.
In the backdrop of global energy transformation, power systems integrating high proportions of renewable energy sources are facing unprecedented challenges in operational stability and dispatch efficiency. To address these challenges, this study introduces a generation-storage coordination real-time dispatch strategy based on Causal Power System Dynamic Reinforcement Learning (CPSDRL). Diverging from traditional reinforcement learning approaches, CPSDRL innovatively incorporates causal inference within the state prediction model - the crux of model-based reinforcement learning - thereby establishing the Power Causal Dynamic Model (PCDM). Assisted by the prior knowledge of power systems, the model significantly enhances prediction accuracy and reliability through a two-stage training process. Utilizing PCDM, this study further applies a direct policy search algorithm to optimize the real-time dispatch strategy. Experimental results indicate that the proposed method improves the stability of generation-storage coordination real-time dispatch and exhibits competitive advantages in sample efficiency and computational speed, compared to traditional model-based and model-free reinforcement learning algorithms. This method is expected to enhance the practicality and adaptability of causal reinforcement learning techniques in power system scheduling and control.
EMOS software performs a real-time hierarchal optimal control for energy systems like multi-port electric vehicles charging site with distributed energy resources (DERs) and energy storage systems (ESSs). It gathers information in real-time from electric vehicles, power grid, and DERs, solves a multi-objective energy management optimization problem, and output setpoint for chargers, ESS converters, DERs converters, and grid converters. The software incorporates a novel integration of two control tasks: a) An Energy Management Optimization (EMO), which is the brain of EMOS controller that gathers information in real-time from EVs [e.g., battery size, state-of-charge (SOC), desired SOC, and charge acceptance curve], grid (e.g., electricity price, allowed feeder capacity, ramp rate limit, and reactive power), and DERs (e.g., prediction for solar generation for PV systems). It solves a control optimization problem in real-time to find optimal setpoint for ESSs power dispatch, EVs charging rate, and grid inverters. The objectives are to (1) minimize the charging cost considering grid energy, demand charges, and battery energy, (2) minimize charging time to meet fast charging criterion, (3) keep high energy level on ESSs at the end of an operating period, while satisfying constraints related to grid, EVs, and power converters. b) Real-Time Energy Management System (RT-EMS) is a rule-based algorithm that has faster response than EMO. It receives optimal setpoint from EMO and actual measurements from the system and modify the setpoint to compensate for any fast disturbance in the system, until a new optimum solution is received. Fast disturbances may include vehicle connect/disconnect, unpredicted variation in DERs profiles, variation in grid voltage, errors in PV generation prediction, and others. In addition, RT-EMS regulates voltage at point of common coupling (PCC) by managing reactive power of grid converters.
Concentrating solar power (CSP) technologies can utilize heat from concentrated sunlight from a field of tracking mirrors to generate electricity, reform fuel, provide process heat, or augment fossil plant heat sources. Electricity-generating power tower systems focus light from thousands of independent heliostats onto a thermal receiver, which uses the focused light to warm a heat transfer fluid (HTF), typically, a molten nitrate salt. The HTF is then sent to a power generation cycle or diverted into thermal energy storage (TES) for later use. Thermal storage is – in principle – a straightforward proposition. However, optimal utilization of a TES resource is complex and multi-faceted: thermal energy may be dispatched to produce electricity immediately upon first availability, or thermal energy may be reserved for next-day peak periods at risk of filling storage and dumping energy, or a portion of the thermal energy can be reserved to maintain equipment temperatures, reducing power cycle startup time, etc. Many possible dispatch permutations variously emphasize producing peak power, operating through transients, expediting daily startup, etc. The best operation strategy can change day-to-day throughout the year, depending on the weather and market pricing forecasts. The project we describe in this report develops a software package that allows users to explore design optimization, operations decisions, and performance characterization of concentrating solar power tower plants. Users interface with the tool through a scripting language, and results are reported in time series tables, plots, runtime logs, and design outputs. Users choose from a list of variables such as tower height, solar multiple, design-point irradiance, thermal storage size, etc., and specify information about the system using a list of parameters. The software can then optimize the specified variables to reduce the cost of energy produced by the system while meeting certain production requirements, accounting for uncertain weather and electricity price forecasts, and correcting for equipment failures or repair time. The software we develop is the first comprehensive design tool of its kind to incorporate all of these aspects while being deployed as open source.
This publication details newly created energy storage and reactor models developed within the HYBRID modeling repository as part of the Department of Energy Office of Nuclear Energy (DOE-NE) Integrated Energy Systems (IES) program, led by Idaho National Laboratory (INL). Model development to-date includes creation of dynamic systems-level models of a pebble bed high temperature gas reactor (HTGR), sodium fast reactor (SFR), compressed air energy storage (CAES), liquid air energy storage (LAES) and Modelica standard library based two-tank sensible heat storage (SHS) in the IES-based HYBRID repository. Models are developed using the latest publicly available data and incorporate the possibility of control strategy inclusion for use with the existing IES modeling, analysis, and optimization toolset. Simulations showcase the abilities of each technology to flexibly operate in ways consistent with IES operation expectations. When these models are available, they can be utilized within different integrated energy park concepts to understand optimal system operation, control, and dispatching. Moreover, given the generic nature of the models, industrial partner technologies can be quickly added to the repository using the existing models as a basis. Additional dynamic models for thermal energy storage concepts can be developed and added to the HYBRID repository as needed. Also detailed in this report are future development goals for the HYBRID repository including adding suites of steady-state models, economic costing information, and reduced-order models. By adding these models in addition to the physical transient models currently existing within HYBRID, HYBRID will be a fully integrable tool for FORCE users.
In this report, we propose a novel model predictive control(MPC)-based real-time conditional self-restoration energy management system (CSR-EMS) for interconnected microgrids (IMGs) integrated with renewable energy sources (RESs) and energy storage systems (ESSs). Superior to the existing IMG self-restoration methods, the “conditionality” of the proposed CSR-EMS can economically realize self-restoration and grid-assisted restoration during energy deficiency or faults, in both islanded and grid-connected modes. Cost minimization is implemented as the objective function to judge in real-time which restoration mode is economically preferred. The proposed CSR-EMS comprises two layers–the lower layer operates locally to eliminate electricity fluctuations created by RESs and ensure economic effectiveness within an MG, whereas the upper layer oversees the real-time operational status of the IMG system and determines power exchange among microgrids (MGs) during abnormalities. In detail, when a microgrid inside the IMG system experiences an energy deficiency, the CSR-EMS, on an MPC basis, intelligently optimizes power production from each dispatchable distributed generator (DG), ESS, power imported from the main grid, and power exchange among the IMGs to maintain the demand–supply balance, while considering system recovery cost, state of charge (SoC) of ESSs and operation modes of the IMGs (i.e., grid-connected or islanded mode). Simulation results and comparisons with existing IMG self-healing EMSs demonstrate the economic efficacy of the proposed CSR-EMS strategy during normal and abnormal operations, which can be used as an energy control framework for modern power systems with multiple interconnected microgrids.
A solid state power substation (SSPS) node is a microgrid that integrates distributed energy resources and loads and injects/absorbs power to/from the SSPS distribution network. It is an essential building block of a futuristic distribution grid network. This paper presents the development and demonstration of optimization use cases of a SSPS DC node. By adopting multi-layer hierarchical control architecture and developing automatic device identification and dynamic optimization formulation algorithms, the SSPS DC node can perform plug-and-play resource integration and seamless transition of the optimized node operation under on and off grid condition without sophisticated algorithms, control mode changes, and user interactions. Four optimization use cases including economic dispatches with price signal changes, a sudden PV power drop, and a single directional meter and its associated costs with sending power back to the grid, and resiliency under a grid inverter trip condition were demonstrated through the real-time controller hardware-in-the-loop simulation.
This publication details newly created energy storage models developed within the HYBRID Modelica repository as part of the Department of Energy Office of Nuclear Energy (DOE-NE) Integrated Energy Systems (IES) program, led by Idaho National Laboratory (INL). Model development to-date includes creation of dynamic systems-level models of concrete, latent heat, and packed-bed thermocline energy storage technologies for deployment in the IES-based HYBRID repository. Models are developed using the latest publicly available data and incorporate the possibility of control strategy inclusion for use with the existing IES modeling, analysis, and optimization toolset. Simulations showcase the abilities of each technology to cyclically charge and discharge when exposed to time-varying boundary conditions. In addition, low-level surrogate models for some of the thermal energy storage technologies were created using Python. These lower order Python files are much cheaper to run (i.e., computationally faster) and thus operate well when incorporated within the stochastic optimization problems run for the IES program. Moreover, economic data was collected for use within the INL-developed Framework for Optimization of ResourCes and Economics (FORCE). This information is incorporated within the FORCE platform. This work has resulted in creation of systems-level models for concrete, latent heat, and thermocline thermal energy storage systems with associated control systems. Now that these models are available, they can be utilized within different integrated energy park concepts to understand optimal system operation, control, and dispatching. Moreover, given the generic nature of the models, industrial partner technologies (e.g., Storworks Power, EnergyNest) can be quickly added to the repository using the existing models as a basis. Additional dynamic models for thermal energy storage concepts can be developed and added to the HYBRID repository as needed.
This publication details newly created energy storage models developed within the HYBRID Modelica repository as part of the Department of Energy Office of Nuclear Energy (DOE-NE) Integrated Energy Systems (IES) program, led by Idaho National Laboratory (INL). Model development to-date includes creation of dynamic systems-level models of a pebble bed high temperature gas reactor (HTGR), liquid air energy storage (LAES), and compressed air energy storage (CAES) in the IES-based HYBRID repository. Models are developed using the latest publicly available data and incorporate the possibility of control strategy inclusion for use with the existing IES modeling, analysis, and optimization toolset. Simulations showcase the abilities of each technology to flexibly operate in ways consistent with IES operation expectations. When these models are available, they can be utilized within different integrated energy park concepts to understand optimal system operation, control, and dispatching. Moreover, given the generic nature of the models, industrial partner technologies can be quickly added to the repository using the existing models as a basis. Additional dynamic models for thermal energy storage concepts can be developed and added to the HYBRID repository as needed.
This publication details newly created energy storage and reactor models developed within the HYBRID modeling repository as part of the Department of Energy Office of Nuclear Energy (DOE-NE) Integrated Energy Systems (IES) program, led by Idaho National Laboratory (INL). Model development to-date includes creation of dynamic systems-level models of a pebble bed high temperature gas reactor (HTGR), compressed air energy storage (CAES), and Modelica standard library based two-tank sensible heat storage (SHS) in the IES-based HYBRID repository. Models are developed using the latest publicly available data and incorporate the possibility of control strategy inclusion for use with the existing IES modeling, analysis, and optimization toolset. Simulations showcase the abilities of each technology to flexibly operate in ways consistent with IES operation expectations. When these models are available, they can be utilized within different integrated energy park concepts to understand optimal system operation, control, and dispatching. Moreover, given the generic nature of the models, industrial partner technologies can be quickly added to the repository using the existing models as a basis. Additional dynamic models for thermal energy storage concepts can be developed and added to the HYBRID repository as needed.
The First Solar Thermal Energy Planner (STEP 1) and Nationwide Industrial Heat and Power Analysis (aka the STEP 1 Project or the Project) aimed to (1) developed a brand-new web tool that could provide decision support through free, rapid techno-economic analysis of behind-the-meter solar+storage systems for industrial process heat and (2) conduct high-level analyses of the cost-competitiveness of the same systems across the US in key sectors. The STEP 1 web tool collects key location, land availability, thermal load profile, proccess heat temperature and media, and other key parameters through an easy-to-use user interface (UI). The UI was designed to meet the user at their level of understanding by minimizing the number of required inputs as much as possible while including options for more nuanced inputs if the user desires. STEP 1 advises users on which solar thermal tehcnologies that could fit their needs based on the inputs provided (namely process media and temperature). The tool can model a wide range of solar thermal technologies including flat plate collectors, evacuated tubes, parabolic troughs, linear Fresnel, and molten salt towers all with corresponding thermal energy storage (TES) - solar PV with resistive heating and TES is also included. Once the parameters are collected, a nominal thermal energy production profile for the facility's location is generated using NREL's System Advisory Model (SAM) and then passed to a modified version of NREL's REopt platform to optimize the size (capacity) and dispatch of the solar+storage system to minimize lifecycle costs subject to energy balance, fuel and electricity rates, emission reductions goals, and other constraints. This entire process takes less than 20 minutes, is completely free, requires zero coding skills, and provides the user with a high-level assessment on the techno-economic feasability of deploying solar+storage systems for their energy needs. In addition to the development of the STEP 1 web tool, the project completed two complementary analyses focused on leveraging the backend code of STEP 1, public industrial facility locations and fuel consumption data, and key sector information to assess the economic opportunity of reducing fuel costs at various levels of capacity factor around the US. Both analyses found that there are key markets, locations, industrial sectors (namely food and beverage), and degrees of offset where solar thermal technologies could be cost-effectively deployed, highlighting a key market entry point for these technologies, and assessing deployment potential. In summary, the STEP 1 project improved the opportunities for solar+storage systems to expand into the industrial process heat market through breaking down barriers to assessing these technologies.