Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DISPATCHES”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Market-Integrated Optimization of Wind-Battery-Hydrogen Hybrids for Peaking Capacity via Storage

As Integrated Energy Systems (IES) combine multiple energy and storage technologies to provide potentially more value and less risk via resource diversification, complementary overbuild, increased flexibility, and revenue-stacking, IES value is dependent on electricity market dispatch and grid interactions should play an important role in IES design and operation. This study hybridizes and retrofits wind and combustion turbine plants to study the impacts of replacing gas generation capacity with wind, battery, PEM electrolysis, hydrogen tanks and hydrogen turbines. The optimized design is co-simulated in a production cost model with different bidding strategies in order to compare performance and highlight the importance of grid-interactions. We analyze the revenue and dispatch changes as well as the price and cost implications of wind-battery-hydrogen IESs.

electrolysis↗
DOE OSTI2023

Optimization of Energy Storage System Economics and Controls by Incorporating Battery Degradation Costs in REopt

The use of stationary electrochemical energy storage systems utilizing lithium-ion batteries has increased rapidly as the production scale and price for lithium-ion batteries has decreased. These energy storage systems are crucial for maintaining grid resiliency, especially for grids operating with high penetration of renewable energy generation assets or for with a variety of distributed energy generation and storage systems. One challenging factor for the development of battery energy storage systems is estimating the proper sizing, in terms of both power and energy, that minimizes total costs over the lifetime of the systems; this calculation is difficult in simple cases, where a battery is costed independently, but is extremely challenging when building loads and electrical generation by photovoltaic resources are also considered. REopt is a techoeconomic optimization tool developed by NREL to address these challenges. Previously, battery degradation has been priced by simply assuming a 10-year replacement schedule for battery systems. However, this does not account for varying degradation trends observed across real-world batteries, or allow for batteries to be operated in a degradation-aware manner that optimizes battery dispatch based on operating costs. This work incorporates a battery life model into REopt. This battery life model is simple, so that it may be solvable within the constrains of a mixed-integer linear optimization problem, but is fit to accelerated aging data recorded in the lab. To achieve the best possible accuracy for lifetime estimates given these constraints, parameters for the battery life model in REopt are estimated by fitting 20-year simulations of battery life after identifying state-space battery degradation model from accelerated aging data. Comparisons of battery life predicted in REopt and from the state-space battery degradation model to ensure validity of lifetime estimates made by REopt. Battery life and cost is optimized by controlling three decision to minimize system life cost: battery sizing, daily state-of-charge, and daily energy-throughput. The cost of battery degradation as a function of these control variables is then estimated assuming two possible maintenance strategies: replacement, where the entire battery system is replaced if cell reach an end-of-life capacity threshold; and augmentation, which establishes a fund to pay for continual purchase of new batteries to maintain the initial energy capacity of the system. These two strategies offer conservative (for replacement) and optimistic (for augmentation) bounds for total system cost. The degradation cost incurred by these strategies is then used to control battery dispatch decisions, operating the battery in a degradation-aware manner that maximizes battery lifetime while also providing energy when favorable. Because the mixed-integer linear program has perfect foresight of future energy needs, batteries with degradation costs are always operated using 'just-in-time' charging, which is unrealistic, as no energy is left in the storage system to perform other energy services or to serve as emergency back-up power. To combat this, an inequality constraint on the average annual state-of-charge is imposed, and the sensitivity of system cost to average stored energy, e.g., the cost of system resiliency, can be quantified. Analysis of results has several conclusions, for instance, oversizing of battery storage systems is not a cost burden when battery storage is an optimal solution, as any additional battery capacity can simply be utilized to avoid costs of purchasing energy from a utility.

battery↗
DOE OSTI2023

Design of a Geothermal Power Plant With Solar Thermal Topping Cycle: Preprint

Geothermal power plants are a reliable source of low-carbon power generation. However, modern electricity markets comprise relatively large proportions of variable renewable energy generation that may require power plants to dispatch energy flexibly. The power output, efficiency, and dispatch flexibility of a geothermal plant can be enhanced by integrating solar thermal energy into the system, as well as possibly compensating against ambient temperature variations. Concentrating Solar Thermal (CST) can generate temperatures much higher than conventional geothermal systems. Using a solar topping cycle is one way to efficiently convert high-temperature solar heat to electricity while also adding lower-temperature heat to the geothermal power cycle, thereby increasing its power output and possibly its efficiency. A hybrid power cycle design is proposed and is simulated using SimTech IPSEpro process modelling software. The design configuration depends upon the expected temperature of the geothermal resource and the quantity of solar heat added at the design point. These design considerations are described and expected performance is calculated. The solar heat addition varies throughout the day and year, therefore off-design models are necessary to assess the impact of solar availability (and ambient temperature) on the power plant performance. Off-design models are developed and combined with hourly weather data to facilitate an evaluation of annual system performance.

concentrating solar power↗
DOE OSTI2023

Design of a Geothermal Power Plant With Solar Thermal Topping Cycle

Geothermal power plants are a reliable source of low-carbon power generation. However, modern electricity markets comprise relatively large proportions of variable renewable energy generation that may require power plants to flexibly dispatch energy. The power output, efficiency, and dispatch flexibility of a geothermal plant can be enhanced by integrating solar thermal energy into the system, as well as possibly compensating against ambient temperature variations. Concentrating solar thermal (CST) can generate temperatures much higher than conventional geothermal systems. Using a solar topping cycle is one way to efficiently convert high-temperature solar heat to electricity while also cascading lower-temperature heat to the geothermal power cycle, thereby increasing its power output and possibly its efficiency. A hybrid power cycle design is proposed and simulated using SimTech IPSEpro process modeling software. The design configuration depends on the expected temperature of the geothermal resource and the quantity of solar heat added at the design point. These design considerations are described and expected performance is calculated. The solar heat addition varies throughout the day and year; therefore, off-design models are necessary to assess the impact of solar availability (and ambient temperature) on the power plant performance. Off-design models are developed and combined with hourly weather data to facilitate an evaluation of annual system performance.

concentrating solar power↗
DOE OSTI2024

Data-Driven Unit Commitment Refinement - a Scalable Approach for Complex Modern Power Grids

Integration of renewable generation, which is often intermittent and decentralized, substantially increases the stochasticity and complexity of power grid operations. Future power systems planning will require significant computational capability to evaluate balance between demand and supply under varying conditions, both temporally and spatially. The standard approach for generation unit commitment is to use mixed-integer linear programming to find the optimal generation schedule considering ramping and generator constraints. In the future grid this poses computational scalability challenges because generation and demand are not known with certainty due to stochasticity in weather and complexity of the grid. To address this challenge, we present a data-driven unit commitment approach that can efficiently include stochastic weather impacts and contingency considerations to improve unit commitment. Our approach uses graph-based data analytics techniques on solutions to the security constrained (and possibly stochastic) economic dispatch problem to identify potential improvements to a given unit commitment. Recent breakthroughs in fully-parallel stochastic economic dispatch software allow this approach to be scalably deployed. Simulations on synthetic South Carolina and Texas grids show this method can improve grid reliability with security constraints over a set of contingencies, while also meaningfully lowering total generation cost.

Holt, Timothy↗
DOE OSTI2022

Demonstrating Advanced Nuclear Energy Solutions for Net Zero

Background/Objectives. The aggressive goals being set by nation states, communities, and private industry for decarbonization of grid electricity, industrial heat sources, and transportation around the world are imperative to mitigating the devastating effects that we are seeing from climate change. Although many of these goals focus on accomplishments by 2035 or 2050, the decisions that we make today won’t just impact the landscape of energy systems for the next 20 or 30 years—they will shape the world’s environment for centuries to come. That means that we can’t just focus on technologies that will get us to 2050, but technologies that will withstand our energy demands over that long-ranging future. Success will require us to utilize all of the clean energy resources that we have available to meet demands for electricity, heat, and steam, and we will need energy carriers such as hydrogen that do not emit additional greenhouse gases at the point of use. Nuclear energy, ranging from technologies in service today to advanced, higher temperature and modular systems that will be in service this decade, will provide a robust complement to renewable energy resources that operate variably. Researchers across the U.S. Department of Energy laboratory complex are working to advance multiple aspects of these clean energy solutions, with many focusing on integrated energy system solutions that leverage all available clean energy assets to meet wide-ranging energy demands. Approach/Activities. Nuclear energy is a proven, zero-emission option during operation that can provide consistent, dispatchable power to meet electricity demands while also providing high-quality heat that can meet energy demands beyond the electricity sector. Energy system design should seek to maximize these assets. As a dispatchable energy source with a small land utilization footprint, nuclear energy can be collocated with renewable resources, and the smaller systems that will be deployed this decade (ranging from a few megawatts to hundreds of megawatts) can be installed right where that energy is needed. Integrated nuclear and renewable systems will enhance power grid reliability and resilience, and they will help stabilize the grid through their increasingly flexible operation. Licensing, installation, and broad adoption of these advanced nuclear energy systems are expected to progress significantly in the 2020s, but this may be longer than desired by some stakeholders wishing to implement impactful clean energy decisions today. However, one must recall that nuclear energy systems will operate for 80 or more years, as is being demonstrated by current fleet nuclear systems. The nuclear community is extremely thorough in reviewing these systems with regard to safety and security; these efforts ensure that the deployed systems will continue to provide reliable, resilient energy over that operational lifetime. That investment of time up front will ensure that we can support energy demands over the centuries to come. While advanced nuclear technologies move through this process, communities and private industry may choose to install renewable generation systems that can later be coupled to the complementary nuclear systems as they become available—thus moving closer to the net zero goals in the near term. Choosing technologies and deployment configurations that allow small modular nuclear powerhouses to be added to these “energy parks” as they become available will ensure that advanced technologies can be readily adopted to support growing demands for clean energy. Results/Lessons Learned. The primary focus of integrated energy systems (IES) research is to assess the technical and economic potential of novel multi-input, multioutput solutions that are expected to enhance energy system flexibility, reliability, and resilience as we pursue a clean energy transition. Various energy applications and product streams beyond electricity are being evaluated, ranging from generation of potable water to production of hydrogen, fertilizers, synthetic fuels, and various chemicals. In early FY23 Idaho National Laboratory (INL) will commission thermal energy generation systems that emulate nuclear fission energy input using electric heating and will allow for integrated system testing with thermal energy storage, hydrogen production via high temperature electrolysis (HTE), and power systems hardware to demonstrate operation of a clean energy park within a microgrid or larger grid infrastructure, supporting up to 450 kW of heat input via electric heating and demonstrating operation of HTE systems at the multi-hundred kW scale. This presentation will highlight the wide array of RD&D being conducted at INL and partner laboratories to develop and deploy nuclear and renewable-based IES that will be key to achieving our net zero goals, including both computational and experimental demonstrations. By working with key collaborators in industry, analytical st

08 HYDROGEN↗
DOE OSTI2023

US 2023/0182605 A1 Network constraint energy management system for electric vehicle depot charging and scheduling

Network constraint energy management system for electric vehicle (EV) depot charging and scheduling. In an embodiment, a power schedule is received from an economic dispatch application for a charging depot comprising EV charging station(s) and distributed energy resource(s). The power schedule may be simulated on a distribution network model of the charging depot, according to load flow analysis, to determine whether any grid-code violations occur. In response to the detection of violation(s), a constraint may be generated for each violating node, and the economic dispatch application may be re-executed with the constraint(s) to produce a new power schedule, until no violations are detected. When not all load demand can be satisfied by the power schedule, a charging schedule may be adjusted to ensure that critical energy requirements are satisfied. The final power and charging schedules may be used to schedule and control power generation and charging in the charging depot.

Hafiz, Faeza↗
DOE OSTI2023

Development of Multiresolution Capabilities for the Holistic Energy Resource Optimization Network (HERON) tool A progress update

INL researchers work on technoeconomic analyses for integrated energy systems (IES) using the Framework for Optimization of ResourCes and Economics (FORCE). Within FORCE, researchers use the Holistic Energy Resource Optimization Network (HERON) tool to conduct optimization of grid portfolios under uncertain market conditions. These optimizations determine optimal capacities for all IES components and strategies for resource dispatch which maximize some economic metric (e.g., net present value). Resource dispatch occurs on finer timescales (typically hours) and thus are asked to respond to a given time series (e.g. hourly load demand profiles for a grid, or pre-determined electricity prices). Volatile and complex bidding dynamics as well as poorly forecasted weather events within deregulated markets add uncertainty to the time series; FORCE can address this uncertainty by training a reduced order model on historical time series and generate unique synthetic time series which represent individual scenarios or realizations of the market. The IES configuration can be simulated under these different sampled realizations and a stochastic optimization is conducted which optimizes the expected value of the desired economic metric. The training of a synthetic time series generator is limited by the chosen time resolution; dynamics can occur on different time scales. Seasonal demand trends can dominate faster dynamical events (such as power outages from certain sectors or severe weather events) which might not get captured correctly by the trained model. In this report, we investigate different ways of addressing the training and generation of time series on multiple time scales using three main algorithms: wavelet decomposition, dynamic mode decomposition, and generative adversarial networks for time series. We demonstrate a time series analysis that yields information on not just the frequency space but also temporal space: where a fast Fourier transform can provide what frequencies dominate, the new algorithms can provide when the frequencies dominate as well. These analyses can help improve IES optimization by allowing researchers to couple simulations at different timescales when it is most needed - seasonal, day-ahead, and real time optimization - with greater computational efficiency. Future work will include implementation of a subset of the proposed algorithms into the FORCE toolset and application of these analyses into multiple timescale optimization.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Valuing EV Managed Charging for Bulk Power Systems

When and where electric vehicle (EV) charging occurs has significant implications for power systems supporting widespread EV adoption, especially with high shares of wind and solar generation. This study extends previous works by leveraging detailed simulation models for EV adoption, EV use, EV charging, and bulk power system operations, and by linking them with methods for describing charging flexibility at both the individual vehicle and aggregate levels. This technical potential study focuses on how the value of EV managed charging (EVMC) changes depending on charging flexibility type (within-charging session or within-week scheduling), dispatch mechanism (direct load control or one of several price-based mechanisms), and managed charging participation rate. We show that naively aggregating EV charging flexibility from individual vehicles into megawatt-scale resources grossly overestimates the flexibility of the fleet, because such aggregate models can unrealistically pair, e.g., one already-fully-charged vehicle's ability to increase load with another already-charging vehicle's ability to accept more charge, effectively requesting a charging rate that is infeasible for the latter vehicle. We find per-vehicle bulk system value is highest at low participation rates for all dispatch mechanisms. Factoring in production cost savings, avoided firm capacity savings, and combustion-related power sector emissions savings, we estimate the value of EVMC at low participation rates (5%) to be $33/vehicle-year to $69/vehicle-yr for within-session charging flexibility and $40/vehicle-yr to $120/vehicle-yr for within-week charging flexibility in an envisioned 2038 New England power system and monetary value reported in 2016 U.S. dollars. At 100% participation, per-vehicle value declines to $25/vehicle-yr to $31/vehicle-yr for within-session charging flexibility and to $29/vehicle-yr to $36/vehicle-yr for within-week charging flexibility; however, 100% participation yields the highest total system savings.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Cold Weather Impacts on Electric School Bus Performance in Aurora, Colorado

This brief highlight details the key takeaways from a project that utilized NLR's Fleet Research, Energy Data, and Insights (FleetREDI) data analysis pipeline related to electric school bus (ESB) operation. ESBs using battery energy as their primary heating source have a higher energy consumption rate in cold weather, which fleet managers can account for when planning ESB purchases and making dispatching and charging decisions. Researchers found that electric school buses operate 2-5 times more efficiently than conventional buses, on average. Cold weather can double electric school bus energy demands, but strategies such as thermal pre-conditioning significantly reduce this effect. Understanding these impacts can help fleets plan charging, dispatching, and purchase decisions.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

HOPP - Hybrid Optimization and Performance Platform

The Hybrid Optimization and Performance Platform, HOPP, is a wind + solar + battery + X design software for optimizing co-located, utility-scale hybrid plants down to the component level for different markets and technoeconomic objectives. Key technology and financial inputs to the HOPP model that inform the objective to be optimized are presented. The layout and performance integration is combined with optimal dispatch and full financial modeling within an optimization framework. With an example scenario, optimal sizing and layout results are shown in a sensitivity analysis of prices for two hybrid configurations.

batteries↗
DOE OSTI2025

A method for assessing economic, environmental, and reliability tradeoffs of interregional transmission connecting ERCOT (the Texas grid) to the eastern and western grids

Reliable development of the power grid is an evolving concern for humanity due to extreme weather that frequently threatens power sector infrastructure. The state of Texas is a uniquely structured testbed for grid planners to study when looking for solutions to development, innovation, and overcoming such challenges. Because of its size and islanded structure, Texas is small enough to model, but big enough to matter. Texas is a global leader in energy production, energy consumption, and maintains an unusually diverse fuel mix. In addition, the state has experienced winter freezes, heat waves, wind storms, droughts and floods that have threatened power sector infrastructure or caused recent blackouts and calls for demand side conservation. One of the most devastating of these events was the North American winter storm, dubbed “Winter Storm Uri” by the Weather Channel, that froze the region in February 2021 and led to an extended power outage event that put the majority of Texan residents in darkness for days. While preparing to avoid such outage events in the future, various tools have been proposed to improve grid reliability, including energy efficiency, demand response, and distributed energy resources. An additional option would be to develop interregional transmission that connects the Texas grid to other national grids. To assess the merits of this idea, we developed a novel, universally-applicable and internationally-relevant framework to study how the Texas grid would evolve alongside access to various interregional ties. This method allows us to stress the synthetic grid structure and analyze how it would respond to the shock of a simulated winter storm event. Our method leverages open-source modeling tools, such as PowerGenome, pyGRETA, and GenX to synthesize unique zonal grid data, construct a consolidated network of model regions, and simulate different developmental pathways of capacity expansion and operational dispatch. We demonstrate our method with an analysis connecting the Electric Reliability Council of Texas (ERCOT), the grid that serves most of Texas, the Western Electricity Coordinating Council (WECC), the grid that serves the western half of the contiguous U.S., and the Eastern Interconnect, the grid that serves the eastern half of the contiguous U.S. Our results indicate that the cost-optimal capacity of interregional transmission connecting the ERCOT grid to other grids lies between 9–13 GW assuming baseline conditions. Building this amount of connecting capacity in one or multiple directions lowers the costs and emissions of development and operation by up to $16 billion and 257 million metric tonnes (MMT) respectively. Additionally, our results show that the interregional connections between ERCOT and other national grids reduce the amount of total load shed required through mild winter storm events. However, our results also show that there is a threshold of very extreme winter storm conditions, spanning multiple service areas, above which the connections exacerbate resource adequacy problems. Therefore, the results indicate that the connections need to be carefully planned alongside the rest of the grid infrastructure to avoid over-reliance on specific resources or technology options.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Hydropower and environmental flow management: System-level trade-offs at Glen Canyon Dam

The research focuses on the Colorado River Basin, specifically examining the Glen Canyon Dam (GCD) and its influence on surrounding aquatic ecosystems. This area is crucial due to its role in hydropower production and its impact on downstream environments, including the Grand Canyon National Park. This study explores the integration of environmental factors into hydro dispatch modeling at GCD to tackle ecological challenges posed by the invasive smallmouth bass (SMB). Utilizing the GTMax SL and SERM models, the research assesses the effects of SMB control experiments on hydropower generation, economic value, and grid stability. The study examines the financial and economic impacts of bypass flows designed to release colder water to prevent SMB spawning, which can significantly reduce hydropower output and increase costs. The research identifies that declining reservoir levels and rising water temperatures in Lake Powell have facilitated SMB spawning, posing a threat to native fish populations like the endangered humpback chub. The findings highlight the importance of adaptive management strategies to balance ecological preservation with hydropower generation amid long-term weather-related challenges. The study underscores the need for comprehensive assessments of flow options to prevent SMB establishment below GCD, considering the broader implications for sediment dynamics and ecological interactions.

Ecological impact assessment↗
DOE OSTI2024

Performance analysis of integrated Nuclear-Solar Energy system sharing same molten salt thermal energy storage

Advanced nuclear reactors may be deployed with integrated thermal energy storage to improve flexibility and maximize revenue. This presents opportunities for thermal integration with concentrating solar power (CSP) to generate component synergies and/or improve performance. Here in this study, a computational model is developed for an integrated nuclear and CSP system that both share the same molten salt thermal energy storage (TES). Optimized dispatch schedules are developed subject to various market conditions, and the ratio of the nuclear to CSP thermal output is also varied. Performance of the combined system is compared to separate nuclear and solar plants, to determine if there is an overall benefit that can be derived from sharing the TES. Given sufficient volatility in electricity prices (e.g., under CAISO market conditions), synergies of up to 8% in net revenue are observed as a result of sharing the same TES, primarily due to improved revenue from enabling operation of the turbine closer to its design point, as well as being able to better take advantage of higher electricity prices. The synergy benefits are largest when the nuclear and solar plants have similar thermal output. However, when prices are less volatile the opposite behavior can be observed and it can be preferable to operate the nuclear plant as a baseload generator.

14 SOLAR ENERGY↗
DOE OSTI2021

Efficient prediction of concentrating solar power plant productivity using data clustering

Concentrating solar power (CSP) plants convert solar energy to electricity and can be deployed with a thermal storage capability to shift electricity generation from time periods with available solar resource to those with high electricity demand or electricity price. Rigorous optimization of plant design and operational strategies can improve the market-competitiveness and commercial viability; however, such optimization may require hundreds of annual performance simulations, each of which can be computationally expensive when including considerations such as optimization of dispatch scheduling, sub-hourly time resolution, and stochastic effects due to uncertain weather or electricity price forecasts. This paper proposes a methodology to reduce the computational burden associated with simulation of electricity yield and revenue for CSP plants over a single- or multi-year period. Data-clustering techniques are employed to select a small number of limited-duration time blocks for simulation that, when appropriately weighted, can reproduce generation and revenue over a single year or within each year of a multi-year period. After selection of appropriate data features and weighting factors defining similarity between time-series profiles, the methodology captured annual revenue within 2.3%, 1.7%, or 1.2% using simulation of 10, 30, or 50 three-day exemplar time blocks, respectively, for each of three single-year location/weather/market scenarios and five plant configurations ranging from low to high solar multiple and storage capacity. When applied to multi-year datasets, the proposed methodology can capture inter-year variability that is unavailable from typical meteorological year (TMY) datasets while simultaneously requiring simulation of less than a single year of data.

14 SOLAR ENERGY↗
DOE OSTI2026

Real-Time Multiregional Market-to-Market Congestion Management Through Exchange of Relief Cost Curve

This paper introduces a novel method for multiregional market-to-market (M2M) coordinated congestion management. It identifies shortcomings in existing M2M approaches, where Regional Transmission Organizations (RTOs) exchange shadow prices and relief requests to optimize congestion relief allocations across interconnected regions. Two methods are proposed to enhance flow and price convergence. The first method proposes that both Regional Transmission Organizations (RTOs) use state-estimator flows directly to determine relief requirements, eliminating delays and potential oscillations caused by using market flows calculated from the prior period under existing M2M approach. The second method involves exchanging transmission relief cost curves, enabling each RTOs to integrate other RTOs' relief costs curve into its real-time security-constrained economic dispatch (SCED). This method can effectively extend the coordination to multiple transmission lines and across more than two RTOs. The alternating direction method of multipliers (ADMM) is also applied to the M2M coordination problem and compared with the proposed methods. Case studies on small and large-scale systems demonstrate the effectiveness of these approaches.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Pricing and Energy Trading in Peer-to-Peer Zero Marginal-Cost Microgrids

Efforts to utilize 100% renewable energy in community microgrids require new approaches to energy markets and transactions to efficiently address periods of scarce energy supply. In this paper we contribute to the promising approach of peer-to-peer (P2P) energy trading in two main ways: analysis of a centralized, welfare-maximizing economic dispatch that characterizes optimal price and allocations, and a novel P2P system for negotiating energy trades that yields physically feasible and at least weakly Pareto-optimal outcomes. Our main results are 1) that optimal pricing is insufficient to induce agents with batteries to take optimal actions, 2) a novel P2P algorithm to addresses this while keeping private information, 3) a formal proof that this algorithm converges to the centralized solution in the case of two agents negotiating for a single period, and 4) numerical simulations of the P2P algorithm performance with up to 10 agents and 24 periods that show it converges on average to total welfare within 0.1% of the social optimum in on the order of 10s to 100s of iterations, increasing with the number of agents, time periods, and total storage capacity.

batteries↗
DOE OSTI2025

Multi-Agent Hierarchical Deep Reinforcement Learning for HVAC Control With Flexible DERs

As electricity consumption in commercial and residential buildings continues to rise, reducing energy costs presents an increasing challenge. Heating, ventilating, and air-conditioning (HVAC) systems, which typically account for 40%-50% of a building's energy use, are prime targets for energy savings. Intelligent control of HVAC temperature through the exploitation of HVAC load flexibility brings significant potential to reduce energy consumption and electricity expenses. The nonlinear models of HVAC systems challenge traditional control methods, while the uncertainty introduced by HVAC load flexibility complicates distributed energy resource (DER) management using conventional optimal dispatch techniques. In response to these challenges, we propose a hierarchical multi-agent deep reinforcement learning (DRL) approach. The lower-level agents focus on balancing comfort and energy conservation, while the upper-level DRL agents optimize the use of DERs to reduce peak demand based on the control outcomes of the HVAC by the lower-level agents. Here, in the upper-level agents, we incorporate a multi-agent structure based on ensemble learning, which acts based on historical and current data without relying on precise load forecasting to address the delayed rewarding issue in DRL. This allows for the effective reduction of energy costs. The proposed method is tested using a real-world microgrid comprising 413 buildings in Southern California, and the results demonstrate that our approach can significantly reduce overall electricity bills while ensuring the comfort of consumers and residents.

24 POWER TRANSMISSION AND DISTRIBUTION↗