SEARCH · Engineering Papers

Results for “grid integration study”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

All sources NASA NTRS DOE OSTI

DOE OSTI2021

A HPC Theory-Guided Machine Learning Cyberinfrastructure for Communicating Hydrometeorological Data Across Scales

High-resolution predictions of hydrometeorological variables are critical for supporting hydropower generation decisions and flood control at hydroelectric power plants. Traditional climate and hydrologic models rely on the numerical simulation of detailed physical processes. Therefore, running these simulations is time-, labor-, and computation-intensive. Improving the spatial and temporal resolution in these modeling outputs could lead to cubic increases in both the simulation time and computational demands, rendering high-resolution hydrometeorological predictions expensive and impractical. Many past studies apply the super resolution (SR) technique to downscale climate models using deep learners. However, deep learners are deemed “black-boxes,” as their derivation processes from low-resolution outputs to high-resolution outputs are often hidden. Their results are difficult for domain scientists to interpret and validate. Thus, there is a need for an exploratory machine learning approach that can partially integrate domain-specific theory and knowledge into the data-driven mapping process between simulation outputs of different spatial scales. The domain-specific theory and knowledge can be incorporated into the data model through an inductive approach in which process-related environmental variables are used and analyzed as key drivers (i.e., environmental surrogates) to reflect the complex physical processes. Many of these variables, such as land use land cover, soil types, topography, digital elevation, air temperature, and various watershed characteristics, can be directly measured through sensors or remote sensing techniques. Additionally, SR applications that can downscale hydrological and hydrodynamics models to efficiently produce high-resolution (1 m) flood depth grids are still rare. Since the flood depth grid can be used to support critical decisions for flood control operation at hydroelectric power plants, it is crucial to enable an SR-based capability for interpolating high-resolution flood inundation maps.

13 HYDRO ENERGY↗

DOE OSTI2022

Reliability and Integrity Management Program Implementation Approach

Nuclear energy is the most reliable and environmentally sustainable energy source available today. In the United States, nuclear-generated power accounts for approximately 20% of total electricity and over 55% of clean energy. New advanced reactors have enormous potential to help further decarbonize the energy market, enhance grid resiliency, create new jobs, and build a stronger economy. More than 50 new reactors are being developed in the United States, and the federal government realizes an urgent need to deploy nuclear technologies to meet the country’s energy, environmental, and national security goals. As such, the U.S. Department of Energy launched multiple programs to support advanced reactor deployment. The research described in this paper explores implementation strategies for the Reliability and Integrity Management Program that directly supports the U.S. Department of Energy goal to enable the near-term deployment of the advanced reactor technologies. The project is conducted under the Regulatory Development Program for advanced reactors sponsored by the U.S. Department of Energy.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

Investigation and Demonstration of Reliability Target Allocation to Support Reliability and Integrity Management Program

Nuclear energy is the most reliable and environmentally sustainable energy source available today. In the United States (U.S.), nuclear-generated power accounts for approximately 20% of total electricity and over 55% of clean energy. New advanced reactors have enormous potential to help further decarbonize the energy market, enhance grid resiliency, create new jobs, and build a stronger economy. More than 50 new reactors are being developed in the U.S., and the federal government realizes an urgent need to deploy nuclear technologies to meet the country’s energy, environmental, and national security goals. As such, the U.S. Department of Energy (DOE) launched multiple programs to support advanced reactor deployment. The research described in this report explores implementation strategies for the Reliability and Integrity Management Program that directly supports the DOE goal to enable the near-term deployment of the advanced reactor technologies. The project is conducted under the Regulatory Development Program for advanced reactors sponsored by the DOE.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

Urban heat islands can influence the wind energy resource during heatwaves

Urban wind energy is critical for sustainable electricity generation in cities. However, little research has explored how the urban heat island (UHI) effect influences wind energy, particularly in heatwaves when energy demand surges. In this study, we examine wind energy distribution in the Boston–Providence metropolitan area during heatwaves, using Weather Research and Forecasting (WRF) model integrated with Building Energy Parameterization/Building Energy Model (BEP/BEM). Two scenarios, a realistic case and a hypothetical case without urban warmth, were compared to isolate UHI impacts. Results reveal that UHI induces a "wind energy loss zone" in this urban area, reducing wind power density (WPD) by 20–30 W/m 2 at 50–100 m, while suburban/rural areas exhibit a "wind energy gain zone," with WPD increases up to 40 W/m 2 at 150–200 m. These losses diminish with distance from urban centers and become negligible beyond main urban and suburban sprawl. Heatwave expands the urban "loss zone", while amplifying wind energy gains in suburban/rural areas, driven by stronger thermal gradients and weakened background winds that intensify air convergence in urban and urban-rural circulations, thereby exacerbating urban wind energy losses by 15–20 %. An analysis of 235 wind farms using turbine power curves reveals that built areas dependent on stand-alone or off-grid turbines face significant energy deficits during a heatwave. Wind energy drops by up to 25 %, while cooling-related building energy demand rises 30–40 % during a heatwave. These findings underscore the need for strategic urban wind energy planning to ensure reliable power during extreme heat.

Energy - Wind↗

DOE OSTI2024

Early Exploration of a Flexible Framework for Efficient Quantum Linear Solvers in Power Systems

The rapid integration of renewable energy resources presents formidable challenges in managing power grids. While advanced computing and machine learning techniques offer some solutions for accelerating grid modeling and simulation, there remain complex problems that classical computers cannot effectively address. Quantum computing, a promising technology, has the potential to fundamentally transform how we manage power systems, especially in scenarios with a higher proportion of renewable energy sources. One critical aspect is solving linear systems of equations, crucial for power system applications like power flow analysis, for which the Harrow-Hassidim-Lloyd (HHL) algorithm is a well-known quantum solution. However, HHL quantum circuits often exhibit excessive depth, making them impractical for current Noisy-Intermediate-Scale-Quantum (NISQ) devices. In this paper, we introduce a versatile framework, powered by NWQSim, that bridges the gap between power system applications and quantum linear solvers available in Qiskit. This framework empowers researchers to efficiently explore power system applications using quantum linear solvers. Through innovative gate fusion strategies, reduced circuit depth, and GPU acceleration, our simulator significantly enhances resource efficiency. Power flow case studies have demonstrated up to a eight-fold speedup compared to Qiskit Aer, all while maintaining comparable levels of accuracy.

quantum computing, Harrow-Hassidim-Lloyd, high-per↗

DOE OSTI2025

Advances in supervisory control strategies for a heat pump centric HVAC system − a comprehensive review on applications

There is an increase in research investigating the development and deployment of supervisory controllers that enable high efficiency electrically driven vapor compression heat pumps operating within grid interactive efficient buildings to provide demand side management. This paper reviews over sixty relevant case studies within this domain that focus on commercial off-the-shelf heat pumps whose primary task is providing space conditioning. The concept of a heat pump-centric heating, ventilation, and air-conditioning system is introduced, accompanied by a detailed overview of various kinds of electric heat pumps and building-level thermal energy storage configurations. Additionally, the different types of supervisory controller designs, including rule-based control and model predictive control, are discussed, along with the various methods for communication between a supervisory controller and a downstream heat pump’s local controller. A comparative analysis is conducted in order to categorize the reviewed case studies based on their system design, supervisory control algorithm, and validation methodology. This detailed analysis allows the review to establish current research trends, identify potential gaps, and suggest future directions for the development of this technology. Overall, the authors recommend that more future research be devoted to low-cost practical retrofits that allow for easy integration of active thermal energy storage within heat pump-centric heating, ventilation, and air-conditioning system systems that utilize direct expansion heat pumps. We also suggest more research into the development and deployment of supervisory controllers that can properly communicate with commercial off-the-shelf heat pump local controller available control inputs, e.g., zone temperature setpoint. Lastly, more rigorous experimental demonstrations of advanced supervisory control within real and or closed-loop, transient/ quasi-steady state environments are necessary to reduce industry wide skepticism of this technology.

Demand side management↗

DOE OSTI2025

Coupled Induction Machine and HVAC Models for Simulating HVAC Performance Considering Grid Dynamics in Buildings

This paper presents the development of novel models that integrate induction machines with HVAC equipment, such as pumps, heat pumps, and chillers, to analyze the impact of electrical parameters on the operational performance of thermo-fluid systems. The proposed model employs a coupling technique that captures the dynamic interactions between induction machines and HVAC systems. By integrating electrical, thermal, and mechanical dynamics, the models provide a comprehensive framework for simulating real-world scenarios, including interactions with the electrical grid. This achievement was made possible through the development of a Computationally Efficient and Accurate Induction Machine (CEAIM) model. Implemented using the equation-based Modelica language, the CEAIM model has been validated against experimental results, manufacturer data sheets, and various operating conditions. Its performance has been compared with existing induction machine models in the Modelica Standard Library (MSL), demonstrating superior accuracy and computational efficiency. The CEAIM model predicts torque, speed, and power consumption with a coefficient of determination (R 2 ) ranging from 0.98 to 1 and a coefficient of variation of root mean square error (CVRMSE) between 0.27% and 6.67%. Additionally, CEAIM scales more efficiently than conventional MSL models, with a slower computational growth rate in large-scale simulations. After thorough validation of the CEAIM model, it was coupled with HVAC equipment as this approach provides a detailed multi-dimensional view of capturing electrical transients and mechanical performance. To support this, a case study was conducted to showcase its capabilities.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Sustainable Campus with PEV and Microgrid

Market penetration of electric vehicles (EVs) is gaining momentum, as is the move towards increasingly distributed, clean and renewable electricity sources. EV charging shifts a significant portion of transportation energy use onto building electricity meters. Hence, integration strategies for energy-efficiency in buildings and transport sectors are of increasing importance. This paper focuses on a portion of that integration: the analysis of an optimal interaction of EVs with a building-serving transformer, and coupling it to a microgrid that includes PV, a fuel cell and a natural gas micro-turbine. The test-case is the Nanyang Technological University (NTU), Singapore campus. The system under study is the Laboratory of Clean Energy Research (LaCER) Lab that houses the award winning Microgrid Energy Management System (MG-EMS) project. The paper analyses three different case scenarios to estimate the number of EVs that can be supported by the building transformer serving LaCER. An approximation of the actual load data collected for the building into different time intervals is performed for a transformer loss of life (LOL) calculation. The additional EV loads that can be supported by the transformer with and without the microgrid are analyzed. The numbers of possible EVs that can be charged at any given time under the three scenarios are also determined. The possibility of using EV fleet at NTU campus to achieve demand response capability and intermittent PV output leveling through vehicle to grid (V2G) technology and building energy management systems is also explored.

Singh, Reshma↗

DOE OSTI2021

INTEGRATE - Inverse Network Transformations for Efficient Generation of Robust Airfoil and Turbine Enhancements

The INTEGRATE (Inverse Network Transformations for Efficient Generation of Robust Airfoil and Turbine Enhancements) project is developing a new inverse-design capability for the aerodynamic design of wind turbine rotors using invertible neural networks. This AI-based design technology can capture complex non-linear aerodynamic effects while being 100 times faster than design approaches based on computational fluid dynamics. This project enables innovation in wind turbine design by accelerating time to market through higher-accuracy early design iterations to reduce the levelized cost of energy. INVERTIBLE NEURAL NETWORKS Researchers are leveraging a specialized invertible neural network (INN) architecture along with the novel dimension-reduction methods and airfoil/blade shape representations developed by collaborators at the National Institute of Standards and Technology (NIST) learns complex relationships between airfoil or blade shapes and their associated aerodynamic and structural properties. This INN architecture will accelerate designs by providing a cost-effective alternative to current industrial aerodynamic design processes, including: - Blade element momentum (BEM) theory models: limited effectiveness for design of offshore rotors with large, flexible blades where nonlinear aerodynamic effects dominate - Direct design using computational fluid dynamics (CFD): cost-prohibitive - Inverse-design models based on deep neural networks (DNNs): attractive alternative to CFD for 2D design problems, but quickly overwhelmed by the increased number of design variables in 3D problems AUTOMATED COMPUTATIONAL FLUID DYNAMICS FOR TRAINING DATA GENERATION - MERCURY FRAMEWORK The INN is trained on data obtained using the University of Marylands (UMD) Mercury Framework, which has with robust automated mesh generation capabilities and advanced turbulence and transition models validated for wind energy applications. Mercury is a multi-mesh paradigm, heterogeneous CPU-GPU framework. The framework incorporates three flow solvers at UMD, 1) OverTURNS, a structured solver on CPUs, 2) HAMSTR, a line based unstructured solver on CPUs, and 3) GARFIELD, a structured solver on GPUs. The framework is based on Python, that is often used to wrap C or Fortran codes for interoperability with other solvers. Communication between multiple solvers is accomplished with a Topology Independent Overset Grid Assembler (TIOGA). NOVEL AIRFOIL SHAPE REPRESENTATIONS USING GRASSMAN SPACES We developed a novel representation of shapes which decouples affine-style deformations from a rich set of data-driven deformations over a submanifold of the Grassmannian. The Grassmannian representation as an analytic generative model, informed by a database of physically relevant airfoils, offers (i) a rich set of novel 2D airfoil deformations not previously captured in the data , (ii) improved low-dimensional parameter domain for inferential statistics informing design/manufacturing, and (iii) consistent 3D blade representation and perturbation over a sequence of nominal shapes. TECHNOLOGY TRANSFER DEMONSTRATION - COUPLING WITH NREL WISDEM Researchers have integrated the inverse-design tool for 2D airfoils (INN-Airfoil) into WISDEM (Wind Plant Integrated Systems Design and Engineering Model), a multidisciplinary design and optimization framework for assessing the cost of energy, as part of tech-transfer demonstration. The integration of INN-Airfoil into WISDEM allows for the design of airfoils along with the blades that meet the dynamic design constraints on cost of energy, annual energy production, and the capital costs. Through preliminary studies, researchers have shown that the coupled INN-Airfoil + WISDEM approach reduces the cost of energy by around 1% compared to the conventional design approach. This page will serve as a place to easily access all the publications from this work and the repositories for the software developed and released through this pr...

aerodynamics↗

DOE OSTI2024

Multiple Functional Bonds Integrated Interphases for Long Cycle Sodium-Ion Batteries

Sodium-ion batteries (SIBs) have garnered significant interest as one of the most promising energy suppliers for power grid energy storage. However, the poor electrode/electrolyte interfacial stability leads to continual electrolyte decomposition and transition metal dissolution, resulting in rapid performance degradation of SIBs. In this work, we propose a strategy integrating multiple functional bonds to regulate electrode/electrolyte interphase by triple-coupling of succinonitrile (SN), sodium hexafluorophosphate (NaPF 6 ) and fluorinated ethylene carbonate (FEC). Theoretical calculation and experiment results show that the solvation structure of Na + and ClO 4 – is effectively reconfigured by the solvated FEC, SN and PF 6 – in PC-based carbonate electrolyte. The newly developed electrolyte demonstrates increased Na + -FEC coordination, weakened interaction of Na + -PC and participation of SN and PF 6 – anions in solvation, resulting in the formation of a conformal interfacial layer comprising of sodium oxynitrides (NaN x O y ), sodium fluoride (NaF) and phosphorus oxide compounds (NaP x O y ). Consequently, a 3 Ah pouch full cell of hard carbon//NaNi 1/3 Fe 1/3 Mn 1/3 O 2 exhibits an excellent capacity retention of 90.4 % after 1000 cycles. Detailed postmortem analysis of interface chemistry is further illustrated by multiple characterization methods. Finally, this study provides a new avenue for developing electrolyte formulations with multiple functional bonds integrated interphases to significantly improve the long-term cycling stability of SIBs.

25 ENERGY STORAGE↗

DOE OSTI2021

Electrification Futures Study: Operational Analysis of U.S. Power Systems with Increased Electrification and Demand-Side Flexibility

This report provides a high-resolution U.S. national-scale power systems assessment of scenarios with widespread electrification using detailed grid simulations. We find that high electrification scenarios envisioned in the Electrification Futures Study can be operated at the hourly level to meet future increased levels of electrified demand and, under the most aggressive cases, with up to 66% of generation from wind and solar technologies. The analysis also examines the value of flexibility from demand by supporting system operability under high electrification and high renewable systems. Demand-side flexibility—especially flexibility from newly electrified loads—is found to enhance the operational efficiency by reducing VRE curtailment and increasing utilization of generators with lower operating costs. It can also enhance the ability of electrification to decarbonize the energy sector.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2020

Assessing geothermal/solar hybridization – Integrating a solar thermal topping cycle into a geothermal bottoming cycle with energy storage

Geothermal and concentrating solar power (CSP) technologies typically use heat at different temperatures in their commercial deployments. This enables a technically viable hybridization of a solar topping cycle and a geothermal bottoming cycle at locations where both resources are available. In this article, an underperforming geothermal power system based at Burley, Idaho is used as a baseline to investigate the technical and economic potential of such a hybrid cycle. A direct thermal energy storage (TES) system is also integrated to overcome the intermittency of the solar resource. Design and off-design behavior of key components are modelled to simulate the annual performance of the hybrid system on an hourly basis. The sizing of the solar field and thermal storage is investigated and is seen to significantly impact the annual electricity generation and efficiency. Various cost scenarios for the solar field and thermal energy storage are investigated. An economic metric - levelized cost of electricity (LCOE) - is used to optimize the solar field sizing and TES capacity. The hybrid plant converts the additional solar heat input into additional work with an efficiency of 32.9%. Retrofitting a geothermal plant with solar and eight hours of energy storage can achieve an LCOE of 0.136 $/kWhe in current cost scenarios and 0.081 $/kWhe in a future cost reduction scenario. Although the hybrid system cannot directly compete with current PV systems without batteries, it has an LCOE 32% lower than that of a PV-battery system. This paper provides insights into the research and development of the future grid with a high renewable energy penetration and encourages further study of energy hybridization for improved efficiencies and economics.

15 GEOTHERMAL ENERGY↗

DOE OSTI2026

Advanced Semi-Supervised Learning with Uncertainty Estimation for Phase Identification in Distribution Systems

The integration of advanced metering infrastructure (AMI) into power distribution networks generates valuable data for tasks such as phase identification; however, the limited and unreliable availability of labeled data in the form of customer phase connectivity presents challenges. To address this issue, we propose a semi-supervised learning (SSL) framework that effectively leverages labeled and unlabeled data. Our approach incorporates self-training, label spreading, and Bayesian neural networks (BNNs) to enhance phase identification with AMI data. Our method uses an ensemble of multilayer perceptron classifiers in a self-training setup, iteratively adding high-confidence pseudo-labels to improve robustness. We also apply label spread to propagate labels based on data similarity, which enhances generalization across diverse distributions. In addition, we employ a BNNs with uncertainty estimation, boosting confidence in predictions and reducing phase identification errors. In our case study, we achieved approximately 98% +/- 0.08 accuracy with uncertainty using minimal and unreliable labeled data from a real U.S. utility, Duquesne Light Company. Our SSL approach, combined with uncertainty estimation, provides an efficient solution for phase identification in AMI data, ultimately improving the reliability of smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

Advanced Semi-Supervised Learning With Uncertainty Estimation for Phase Identification in Distribution Systems

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Analysis of Transformer Magnetizing Reactance Using Describing Function in Direct Power Control of Back-to-Back Modular Multilevel Converter with Advanced Grid Support

This paper presents a Port Controlled Hamiltonian based direct power control architecture for a back-to-back modular multilevel converter system connecting two ac sources at different frequencies. The system features advanced grid support functionalities based on IEEE 1547-2018, implemented on the inverter side. The rectifier side controller ensures reference following for active and/or reactive powers and maintains the commanded dc bus voltage. The inverter side controller ensures power command following for active and reactive powers.The proposed control architecture is designed to suppress second harmonic oscillations in powers during unbalanced grid voltage sags by dynamically adjusting the currents on each ac side. This also ensures effective elimination of any second harmonic oscillations in the equivalent dc bus voltage. Validation is performed on an OPAL-RT real-time platform with case studies on unbalanced and balanced sags, demonstrating the controller's effectiveness during real time implementation. A reduced-scale laboratory prototype further verifies these case studies, with experimental results for balanced sags due to grid simulator limitations. The results confirm the robustness and efficiency of the proposed control strategy in ensuring stable and reliable operation under various grid conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

The Fluid Dynamics Uncertainty Quantification Challenge Problem: XFOIL vs. MFOIL

Uncertainty quantification (UQ) has become more critical in aerospace engineering due to the growing dependence on computational tools for design optimization and performance analyses of aerospace vehicles. Even though the significance of UQ in assessing the credibility of computational analyses is well recognized, its costs and complexity impede its integration into standard practices, particularly in computational fluid dynamics (CFD) and other fluid analyses. This paper presents a UQ study for low-fidelity computational aerodynamics analyses with XFOIL and mfoil (i.e., the MATLAB version of XFOIL with several implementation modifications); these tools are utilized widely in both research and education. The main contributions of this paper are as follows: 1) improved precision in quantifying the uncertainty of the baseline Monte Carlo results used to benchmark surrogate modeling techniques for UQ, 2) quantification of the effect of the implementation differences between XFOIL and mfoil on solution quantities of interest (QoIs), such as lift and pitching moment coefficients, and 3) development of an open-source UQ library for use with XFOIL and mfoil, which has educational values and helps promote UQ for fluid analyses with aerospace applications. Results and discussions revolve around cases 1-4 of the challenge problem posed by the AIAA Fluid Dynamics Technical Committee’s Uncertainty Quantification Discussion Group (UQDG). In case 3, this work employs CFDverify, an open-source solution verification software, to quantify the discretization error and evaluate the extrapolated QoIs based on the grid convergence index (GCI). This UQ study differentiates itself from previous studies in the rigor of handling baseline Monte Carlo uncertainty and in including mfoil, which is a more accessible alternative to XFOIL. Finally, despite the growing computing power, low-fidelity computational tools remain valuable, such as for aerodynamic shape optimization at Mach numbers below 0.65 and low-to-mid Reynolds numbers.

Lay, Aidan S [University of Tennessee, Knoxville (↗

DOE OSTI2022

Microgrid Resilience: A Holistic and Context-Aware Resilience Metric

Microgrids present an effective solution for the coordinated deployment of various distributed energy resources and furthermore provide myriad additional benefits such as resilience, decreased carbon footprint, and reliability to energy consumers and the energy system as a whole. Boosting the resilience of distribution systems is another major benefit of microgrids. This is because they can also serve as a backup power source when the utility grid's operations are interrupted due to either high-probability low-impact events like a component failure or low-probability high-impact events - be it a natural disaster or a planned cyberattack. However, the degree to which any particular system can defend, adapt, and restore normal operation depends on various factors including the type and severity of events to which a microgrid is subjected. These factors, in turn, are dependent on the geographical location of the deployed microgrid as well as the cyber risk profile of the site where the microgrid is operating. Therefore, in this work, we attempt to capture this multi-dimensional interplay of various factors in quantifying the ability of the microgrid to be resilient in these varying aspects. This paper, thus, proposes a customized site-specific quantification of the resilience strength for the individual microgrid's capability to absorb, restore, and adapt to the changing circumstances for sustaining the critical load when a low-probability high-impact event occurs - termed as - context-aware resilience metric. We also present a case study to illustrate the key elements of our integrated analytical approach.

microgrid↗

DOE OSTI2020

An Edge-Cloud Integrated Solution for Buildings Demand Response Using Reinforcement Learning

Buildings, as major energy consumers, can provide great untapped demand response (DR) resources for grid services. However, their participation remains low in real-life. One major impediment for popularizing DR in buildings is the lack of cost-effective automation systems that can be widely adopted. Existing optimization-based smart building control algorithms suffer from high costs on both building-specific modeling and on-demand computing resources. To tackle these issues, this paper proposes a cost-effective edge-cloud integrated solution using reinforcement learning (RL). Beside RL’s ability to solve sequential optimal decision-making problems, its adaptability to easy-to-obtain building models and the off-line learning feature are likely to reduce the controller’s implementation cost. Using a surrogate building model learned automatically from building operation data, an RL agent learns an optimal control policy on cloud infrastructure, and the policy is then distributed to edge devices for execution. Simulation results demonstrate the control efficacy and the learning efficiency in buildings of different sizes. A preliminary cost analysis on a 4-zone commercial building shows the annual cost for optimal policy training is only 2.25% of the DR incentive received. Results of this study show a possible approach with higher return on investment for buildings to participate in DR programs.

24 POWER TRANSMISSION AND DISTRIBUTION↗