Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Demand Response”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Clean Grid Vision: A U.S. Perspective - Chapter 4. Demand-Side Development

This chapter focuses on recent developments on the demand side of the electricity system in the United States and beyond. After decades of slow-moving change in power system technology, business models, regulatory structures, and even financing schemes, changes on the demand side are accelerating rapidly. These changes are also more tightly linking the supply side with the demand side. This chapter provides high-level summaries of traditional subjects like demand-side management, which includes energy efficiency and demand response, and then transition to a subject that has gathered increasing attention as the most dynamic change likely to impact power systems in the coming decades: beneficial electrification. In each case, we attempt to address the impacts on system flexibility to the degree possible. These demand-side subjects are widely considered essential elements of a clean grid strategy.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Benefits of Dual Fuel Heat Pump Grid-responsive Control: A Model-based Control Optimization Approach Using Building and Equipment Co-simulation

Conventional dual fuel heat pumps lack the intelligent control mechanisms to efficiently manage the switch between heat pump and furnace, leading to sub-optimal energy usage and, in some cases, increased operating costs. To resolve this gap, this study applies optimized control on hybrid heat pumps. With a focus on equipment control strategies, we compare the performances of five spacing heating equipment, including a conventional heat pump (HP), a conventional furnace, a dual fuel heat pump (DFHP) with conventional control, a dual fuel heat pump with smart control, and a novel seamlessly fuel flexible heat pump (SFFHP). While DFHP runs on either gas or electricity at any given moment, SFFHP concurrently consumes gas and electricity by continuously optimizing the proportion of each. In this research, a co-simulation framework is developed by integrating a building envelope model with a physics-based heat pump simulation model to analyze the benefits of grid-responsive controls of DFHP and SFFHP. The model-based optimal controls adjust the operation of the heat pump and gas furnace based on utility price signals and marginal grid emission to minimize utility cost and CO 2 emissions for multiple climate zones, different utility tariffs, and marginal grid emission scenarios. Case studies in Chicago and Los Angeles demonstrate that SFFHP and DFHP, with model-based optimal control, can deliver significant reductions in peak demand, utility cost, and CO 2 emission. In Chicago, SFFHP and smart controlled DFHP yield up to 64.7% and 61.7% utility cost reduction and up to 15.7% and 8.5% CO 2 emission reduction compared to the gas furnace. In Los Angeles, SFFHP and smart controlled DFHP achieve up to 43.6% and 40.1% utility cost reduction and up to 13.8% and 14.1% CO2 emission reduction compared to conventional heat pumps. In conclusion, by leveraging the fuel flexibility nature of dual fuel heat pumps, the model-based control optimization approach makes dual fuel heat pump an attractive option for demand response programs.

Control↗
DOE OSTI2024

Risk-informed Hierarchical Control of Behind-the-Meter DERs with AMI Data Integration (Final Technical Report)

This project addresses several key barriers to implement the next generation demand response applications and provides a clear understanding of implementing hierarchical and standalone control using AMI data. Through this program, Eaton has developed and tested a meter-as-a-controller prototype with the help of other partners--- National Renewable Energy Laboratory (NREL), Electric Power Research Institute (EPRI), Pecan St Inc. (PSI), and Delaware Electric Cooperative (DEC). The controller can utilize residential controllable loads such as heating, ventilation, and air conditioner (HVAC), electric water heater and distributed energy resources like solar PV and battery energy storage systems for off-setting the demand that is required from the grid, thus providing reliable grid-services for demand reduction or peak shaving. The controller is also capable of coordinating the resources of the premises for better management and energy efficiency while meeting the comfort bound of the premises owner as quality-of-service. The development has been demonstrated in a three virtual-home setup at system performance lab of NREL with real appliances (HVAC, electric water heater, solar PV, and battery). The technology has also been proved through laboratory and field demonstration with successful interconnectivity (e.g., end-to-end communication and data exchange) between the residential appliances and utility through the RF network at Delaware Electric Co-op (DEC) in Delaware.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Global-Local Policy Search and its Application in Grid-Interactive Building Control

As the buildings sector represents over 70% of the total U.S. electricity consumption, it offers a great amount of untapped demand-side resources to tackle many critical grid-side problems and improve the overall energy system's efficiency. To help make buildings grid-interactive, this paper proposes a global-local policy search method to train a reinforcement learning (RL) based controller which optimizes building operation during both normal hours and demand response (DR) events. Experiments on a simulated five-zone commercial building demonstrate that by adding a local fine-tuning stage to the evolution strategy policy training process, the control costs can be further reduced by 7.55% in unseen testing scenarios. Baseline comparison also indicates that the learned RL controller outperforms a pragmatic linear model predictive controller (MPC), while not requiring intensive online computation.

demand response↗
DOE OSTI2024

Autonomous Grid Support Functionality in Variable-Speed Drive-Based End-Use Loads

High penetration of inverter-based resources into power systems causes lower inertia, and it becomes more challenging to maintain grid stability during contingency events. While conventional demand response and shedding at the load side suffer from slow response, impact by unavailability, and issues from communication, variable-speed drives (VSDs) are becoming strong candidates for fast frequency response (FFR) thanks to their fast response and reduced user impact from variable power adjustment capability. In this letter, we propose an autonomous frequency support control method for a residential refrigerator with a VSD, a promising target small end-use load for FFR. We analyze the effect of the proposed controller on grid stability, and we verify the performance through laboratory experiments with a commercially available refrigerator.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

A hybrid architecture for volt-var control in active distribution grids

Modern active distribution grids are characterized by the increasing penetration of distributed energy resources (DERs). The proper coordination and scheduling of a large numbers of these small-scale and spatially distributed DERs is necessary, and warrants the use of novel distributed approaches. In this paper, we propose a hybrid volt-var control architecture for the distribution grid, which leverages existing centralized and local approaches to planning, decision making, and control, and augments it with distributed optimization and distributed control for DER management. First, we propose a convex model to describe the power physics of distribution grids of meshed topology and unbalanced structure, based on current injection and McCormick Envelopes. Second, we employ the distributed proximal atomic coordination (PAC) algorithm to coordinate DERs to provide voltage support. We implement volt-var optimization by optimally coordinating DERs including PV smart inverters and demand response. We present results using the IEEE-34 bus network, using real data from a distribution feeder in Hawaii, to model load and PV generation. Different levels of DER penetration and objective functions are simulated. Finally, our results show the need for the coordination of DERs to improve voltage profiles, even in networks with existing voltage control devices. Further, we show the need for flexible reactive power capabilities to achieve desired grid performance.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Valuation of Hydrogen Technology on the Electric Grid Using Production Cost Modeling: Cooperative Research and Development Final Report, CRADA Number CRD-18-00736

This research project will estimate the value to the United States electric grid of deploying hydrogen technology (such as electrolyzers and hydrogen-fueled generation) under projected conditions of high renewable penetration. The analysis will advance the state of the art in systems-level cost-benefit analysis of hydrogen technology for the electric grid by incorporating production cost modeling results in the analysis. Large-scale grid simulation tools will be used to evaluate total system production cost and grid operation when hydrogen technology is deployed for applications such as energy storage and demand response. Scenarios will include one or more future grid mixes in the Western Interconnect (WI) with a high proportion of intermittent renewables. Electric Power Research Institute (EPRI) will work with four utility companies to refine scenarios. Results of the analysis will include comparing the net cost of hydrogen to other technologies for long duration storage, and of power-to-gas (P2G) scenarios including merchant hydrogen sale and hydrogen-fueled generation.

08 HYDROGEN↗
DOE OSTI2026

Distribution System Congestion Management - A Survey of Reliable Integration for Aggregated Resources and Microgrids

Rising penetration of consumer-owned Distribution Grid Resources (DGRs), increasingly managed by third party aggregators and enrolled in grid services and wholesale market programs, can create localized congestion in distribution networks. Managing these constraints is challenging due to a persistent coordination and information gap: utilities are accountable for reliability and have network topology and state visibility, while aggregators control the DGR capability needed to relieve congestion. This survey synthesizes congestion management solutions for distribution systems with high DGR penetration, covering both market-based mechanisms (distribution level markets, locational pricing, flexibility auctions) and non-market-based solutions (network reconfiguration, direct DGR control, demand response, curtailment, etc.). The literature is organized across three decision horizons: long term planning, operational planning, and real-time operation. Special attention is devoted to emerging distribution system operator architectures and coordination frameworks spanning transmission system operators, aggregators, and microgrids. Drawing on recent case studies and implementations, we distill best practices, identify key technical and economic barriers, and outline research directions. The evidence points to a shift toward integrated congestion management that combines market signals with technical controls, enabled by improved monitoring, forecasting, and closed loop control capabilities.

Active Distribution Networks (ADN)↗
DOE OSTI2020

Identification of hot water end-use process of electric water heaters from energy measurements

This paper presents an algorithm for the identification of parameters for a stochastic hot water end-use process that drives a homogeneous population of thermostatically controlled electric water heaters (EWH). Usually, only metered interval consumption data (kWh) is collected and the hot water end-use process is unobservable to utility and aggregators. However, the availability of EWHs for demand response (DR) is closely coupled with the hot water end-use process. In this context, the hot water end-use process is modeled as a two-state Markov chain (Use / No use), which causes the thermostatic ON-OFF switching process to behave as a Markov renewal process (MRP). A set of first passage-time problems is developed to obtain the moments of the transition probability densities of the MRP. These problems are addressed by establishing a system of coupled partial differential equations characterizing the temperature evolution of the EWH population. A key quantity in the methodology for estimating the parameters is the total time an EWH is ON within a period of interest. It is referred to as the total busy time. Total busy time in this approach is a random variable for which analytical expressions of the moments are developed as a function of the metered window length. The latter expressions become the basis of a hot water demand model identification algorithm which is validated using agent-based simulations of EWHs.

42 ENGINEERING↗
DOE OSTI2021

Centralized and Decentralized Optimal Control of Variable Speed Heat Pumps

Utility service providers are often challenged with the synchronization of thermostatically controlled loads. Load synchronization, as a result of naturally occurring and demand-response events, has the potential to damage power distribution equipment. Because thermostatically controlled loads constitute most of the power consumed by the grid at any given time, the proper control of such devices can lead to significant energy savings and improved grid stability. The contribution of this paper is the development of an optimal control algorithm for commonly used variable speed heat pumps. By means of selective peer-to-peer communication, our control architecture allows for the regulation of home temperatures while simultaneously minimizing aggregate power consumption, and aggregate load volatility. An optimal centralized controller is also explored and compared against its decentralized counterpart.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2021

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to nonlinear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2021

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search: Preprint

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to non-linear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2025

Modeling distributed energy resource aggregations in security constrained unit commitment and economic dispatch

The Federal Energy Regulatory Commission (FERC) recently issued Order 2222, which requires all wholesale electricity markets in the US to allow distributed energy resources (DERs) to participate in the market as aggregated resources. These DER aggregations may be composed of many individual resources that are offered and dispatched by the market as a single entity. We present here a model of a distributed energy resource aggregator (DERA) that is scheduled by a market operator’s security constrained unit commitment (SCUC) and security constrained economic dispatch (SCED). The DERA model includes constraints for battery energy storage systems (BESSs), demand response resources (DRRs), and a simple distributed energy resource (DER). This paper describes a model for each resource type and presents two methods for the DERA to generate market offer curves: a profit-maximizing optimization to compute cost curves and a direct cost algorithm to determine dispatch costs for each resource and combine into cost curves. Once all participating DERAs are scheduled in SCUC/SCED, the model is then modified to dispatch individual DERs to maximize profit or minimize schedule deviation of the DERAs. A simulation of a representative day illustrates the DERA offers, the scheduled generation, and the DERA dispatch. Findings show the potential for unavoidable schedule deviations due to internal DER constraints and due to economic incentives to deviate from the SCUC/SCED schedules. This highlights the importance of DERA offer construction on market efficiency and system reliability. Novel aspects of our approach include: (1) We consider the asymmetry of price incentives impacting DERAs from the wholesale market compared to those impacting consumers from the retail market, as imposed by current regulations and laws. (2) We model aggregate consumer response through statistically parameterizable utility functions rather than a potentially impractical approach of modeling each individual consumer. (3) We show how to use the DERA operational dispatch model to create offers into the wholesale electricity market. (4) We show how DERAs may fail to meet their scheduled dispatch because the market offer format may not permit them to fully express their operational features such as intertemporal costs and constraints to the market.

aggregations↗
DOE OSTI2020

Local Communication in Populations of Thermostatically Controlled Loads

Thermostatically controlled loads (TCLs) have shown great potential for demand response (DR) in electric grid operations. However, it has been commonly seen that DR events using TCLs may cause load synchronization and unwanted oscillatory effects, especially in homogeneous populations. In an attempt to mitigate the negative impacts of DR events, a decentralized method is proposed that modifies each thermostat behavior based on the activity of a small number of nearby TCLs. This feedback introduces the possibility of instability in the aggregate behavior. A stability analysis is performed on a linearized model of the aggregate system and the results of that analysis compared to simulation results. The proposed modification of thermostat behavior results in fourfold reduction in the post-DR peak while suppressing ensuing oscillations at the expense of a modest increase in compressor cycling. Further, the linearized model also provides insight into the aggregate behavior of the population.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Deep Reinforcement Learning for Autonomous Water Heater Control

Electric water heaters represent 14% of the electricity consumption in residential buildings. An average household in the United States (U.S.) spends about USD 400–600 (0.45 ¢/L–0.68 ¢/L) on water heating every year. In this context, water heaters are often considered as a valuable asset for Demand Response (DR) and building energy management system (BEMS) applications. To this end, this study proposes a model-free deep reinforcement learning (RL) approach that aims to minimize the electricity cost of a water heater under a time-of-use (TOU) electricity pricing policy by only using standard DR commands. In this approach, a set of RL agents, with different look ahead periods, were trained using the deep Q-networks (DQN) algorithm and their performance was tested on an unseen pair of price and hot water usage profiles. The testing results showed that the RL agents can help save electricity cost in the range of 19% to 35% compared to the baseline operation without causing any discomfort to end users. Additionally, the RL agents outperformed rule-based and model predictive control (MPC)-based controllers and achieved comparable performance to optimization-based control.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Cooperative Load Scheduling for Multiple Aggregators Using Hierarchical ADMM

Demand response (DR) serves an important role in improving the efficiency and stability of power systems. In recent years, with advances in communication and smart device technologies, many aggregators have emerged to facilitate end customer participation in DR programs. These aggregators, equipped with customized optimal control algorithms, are capable of providing various grid services. Among them is load scheduling during DR events, namely following a load signal provided by the utility company while minimizing overall customer discomfort. However, as the number of aggregators keeps increasing, it becomes challenging for utility companies to conduct load scheduling for multiple aggregators and generate reference signals for each of them. This paper proposes an optimization framework using hierarchical alternating direction method of multipliers (H-ADMM) to optimally generate load following signals for multiple aggregators. Under this framework, utility and multiple aggregators work in a cooperative manner, aiming at minimizing an overall system cost from different levels of the power system hierarchy, while protecting user privacy. A case study has been conducted in a system with multiple aggregators, based on control of HVAC loads. Experimental results validate the effectiveness of the proposed algorithm.

ADMM↗
DOE OSTI2021

End-Use Load Profiles for the U.S. Building Stock

The United States is embarking on an ambitious transition to a 100% clean energy economy by 2050, which will require improving the flexibility of electric grids. One way to achieve grid flexibility is to shed or shift demand to align with changing grid needs. To facilitate this, it is critical to understand how and when energy is used. High quality end-use load profiles (EULPs) provide this information, and can help cities, states, and utilities understand the time-sensitive value of energy efficiency, demand response, and distributed energy resources. Publicly available EULPs have traditionally had limited application because of age and incomplete geographic representation. To help fill this gap, the U.S. Department of Energy (DOE) funded a three-year project, End-Use Load Profiles for the U.S. Building Stock, that culminated in this publicly available dataset of calibrated and validated 15-minute resolution load profiles for all major residential and commercial building types and end uses, across all climate regions in the United States. These EULPs were created by calibrating the ResStock and ComStock physics-based building stock models using many different measured datasets, as described in the "Technical Report Documenting Methodology" linked in the submission.

Array↗
DOE OSTI2020

Cooperative Load Scheduling for Multiple Aggregators Using Hierarchical ADMM: Preprint

Demand response (DR) serves an important role in improving the efficiency and stability of power systems. In recent years, with advances in communication and smart device technologies, many aggregators have emerged to facilitate end customer participation in DR programs. These aggregators, equipped with customized optimal control algorithms, are capable of providing various grid services. Among them is load scheduling during DR events, namely following a load signal provided by the utility company while minimizing overall customer discomfort. However, as the number of aggregators keeps increasing, it becomes challenging for utility companies to conduct load scheduling for multiple aggregators and generate reference signals for each of them. This paper proposes an optimization framework using hierarchical alternating direction method of multipliers (H-ADMM) to optimally generate load following signals for multiple aggregators. Under this framework, utility and multiple aggregators work in a cooperative manner, aiming at minimizing an overall system cost from different levels of the power system hierarchy, while protecting user privacy. A case study has been conducted in a system with multiple aggregators, based on control of HVAC loads. Experimental results validate the effectiveness of the proposed algorithm.

97 MATHEMATICS AND COMPUTING↗