SEARCH · Engineering Papers
Results for “load shift”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system
Both model predictive control (MPC) and deep reinforcement learning control (DRL) have been presented as a way to approximate the true optimality of a dynamic programming problem, and these two have shown significant operational cost saving potentials for building energy systems. Furthermore, there is still a lack of in-depth quantitative studies on their approximation levels to the true optimality, especially in the building energy domain. To fill in the gap, this paper provides a numerical framework that enables the evaluation of the optimality levels of different controllers for building energy systems. This framework is then used to comprehensively compare the optimal control performance of both MPC and DRL controllers with given computation budgets for a single zone fan coil unit system. Note the optimality is estimated based on a user-specific selection of trade-off weights among energy costs, thermal comfort and control slew rates. Compared with the best optimality we can find through expensive optimization simulations, the best DRL agent can maximally approximate the optimality by 96.54%, which outperforms the best MPC whose optimality level is 90.11%. However, due to the stochasticity, the DRL agent is only expected to approximate the optimality by 90.42%, which is almost equivalent to the best MPC. Except for Proximal Policy Optimization (PPO), all DRL agents can have a better approximation to the optimality than the best MPC, and are expected to have better approximation than the MPC with a prediction horizon of 32 steps (15 min per step). In terms of reducing energy cost and thermal discomfort, MPC can outperform the rule-based control (RBC) by 18.47%–25.44%. DRL can be expected to outperform RBC by 18.95%–25.65% ,and the best DRL control policy can outperform RBC by 20.29%–29.72%. Although the comparison of the optimality level is performed in a perfect setting, e.g., MPC assumes perfect models, and DRL assumes a perfect offline training process and online deployment process, this can shed insight on their capabilities of approximating to the original dynamic programming problem.
Using building cooling for load shifting on a 5-minute wholesale energy market
Not Available
Grid Services Load Shift Baseline Degradation Analysis Methodology v1
As demand flexibility becomes more common, the mix and frequency of a range of demand flexibility strategies will introduce potential biases into baselines, i.e., the time period immediately prior to a LS event may include other LS or DF events. Baseline degradation assessment provides an approach to quantify how these biases begin to compromise predictive accuracy. Heatmaps, based on each month of the year provides a granular view of a given model's predictive capability. However, for comparing multiple algorithms, separately for weekdays and weekends, aggregating results to seasons provides a simpler means of comparison while still allowing for review of variations by time of day and time of year
Field Demonstration of Cost Minimizing Load Shifting Controls for 120V Heat Pump Water Heaters in Different Pricing Scenarios
Explore the source record for details and available documents.
Influence of Phase-Change Materials and Operating Periods on Load Shifting for Thermal Storage Heat Pumps in European Climate Zones
As the reliance on heat pumps (HPs) for space conditioning increases worldwide, ex-tensive grid strains during utility peak hours are expected. Significant research efforts focus on investigating the use of integrated thermal energy storage (TES) systems to reduce peak energy demands. Conventionally, TES systems are often integrated to store and provide either cooling or heating, but not both. In this work, a single room-temperature phase-change material (PCM)-TES was integrated for dual-mode opera-tion with an R290 air-to-water 10.5 kW (3-Ton) HP. Two PCM melting temperatures (17°C, 22°C) were assessed to investigate their impact on system performance and cost reductions for Milan, Italy (4A); Barcelona, Spain (3A); and Oslo, Norway (6A). HP and HP-TES performance maps were generated using Modelica-based transient models and co-simulated with a prototype residential building using the Spawn of En-ergyPlusTM with simple rule-based controls. Our simulations indicate that PCM-17°C provided annual cost savings at higher peak-to-off-peak cost ratios, as the demand re-duction dominated the savings potential. The recharge energy costs and requirements became more dominant at lower cost ratios, making PCM-22°C more beneficial at lower cost ratios. Finally, despite Oslo's heating-dominated climate, the utility peak hours favor cooling demand reductions, making PCM-17°C more appealing. In all cases, the cost savings potential stabilized between 4 – 10% regardless of cost ratio, suggesting that system-level component and operation control optimization is required to maximize cost savings further.
Year-Round Experimental Demonstration of a Thermal Energy Storage–Integrated Heat Pump for Space Cooling and Heating Load Shifting
Explore the source record for details and available documents.
Utilizing commercial heating, ventilating, and air conditioning systems to provide grid services: A review
The modern power grid faces multiple challenges due to an increase in the adoption of renewable generation, such as dynamically balancing supply and demand at different time scales. Demand side management in buildings plays a vital role in achieving this balance because buildings can provide grid services through a variety of building assets. However, the development of grid-interactive, efficient buildings is still in its infancy, and a systematic and holistic understanding of grid service delivery strategies in terms of energy efficiency, load shifting, load shedding and load modulating is still limited. This paper is a comprehensive review of the development and application of building-level control strategies for utilizing heating, ventilating, and air conditioning systems to provide grid services. These strategies have been investigated through numerical and experimental studies. Control algorithms, such as heuristic rule-based control and model-based control, have been used to enable the automatic control delivery of grid services. The advantages and disadvantages of the strategies are summarized and discussed. Finally, research trends are also identified, which include considering predicted mean vote-based and occupant-based thermal comfort, modeling of occupant behavior, integrating power grid operations with building control, and combining different demand flexibility modes in the control design.
Factors Influencing Grid-connected Heat Pump Water Heater Performance in the Southeast U.S.
Grid-connected heat pump water heaters (HPWH) can shift electrical load while minimizing impacts to hot water availability for occupants. This capability provides a flexible grid resource to utilities seeking to manage peak loads Such load control also can feasibly improve renewable utilization within the utility electric production mix, for instance using off-peak generation during periods with high renewable energy generation. It also offers lower electric bills to customers through increased energy efficiency of HPWH and cuts greenhouse gas emissions. In particular, the Southeast U.S. due to its high penetration of electric water heating presents a promising opportunity for grid-connected HPWHs. This paper builds upon the results of an extensive HPWH load shifting field study conducted in 51 occupied homes in Florida using EcoPort technology (Butzbaugh et al, 2022). In 2022, only an initial evaluation was available. Here, long term load results are available as well as examination of various control strategies and influences. Analysis is conducted for HPWH energy use and load shifting performance based on home occupancy (i.e., low and high) and water heater location (i.e., conditioned and unconditioned) across different temperature profiles. An unexpected outcome of this analysis was the poor performance of HPWHs located in conditioned spaces, possibly because of inadequate air volume from improper installation. We did find higher demand reductions from 2-hour load ups and slightly improved for critical peak signals in the afternoon control periods. As expected, higher occupancy households showed great load reductions.
Stabilizing the Grid and Reducing Utility Bills Through Price-Responsive Controls for Heat Pump Water Heaters
The electricity grid is facing increasing challenges in cost-effectively balancing supply and demand. These challenges are exacerbated by increased penetration of photovoltaics, which causes mid-day overproduction, and electrification of gas appliances, which increases peak-period electricity demand. Decarbonization requires shifting building loads from fossil-intensive high-cost times to renewable-intensive low-cost times while maintaining quality of service to occupants. Utilities and ISO’s are investigating new ways of incentivizing this load shifting. One promising method is the use of Highly Dynamic Prices (HDPs). HDPs feature continuously changing prices that reflect real-time grid generation and distribution costs and capacity constraints, and thus incentivize consumers to shift their loads. California’s CPUC CalFUSE proposal and Hawaii’s recent changes demonstrate that electricity tariffs are moving towards this model. For this to work however, loads must have the capability to respond to these prices. Heat pump water heaters (HPWHs) are an ideal device for this purpose because their storage tanks decouple delivery of domestic hot water from electricity consumption. The storage enables control strategies that consume midday solar power to increase the energy stored in the tank, then provide evening peak domestic hot water services using the stored energy. Berkeley Lab's CalFlexHub project is pioneering price-driven load flexibility by developing and deploying cost-minimizing controls for many flexible loads - including HPWHs - in response to HDP. Control development is based on simulations using the Flexible Heat Pump Water Heater Performance Predictor which captures the control decisions of the on-board controller in a residential, integrated HPWH . The price-responsive controls a) shift load in ways that consume additional midday solar power to help stabilize the grid and reduce overall emissions, b) ensure that occupants receive equal or better hot water delivery service, and c) minimize the operating cost for each home in the fleet. On the grid level, the resulting shift will reduce utility operating costs and emissions, and can avoid expensive system capacity expansions. The control approach is customized to each home based on typical hot water consumption patterns. HPWH controllers, whether on the device or remotely, will receive a schedule of CTA-2045-B signals or set temperature adjustments customized to the current HDP price schedule and home. Simulation results for a fleet of 148 HPWHs on a summer day in Berkeley, California show cost savings of 29% and high price electricity consumption reductions of 80%, while maintaining full quality of service.
Design and performance assessment of a dual-mode latent thermal storage integrated heat pump across multiple climate zones
The electrification of space cooling and heating systems risks overloading the existing electrical grid during peak hours. Heat pumps integrated with thermal energy storage (HP-TES) offer a promising solution by shifting peak loads to off-peak hours, reducing grid strains. This work presents the design and assessment of a dual-mode HP-TES that uses a single 22°C phase-change material (PCM) as a heat source or sink in heating and cooling modes, respectively. Performance assessment was conducted using Modelica-based transient models, and full-year simulations were conducted across eight US climate zones using typical weather data. Two HP-TES performance metrics: peak energy reduction and recharge energy increases, were defined by comparing HP-TES energy consumption with base HP peak consumptions. Annual heating demand reductions (40–65%) exceeded cooling demand reductions (15–20%) due to the elimination of peak-hour backup heating. Cooling mode recharge energy requirements (0–10%) were reduced in locations with lower summer nighttime temperatures, while heating recharge requirements were lower than the high base-peak energy demand from backup heating. Simplified rapid methods that were 10 7 times faster than annual simulations were developed to predict seasonal cooling and heating energy reductions, and recharge energy requirements, with maximum deviations of ±2.5% and ±3.5% points. These methods enabled rapid parametric studies that identified optimal location-specific PCM temperatures between 22°C and 27°C, highlighting the need to consider both discharge and recharge energy requirements to achieve sustainable, energy-efficient peak load shifting across various climate zones.
Techno-Economic Assessment of Residential Heat Pump Integrated with Thermal Energy Storage
Phase change material (PCM)-based thermal energy storage (TES) can provide energy and cost savings and peak demand reduction benefits for grid-interactive residential buildings. Researchers established that these benefits vary greatly depending on the PCM phase change temperature (PCT), total TES storage capacity, system configuration and location and climate of the building. In this study, preliminary techno-economic performance is reported for a novel heat pump (HP)-integrated TES system using an idealized approach. A simplified HP-TES was modeled for 1 year of space heating and cooling loads for a residential building in three different climates in the United States. The vapor compression system of the HP was modified to integrate with TES, and all heat transfer to and from the TES was mediated by the HP. A single PCM was used for heating and cooling, and the PCT and TES capacity were varied to observe their effects on the building’s energy consumption, peak load shifting and cost savings. The maximum reduction in electric consumption, utility cost and peak electric demand were achieved at a PCT of 30 °C for New York City and 20 °C for Houston and Birmingham. Peak energy consumption in Houston, New York City, and Birmingham was reduced by 47%, 53%, and 70%, respectively, by shifting peak load using a time-of-use utility schedule. TES with 170 MJ storage capacity allowed for maximum demand shift from on-peak to off-peak hours, with diminishing returns once the TES capacity equaled the daily building thermal loads experienced during the most extreme ambient conditions.
Tooth Contact Shift in Loaded Spiral Bevel Gears
An analytical method is presented to predict the shifts of the contact ellipses of spiral bevel gear teeth under load. The contact ellipse shift is the motion of the tooth contact position from the ideal pitch point to its location under load. The shifts are due to the elastic motions of the gear and pinion supporting shafts and bearings. The calculations include the elastic deflections of the gear shafts and the deflections of the four shaft bearings. The method assumes that the surface curvature of each tooth is constant near the unloaded pitch point. Results from these calculations will help designers reduce transmission weight without seriously reducing transmission performance.
Tooth contact shift in loaded spiral bevel gears
An analytical method is presented to predict the shifts of the contact ellipses of spiral bevel gear teeth under load. The contact ellipse shift is the motion of the tooth contact position from the ideal pitch point to its location under load. The shifts are due to the elastic motions of the gear and pinion supporting shafts and bearings. The calculations include the elastic deflections of the gear shafts and the deflections of the four shaft bearings. The method assumes that the surface curvature of each tooth is constant near the unloaded pitch point. Results from these calculations will help designers reduce transmission weight without seriously reducing transmission performance.
Model predictive control for demand flexibility: Real-world operation of a commercial building with photovoltaic and battery systems
Hundreds of studies have investigated Model Predictive Control (MPC) for the optimal operation of building energy systems in the past two decades. However, MPC field tests are still uncommon, especially for small- and medium-sized commercial buildings and for buildings integrated with onsite renewables. This paper describes the implementation and the long-term performance evaluation of an MPC controller in a small commercial building equipped with behind-the-meter photovoltaics and electrochemical batteries. MPC controls space conditioning, commercial refrigeration, and the battery system. We tested two types of demand flexibility applications in the field: electricity bill minimization under time-of-use tariffs and responses to grid flexibility events. Results show that the proposed controller achieves 12% of annual electricity cost savings and 34% peak demand reduction against the baseline, while respecting thermal comfort and food safety. The field tests also demonstrate the ability of the MPC controller to provide a multitude of grid services including real-time pricing, demand limiting, load shedding, load shifting, and load tracking, using the same optimization framework.
Controlling distributed energy resources via deep reinforcement learning for load flexibility and energy efficiency
Behind-the-meter distributed energy resources (DERs), including building solar photovoltaic (PV) technology and electric battery storage, are increasingly being considered as solutions to support carbon reduction goals and increase grid reliability and resiliency. However, dynamic control of these resources in concert with traditional building loads, to effect efficiency and demand flexibility, is not yet commonplace in commercial control products. Traditional rule-based control algorithms do not offer integrated closed-loop control to optimize across systems, and most often, PV and battery systems are operated for energy arbitrage and demand charge management, and not for the provision of grid services. More advanced control approaches, such as MPC control have not been widely adopted in industry because they require significant expertise to develop and deploy. Recent advances in deep reinforcement learning (DRL) offer a promising option to optimize the operation of DER systems and building loads with reduced setup effort. However, there are limited studies that evaluate the efficacy of these methods to control multiple building subsystems simultaneously. Additionally, most of the research has been conducted in simulated environments as opposed to real buildings. This paper proposes a DRL approach that uses a deep deterministic policy gradient algorithm for integrated control of HVAC and electric battery storage systems in the presence of on-site PV generation. The DRL algorithm, trained on synthetic data, was deployed in a physical test building and evaluated against a baseline that uses the current best-in-class rule-based control strategies. Performance in delivering energy efficiency, load shift, and load shed was tested using price-based signals. The results showed that the DRL-based controller can produce cost savings of up to 39.6% as compared to the baseline controller, while maintaining similar thermal comfort in the building. The project team has also integrated the simulation components developed during this work as an OpenAIGym environment and made it publicly available so that prospective DRL researchers can leverage this environment to evaluate alternate DRL algorithms.
Development and validation of a second-order thermal network model for residential buildings
Heating, Ventilation, and Air Conditioning (HVAC) systems can maintain the space air temperature of residential buildings, either directly by heating/cooling the air, or indirectly via heat transfer to and from the building structure that acts as a thermal mass. Hence, HVAC systems can help achieve load shifting, peak load reduction, and/or energy cost saving, thus enabling grid-interactive HVAC operation. A home thermal model that can accurately reflect the dynamics of the space air and interior wall surface temperatures, is therefore valuable. This paper develops such a model using the standard RC (resistance-capacitance) approach. The model contains a virtual envelope node and an internal space node and is thus second-order. A hybrid parameter identification scheme, made up of the least-squares and optimal search methods, is also developed. The proposed model and scheme were validated using data collected from a test home. It was found that a modest amount of training data was sufficient to yield reliable parameter estimates and accurate prediction. It was also found that when making 24-hour-ahead prediction of the space air temperature, both methods had comparable performances when the training data began in a transition season. However, when they began in an HVAC season, the optimal search method performed better. Furthermore, the least-squares method is recommended during a transition season due to its lower computational burden, while the optimal search method is recommended during an HVAC season due to its better estimation performance.
Collaborative Decision Approach for Electricity Pricing-demand Response Stackelberg Game
Demand response programs are considered as a valuable resource in smart grids that provide several advantages of load shifting, peak load reduction, mediating intermittency of renewable energy integration, etc. Flexible price-based incentives have been recognized as a critical strategy in motivating and compensating consumers' load adjustment actions for successful implementation of demand response. Game theoretical approaches, especially Stackelberg games are popularly adopted to model the relationship between electricity price and customers' demand response and solved by the classical centralized backward induction (BI) method. However, the BI method generally requires convexity of the follower's model for necessary optimality conditions, and the computational time of any centralized approach increases sharply with larger problem instances. In this paper, the Stackelberg game of electricity pricing-demand response between a distribution system operator (DSO) and load aggregators (LAs) is decomposed based on a collaborative optimization (CO) framework, where each LA is treated as a discipline with its own domain constraints (e.g. building temperature control), while the DSO at the system level tries to reduce the solution discrepancy and guide the searching towards optimality. Several groups of comparison experiments have demonstrated the effectiveness of the proposed collaborative decision approach in solving the demand response game.