Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “building HVAC”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Technology Development and Field Monitoring in nZEB - US Country report IEA HPT Annex 49 Task 3

The International Energy Agency (IEA) Heat Pumping Technologies (HPT) Annex 49, “Design and Integration of Heat Pumps for Nearly Zero Energy Buildings,” deals with the application of heat pumps (HPs) as a core component of the HVAC system for nearly or net-zero energy buildings. This report covers the Task 3 activities of the US team. Three institutions are involved on the US team and have worked on the following projects. 1) Oak Ridge National Laboratory (ORNL) summarized development activities since the conclusion of IEA HPT Annex 40 for several integrated HP (IHP) systems - electric ground-source IHP and air-source IHP versions and engine-driven AS-IHP version. 2) The University of Maryland partnered with ORNL and Blue Bear Management to develop a personal cooling device called RoCo that can provide personalized conditioned air to occupants in inadequately or unconditioned environments. With RoCo, building facility management can elevate the HVAC thermostat settings without compromising occupants’ thermal comfort. Researchers have found that a 4°F increase in thermostat settings can save 12–30% energy savings. Therefore, RoCo is a promising technology that can help reduce building energy consumption and facilitate achievement of net-zero energy building performance. 3) The National Institute of Standards and Technology (NIST) is working on a field study effort on the NIST Net-Zero Energy Residential Test Facility. Two air-source split-system HPs were installed in a residential, net-zero energy home that was constructed as a laboratory on the NIST campus in Gaithersburg, Maryland. The first HP was a two-stage, 7 kW (2 ton), 15.8 seasonal energy efficiency ratio (SEER), 9.05 heating seasonal performance factor (HSPF) conventionally ducted system; the second HP was a variable-speed, 10.6 kW (3 ton), 14 SEER, 8.35 HSPF, high-velocity ducted system. These two systems operated side by side, using separate supply ducts and a common return duct, on a weekly alternating schedule to condition the home that was operated with very consistent simulated thermal loads. The team wanted to determine whether the high-velocity system could provide comparable energy-use efficiency to the conventional system. The results of this study showed that it did meet the required loads and had slightly greater efficiency; the average cooling coefficient of performance (COP) was (0.40 ± 0.11) higher, and the average heating COP was statistically equal. A new firmware was provided at the end of the heating season that greatly improved the performance of the high-velocity system; its average heating COP went from (1.8 ± 0.9) to (2.5 ± 1.1) at a 95% confidence level. The new firmware heating COP averaged (1.05 ± 0.23) higher than the old firmware over the same outdoor temperatures. The defrost performance is very different for these two systems, yet they consumed equivalent energy per HDD. The conventional system uses a timed-initiate, temperature-terminate algorithm with auxiliary electric resistive heating, whereas the high-velocity system uses calculated evaporator parameters with a hot-gas bypass before a full reverse-cycle defrost with no supplementary resistive heat.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

ResStock Measure Documentation: HVAC Load Flexibility

This report is part of a series describing different ResStock(TM) measures. "Measures" refers to energy efficiency retrofits that can be applied to buildings during modeling. This documentation covers the "HVAC Load Flexibility" measure upgrade methodology and briefly discusses key results.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Multi-Agent Hierarchical Deep Reinforcement Learning for HVAC Control With Flexible DERs

As electricity consumption in commercial and residential buildings continues to rise, reducing energy costs presents an increasing challenge. Heating, ventilating, and air-conditioning (HVAC) systems, which typically account for 40%-50% of a building's energy use, are prime targets for energy savings. Intelligent control of HVAC temperature through the exploitation of HVAC load flexibility brings significant potential to reduce energy consumption and electricity expenses. The nonlinear models of HVAC systems challenge traditional control methods, while the uncertainty introduced by HVAC load flexibility complicates distributed energy resource (DER) management using conventional optimal dispatch techniques. In response to these challenges, we propose a hierarchical multi-agent deep reinforcement learning (DRL) approach. The lower-level agents focus on balancing comfort and energy conservation, while the upper-level DRL agents optimize the use of DERs to reduce peak demand based on the control outcomes of the HVAC by the lower-level agents. Here, in the upper-level agents, we incorporate a multi-agent structure based on ensemble learning, which acts based on historical and current data without relying on precise load forecasting to address the delayed rewarding issue in DRL. This allows for the effective reduction of energy costs. The proposed method is tested using a real-world microgrid comprising 413 buildings in Southern California, and the results demonstrate that our approach can significantly reduce overall electricity bills while ensuring the comfort of consumers and residents.

24 POWER TRANSMISSION AND DISTRIBUTION↗

What's in a Name? Developing a Standardized Taxonomy for HVAC System Faults

Faults occurring in heating, ventilation and air-conditioning (HVAC) systems have significantly negative impacts on building energy consumption, occupant comfort, and indoor air quality. In the past thirty years, extensive research has been conducted on fault detection and diagnostics (FDD) methods, and there are now dozens of commercially available FDD software tools. Growing adoption of FDD tools has the potential to generate a massive and useful data set on fault characteristics. However, the lack of a unifying taxonomy is a significant barrier to efficient analysis and evaluation of FDD outputs. Therefore, there is a strong need to develop a robust taxonomy which can better represent and interpret FDD output data. This paper documents the development of a unifying taxonomy for HVAC system faults in commercial buildings, with initial focus on air handling units, variable air volume terminal units, and roof top unit systems. The developed fault taxonomy employs both a physical hierarchy of HVAC equipment and a cause-effect relationship model as tools to better understand and support root cause analysis for HVAC faults. A variable air volume terminal unit is used as an example to demonstrate the application of the developed fault taxonomy. The taxonomy has short-term application in a major U.S. study on fault prevalence, and promises longer term benefits to FDD software developers and building operators by creating a foundation for improved approaches to identifying and resolving HVAC faults.

Chen, Yimin↗

Development of a simplified calibrated building simulation model of a supermarket for proposed ECMs and control strategies impact evaluation

Calibrated building energy simulation is an important pathway to more energy-efficient buildings, but the information requirements of some approaches to this problem are significant. This is particularly true for supermarkets and other so-called “big-box” retail stores. Another characteristic of supermarkets is the significant interaction between Heating Ventilating and Air Conditioning (HVAC) and refrigeration systems in these buildings. These buildings could contain a wide variety of systems and a degree of load diversity that makes calibrated modeling a challenge. This paper describes a simplified approach that uses OpenStudio and EnergyPlus to combine known building parameters with “typical” parameters, resulting in a simplified building that is amenable to calibration. This approach was applied to a big-box store located in Nashville, Tennessee, and a calibrated model was obtained that was used to study potential energy conservation measures. Further, the paper also explores the capabilities of whole-building energy modeling tools, such as EnergyPlus, for modeling the HVAC controls and sequences and their impact evaluation. Although some measures are precluded by the model simplicity, several measures were found to improve the efficiency of the model and demonstrate that the simplified modeling approach is effective. Practical Application: This paper introduces a hybrid approach of building energy model calibration using limited information available from the actual building in combination with characteristics of a “typical” building of the same type. This hybrid approach would also be applicable for other building types than discussed in this paper to calibrate the building energy model using limited information from the actual building.

42 ENGINEERING↗

Brick Schema Standardized Plug Load Control Strategies for Load Reduction: Preprint

Plug loads comprise a significant percentage of commercial building energy consumption. Applying intelligent controls to turn off plug loads when unused can provide dynamic load reduction and flexibility, which are key traits of grid-interactive efficient buildings. This capability is important for equitable decarbonization as it can enable disadvantaged communities to electrify buildings without costly upgrades to electrical infrastructure. In this work, we present the effectiveness of various control strategies along with the operational lessons that informed their design. During a three-year period, we operated over 600 smart outlets in 12 university office buildings. The attached plug loads consisted primarily of printers, TVs, water dispensers, and copiers. After recording baseline power measurements for one year, we designed plug load control (PLC) strategies for each plug load type, use, and for different risk tolerance levels because PLC can potentially be disruptive to daily work. We used the Brick Schema to facilitate the management of plug load locations and other metadata. For advanced controls, we integrated the smart plugs with heating, ventilation, and air conditioning (HVAC) systems through the campus building automation system. We found static schedules to be the least disruptive and most predictable for occupants, resulting in 38% and 66% energy savings in two studies. For printers, print server-triggered PLC produced 86% savings, the highest of all strategies with minimal occupant impact. Scheduling of water dispensers and digital signage TVs produced 49% and 70% savings respectively with opportunities to improve performance with the use of HVAC occupancy data.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗

Energy Demand Management in Buildings Using PCM-Integrated Wall

The buildings in the United States annually consume nearly 40% of total U.S. energy consumption and approximately 75% of U.S. electricity consumption. Almost half of the total U.S. energy consumption in buildings is attributed to the space conditioning through Heating, Ventilation, and Air Conditioning (HVAC) systems. Utilizing thermal energy storage in buildings, particularly integrating phase change material (PCM) in the walls, has been reported to be an effective method of managing the space heating and cooling loads. This presentation covers an in-depth discussion on the integration of a PCM to building walls, the key conditions required for effective utilization of the PCM, and effect of the PCM transition temperature and the PCM location on energy-saving potential of the PCM-integrated wall.

building↗

Development of a water source heat pump hardware-in-the-loop (HIL) testing facility for smart building applications

Over the last decade, the global fight against climate change through electrification has led to an increase in research on building heating, ventilation, and air conditioning (HVAC) systems that utilize intelligent control algorithms to provide demand-side grid service while maintaining the thermal comfort of building occupants. As the pivotalpoint between building electricity consumption and indoor thermal comfort, high-efficiency electrical heatpumps are at the center of these emerging studies, and various grid-interactive and occupant-comfort control algorithms have been developed for them. The impact of these algorithms on the heatpump operation andperformance under different weather, building load, and grid requests calls for investigation and verification via experimental tests with actual heat pumps integrated with real-time building and grid responses. This study presents a Water-Source Heat Pump Hardware-in-The-Loop (HIL) Test Facility developed with the capability to perform such tests. The hardware configuration for this testfacility introduces a hydronic system that emulates the conditions for the heat pump water-side, and a duct system that emulates conditions for the heat pump airside. Both data acquisition and emulator control are implemented through the National Instruments (NI) LabVIEW software running on an NI PXIplatform. The HIL mechanism based on the hardware-software integration that allows the testbed to communicate with a generic simulation environment is also discussed. Currently, the test facility setup includes a single heatpump and virtual building model in EnergyPlus coupled with an occupant behavioral model in MATLAB. Preliminary test results of the current setup demonstrate the building load emulator's ability to track the simulated gone temperature with a Root Mean Square Deviation (RSME) below 0.12°C (0.216°F). An uncertainty analysis based on sensor accuracies shows that the heat pump coefficient of performance (COP) can be measured with a relative uncertainty of 10.4% in cooling and 3.7% in heating. Apartfrom the current testing on a single heat pump, the test facility also provides the flexibility to include additional heat pumps to form a heat pump cluster, as well as coupling the heat pump with active thermal storage to provide enhanced demandflexibility.

Calfa, Caleb↗

Automated Air Sealing Demonstration: Denver Federal Center Building 40

This project aimed to demonstrate building airtightness achieved by automated air sealing in a commercial building setting. The automated air sealing demonstrated in this project uses a modified blower door to pressurize and distribute the sealing aerosol to achieve the required building airtightness. To demonstrate this technology, Building 40 at the Denver Federal Center, a federally owned campus under the jurisdiction, custody and control of the U.S. General Services Administration (GSA), was selected for testing (Figure 2). This building is currently undergoing several retrofit projects, including increasing insulation, installing high-performance windows, and adding advanced equipment, control systems, and automated air sealing. This demonstration project involved installing automated air sealing and measuring the improvements in the building's airtightness. The automated air sealing was installed over two days by AeroBarrier, the vendor. An external blower door test contractor measured the airtightness of the demonstration space before and after air sealing. The new airtightness value and the percentage increase in airtightness were used to evaluate the energy savings potential of automated air sealing. These airtightness values were used to compute the energy savings and CO 2 emissions reduction for different climate zones, building types, and initial airtightness conditions. In addition, the heating, ventilation and air conditioning (HVAC) load reduction attributable to the reduced building air leakage was studied. This study included research to determine the cost and time reduction of automated air sealing. Finally, the automated air sealing performance was evaluated qualitatively using a focus group discussion that included GSA and Bristol, the general contractor. The installation has shown the demonstration site, with a floor size of 4,462 ft 2 , air leakage has reduced by more than 50% in less than 7 hours, including preparation, site sealing, and cleanup. The performance objectives were classified as quantitative or qualitative based on the evaluation metrics used to assess the project’s success. The key performance objectives for this project were the level of airtightness achieved, the time and cost required to perform the sealing, and the HVAC load reduction attributable to air sealing. Table 1 shows the quantitative performance objectives.

42 ENGINEERING↗

HVAC End-of-Life: Options and Best Practices

When heating, ventilating, and air-conditioning (HVAC) systems reach end-of-life status, building owners typically seek the quickest, most cost-effective replacement. Although there are several rooftop unit (RTU) replacement tool kits and programs to guide clients through this process, there is limited information on how to handle end-of-life HVAC systems. This fact sheet provides relevant information to help building owners manage proper disposal of HVAC systems, how to navigate regulations, and how to recover economic value from old systems.

30 DIRECT ENERGY CONVERSION↗

Retrofitting Buildings with Solar-Reflective Roofs and Walls and its Impact on Peak Power Demand

Buildings are a major consumer of electricity in the United States and a significant portion of the consumption comes from heating, ventilation, and air-conditioning (HVAC) applications. Passive cooling strategies in the building envelope help to reduce the energy consumption for HVAC as well as peak electricity demand. Although being one of the most cost-effective passive cooling strategies, modern reflective roofing and reflective exterior wall technology is not well documented for its impact on peak demand. This study utilized whole building energy simulations on residential and commercial building prototype models to quantify the impact of cool roofs and cool exterior walls. The analysis was performed in three climate zones with varying insulation levels and solar reflectances for roofs and exterior walls. For both the residential and commercial buildings, the baseline building had a roof solar reflectance value of 0.10 and an exterior wall solar reflectance value of 0.25. The results from the simulations show that roofs and exterior walls with higher reflectance values increase cooling energy savings but can also increase heating energy consumption. The impact of changes in solar reflectances was greater in buildings with low roof/wall insulation levels compared to roofs/walls with higher insulation levels. A baseline for the simulations was set with the roof and exterior wall solar reflectances set at 0.1 and 0.25, respectively and simulations having varying roof and exterior wall thermal resistances were compared to the baselines.

14 SOLAR ENERGY↗

Performance assessment of a real water source heat pump within a hardware-in-the-loop (HIL) testing environment

Over the last decade, the global fight against climate change through electrification has led to an increase in research on building heating, ventilation, and air conditioning (HVAC) systems that utilize intelligent control algorithms to provide demand-side grid service while also maintaining the thermal comfort of building occupants. As the pivotal point between building electricity consumption and indoor thermal comfort, high-efficiency electrical vapor-compression heat pumps are at the center of these emerging studies, and various grid-interactive and occupant-comfort control algorithms have been developed for them. The impact of these algorithms on heat pump operation and performance when subjected to different weather conditions, building loads, and grid requests calls for investigation and verification via experimental testing with actual heat pumps integrated with real-time building and grid responses. This study introduces a Water-Source Heat Pump (WSHP) Hardware-in-The-Loop (HIL) Test Facility that is the first of its kind. This testbed utilizes a 2-ton variable speed water-to-air heat pump that is capable of interacting with a virtual environment currently comprised of an EnergyPlus (E+) building simulation, an agent-based occupant behavioral model, and a single U-tube ground-loop heat exchanger (GLHE) model. Detailed descriptions of the testbed’s physical design and operation, virtual environment, as well as their mutual communication is provided. An uncertainty analysis is also performed under manufacturer specified heating and cooling design conditions. This analysis shows that the total load across the WSHP’s demand side heat exchanger, i.e., the sum of its latent and sensible components, can be measured with a relative uncertainty of ± 10.4% and ± 3.6% in cooling and heating mode respectively. The WSHP’s coefficient of performance (COP) can be measured with relative uncertainties of ± 10.4% in cooling mode, and ± 3.7% in heating mode. A preliminary 24-h experimental demonstration is then performed utilizing the DOE prototype small commercial office building model in E+. The simulation takes place in Atlanta, GA on the date of 08/26/15 from 12:00 AM to 11:59 PM using TMY3 weather data. Here, the results from this demonstration show that over the course of this experiment the simulated outputs of zone dry-bulb temperature, zone humidity ratio, and WSHP inlet water temperature can be tracked by testbed emulators up to a root mean squared error (RMSE) of ± 0.27 °C, ± 0.376 g/kg, and ± 0.85 °C respectively. The WSHP’s dynamic behavioral characteristics and performance are also captured, and correspond well with the authors’ previous understanding of heat pump efficiency as a function of evaporator and condenser fluid inlet conditions respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Low-cost Manufacturing of Semitransparent CdTe PV for Building Integration

Solar has been demonstrated to be a robust renewable energy source, constituting a significant portion of the United States’ renewable energy portfolio. Despite its growth across residential, commercial, and utility sectors over the past decades, it remains a small fraction of the overall energy infrastructure. Challenges persist in fully harnessing solar power to meet the nation's escalating energy demands. Among these challenges lies the hurdle of efficiently distributing large quantities of solar-generated electricity to densely populated regions with the highest energy needs and costs. Traditional utility-scale arrays demand extensive land, a luxury often unavailable in metropolitan areas. Consequently, installations must be situated at a distance, necessitating additional infrastructure for electricity transmission to service areas. While metropolitan landscapes lack sprawling open spaces suitable for conventional utility-scale solar deployment, they offer a different resource: windows. Semitransparent photovoltaic window technology has the potential to not only bolster the grid's energy capacity, but to also provide HVAC and economic advantages to building owners. However, commercial availability of building-integrated photovoltaic windows remains limited. Silicon based photovoltaics currently dominate the solar market but adapting them for use in windows poses a variety of engineering and economic challenges such as relatively low power density, high costs associated with custom manufacturing, and aesthetic considerations. Addressing these challenges, this project explored the use of laser ablation patterning to manufacture cost-effective, high-efficiency, semitransparent Cadmium Telluride photovoltaic modules. Results showcased the potential of this methodology in developing photovoltaic windows and other innovative semitransparent PV applications. The ablation manufacturing technique demonstrated great versatility in achieving different patterns and levels of visible light transmission, and the power loss due to ablation was nearly directly proportional to the amount of material removed. Furthermore, the manufacturing process for Cadmium Telluride modules already has established advantages in material and energy efficiency, and the conversion of a standard submodule to semitransparent essentially requires a single additional process step, ensuring scalability. It is important to note that during this work, Toledo Solar experienced substantial organizational upheaval stemming from a lawsuit with First Solar. An external investigation led the board of directors to remove and replace the previous management team, and several other members of the staff elected to depart as well, including the then acting Principle Investigator on this project. The remaining Toledo Solar team attempted to recover from the disruption and deliver on the remaining tasks, but upon its own review, the Department of Energy ruled the project in default and terminated the contract in December 2023.

14 SOLAR ENERGY↗

Energy Analysis of Combi Heat Pump System Configurations for Space Conditioning and Domestic Hot Water Heating in Residential Buildings

Combi heat pump systems, also referred to multifunctional variable refrigerant flow heat recovery (MF-VRFHR) systems, are specifically designed for residential applications to manage both space conditioning and domestic hot water (DHW). They have attracted attention due to their potential for energy conservation through heat recovery. The incorporation of a hot water tank introduces various system configurations, each characterized by distinct pros and cons related to energy efficiency, system stability, and maintenance. Despite this, a critical gap exists as the specific energy performance remains unquantified under diverse operational modes (e.g., heating mode and heat recovery mode). This paper aims to bridge this gap by conducting a comprehensive comparative analysis of two prevalent system configurations while considering feasible proposed control logics. Configuration 1 integrates a separate hot water tank and a refrigerant-to-water heat exchanger (HEX), also known as a Hydro Kit while Configuration 2 incorporates a refrigerant-wrapped hot water tank. To facilitate this analysis, we developed high-fidelity system models for both configurations in Modelica, capturing system dynamics and detailed control sequences effectively. These system models were built upon the TIL library for HVAC equipment components and the Buildings library for residential building thermal load calculations. The validation of the simulation testbed utilized data from experiments conducted in the PNNL lab home for Configuration 1. To establish the simulation testbed for Configuration 2, we extended the modeling setup derived from Configuration 1. This extension specifically involved substituting the separate hot water tank and Hydro Kit with a refrigerant-wrapped hot water tank of similar sizing sourced from an actual product. The simulation analysis of heating-only and heat recovery modes reveals that Configuration 2 not only saves energy and maintains warmer tank temperatures but also demonstrates faster water heating capabilities. This is attributed to decreased energy loss and improved heat transfer. The study encompasses a wide range of scenarios, considering diverse thermal loads and water usage patterns across heating and heat recovery modes. Overall, the comprehensive results indicate that Configuration 2 achieves energy savings ranging from 3.5% to 12.2% compared to Configuration 1, depending on factors such as water usage patterns, thermal loads, and operational modes.

Configuration, Comparison, Multi-functional, Resid↗

Sumner County Field Validation: An Assessment of Thermal Energy Storage in Municipal Buildings in Mixed-Humid Climates

The overall aim of the project was to conduct a full-scale implementation of TES in an operational administrative building in Sumner County, Kansas with a special focus of phase change material (PCM) passive implementation in the ceiling envelope. PCM was used with the intention of increasing the ability of public buildings to shift the peak HVAC energy demand and consumption. The study was conducted during the span of three years in 3 phases, (i) phase I: energy audit (pre-retrofit) (ii) phase II: ceiling tile installation (PCM retrofit), and (iii) phase III: energy evaluation (post-retrofit). Temperature and HVAC energy measurements as well as weather data collected is used for an extensive validation study and further parametric assessment to find (a) annual HVAC energy savings (b) peak period electricity and load savings focusing on cooling dominant months of the year.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Smart, Connected Manufactured Housing Solutions through High-Performance Design. Final CRADA report

This report focuses on HVAC, domestic hot water, and miscellaneous electric loads via voluntary opportunities that may arise from partnerships with utilities, as well as future US Environmental Protection Agency ENERGY STAR and DOE Zero Energy Ready Manufactured Home programs. Phase I of this project has begun the technical dialogue toward developing an implementation plan among DOE’s Oak Ridge National Laboratory, Clayton Manufactured Homes, and US Department of Housing and Urban Development Code manufactured housing stakeholders. These activities have focused on delivering high-performance design through integration of technology. Project tasks include the following: Identifying baseline energy analysis resources opportunities from a variety of DOE and utility stakeholders; Developing a smart home and business solution by leveraging existing utility programs working with Smart Homes Partners resources such as ACE IoT Solutions, Google Nest, and Ecobee; Developing improved smarter ventilation systems with industry ventilation partners such as the Madison Group; Developing improved building science QA/QC testing equipment with manufacturers such as The Energy Conservatory, and supporting other feasible concepts vetted under DOE’s Advanced Buildings Collaborative with Slipstream, reinventing HVAC in manufactured housing; and, Developing smart home short- and long-term viable technical solutions in coordination with Clayton Manufactured Homes in new and/or revitalized community scales for future Phase II prototype demonstrations, which may include design (and perhaps construction) of single-section homes targeting rental property developers and multi-section homes targeting low- to middle-income affordable housing community developers Given the ongoing US Department of Energy (DOE) rulemaking activities, baseline energy analysis assessments of envelope prescriptive and Uo (i.e., the overall thermal energy efficiency of the home in British thermal units per square foot of exterior heat loss/gain surfaces) measures were removed from the scope of Phase I of this project.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Automated Control of Transactive HVACs in Energy Distribution Systems

Heating, Ventilation, and Air Conditioning (HVAC) systems contribute significantly to a building’s energy consumption. In the recent years, there is an increased interest in developing transactive approaches which could enable automated and flexible scheduling of HVAC systems based on the customer demand and the electricity prices decided by the suppliers. Flexible and automated scheduling of the HVAC systems make it a prime source for participation in residential demand response or transactive energy systems. Therefore, it is of significant interest to identify an optimal strategy to control the HVAC systems. Here, reducing the energy cost while keeping the comfort level acceptable to the users, we argue that such a control strategy should consider both the energy cost and user comfort simultaneously. Accordingly, we develop the control strategy through the solution of an optimization problem that balances between the energy cost and consumer’s dissatisfaction. This optimization enables us to solve a decision-making problem through first price prediction and then choosing HVAC temperature settings throughout the day based on the predicted price, history of the price and HVAC settings, and outside temperature. More specifically, we formulate the control design as a Markov decision process (MDP) using deep neural networks and use Deep Deterministic Policy Gradients (DDPG)-based deep reinforcement learning algorithm to find the optimal control strategy for HVAC systems that balances between electricity cost and user comfort.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗