Engineering Papers⌕ Search

Engineering topics

Smith, Amanda D.

Publications and source records attributed to Smith, Amanda D..

On-policy learning-based deep reinforcement learning assessment for building control efficiency and stability

Artificial intelligence technologies have emerged as a game changer not only in specific applications such as image recognition and machine translation but also in many scientific domains. In particular, as deep reinforcement learning (DRL) has shown great success in complex control problems, DRL-based control has been considered as a potential solution to efficiently control and manage building systems. However, broad assessment of DRL-based building control is still required to characterize their pros and cons in comparison with conventional building control methods (e.g., rule-based feedback controls). In this paper, we assessed DRL-based controls with on-policy learning-based algorithms and continuous control actions for cooling control of large office buildings in the summer season to minimize whole-building energy use and occupant discomfort. We compared DRL-based control methods with two baseline control methods: (1) a pre-determined schedule with supply temperature and static pressure setpoints, and (2) advanced reset method that adjusts setpoints based on heuristic rules, i.e., ASHRAE Guideline 36. We also tested the DRL algorithms to evaluate their performances in multiple climate locations. We found that DRL-based control methods outperformed the baseline control methods in terms of energy savings while maintaining a thermal comfort. DRL reduced energy use between ~4%–22% on average compared to the baseline methods, depending on climate location. We also evaluated DRL-based control in terms of control stability and showed that DRL-based methods should address the span of hardware lifetimes in practical operations.

control stability↗

Methodology and analytical approach to investigate the impact of building temperature setpoint schedules

This work presents a method for generating a large set of stochastically varying temperature setpoint schedules for building performance simulations. It analyses tradeoffs resulting from specific changes to those schedules in terms of three quantities: total electricity consumption per day; maximum hourly electricity consumption per day and predicted percentage dissatisfied (occupant thermal comfort). The method for generating schedules requires a single base schedule as the starting point and, using a few clearly defined parameters, transforms it into a set of schedules that can be used for modelling an existing building stock or for performing parametric studies. Temperature setpoint schedules are generated and simulated for a small office building in a cool-dry climate in three different case studies pertaining to changing temperature setpoint schedules. Tradeoffs between the three output metrics are significant and vary based on the temperature setpoint schedules and the time of the year.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Multiscale Effects Masked the Impact of the COVID-19 Pandemic on Electricity Demand in the United States

Shelter-in-place orders and business closures related to COVID-19 changed the hourly profile of electricity demand and created an unprecedented source of uncertainty for the grid. The potential for continued shifts in electricity profiles has implications for electricity sector investment and operating decisions that maintain reserve margins and provide grid reliability. This study reveals that understanding this uncertainty requires an understanding of the underlying drivers at the customer-class scale. This paper utilizes three datasets to compare the impacts of COVID-19 on electricity consumption across a range of spatiotemporal and customer scales. At the utility/customer-class scale, COVID-19-induced shutdowns in the spring of 2020 shifted weekday residential load profiles to resemble weekend profiles from previous years. Total commercial loads declined, but the commercial diurnal load profile was unchanged. With only total loads available at the balancing authority scale, the apparent impact of COVID-19 was smaller during the summer due in part to phased re-opening and spatial variability in re-opening, but there were still clear variations once total loads were broken down zonally. Monthly data at the state scale showed an increase in state-level residential electricity sales, a decrease in commercial sales, and a small net decrease in total sales in most states from April-August 2020. Analyses that focus on total load or a single scale may miss important changes that become apparent when the load is broken down regionally or by customer class.

COVID-19, electricity demand, multiscale, Commonwe↗

Analysis of Automated Fault Detection and Diagnosis Records as an Indicator of HVAC Fault Prevalence: Methodology and Preliminary Results

Faults in commercial buildings can cause energy waste and other performance problems such as reduced occupant comfort, reduced equipment longevity, and increased noise. However, it is currently unknown how commonly faults occur in different equipment types. A method has been developed to estimate the prevalence of faults in air handling units, air terminal units, and rooftop units. This method includes two types of data. The first is data from several automated fault detection and diagnostics (AFDD) software technologies. This type of data provides a large sample that represents a wide range of building types, geographical locations, and equipment types. It includes fault diagnoses from thousands of buildings around the United States, as well as anonymized metadata describing the building and equipment characteristics. The number of fault records is in the order of 107. However, despite the size and richness of the data sample, this data contains some degree of inaccuracy, i.e., false positive and false negative findings. Therefore, the study includes a second type of data, coming from manual inspection of buildings that have had the same AFDD methods applied to them (from the commercial AFDD offerings). Since the field tests are conducted in buildings with AFDD-generated fault prevalence data, they can be combined with the larger sample size to provide insight into the potential biases or lower sensitivity of the AFDD data. Once a library of fault prevalence data is built, it will be studied to provide further insight into the drivers of fault prevalence, for example, whether prevalence is correlated with building type, geographical location (which is tied to climate and to utility rates), building size, etc. This paper describes the methods developed for this study and illustrates them with preliminary data. It discusses some of the challenges of harmonizing disparate outputs from multiple AFDD vendors, application of a unifying fault taxonomy, and fault prevalence metrics.

Ebrahimi Fakhar, Amir↗

Flexible Reinforcement Learning Framework for Building Control using EnergyPlus-Modelica Energy Models

In recent years, reinforcement learning (RL) methods have been greatly enhanced by leveraging deep learning approaches. RL methods applied to building control have shown potential in many applications due to their ability to complement or replace conventional methods such as model-based or rule-based controls. However, RL-based building control software is likely tailored either to one target building system or to a specific RL method so that significant additional effort would be required to customize the RL-based controller for use in other building systems or with other RL approaches. Also, RL-based building controls usually depend on building energy simulations to train controllers, so emulating building dynamics (i.e., thermal dynamics and control dynamics) and capturing sub-hourly dynamic profiles are crucial to further the development of effective RL-based building control methods. To address these challenges, we present an open source RL-based control software employing a high-fidelity hybrid EnergyPlus-Modelica building energy model which emulates building dynamics at 1-minute resolution. This software consists of decoupled components (environment, building emulator, control agent, and RL algorithm), which allows for quick prototyping and benchmarking of standard RL algorithms in different systems; for example, a single component can be replaced without revising all of the software. To demonstrate this software framework, we conducted a benchmark study using an EnergyPlus-Modelica building energy model for a Chicago office building with an RL-based controller to dynamically control the chilled water temperature setpoint and the air handling unit supply air temperature setpoint on selected floors.

Lee, Joon-Yong↗

Leveraging Open-Source Tools for Collaborative Macro-energy System Modeling Efforts

The authors are founding team members of a new effort to develop an Open Energy Outlook for the United States. The effort aims to apply best practices of policy-focused energy system modeling, ensure transparency, build a networked community, and work toward a common purpose: examining possible US energy system futures to inform energy and climate policy efforts. Individual author biographies can be found on the project website: https://openenergyoutlook.org/.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Design, Development and Testing Plan for Energy Efficiency Algorithms Related to Building-Integrated Cooling, Heating, and Power Systems

Building-integrated cooling, heating and power (CHP) systems are more efficient than conventional systems at providing local power and thermal energy, and favorable fuel prices are bound to spur their increased adoption. It is estimated that the total CHP technical potential in the commercial building sector is approximately 76 GW, but only a small fraction of it is actually deployed. Advanced control and monitoring systems that realize the full potential of these CHP systems can transform this capacity into an asset for both the owner and the grid and also accelerate the adoption of these systems in the building sector. However, to realize the full benefit of the CHP systems, we must ensure persistence of energy efficient operations. It has been demonstrated by several studies that as much as 30% of building energy use is wasted. Much of the waste results from the inability to anticipate load variations (design day vs. non-design day operations; diurnal variation of loads), identify improper operation, and efficiently operate, control and maintain building systems. Moreover, many buildings, even those with adequate control infrastructure, lack knowledgeable staff to operate and maintain energy systems. Operators of buildings with CHP systems will constantly need to make tradeoffs (economic dispatch) between onsite power generation and purchasing power, between onsite heat production from distributed generation versus heating/cooling from conventional systems, and different passive and active load management measures. Much of the inefficiency in the current building operations can be eliminated by use of automated performance monitoring (PM), real-time commissioning verification (CxV) and automated fault detection and diagnostic (AFDD) tools. Automation can help system operators make intelligent decisions. Remote and continuous monitoring of system conditions and performance will enable better management and integration of CHP with existing building systems. Continuous PM, real-time CxV and AFDD could alleviate burdens for operations staff, enhance operations and maintenance (O&M), and improve reliability of building and CHP systems. To address the O&M challenges and to provide a means to maximize the rate-of-return of building-integrated CHP systems, the Building Technologies Office (BTO) within the U.S. Department of Energy’s (DOE’s) Office of Energy Efficiency and Renewable Energy (EERE) initiated a project to design, develop, and field test a VOLTTRON™-based supervisory controller and associated open-source algorithms. These algorithms will ensure real-time optimal operation of a building-integrated CHP system, support electric grid reliability, and lead to achieving the goal of a clean, efficient, reliable and affordable next-generation integrated energy systems. This report lists the components for which PM, real-time CxV and AFDD algorithms will be developed, how the algorithms will be tested, and metrics that will be used to validate the algorithms and easy of deployment. Deployment of these algorithms in the field will result in savings reduction in energy consumption of between 10% and 20%.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Modeling Two-Phase Flow and Vapor Cycles Using the Generalized Fluid System Simulation Program

This work presents three new applications for the general purpose fluid network solver code GFSSP developed at NASA's Marshall Space Flight Center: (1) cooling tower, (2) vapor-compression refrigeration system, and (3) vapor-expansion power generation system. These systems are widely used across engineering disciplines in a variety of energy systems, and these models expand the capabilities and the use of GFSSP to include fluids and features that are not part of its present set of provided examples. GFSSP provides pressure, temperature, and species concentrations at designated locations, or nodes, within a fluid network based on a finite volume formulation of thermodynamics and conservation laws. This paper describes the theoretical basis for the construction of the models, their implementation in the current GFSSP modeling system, and a brief evaluation of the usefulness of the model results, as well as their applicability toward a broader spectrum of analytical problems in both university teaching and engineering research.

Smith, Amanda D.↗