Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Building control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Reinforcement Learning Control for Buildings Co-Optimizing Energy, Comfort, and Indoor Air Quality: An Annual Assessment

Efficient control of Heating, Ventilation, and Air Conditioning (HVAC) systems is crucial for optimizing energy use and maintaining indoor comfort in buildings. Traditional control methods, such as PID control, cannot handle energy use trade-offs among multiple components in the building energy system at a supervisory level. Reinforcement learning (RL) presents a promising solution, offering adaptive and data-driven control strategies that optimize performance over time. However, RL also faces several challenges, including the conflicts encountered in co-optimizing energy savings, occupant comfort, and indoor air quality, and the requirement for extensive interactions with the environment in training. We proposed a flexible simulation platform that integrates a hybrid model for RL training and designed an RL agent to control the entire central HVAC system, focusing on co-optimizing energy consumption, thermal comfort, and indoor air quality ($\text{CO}_{2}$ and PM2.5 concentrations). Finally, we evaluated the RL agent's performance over an annual cycle. Our findings indicate that the RL agent can effectively manage the HVAC system with 14.7 % energy savings annually and balance multiple objectives, which demonstrates significant potential for improving HVAC system control and sustainability in buildings.

Guo, Fangzhou↗
DOE OSTI2023

Skewering the silos: using Brick to enable portable analytics, modeling and controls in buildings

Nearly all large commercial buildings have heating, ventilation and air conditioning (HVAC) systems, lighting systems, safety and other systems controlled by a computer—a dedicated server with a building energy management system (BMS). However, these BMSs are proprietary with each building’s assets (that is, fans, valves, pumps, and their setpoints) named and coded uniquely by the BMS vendor or engineer; building analytics and control algorithms are written specific to the assets and the building. Thus, any control updates or analytics to improve building performance—especially critical to reduce greenhouse emissions or improve load flexibility—are labor intensive and costly. The Brick schema was developed so the same analysis or control algorithms can work on a variety of buildings if each is digitally represented in a Brick data model. The goal of this project was to further the development of Brick to extend it beyond an academic project with demonstrated success in a small field study, to a practical choice for industrial and commercial stakeholders seeking to realize value from building data. To do this, we executed four objectives: (1) expand the Brick schema including its modeling capabilities and vocabulary, (2) develop tools for integrating Brick with existing digital technologies and representations in buildings, (3) develop an open-source analytics platform to facilitate use of Brick in delivering data value, and (4) demonstrate Brick-driven analytics and controls in real settings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Sensor impacts on building and HVAC controls: A critical review for building energy performance

Building operations rely heavily on control systems and sensors. This paper provides a sophisticated literature review on sensor systems in building/HVAC systems, particularly in the context of controls, and their impacts on energy efficiency and thermal comfort. This study aims to understand the previous and current research and identify future research opportunities on this subject. The reviewed sensor systems were used for heuristic rule-based controls, local controls, and advanced optimal controls for existing and emerging technologies. Five major aspects of sensors are reviewed here: control loops for sensors, sensor types, sensor locations, sensor data, and a sensor impact evaluation framework. To augment the literature review, comprehensive standardized interviews were also conducted with relevant industry experts and practitioners. These interviews were designed and performed to (1) identify significant factors for selecting sensor sets and current undergoing issues, (2) identify potential improvements in sensor configuration/deployment, and (3) integrate expert (e.g., researcher, building operation practitioner) knowledge and experiences to develop structured use-case scenarios. Researchers collected and analyzed 31 interview responses for this paper.

Building control↗
NASA NTRS1993

Active control of buildings during earthquakes

The objective of this report is to provide an overview of the different types of control systems used in buildings, to discuss the problems associated with current active control mechanisms, and to show the cost-effectiveness of applying active control to buildings. In addition, a small case study investigates the feasibility and benefits of using embedded actuators in buildings. Use of embedded actuators could solve many of the current problems associated with active control by providing a wider bandwidth of control, quicker speed of response, increased reliability and reduced power requirement. Though embedded actuators have not been developed for buildings, they have previously been used in space structures. Many similarities exist between large civil and aerospace structures indicating that direct transfer of concepts between the two disciplines may be possible. In particular, much of the Controls-Structures Interaction (CSI) technology currently being developed could be beneficially applied to civil structures. While several buildings with active control systems have been constructed in Japan, additional research and experimental verification are necessary before active control systems become widely accepted and implemented.

Vance, Vicki L.↗
DOE OSTI2021

Hardware-Based Emulator with Deep Learning Model for Building Energy Control and Prediction Based on Occupancy Sensors’ Data

Heating, ventilation, and air conditioning (HVAC) is the largest source of residential energy consumption. Occupancy sensors’ data can be used for HVAC control since it indicates the number of people in the building. HVAC and sensors form a typical cyber-physical system (CPS). In this paper, we aim to build a hardware-based emulation platform to study the occupancy data’s features, which can be further extracted by using machine learning models. In particular, we propose two hardware-based emulators to investigate the use of wired/wireless communication interfaces for occupancy sensor-based building CPS control, and the use of deep learning to predict the building energy consumption with the sensor data. We hypothesize is that the building energy consumption may be predicted by using the occupancy data collected by the sensors, and question what type of prediction model should be used to accurately predict the energy load. Another hypothesis is that an in-lab hardware/software platform could be built to emulate the occupancy sensing process. The machine learning algorithms can then be used to analyze the energy load based on the sensing data. To test the emulator, the occupancy data from the sensors is used to predict energy consumption. The synchronization scheme between sensors and the HVAC server will be discussed. We have built two hardware/software emulation platforms to investigate the sensor/HVAC integration strategies, and used an enhanced deep learning model—which has sequence-to-sequence long short-term memory (Seq2Seq LSTM)—with an attention model to predict the building energy consumption with the preservation of the intrinsic patterns. Because the long-range temporal dependencies are captured, the Seq2Seq models may provide a higher accuracy by using LSTM architectures with encoder and decoder. Meanwhile, LSTMs can capture the temporal and spatial patterns of time series data. The attention model can highlight the most relevant input information in the energy prediction by allocating the attention weights. The communication overhead between the sensors and the HVAC control server can also be alleviated via the attention mechanism, which can automatically ignore the irrelevant information and amplify the relevant information during CNN training. Our experiments and performance analysis show that, compared with the traditional LSTM neural network, the performance of the proposed method has a 30% higher prediction accuracy.

Ye, Zhijing↗
DOE OSTI2020

Innovations in Sensors and Controls for Building Energy Management: Research and Development Opportunities Report for Emerging Technologies

Sensors, actuators, and controllers, which collectively serve as the backbone of cyberphysical systems for building energy management, are one of the core technical areas of investment for achieving the U.S. Department of Energy (DOE) Building Technologies Office's (BTO's) goals for energy affordability in the national building stock - both commercial and residential. In fact, an aggregated annual energy savings of 29% is estimated in the commercial sector alone through the implementation of efficiency measures using current state-of-the-art sensors and controls to retune buildings by optimizing programmable settings based on occupant schedules and comfort requirements, as well as detecting and diagnosing equipment operation and installation problems (Fernandez et al. 2017). Monitoring and control of building conditions and operations has advanced significantly, from the invention of the modern thermostat just before the start of the 20th century to the midcentury incorporation of direct digital control into devices, the introduction of open protocols and network communications at the end of the century, and finally the invention of cloud-based computing and additional advancements that have enabled remote operation and a proliferation of connected and intelligent devices in building automation. Despite this potential, however, two main challenges hinder widespread adoption of sensors and controls in building operations that can ensure savings for high-efficiency components and equipment (e.g., heat pumps, windows, and lighting devices), as well as additional savings from more sophisticated control architectures and algorithms. energy savings of 29% is estimated in the commercial sector alone through the implementation of efficiency measures using current state-of-the-art sensors and controls to retune buildings by optimizing programmable settings based on occupant schedules and comfort requirements, as well as detecting and diagnosing equipment operation and installation problems (Fernandez et al. 2017). Monitoring and control of building conditions and operations has advanced significantly, from the invention of the modern thermostat just before the start of the 20th century to the midcentury incorporation of direct digital control into devices, the introduction of open protocols and network communications at the end of the century, and finally the invention of cloud-based computing and additional advancements that have enabled remote operation and a proliferation of connected and intelligent devices in building automation. Despite this potential, however, two main challenges hinder widespread adoption of sensors and controls in building operations that can ensure savings for high-efficiency components and equipment (e.g., heat pumps, windows, and lighting devices), as well as additional savings from more sophisticated control architectures and algorithms.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Reinforcement Learning for Intelligent Building Energy Management System Control *

A building energy management system (BEMS) is a computer-based system designed to monitor and control a building's energy needs. Modern BEMS rely on the sensing and connectivity capabilities of Internet of Things (IoT) technology to intelligently adjust the energy consumption to reduce cost while respecting the consumers' preferences. Increasingly, control decisions are made based on predictions by models trained using supervised machine learning methods, which still requires control policies to be formulated in a rule-based fashion. When using reinforcement learning (RL) instead, control policies are learned by observing the utility in terms of cost and comfort associated with actions such as a change in the heating system's setpoint. The resulting RL-based controllers can capture not only the dynamics of the building and the associated electrical devices, but also fluctuations in electricity prices and user demand, avoiding the need to combine multiple predictive models with tailored control policies. This chapter will provide an overview of RL-based approaches for BEMS. After sketching the taxonomy of general RL methods, we discuss the implications of relying on the individual methods in a BEMS context. Existing work applying RL is presented along the key devices controlled by BEMS systems. Finally, we summarize the state-of-the-art and sketch limitations and open research directions.

Kotevska, Olivera↗
DOE OSTI2021

Learning-based framework for sensor fault-tolerant building HVAC control with model-assisted learning

As people spend up to 87% of their time indoors, intelligent Heating, Ventilation, and Air Conditioning (HVAC) systems in buildings are essential for maintaining occupant comfort and reducing energy consumption. These HVAC systems in smart buildings rely 'on real-time sensor readings, which in practice often suffer from various faults and could also be vulnerable to malicious attacks. Such faulty sensor inputs may lead to the violation of indoor environment requirements (e.g., temperature, humidity, etc.) and the increase of energy consumption. While many model-based approaches have been proposed in the literature for building HVAC control, it is costly to develop accurate physical models for ensuring their performance and even more challenging to address the impact of sensor faults. In this work, we present a novel learning-based framework for sensor fault-tolerant HVAC control, which includes three deep learning based components for 1) generating temperature proposals with the consideration of possible sensor faults, 2) selecting one of the proposals based on the assessment of their accuracy, and 3) applying reinforcement learning with the selected temperature proposal. Moreover, to address the challenge of training data insufficiency in building-related tasks, we propose a model-assisted learning method leveraging an abstract model of building physical dynamics. Through extensive experiments, we demonstrate that the proposed fault-tolerant HVAC control framework can significantly reduce building temperature violations under a variety of sensor fault patterns while maintaining energy efficiency.

Xu, Shichao↗
DOE OSTI2025

Efficient and assured reinforcement learning-based building HVAC control with heterogeneous expert-guided training

Abstract Building heating, ventilation, and air conditioning (HVAC) systems account for nearly half of building energy consumption and $$20\%$$ of total energy consumption in the US. Their operation is also crucial for ensuring the physical and mental health of building occupants. Compared with traditional model-based HVAC control methods, the recent model-free deep reinforcement learning (DRL) based methods have shown good performance while do not require the development of detailed and costly physical models. However, these model-free DRL approaches often suffer from long training time to reach a good performance, which is a major obstacle for their practical deployment. In this work, we present a systematic approach to accelerate online reinforcement learning for HVAC control by taking full advantage of the knowledge from domain experts in various forms . Specifically, the algorithm stages include learning expert functions from existing abstract physical models and from historical data via offline reinforcement learning, integrating the expert functions with rule-based guidelines, conducting training guided by the integrated expert function and performing policy initialization from distilled expert function. Moreover, to ensure that the learned DRL-based HVAC controller can effectively keep room temperature within the comfortable range for occupants, we design a runtime shielding framework to reduce the temperature violation rate and incorporate the learned controller into it. Experimental results demonstrate up to 8.8 X speedup in DRL training from our approach over previous methods, with low temperature violation rate.

Xu, Shichao↗
DOE OSTI2022

Cascaded Control for Building HVAC Systems in Practice

Actuator hunting is a widespread and often neglected problem in the HVAC field. Hunting is typically characterized by sustained or intermittent oscillations, and can result in decreased efficiency, increased actuator wear, and poor setpoint tracking. Cascaded control loops have been shown to effectively linearize system dynamics and reduce the prevalence of hunting. This paper details the implementation of cascaded control architectures for Air Handling Unit chilled water valves at three university campus buildings. A framework for implementation the control in existing Building Automation software is developed that requires only a single line of additional code. Results gathered for more than a year show that cascaded control not only eliminates hunting in control loops with documented hunting issues, but provides better tracking and more consistent performance during all seasons. A discussion of efficiency losses due to hunting behavior is presented and illustrated with comparative data. Furthermore, an analysis of cost savings from implementing cascaded chilled water valve control is presented. Field tests show 2.2–4.4% energy savings, with additional potential savings from reduced operational costs (i.e., maintenance and controller retuning).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Systems and methods for monitoring traffic on industrial control and building automation system networks

Technologies relating to monitoring communications traffic to detect potential attacks on industrial control system networks and building automation system networks are described herein. In an embodiment, a monitoring device receives a plurality of communications from a control network. The monitoring device transmits the communications to a computing device. Based on the communications, the computing device generates a listing of devices that communicated by way of the control network over a period of time, and computes a volume of traffic between each pair of devices in the listing of devices. The computing device then outputs a graphical user interface (GUI) by way of display, the GUI comprising data indicative of the computed volumes of traffic, which may be indicative of a potential attack on the control network.

Jenkins, Chris↗
DOE OSTI2026

Prime Time for Model-Predictive Control? Assessing the Technical and Market Readiness of Advanced Controls in Buildings

Despite three decades of extensive research and field testing that have consistently validated the benefits of Model Predictive Control (MPC) in building applications, the technology has seen limited market adoption. This paper evaluates the readiness of MPC for widespread deployment, showcases recent demonstrations and field tests across diverse building types, including residential, small commercial, large commercial, and campus settings. Our results demonstrate that MPC can optimize system operations to achieve load shifting, minimize curtailment of on-site generation, and reduce energy costs by up to 80 %, while maintaining or improving occupant comfort. We also show that MPC can effectively control large assets, such as MW-sized thermal storage systems, and respond to dynamic pricing signals. However, achieving scale remains difficult due to labor-intensive workflows, reliance on a “PhD-in-the-loop” for MPC design and maintenance, susceptibility to fragile data infrastructure, and persistent workforce education and acceptance barriers. To bridge this gap, we outline a transition from bespoke, labor intensive prototypes toward streamlined, segment-targeted deployment strategies that leverage model templates, semantic tools, and generative AI. By automating control configuration and reducing engineering effort, these recommendations provide a pathway for transforming successful research demonstrations into scalable, market ready solutions for MPC-based controls.

Pritoni, Marco↗
DOE OSTI2024

Western States Building Energy & Controls Apprenticeship (BECA) Program

How does this project help to understand the challenges of workforce development in the commercial building energy management industry? The purpose of this project was to create a replicable, scalable, and portable apprenticeship program for building energy management and controls. This paper will demonstrate how local processes can be more adaptable and inclusive than federal processes in achieving workforce development goals. Our work provides insights into the technical effectiveness of the program, enabling others to achieve greater success in their workforce development initiatives. The project required more time and financial resources than initially anticipated and spent a year in a no-cost extension working to accomplish the Statement of Project Objectives. The original goal was to create an Industry Related Apprenticeship Program (IRAP). The development of this apprenticeship presented challenges due to the lack of existing programs for reference and the absence of relevant industry classification codes by the Department of Labor (DOL). Notably, the role of a commercial building energy analyst is not recognized by the DOL. The SIC (industry codes) do not have a good description of this job. There are many that may fall into related categories, but none are the actual duties of an energy analyst. Discussions with the DOL indicated that substantial groundwork was necessary before a national apprenticeship program could be implemented, causing delays in the program’s commencement. As a result, students experienced longer wait times before starting their apprenticeship component. The apprenticeship program officially launched on September 14, 2021. The success of the State of Oregon’s apprenticeship program, the first of its kind in the state, underscored the flexibility and effectiveness of local initiatives compared to federal efforts. The COVID-19 pandemic also significantly impacted the project’s success. Beginning in March 2020, the pandemic led to widespread closures of schools and colleges by fall 2020. By September 2021, when the apprenticeship option became available, enrollment in colleges and universities nationwide had decreased, affecting student participation in the program. Moreover, as employers transitioned their employees to remote work, there was limited interaction with external personnel, influencing the willingness of training agents (employers) to integrate additional workers into their teams. This paper addresses several challenges encountered during the project, with the hope that future workforce development efforts will benefit from these experiences. We Final Technical Report 4 | Page encourage others to engage with state and federal agencies to enhance and update pathways for workforce development and apprenticeship programs.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Hierarchical Model-Free Transactive Control of Building Loads to Support Grid Services

Residential buildings consume 4.4 quads of electricity annually, approximately 37% of the total electricity consumption in the United States. This represents a vast resource that can be used for demand management and other ancillary services. This project aims to develop a robust, scalable hierarchical transactional control mechanism incorporating elements of model-free control (MFC) and game theory to harness buildings to provide ancillary services to the grid. This approach is being taken to address the challenges of incorporating traditional transactional control schemes into existing buildings. The challenges include small individual building sizes requiring aggregation of many buildings, unpredictable energy usage that makes model identification difficult, and satisfying the sensitive occupant comfort constraints. In the proposed approach, by separating the control mechanism into two layers above and below the load aggregator, MFC can be used below the aggregator to modulate flexible building loads in response to pricing signals with guaranteed performance. This allows the burden of identifying an accurate model of the system to be shifted to the above-aggregator layer, where fluctuations in individual building usage have less impact on predicted building system behavior. Game theory concepts can then be used to determine pricing curves and control signals among regional aggregators. Managing this control in a game-theoretic approach will allow us to build in financial incentives that increase customer engagement. Additionally, the usage of MFC necessitates less burdensome computational and communication requirements, thus, it is easily deployable on small, embedded devices. In a broader sense, developing a strategy capable of effectively incorporating residential and small commercial buildings will allow greater throughput of existing and emerging grid services in addition to future transactive energy grid management methods. Using MFC within a hierarchical control architecture will allow the shifting of existing forecasting challenges to an aggregate level, where dynamics are slower and more predictable. This will enable a smooth interface between the grid services requests of utilities and the reliable control required by participating buildings. MFC, which supports distributed control architecture, permits a scalable solution that can be deployed to neighborhood-size systems as well as individual buildings. This project focuses on three objectives: (1) developing the mathematical framework, algorithm toolkit, and software toolset of the two-layer transactive control testbed; (2) developing a scalable solution for application over many residential and small-size commercial buildings with sparse distributed communication; and (3) field testing and implementation on hardware of the control strategies developed in the previous two objectives. The research and development activities are focused and designed to be impactful within the relevant 2025 targets timeframe. An open-source control framework for exploiting variability and dispatchability of building loads will be delivered as the outcome of the project. This capability enables greater participation of loads in electricity markets and ancillary services that are both useful for the utility and financially beneficial for building owners.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Commercial Building Sensors and Controls Systems: Barriers, Drivers, and Costs

Building sensors and controls systems, including building automation systems, consists of the sensor-based devices installed in buildings and the control and automation of those devices. Optimized sensors and controls systems could lead to 29% annual energy savings in commercial buildings and are integral to the growth of grid-interactive efficient buildings. Only 8% of small commercial buildings, however, have installed sensors and controls systems. This is largely due to cost barriers. This work seeks to increase the transparency of system costs and identify specific barriers and drivers for increased adoption. To gather industry insights, the team reached out to building owners, vendors, and contractors and conducted 20 interviews with the goal of collecting cost data and market characteristics regarding building sensors and controls. The qualitative interview data was analyzed using grounded theory to identify overarching concepts, such as barriers, drivers, and future directions on the field. From this analysis, primary barriers were found to be complexity, a lack of knowledge, and money. Primary drivers were found to be the knowledge of data, savings, and remote access. The qualitative cost data was collected in the form of invoices during the interviews. The cost values were used to develop a percentage-based cost stack which identifies the average fraction of the total cost attributed to each category (hardware, software, labor, fees, and taxes). This greater understanding of costs and barriers associated with commercial building sensors and controls systems lays the groundwork for future steps in increasing system adoption, reducing energy consumption, and market transformation.

advanced building controls↗
DOE OSTI2023

Dynamic Thermal Performance Analysis of PCM Products Used for Energy Efficiency and Internal Climate Control in Buildings

PCMs are attractive for the future generation of buildings, where energy efficiency targets and thermal comfort expectations are increasingly prioritized. Experimental analysis of local thermal processes in these dynamic components and whole-building energy consumption predictions are essential for the proper implementation of PCMs in buildings. This paper discusses the experimental analysis of the thermophysical characteristics of both a latent heat storage material (PCM) and a product containing this PCM. The prototype product under investigation is a panelized PCM technology containing inorganic, salt-hydrate-based PCM. The thermal analysis includes studies of melting and freezing temperatures, enthalpy changes during phase change processes, nucleation intensity, sub-cooling effects, and PCM stability. The PCM’s stability is also investigated, as is the ability of PCM products to control local temperatures and peak load transmission times. Two inorganic PCM formulations based on calcium chloride hexahydrate (CaCl 2 .6H 2 O) were prepared and tested in laboratory conditions. Material-scale testing results were compared with outcomes from the system-scale analysis, using both laboratory test methods as well as field exposure in test huts. This work demonstrates that PCM technologies used in buildings can effectively control both the magnitude of thermal storage capacity as well as the time of the peak thermal load. It was found that commonly used material-scale testing methods may not always be beneficial in assessing the dynamic thermal performance characteristics of building technologies containing PCMs.

42 ENGINEERING↗