Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Building simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Creating a Simulation Platform for Research and Development of Advanced Control Methods

Advanced nuclear reactors are essential to meet the changing energy requirements throughout both the United States and the rest of world. In addition to other features, they are designed to enable deployment in remote locations and operate in a fully (or near-fully) autonomous manner, which will require a new control paradigm. To realize autonomously operating reactors, the U.S. Department of Energy’s Nuclear Energy Enabling Technologies Advanced Sensors and Instrumentation (NEET ASI) program conducts research and development into the enabling technologies and methods needed, including digital twins, machine learning, and risk modeling, in addition to various types of control methods. These technologies and methods are the key foundations needed to achieve fully autonomous systems. To develop and evaluate the technologies and methods necessary for achieving autonomous operations, it is critical to identify a software tool capable of integrating all the required elements. In surveying the available solutions, no software platforms were identified that could accomplish what was needed without introducing drawbacks. This challenge was the motivation for the current effort: to develop a software platform that can seamlessly integrate autonomouscontrol-enabling technologies and methods, allowing for accelerated research and development and transfer of ideas. The resulting platform, known as the Control and Optimization Modular Modeling Application for Nuclear Deployment (COMMAND), is Python-based, and leverages open-source tools to provide flexibility and facilitate building upon prior research. It is designed to enable advanced reactor developers to deploy and test advanced control technologies and methods coupled with their own models, solutions, and hardware. Given the substantial undertaking of developing such a platform, the current effort focused on laying down scalable, flexible software foundations and infrastructure, then demonstrating the platform via a use case. These foundations included developing generic modules, which contain the base variable and system blocks (the information and functional building blocks, respectively, that can be used to design a simulation) and the data handling and storage blocks needed to exchange information between the various blocks; as well as enablingtechnology-specific modules. This platform was evaluated via a use case, which was to simulate and control a process for the Microreactor Automated Control System (MACS) test bed. While MACS is not currently directly coupled to any specific microreactor physics, it was initially developed in concert with the Microreactor Applications Research Validation and Evaluation (MARVEL) microreactor, and so the MARVEL physics are used here. As part of this use case, several enabling-technology-specific blocks within COMMAND were integrated, including a proportional integral derivative (PID) control block, a Reactor Excursion and Leak Analysis Program (RELAP5-3D) block, and an anomaly detection block. The COMMAND software platform was successfully demonstrated to achieve the scalability and flexibility objectives of this effort and will be leveraged by the program’s research efforts to advance state of the art control methodologies towards autonomous operations of advanced reactors. As new use cases are created and implemented, it is anticipated that COMMAND will continue to grow and evolve to meet new requirements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Provably accurate simulation of gauge theories and bosonic systems

Quantum many-body systems involving bosonic modes or gauge fields have infinite-dimensional local Hilbert spaces which must be truncated to perform simulations of real-time dynamics on classical or quantum computers. To analyze the truncation error, we develop methods for bounding the rate of growth of local quantum numbers such as the occupation number of a mode at a lattice site, or the electric field at a lattice link. Our approach applies to various models of bosons interacting with spins or fermions, and also to both abelian and non-abelian gauge theories. We show that if states in these models are truncated by imposing an upper limit Λ on each local quantum number, and if the initial state has low local quantum numbers, then an error at most ϵ can be achieved by choosing Λ to scale polylogarithmically with ϵ − 1 , an exponential improvement over previous bounds based on energy conservation. For the Hubbard-Holstein model, we numerically compute a bound on Λ that achieves accuracy ϵ , obtaining significantly improved estimates in various parameter regimes. We also establish a criterion for truncating the Hamiltonian with a provable guarantee on the accuracy of time evolution. Building on that result, we formulate quantum algorithms for dynamical simulation of lattice gauge theories and of models with bosonic modes; the gate complexity depends almost linearly on spacetime volume in the former case, and almost quadratically on time in the latter case. We establish a lower bound showing that there are systems involving bosons for which this quadratic scaling with time cannot be improved. By applying our result on the truncation error in time evolution, we also prove that spectrally isolated energy eigenstates can be approximated with accuracy ϵ by truncating local quantum numbers at Λ = polylog ( ϵ − 1 ) .

Tong, Yu↗
DOE OSTI2025

Building Datasets and Training Methods for ML Based Magnet Quench Detection

Detecting quenches in superconducting (SC) magnets during training is a challenging process that involves capturing physical events that occur at different frequencies and appear as various signal features. These events may be correlated across instrumentation type, thermal cycle, and ramp. These events together build a more complete picture of continuous processes occurring in the magnet, and may allow us to flag potential precursors for quench detection. We present our work on building an automatic machine learning (ML) based quench detection system. We build upon our existing work on unsupervised auto-encoders for acoustic sensors and quench antenna (QA) by first establishing a supervised ML training pipeline. We show the results of an event tagging, analysis, and simulation framework on our QA and acoustic data which are used concurrently to build a training dataset for a supervised implementation. We then show how this supervised training can be used as a prior in a semi-supervised framework and compare this to the unsupervised neural network auto-encoder performance.This allows us to have a more concrete understanding of the performance of our algorithms relative to physical events occurring in the magnet, and also provides a baseline software tool to generically evaluate our quench prediction autoencoders under completely unsupervised, supervised, and semi-supervised training conditions.

Khan, Maira [Fermilab]↗
DOE OSTI2025

GridLAB-D Technical Support Document: Residential Equivalent Thermal Parameter Model

GridLAB-D is a power distribution systems simulation and analysis tool developed by Pacific Northwest National Laboratory. Although GridLAB-D and its underlying residential load model has been used in a variety of power systems analyses, comprehensive documentation of the derivation of the residential house model has not been formally published. The purpose of this technical support document is to serve as a comprehensive resource for the thermal dynamics modeling and house definition implemented in GridLAB-D. It covers model derivation, parameter definitions, and implementation steps in the codebase.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Home energy management under realistic and uncertain conditions: A comparison of heuristic, deterministic, and stochastic control methods

We report home energy management systems (HEMS) have been shown to reduce energy bills and to provide grid services including peak demand reduction and demand flexibility. However, uncertainty in residential energy systems is a significant issue and can reduce the benefits of a HEMS to the homeowner or grid operator. Sources of uncertainty include weather forecasts, predictions of energy-related occupant activities (e.g., hot water draws), and parameter estimation for the building envelope and energy-consuming equipment. This paper tackles the problem of uncertainty by developing a framework that simulates HEMS in uncertain conditions and evaluates the performance of multiple control strategies. A linear, reduced-order residential building model for model predictive control applications is derived and compared to a full-order model. Stochastic model predictive control is shown to perform better than deterministic and heuristic methods when considering realistic forecasts with uncertainty. The framework can evaluate the performance of HEMS in real-world applications, which can help de-risk HEMS deployment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Efficient Simulation of Logical Magic State Preparation Protocols

Developing space- and time-efficient logical magic state preparation (MSP) protocols will likely be an essential step toward building a large-scale fault-tolerant quantum computer. Motivated by this need, we introduce a scalable method for simulating logical MSP protocols under the standard circuit-level noise model. When applied to protocols based on code-switching, magic state cultivation, and magic state distillation, our method yields a complexity polynomial in (i) the number of qubits and (ii) the nonstabilizerness, e.g., stabilizer rank or Pauli rank, of the target encoded magic state. The efficiency of our simulation method is rooted in a curious fact: every circuit-level Pauli error in these protocols propagates to a Clifford error at the end. This property is satisfied by a large family of protocols, including those that repeatedly measure a transversal Clifford that squares to a Pauli. We provide a proof-of-principle numerical simulation that prepares a magic state using such logical Clifford measurements. Our work enables practical simulation of logical MSP protocols without resorting to approximations or resource-intensive state-vector simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

Enhancing Building Resilience: Maintaining Energy Efficiency and Thermal Comfort During Power Outages in Cold Climates

The increasing frequency and intensity of extreme weather events, such as heatwaves and cold snaps, present significant challenges to building energy performance and occupant comfort. Highly correlated with climate events are widespread long duration power interruptions that may affect thousands of buildings and millions of customers. This study evaluates the impact of building energy performance and occupant thermal comfort in medium-sized office buildings in a cold climate region. Using energy models representing pre-1980 and 2019 vintages, simulations were conducted to assess energy performance under typical weather conditions and occupant thermal comfort during power interrupted extreme cold snap and heatwave climate events under both current 2020s and future 2050s weather conditions. The results show a projected 33% increase in cooling energy demand and a 19% reduction in heating energy by 2050. Findings reveal that older buildings are more susceptible to cold discomfort during cold snaps, while modern airtight buildings are more vulnerable to overheating during heatwaves. Various passive energy efficiency measures, such as improved infiltration control, thermal windows, solar-controlled windows, and cool envelopes, were evaluated for their ability to mitigate thermal discomforts. Solar controlled windows and weatherstripping contribute to reducing cold thermal discomfort by 21% during a power-interrupted cold snap. Solar-controlled windows were found to reduce hot thermal discomfort by 34% during a future power-interrupted heatwave. The study highlights the importance of targeted retrofitting strategies to enhance thermal resilience, especially during power outages, to ensure occupant safety and comfort during extreme climate events.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Multidisciplinary concurrent optimization framework for multi-phase building design process

Modern day building design projects require multidisciplinary expertise from architects and engineers across various phases of the design (conceptual, preliminary, and detailed) and construction processes. The Architecture Engineering and Construction (AEC) community has recently shifted gears toward leveraging design optimization techniques to make well-informed decisions in the design of buildings. However, most of the building design optimization efforts are either multidisciplinary optimization confined to just a specific design phase (conceptual/preliminary/detailed) or single disciplinary optimization (structural/thermal/daylighting/energy) spanning across multiple phases. Complexity in changing the optimization setup as the design progresses through subsequent phases, interoperability issues between modeling and physics-based analysis tools used at later stages, and the lack of an appropriate level of design detail to get meaningful results from these sophisticated analysis tools are few challenges that limit multi-phase multidisciplinary design optimization (MDO) in the AEC field. Here this paper proposes a computational building design platform leveraging concurrent engineering techniques such as interactive problem structuring, simulation-based optimization using meta models for energy and daylighting (machine learning based) and tradespace visualization. The proposed multi-phase concurrent MDO framework is demonstrated by using it to design and optimize a sample office building for energy and daylighting objectives across multiple phases. Furthermore, limitations of the proposed framework and future avenues of research are listed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Smarter building start – A distributed solution

A significant focus of research and new technologies for reducing energy use in buildings is on operating the systems more efficiently during the times when the systems are active. However, there is a large potential for energy savings in determining the periods when the systems should or should not be active. This scheduling aspect of operation is often overlooked even though relatively simple solutions can unlock substantial energy savings. In this paper we describe a smart building start (SBS) algorithm that considers multiple zones in a building to determine individual schedules for room controllers as well as the central systems based on solving a simple optimization problem. Application of the SBS algorithm to multiple interconnected systems enables a staggered start-up that minimizes peak loads and also ensures comfort is within a target range with minimal system run time. The SBS algorithm extends the capability of traditional optimal start and is designed to be simple to deploy and robust. Simulation results as well as results from tests in a real building with a VAV system are presented. The presented algorithm is applicable to any type of building with a zonal or multi-zone HVAC system. To function, it needs to be able to change setpoints in rooms and monitor room temperatures, as well as, if desired, turn the central system on or off.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Factors Influencing Building Demand Flexibility

The U.S. Department of Energy’s National Roadmap for Grid-interactive Efficient Buildings (GEB) acknowledged that building demand flexibility (DF) is both an important strategy to decarbonizing the buildings sector and an important resource for meeting the changing needs of the electrical grid such as improving grid reliability. However, understanding the complexity and uncertainties in real building field performance of DF strategies is a large gap hindering stakeholders on both grid and buildings side to make investments on deploying such strategies. The research work in this report intended to advance understanding of the variability and influential factors in building demand flexibility. Adding such knowledge based on lab testing results and measured performance data from real buildings is an important contribution. The report uses standardized metrics and methods to quantify DF performance from field-measured DF datasets of two significant building groups of big-box retail and medium office buildings to present the challenge of building DF variability in multiple dimensions. The report presents findings related to how several key factors influence building demand flexibility from implementing a common, cost-effective DF control strategy (i.e., adjusting zone temperatures). The findings are supported by full-scale lab testing, field data analysis and simulation research. The authors also provided application-oriented recommendations to stakeholders such as building aggregators, utility program design professionals, sophisticated building portfolio owners, and more.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Surrogate Modeling of Landau Damping with Deep Operator Networks

Kinetic simulations excel at capturing microscale plasma physics phenomena with high accuracy, but their computational demands make them impractical for modeling large-scale space and astrophysical systems. In this context, we build a surrogate model, using Deep Operator Networks (DeepONets), based upon the Vlasov–Poisson simulation data to model the dynamical evolution of plasmas, focusing on the Landau damping process—a fundamental kinetic phenomenon in space and astrophysical plasmas. The trained DeepONets are able to capture the evolution of electric field energy in both linear and nonlinear regimes under various conditions. Extensive validation highlights DeepONets’ robust performance in reproducing complex plasma behaviors with high accuracy, paving the way for large-scale modeling of space and astrophysical plasmas.

plasma astrophysics↗
DOE OSTI2022

Development of a water source heat pump hardware-in-the-loop (HIL) testing facility for smart building applications

Over the last decade, the global fight against climate change through electrification has led to an increase in research on building heating, ventilation, and air conditioning (HVAC) systems that utilize intelligent control algorithms to provide demand-side grid service while maintaining the thermal comfort of building occupants. As the pivotalpoint between building electricity consumption and indoor thermal comfort, high-efficiency electrical heatpumps are at the center of these emerging studies, and various grid-interactive and occupant-comfort control algorithms have been developed for them. The impact of these algorithms on the heatpump operation andperformance under different weather, building load, and grid requests calls for investigation and verification via experimental tests with actual heat pumps integrated with real-time building and grid responses. This study presents a Water-Source Heat Pump Hardware-in-The-Loop (HIL) Test Facility developed with the capability to perform such tests. The hardware configuration for this testfacility introduces a hydronic system that emulates the conditions for the heat pump water-side, and a duct system that emulates conditions for the heat pump airside. Both data acquisition and emulator control are implemented through the National Instruments (NI) LabVIEW software running on an NI PXIplatform. The HIL mechanism based on the hardware-software integration that allows the testbed to communicate with a generic simulation environment is also discussed. Currently, the test facility setup includes a single heatpump and virtual building model in EnergyPlus coupled with an occupant behavioral model in MATLAB. Preliminary test results of the current setup demonstrate the building load emulator's ability to track the simulated gone temperature with a Root Mean Square Deviation (RSME) below 0.12°C (0.216°F). An uncertainty analysis based on sensor accuracies shows that the heat pump coefficient of performance (COP) can be measured with a relative uncertainty of 10.4% in cooling and 3.7% in heating. Apartfrom the current testing on a single heat pump, the test facility also provides the flexibility to include additional heat pumps to form a heat pump cluster, as well as coupling the heat pump with active thermal storage to provide enhanced demandflexibility.

Calfa, Caleb↗
DOE OSTI2025

Thermal and electric multidomain dynamic model for integration of power grid distribution with behind-the-meter devices

As renewable energy sources like solar and wind power become more integrated into the grid, coordinated control of behind-the-meter devices is crucial for enhancing grid flexibility and reliability and for meeting cost targets, with standardized models being developed to support this transition. The increasing flexibility and uncertainty of integrated renewable energy grids, along with interactions between various subsystems, make traditional steady-state modeling insufficient to capture transient and dynamic behaviors. Current models (e.g., composite load and battery equivalent models) focus on thermodynamic or electrical characteristics but overlook critical electromechanical interactions. This limits the ability to share performance information for grid services and hampers fast dynamic simulations. In addition, motor stalling is usually triggered by a fault event and attributed to the characteristics of the mechanical torque of the motor, resulting in absorption of a large amount of reactive power during the stalling period. Further, this significant withdrawal of reactive power will deteriorate the dynamic voltage stability of power grids and cause delayed voltage recovery. Therefore, an in-depth modeling of the thermodynamics or mechanical torque is essential to study the impacts of the realistic torque characteristics of those behind-the-meter devices on power system voltage stability. This study developed a dynamic multidomain model for building HVAC systems, such as air-source heat pumps, to simulate their thermal and electrical responses to grid transients. The model can accurately predict power metrics with a mean absolute percentage error of 10%, by validating against with power system computer-aided design performance data. Case studies demonstrate the model capability of capturing the transient response to sudden voltage changes, rapid load fluctuations, and system shutdowns respectively. During a sudden voltage drop (30% for 0.1s), a fully loaded heat pump’s motor speed dropped, continued declining, and shut down after 3.6s, with severe power oscillations and a torque spike. A partially loaded unit experienced temporary oscillations but stabilized. Under higher building loads, compressor speed increased from 64% to 100%, with power and torque rising before stabilizing. In safety-triggered shutdowns, power decreased after minor fluctuations, and torque briefly spiked before dropping to zero.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Reservoir Characterization and Techno-Economic Analysis of Enhanced Geothermal and Closed-Loop Systems in the Wattenberg Field of the Denver-Julesburg Basin, Colorado

This report provides details of reservoir characterization and techno-economic analysis for enhanced geothermal systems and closed-loop geothermal systems in the Denver-Julesburg Basin Wattenberg area. The analysis contributes to the Geothermal Limitless Approach to Drilling Efficiencies (GLADE) project, a multi-institutional research initiative focused on advancing geothermal energy development by reducing drilling costs and improving the rate of penetration. The GLADE project brings together national laboratories, academic institutions, and industry partners, including the U.S. Department of Energy's Geothermal Technologies Office, Occidental Petroleum, the National Laboratory of the Rockies (NLR), Los Alamos National Laboratory, Colorado School of Mines, Louisiana State University, Texas A&M University, and several drilling technology companies. As part of this effort, NLR developed and applied slender-body theory modeling tools and the GEOPHIRES simulator to support techno-economic analysis. The slender-body theory wellbore simulator evaluated thermal performance in U-loop, Eavor-type multilateral, and enhanced geothermal system well configurations. Results indicated that an optimized single U-loop design delivers an outlet temperature of 168.8 degrees Celsius,stabilizing at a final outlet temperature of 135.3 degrees Celsius. Heat production also improved significantly, with an average thermal output of 16.9 MWth and a final thermal output of 11.0 MWth. These results provided critical baseline data for selecting optimized systems for techno-economic analysis. Building on these outputs, NLR applied the GEOPHIRES techno-economic simulator to estimate the levelized cost of electricity for both the Eavor multilateral and enhanced geothermal systems. The sensitivity analysis showed that drilling costs exert a particularly strong impact on the levelized cost of electricity of multilateral systems. Therefore, advances in drilling technology and improved drilling rates could yield significant gains in the economic performance of these systems. In this context, the GLADE project directly supports the U.S. Department of Energy's mission to reduce the cost of geothermal energy and accelerate the deployment of next-generation geothermal technologies.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

High-resolution hourly surrogate modeling framework for physics-based large-scale building stock modeling

Surrogate modeling can play a key role in reducing high computational burdens for large-scale physics-based modeling and uncertainty quantification. With the rapid development of large-scale building stock energy modeling, surrogate modeling has also begun to be widely applied in this field; however, most existing surrogate models lack hourly time resolution for regional-scale modeling, which is essential for understanding building demand profiles and grid impacts. Further, there is generally a lack of necessary data and feature engineering frameworks specific to building modeling for efficiently managing large datasets and complex computations. Furthermore, this paper proposes a modeling framework for large-scale (city-/region-scale), high-resolution, high-fidelity surrogate building stock energy models. Our developed framework consists of six modules: (1) building stock energy modeling (ComStock TM and ResStock TM ), (2) data engineering for large simulation data, (3) high performance computing workflow, (4) feature engineering, (5) machine learning model development, and (6) model performance evaluation. Two case studies apply the developed framework in both residential and commercial building stock analysis to demonstrate its computational efficiency and surrogate modeling accuracies. Results show that surrogate models, when efficiently trained using the HPC workflow module, reach a high level of modeling accuracy for two case studies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Thermal Resilience of Residential Building with Thermally Anisotropic Building Envelope Connected to Geothermal Sources

Heat waves and cold snaps have become more frequent and more intense because of climate change. A heat wave and a cold snap are a period of excessively hot and cold weather, respectively, that poses severe risks to building occupants’ health, especially for vulnerable people. They increase electrical energy consumption and put high stress on the grid which leads to potential power outages. Therefore, it is critical to assess and actively improve the thermal resilience of buildings to cope with heat waves, cold snaps, and power outages. The thermally anisotropic building envelope (TABE) is a novel active building envelope that can save energy while maintaining thermal comfort in buildings by redirecting heat and coolness from building envelopes to hydronic loops. When connecting to a ground thermal loop (GL), TABE can utilize the relatively stable temperature of the ground to protect the indoor environment during heat waves and cold snaps. This study assesses the thermal resilience of residential buildings that installed TABE and used ground thermal energy to supply the hydronic loops, abbreviated as ground thermal loop or TABE+GL. The simulation and analysis are conducted for the US Department of Energy prototype single-family detached residential building in the hot climate of Miami, Florida and Tucson, Arizona, and the cold climate of Denver, Colorado, and Rochester, Minnesota. Heat waves and cold snaps were obtained from the historical weather data of 1998-2020 for the studied regions. Three thermal resilience metrics, including the standard effective temperature (SET) degree-hours, the Heat Index, and the Hours of Safety (HOS) were used to quantify the effect of TABE+GL. The results showed that buildings installed TABE+GL could significantly reduce the average SET degree-hours above 30°C, increase HOS, and greatly improve thermal resilience.

Shen, Zhenglai↗
DOE OSTI2024

Control And Optimization Modular Modeling Application For Nuclear Deployment

The purpose of the COMMAND code is to provide a flexible, scalable tool for use in developing, integrating, and testing the technologies necessary for achieving autonomous operations of advanced nuclear reactors. The code enables users to efficiently implement custom simulations and experiments by combining key methods from different software modules. These modules are focused on: modeling and simulation tools, such as nuclear simulation tools used for high-fidelity modeling (e.g., Reactor Excursion and Leak Analysis Program [RELAP5-3D] and Monte Carlo N-Particle [MCNP]); machine learning and optimization tools (e.g., anomaly detection and data-driven modeling techniques); advanced control in its digital, high-performance, and supervisory control forms (e.g., proportional integral derivative (PID) control and model predictive control (MPC); and integration with hardware through industrial communication protocols. To ensure flexibility and scalability, COMMAND was designed to be both modular—the software “pieces” all inherit from generic building blocks and can be combined and connected to create complicated simulations—and high performing—designed for parallel processing, enabling simulations and experiments to take advantage of multi-core computers, servers, and nodes. The code is written in the Python programming language due to the language's popularity, active community, and open-source and cross-platform nature. Maintaining consistency with other simulation tools used within the nuclear energy community, users implement simulations and experiments through text input files, which define components, parameters, connections, etc., through lines of text. Given that COMMAND is written in Python, these input files are native Python scripts, and so use the standard Python structure and formatting. This also enables users to take advantage of Python's extensive package library to develop custom capabilities for their specific use cases.

Faber, Jacob [Idaho National Laboratory (INL), Ida↗
DOE OSTI2025

Deep reinforcement learning control for co-optimizing energy consumption, thermal comfort, and indoor air quality in an office building

With the recent demand for decarbonization and energy efficiency, advanced HVAC control using Deep Reinforcement Learning (DRL) becomes a promising solution. Due to its flexible structures, DRL has been successful in energy reduction for many HVAC systems. However, only a few researches applied DRL agents to manage the entire central HVAC system and control multiple components in both the water loop and the air loop, owing to its complex system structures. Moreover, those researches have not extended their applications by incorporating the indoor air quality, especially both CO2 and PM2.5concentrations, on top of energy saving and thermal comfort, as achieving those objectives simultaneously can cause multiple control conflicts. What's more, DRL agents are usually trained on the simulation environment before deployment, so another challenge is to develop an accurate but relatively simple simulator. Therefore, we propose a DRL algorithm for a central HVAC system to co-optimize energy consumption, thermal comfort, indoor CO2 level, and indoor PM2.5 level in an office building. To train the controller, we also developed a hybrid simulator that decoupled the complex system into multiple simulation models, which are calibrated separately using laboratory test data. The hybrid simulator combined the dynamics of the HVAC system, the building envelope, as well as moisture, CO2, and particulate matter transfer. Three control algorithms (rule-based, MPC, and DRL) are developed, and their performances are evaluated on the hybrid simulator environment with a realistic scenario (i.e., with stochastic noises). The test results showed that, the DRL controller can save 21.4 % of energy compared to a rule-based controller, and has improved thermal comfort, reduced indoor CO2 concentration. The MPC controller showed an 18.6 % energy saving compared to the DRL controller, mainly due to savings from comfort and indoor air quality boundary violations caused by unmeasured disturbances, and it also highlights computational challenges in real-time control due to non-linear optimization. Finally, we provide the practical considerations for designing and implementing the DRL and MPC controllers based on their respective pros and cons.

Guo, Fangzhou↗