Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “functional modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Charge State of Metallic Nanoparticles on a Conducting Substrate

The charge state of a disordered system of metallic nanoparticles on a conducting substrate is analyzed. The theoretical model that describes thermostimulated tunnel transitions of electrons between the particles and also the electron transitions between the particles and the substrate due to the difference in the work functions has been built. The model takes into account the interaction of the charges of the nearest particles and also the interaction of the particle charges with the image charges in the substrate. The Monte Carlo computer simulation for this model makes it possible to obtain the distribution pattern of the charge in structures with different nanoparticle density in a one-layer coating on the substrate at various values of the dielectric permittivity of the environment and various values of the difference of the work functions of particles and the substrate. The numerical results for structures with Ni and Pt nanoparticles on a carbon substrate, which are often used as catalysts of chemical processes, are presented as an example.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

Reduction of electron-phonon coupling in warm dense iron

The electron-ion relaxation dynamics in warm dense iron were investigated by time-resolved x-ray absorption near-edge spectroscopy (XANES). A novel analysis, combining ab initio density functional theory (DFT) and two temperature model (TTM) simulations, was developed to calculate the x-ray absorption spectra as a function of delay time. Here we present experimental evidence of changes at the XAS L3 edge of iron that are consistent with the reduction of the electron-phonon coupling under warm dense matter conditions. The experimental results are in agreement with the model that takes both the electron ($T_e$) and the ion temperature ($T_i$) dependence of the thermophysical properties into consideration, while models where either constant electron-phonon coupling factor (G) or only $T_e$- dependent G are used do not agree with the observed relaxation dynamics of iron.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

A Differentiable Hydrology Approach for Modeling With Time-Varying Parameters

In the analysis of observational data with mathematical models, it is often desirable to let one or more model parameters vary with time to account for changing environmental conditions or to offer more flexibility. A standard approach for dynamic models is to allow for the number of parameters to grow as a function of time, leading to a high-dimensional inference problem for long data records. We propose using Hamiltonian Monte Carlo, a gradient-based Markov chain Monte Carlo (MCMC) method, to perform Bayesian inference for time-varying parameters (TVP) in hydrology models. As derivatives of model error functions with regard to parameters are not available in closed form, we implemented the GR4J rainfall-runoff models in Theano/PyMC3, and Jax/NumPyro, allowing for the application of automatic differentiation techniques. A simulation experiment assessing the viability of these methods for recovering underlying temporal variation in parameters indicates that a discrete Gaussian random walk-based prior appears to be best suited across a range of scenarios while the continuous-time Gaussian process compares relatively poorly. In an analysis of 20 years of daily real-world streamflow records from the Model Parameter Estimation Experiment (MOPEX) hydrology data set with increasing data sparsity and at multiple temporal resolutions, we find that TVP inference with gradient-based MCMC is a flexible and reliable approach for analyzing hydrology models with dynamic parameter sets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The contributions from the progenitor genomes of the mesopolyploid Brassiceae are evolutionarily distinct but functionally compatible

The members of the tribe Brassiceae share a whole-genome triplication (WGT), and one proposed model for its formation is a two-step pair of hybridizations producing hexaploid descendants. However, evidence for this model is incomplete, and the evolutionary and functional constraints that drove evolution after the hexaploidy are even less understood. Here, we report a new genome sequence of Crambe hispanica , a species sister to most sequenced Brassiceae. Using this new genome and three others that share the hexaploidy, we traced the history of gene loss after the WGT using the Polyploidy Orthology Inference Tool (POInT). We confirm the two-step formation model and infer that there was a significant temporal gap between those two allopolyploidizations, with about a third of the gene losses from the first two subgenomes occurring before the arrival of the third. We also, for the 90,000 individual genes in our study, make parental subgenome assignments, inferring, with measured uncertainty, from which of the progenitor genomes of the allohexaploidy each gene derives. We further show that each subgenome has a statistically distinguishable rate of homoeolog losses. There is little indication of functional distinction between the three subgenomes: the individual subgenomes show no patterns of functional enrichment, no excess of shared protein-protein or metabolic interactions between their members, and no biases in their likelihood of having experienced a recent selective sweep. We propose a "mix and match" model of allopolyploidy, in which subgenome origin drives homoeolog loss propensities but where genes from different subgenomes function together without difficulty.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Geodyn Material Library: Pseudocap models for dry porous tocks

This report describes the second edition of the Pseudocap Strength models for porous rocks implemented in GEODYN material library. The first model was developed in 2007 and calibrated for concrete. Then, the model parameters were calibrated based on triaxial tests reported for limestones and sandstones of various porosities. In these models some key parameters were chosen as functions of the reference porosity,Φ. Since then multiple modifications were implemented in the model, therefore, it has been recalibrated for some common porous materials such as limestones, sandstones, alluvium, tuffs and granite. Two types of models are described in this repot. The first type (called Pseudocap Model or PM) is for rocks from a specific location. Parameters were calibrated for several specific geologic materials. The second type (called Generic Pseudocap Model or GPM) is useful for the sites where only basic information (rock type, porosity) is available. Generic models include built-in correlations between porosities and other mechanical properties observed for certain rock types. The models of both types were validated by comparing not only to quasi-static triaxial tests for these materials but also to shock Hugoniot data and spherical explosion data for some materials. All models were derived in the frame of isotropic plasticity. They are designed to be used in explicit finite element/difference codes. Tangent stiffness tensor is not provided but can be calculated numerically for the model to be used in implicit finite element codes. For an isotropic material the stress can be decomposed into volumetric and deviatoric parts. The volumetric part is modeled using an Equation of state (EOS) which calculates the pressure and the bulk sound speed as functions of the internal specific energy and density. Here a simple, Mie-Gruneisen EOS is presented, but tabulated EOS (LEOS) provided by the library can be used as well. The stress is limited by the yield surface which depends on three invariants of the stress tensor and specific internal energy. In addition, to capture the strain-rate dependence a simple multiplier is used for the yield surface which depends on the equivalent plastic strain rate. The failure surface (the ultimate yield, Y f , defined later) is chosen in the Hoek-Brown form, commonly used in rock mechanics. It includes measurable parameters such as Unconfined Compressive Strength (UCS) as well as scale parameters characterizing the quality of the rock such as GSI (Geologic Strength Index). Thus, even though the model is calibrated for small samples it offers a way to extrapolate the strength to the field scale using geological characterization of the rock mass. The model captures effects of brittle-ductile transition in rocks by introducing a cap multiplier to the yield function. The rate of dilatancy (bulking) is proportional to the slope of the yield surface affected by the cap. Therefore, it takes place only at low confinements when the pressure is less than the brittle-ductile transition pressure, P BD . On the contrary, the porous compaction takes place at pressures higher than P BD . The cap moves as the porosity is compacted or new porosity is generated due to dilatancy. The porous compaction is modeled using an evolution equation which includes deviatoric stress so that the onset of compaction corresponds to the cap surface. The model captures effects of shear-enhanced compaction which is an important for porous rocks. Section 2 describes the modeling framework and Section 3 presents the model calibration procedure. Section 4 compares experimental data for various rocks versus model predictions. The model parameters used for this comparison are given in Appendix. The files with material constants are available with the latest GEODYN material library distribution.

58 GEOSCIENCES↗
DOE OSTI2019

Vinylester and Polyester 3D Printing (CRADA NFE-17-06792 Final Report)

In Phase 2 of the technical collaboration between Oak Ridge National Laboratory (ORNL) and Polynt Composites USA, a vinyl ester composite material for extrusion deposition additive manufacturing (AM) of thermoset materials was developed, characterized, and functionality demonstrated. Through this work modeling capability was developed to determine the desired in use material characteristics and refined process parameters. Coupon level testing was performed to validate the end use functionality of printed structures. Finally, the material was printed to evaluate its performance in composites tooling applications. This combined effort led to a commercial product, PRD-1520, for Polynt Composites USA specifically designed for large-scale extrusion deposition additive manufacturing of thermoset materials.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Computational design of high entropy alloy coating for hydrogen turbine applications

This project aims to develop novel high entropy alloy (HEA)-based coatings to protect critical components in hydrogen-fueled turbine power system. The HEA-coatings will demonstrate superior performance in hydrogen combustion environment to commercial NiCoCrAlY coating in current natural gas turbine system. The HEA coating facilitates the formation of a protective scale of alpha-alumina to slow down the inward diffusion of oxidizing species and the outward diffusion of metal elements, and possesses ultrahigh corrosion and spallation resistance to prolong the service lifetime of critical components in hydrogen turbine power system. Aimed to accelerate the discovery of novel HEA coating compositions, high throughput computational modeling including CALPHAD and density functional theory and machine learning are performed to predict phase stability, oxygen permeability, oxidation rate constant, coefficient of thermal expansion, and mechanical properties. Based on the modeling and machine learning prediction, experimental validation is performed. Preliminary results will be presented and approaches to minimize oxidation will be discussed.

alloy design↗
DOE OSTI2024

Direct Observation of Morphological and Chemical Changes during the Oxidation of Model Inorganic Ligand-Capped Particles

Functionalization and volatilization are competing reactions during the oxidation of carbonaceous materials and are important processes in many different areas of science and technology. Here, we present a combined ambient pressure X-ray photoelectron spectroscopy (APXPS) and grazing incidence X-ray scattering (GIXS) investigation of the oxidation of oleic acid ligands surrounding NaYF 4 nanoparticles (NPs) deposited onto SiO x /Si substrates. While APXPS monitors the evolution of the oxidation products, GIXS provides insight into the morphology of the ligands and particles before and after the oxidation. Our investigation shows that the oxidation of the oleic acid ligands proceeds at O 2 partial pressures of below 1 mbar in the presence of X-rays, with the oxidation eventually reaching a steady state in which mainly CH x and –COOH functional groups are observed. The scattering data reveal that the oxidation and volatilization reaction proceeds preferentially on the side of the particle facing the gas phase, leading to the formation of a chemically and morphologically asymmetric ligand layer. This comprehensive picture of the oxidation process could be obtained only by combining the X-ray scattering and APXPS data. The investigation presented here lays the foundation for further studies of the stability of NP layers in the presence of reactive trace gases and ionizing radiation and for other nanoscale systems where chemical and morphological changes happen simultaneously and cannot be understood in isolation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Reconstructing gravity on cosmological scales

We present the data-driven late-time reconstruction of gravitational theories and dark energy models on cosmological scales. We showcase the power of present cosmological probes at constraining these models and quantify the knowledge of their properties that can be acquired through state of the art data. This reconstruction exploits the power of the effective field theory approach to dark energy and modified gravity phenomenology, which compresses the freedom in defining such models into a finite set of functions that can be reconstructed across cosmic times using cosmological data. We consider several model classes described within this framework and thoroughly discuss their phenomenology and data implications. In this work, we find that some models can alleviate the present discrepancy in the determination of the Hubble constant as inferred from the cosmic microwave background and as directly measured. This results in a statistically significant preference for the reconstructed theories over the standard cosmological model.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Sensitivity-Informed Bayesian Inference for Home PLC Network Models with Unknown Parameters

Bayesian inference is used to calibrate a bottom-up home PLC network model with unknown loads and wires at frequencies up to 30 MHz. A network topology with over 50 parameters is calibrated using global sensitivity analysis and transitional Markov Chain Monte Carlo (TMCMC). The sensitivity-informed Bayesian inference computes Sobol indices for each network parameter and applies TMCMC to calibrate the most sensitive parameters for a given network topology. A greedy random search with TMCMC is used to refine the discrete random variables of the network. This results in a model that can accurately compute the transfer function despite noisy training data and a high dimensional parameter space. The model is able to infer some parameters of the network used to produce the training data, and accurately computes the transfer function under extrapolative scenarios.

42 ENGINEERING↗
DOE OSTI2020

Thermal Model Heat Rate Predictions of the AGR-5/6/7 Experiment

Several fuel and material irradiation experiments have been planned for the U.S. Department of Energy Advanced Gas Reactor Fuel Development and Qualification Program, which supports the development and qualification of tristructural isotropic (TRISO) coated particle fuel for use in high-temperature gas-cooled reactors. The goals of these experiments are to provide irradiation performance data to support fuel process development, qualify fuel for normal operating conditions, support development of fuel performance models and codes, and provide irradiated fuel and materials for post-irradiation examination and safety testing. Originally planned and named as separate fuel experiments, but subsequently combined into a single test train. AGR-5/6/7 will test low-enriched uranium oxycarbide (UCO – a heterogeneous mixture of uranium oxide and uranium carbide) TRISO fuel. The AGR-5/6 portion of the experiment will provide data to support qualification of the selected reference fuel design, while the AGR-7 portion will serve as a margin test, irradiating the fuel beyond normal operating conditions. During irradiation, the temperature in each capsule is controlled by varying the helium / neon gas mixture flowing through the capsule until the desired thermocouple temperature is reached. Further adjustments can be made by changing the lobe power and the neutron filter. Three neutron filters are available to use as the experiment burns up the fissionable fuel. A thermal finite element model has been created for the five capsules comprising the AGR-5/6/7 experiment. Heat rates from a physics analysis are imported into the model along with fast neutron fluence. Graphite shrinkage due to the fast neutron fluence is incorporated into the model. Gas gaps change as a function of fast neutron fluence. Radiation heat transfer is a major contributor in this model. This is a large model with more than 1 million finite element brick elements. More than 150 different parts are modeled in the finite element model and communicate with each other from a heat transfer sense. More than 50 thermocouples are used in the experiment and are compared to actual measurements. The experiment is composed of five separate stainless steel capsules all welded together. This paper presents a method used to predict the gas mixture in the event that all of the thermocouples fail in a particular capsule. Curve fitting of heat rates from previous cycles and projecting them into the future is the basis of the method.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Impact of point spread function higher moments error on weak gravitational lensing – II. A comprehensive study

ABSTRACT Weak lensing is one of the most powerful probes for dark matter and dark energy science, although it faces increasing challenges in controlling systematic uncertainties as the statistical errors become smaller. The point spread function (PSF) needs to be precisely modeled to avoid systematic error on the weak lensing measurements. The weak lensing biases induced by errors in the PSF model second moments, i.e. its size and shape, are well-studied. However, Zhang et al. showed that errors in the higher moments of the PSF may also be a significant source of systematics for upcoming weak lensing surveys. Therefore, this work comprehensively investigate the modelling quality of PSF moments from the 3rd to 6th order, and propagate the PSFEx higher moments modelling error in the HSC survey data set to the weak lensing shear–shear correlation functions and their cosmological analyses. The overall multiplicative shear bias associated with errors in PSF higher moments can cause an ∼0.1σ shift on the cosmological parameters for LSST Y10, while the associated additive biases can induce 1σ uncertainties in cosmology parameter inference for LSST Y10, if not accounted. We compare the PSFEx model with PSF in Full FOV, and find similar performance in modelling the PSF higher moments. We conclude that PSF higher moment errors of the future PSF models should be reduced from those in current methods, otherwise needed to be explicitly modeled in the weak lensing analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Assessing mechanisms for microbial taxa and community dynamics using process models

Disentangling the assembly mechanisms controlling community composition, structure, distribution, functions, and dynamics is a central issue in ecology. Although various approaches have been proposed to examine community assembly mechanisms, quantitative characterization is challenging, particularly in microbial ecology. Here, we present a novel approach for quantitatively delineating community assembly mechanisms by combining the consumer–resource model with a neutral model in stochastic differential equations. Using time-series data from anaerobic bioreactors that target microbial 16S rRNA genes, we tested the applicability of three ecological models: the consumer–resource model, the neutral model, and the combined model. Our results revealed that model performances varied substantially as a function of population abundance and/or process conditions. The combined model performed best for abundant taxa in the treatment bioreactors where process conditions were manipulated. In contrast, the neutral model showed the best performance for rare taxa. Our analysis further indicated that immigration rates decreased with taxa abundance and competitions between taxa were strongly correlated with phylogeny, but within a certain phylogenetic distance only. The determinism underlying taxa and community dynamics were quantitatively assessed, showing greater determinism in the treatment bioreactors that aligned with the subsequent abnormal system functioning. Given its mechanistic basis, the framework developed here is expected to be potentially applicable beyond microbial ecology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

A geometric approach for computing tolerance bounds for elastic functional data

We design an approach for constructing tolerance bounds for functional data with random warping variability. In particular, we define a generative, probabilistic model for the amplitude and phase components of such observations, which parsimoniously characterizes variability in the baseline data. Based on the proposed model, we define two different types of tolerance bounds that are able to measure both types of variability, and as a result, identify when the data has gone beyond the bounds of amplitude and/or phase. The first functional tolerance bounds are computed via a bootstrap procedure on the geometric space of amplitude and phase functions. The second functional tolerance bounds utilize functional Principal Component Analysis to construct a tolerance factor. Our report is motivated by two main applications: process control and disease monitoring. The problem of statistical analysis and modeling of functional data in process control is important in determining when a production has moved beyond a baseline. Moreover, in biomedical applications, doctors use long, approximately periodic signals (such as the electrocardiogram) to diagnose and monitor diseases. In this context, it is desirable to identify abnormalities in these signals. We additionally consider a simulated example to assess our approach and compare it to two existing methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Ripening of Rh Nanoparticle Catalysts in Reverse Water–Gas Shift via a Data-Driven Model Combining Physics, Theory, and Experiment

Degradation via sintering is an ongoing challenge that impedes the broad commercial success of supported metallic nanoparticle catalysts. To mitigate degradation via informed catalyst design and process operations, here we aim to disambiguate the underlying mechanisms of sintering by combining theory and experiment in a quantitative framework. While mechanistic sintering models exist, they only model a single sintering pathway, even though multiple sintering mechanisms can occur simultaneously or dominate at different stages of the process. Data-driven machine learning models have emerged as a means to represent complex processes through data regression. However, machine learning models have very large data needs and lack mechanistic insights due to their black-box encoding. To develop an interpretive model of catalyst degradation via sintering, we constructed a hybrid model combining mechanistic “physics-based” models and data-driven methods to obtain both reliable predictions and mechanistic insights regarding experimentally observed sintering phenomena. Focusing on nanoparticle sintering in the Rh–TiO 2 catalyst for the reverse water–gas shift (RWGS) reaction, the hybrid model couples a mechanistic term for Ostwald ripening with energy values calculated via density functional theory (DFT) with a parametric, data-driven discrepancy function term for unmodeled mechanisms. The hybrid model is trained using Bayesian inference with data collected from small-angle X-ray scattering (SAXS) in situ experiments wherein average nanoparticle diameter versus time was measured at three relevant operating temperatures. The calibrated hybrid model results show that an Ostwald ripening-only model parameterized with fixed DFT energies does not fully capture the time and temperature dependence of the SAXS-observed sintering kinetics, and that an additional functional contribution, or DFT energy calibration, is required to reconcile simulation and experiment. Analysis of the hybrid-model error confirms that the hybrid model outperforms both the purely mechanistic and purely data-driven alternatives in terms of expected predictive accuracy for time-evolving average particle sizes. Furthermore, the results support the hypothesis that the Ostwald ripening mechanism is less important for explaining the sintering phenomena as operating temperature increases under an assumed fixed DFT parameterization. This could be explained in one of two ways: either latent, unmodeled sintering mechanisms dominate at higher temperatures, or the DFT uncertainty increases with temperature. The proposed modeling approach directly links theory to experiments and simulations via a statistical hybrid modeling framework and can be extended to other catalytic systems to improve predictive models and mechanistic understanding.

Bayesian hybrid modeling↗
DOE OSTI2023

Carbon Organisms Rhizosphere and Protection in Soil Environment model script and input data for soil moisture-respiration responses in tropical forests

Objectives: Climatic drying is predicted for many tropical forests, yet models remain poorly parameterized for tropical forests, hampering predictions of forest-climate feedbacks. We applied an integrated model–experiment approach, parameterizing an ecosystem model Carbon Organisms Rhizosphere and Protection in the Soil Environment (CORPSE) with tropical forest observational data, and comparing model predictions with a field drying manipulation. We hypothesized that drying would suppress soil CO2 fluxes (i.e., respiration) in already-drier tropical forests, but increases CO2 fluxes in wetter tropical forests by alleviating anaerobiosis. We measured soil CO2 fluxes, soil moisture, soil temperature, and forest floor biomass during wet-dry cycles (2015 – 2022) in four Panamanian forests that vary in rainfall and soil fertility. We used the field data to parameterize and run tests in the model.Results: Measured CO2 fluxes declined in the dry season and peaked in the early wet season ahead of peak soil moisture, resulting in a lower soil moisture optimum for respiration than previously modeled. We used this data to parameterize the model, which then predicted increased soil CO2 fluxes in wetter and fertile forests with drying, and decreased fluxes in drier, infertile forests. In contrast to model predictions, a chronic throughfall exclusion experiment in the forests initially suppressed soil CO2 fluxes across forests, with sustained suppression after four years in the wettest forest only (-28 ± 4% during the dry season), but elevated soil CO2 fluxes in a fertile forest after four years (+75 ± 28% during the late wet season), as predicted by the model. The unexpected negative drying effect in the wettest, most infertile forest could have resulted from reduced vertical flushing of nutrients into soils. Including hydro-nutrient interactions in ecosystem models could improve predictions of tropical forest-climate feedbacks (results presented in Cusack et al. 2023). Datasets included: Code files:CORPSE_array.py: Defines the equations of the CORPSE modelCORPSE_solvers: Functions for running the CORPSE model using either iterative or ordinary differential equation (ODE) solversrun_Panama_sims.py: Read in datasets and run the model simulations for this studyInput data:PanamaGradientEcosystemChem_BT_CPools_20152016CO2_DC_20190615.xlsx: Plot characteristics used in running model simulationsLiCor compiled surface flux only to 2020_03 DC_20200825.xlsx: Surface gas exchange fluxes used in model-data comparisonsPARCHED litterfall data for Ben Sulman LD 20200902.xlsx: Litterfall data used to drive model simulationsInitialization data:state_500y_20190823.csv: Initial state of model pools based on previous spinup runsOutput data:Outputs/prev_moisture_response.csv: Simulations of multiple sites using original model moisture response function.Outputs/updated_moisture_response.csv: Simulations of multiple sites using updated model moisture response function.Outputs/dry15_prev_moisture_response.csv: Simulations with soil moisture reduced by 15%, using original moisture response function.Outputs/dry15_updated_moisture_response.csv: Simulations with soil moisture reduced by 15%, using updated moisture response function.Outputs/dry30_prev_moisture_response.csv: Simulations with soil moisture reduced by 30%, using original moisture response function.Outputs/dry30_updated_moisture_response.csv: Simulations with soil moisture reduced by 30%, using updated moisture response function.Outputs/latestart_prev_moisture_response.csv: Simulations with extended dry season, using original moisture response function.Outputs/latestart_updated_moisture_response.csv: Simulations with extended dry season, using updated moisture response function.Outputs/[site name]_oneyear.csv: One-year simulation for each site in expanded site list using original moisture response function.Outputs/[site name]_oneyear_dried.csv: One-year simulation for each site in expanded site list using original moisture response function, with soil moisture reduced by 25%.Outputs/[site name]_oneyear_updated_moisture_response.csv: One-year simulation for each site in expanded site list using updated moisture response function.Outputs/[site name]_oneyear_updated_moisture_response_dried.csv: One-year simulation for each site in expanded site list using updated moisture response function, with soil moisture reduced by 25%.Field plot location data:There is also a .kml file that includes coordinates for all 32 plots included in the study of four forests (n = 4 throughfall reduction and n = 4 control plots per site).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Efficient and assured reinforcement learning-based building HVAC control with heterogeneous expert-guided training

Abstract Building heating, ventilation, and air conditioning (HVAC) systems account for nearly half of building energy consumption and $$20\%$$ of total energy consumption in the US. Their operation is also crucial for ensuring the physical and mental health of building occupants. Compared with traditional model-based HVAC control methods, the recent model-free deep reinforcement learning (DRL) based methods have shown good performance while do not require the development of detailed and costly physical models. However, these model-free DRL approaches often suffer from long training time to reach a good performance, which is a major obstacle for their practical deployment. In this work, we present a systematic approach to accelerate online reinforcement learning for HVAC control by taking full advantage of the knowledge from domain experts in various forms . Specifically, the algorithm stages include learning expert functions from existing abstract physical models and from historical data via offline reinforcement learning, integrating the expert functions with rule-based guidelines, conducting training guided by the integrated expert function and performing policy initialization from distilled expert function. Moreover, to ensure that the learned DRL-based HVAC controller can effectively keep room temperature within the comfortable range for occupants, we design a runtime shielding framework to reduce the temperature violation rate and incorporate the learned controller into it. Experimental results demonstrate up to 8.8 X speedup in DRL training from our approach over previous methods, with low temperature violation rate.

Xu, Shichao↗