Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model calibration techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

A Method to Test Model Calibration Techniques

This paper describes a method for testing model calibration techniques. Calibration is commonly used in conjunction with energy retrofit audit models. An audit is conducted to gather information about the building needed to assemble an input file for a building energy modeling tool. A calibration technique is used to reconcile model predictions with utility data, and then the 'calibrated model' is used to predict energy savings from a variety of retrofit measures and combinations thereof. Current standards and guidelines such as BPI-2400 and ASHRAE-14 set criteria for 'goodness of fit' and assume that if the criteria are met, then the calibration technique is acceptable. While it is logical to use the actual performance data of the building to tune the model, it is not certain that a good fit will result in a model that better predicts post-retrofit energy savings. Therefore, the basic idea here is that the simulation program (intended for use with the calibration technique) is used to generate surrogate utility bill data and retrofit energy savings data against which the calibration technique can be tested. This provides three figures of merit for testing a calibration technique, 1) accuracy of the post-retrofit energy savings prediction, 2) closure on the 'true' input parameter values, and 3) goodness of fit to the utility bill data. The paper will also discuss the pros and cons of using this synthetic surrogate data approach versus trying to use real data sets of actual buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2016

A Method to Test Model Calibration Techniques: Preprint

This paper describes a method for testing model calibration techniques. Calibration is commonly used in conjunction with energy retrofit audit models. An audit is conducted to gather information about the building needed to assemble an input file for a building energy modeling tool. A calibration technique is used to reconcile model predictions with utility data, and then the 'calibrated model' is used to predict energy savings from a variety of retrofit measures and combinations thereof. Current standards and guidelines such as BPI-2400 and ASHRAE-14 set criteria for 'goodness of fit' and assume that if the criteria are met, then the calibration technique is acceptable. While it is logical to use the actual performance data of the building to tune the model, it is not certain that a good fit will result in a model that better predicts post-retrofit energy savings. Therefore, the basic idea here is that the simulation program (intended for use with the calibration technique) is used to generate surrogate utility bill data and retrofit energy savings data against which the calibration technique can be tested. This provides three figures of merit for testing a calibration technique, 1) accuracy of the post-retrofit energy savings prediction, 2) closure on the 'true' input parameter values, and 3) goodness of fit to the utility bill data. The paper will also discuss the pros and cons of using this synthetic surrogate data approach versus trying to use real data sets of actual buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2016

Estimation of Uncertainties of Wall Temperature Accomplished by Model Calibration Technique Using Small to Large Scale Reflooding Test Data

The fidelity of the prediction can be evaluated by performing validation and uncertainty quantification with suitable test data. Nuclear power plant design and operation must accommodate the uncertainties in predicting system performance, where those uncertainties originating due to initial and boundary conditions, numerics, and modeling uncertainties. To improve the prediction of the reactor system performance, these various sources of uncertainties can be refined through model calibration technique. The objective of this work is to refine the model parameters and to estimate the uncertainties on parameters/responses during reflood phase. To accomplish this experiments should be performed, data collected, and the data utilized to complete model calibration for the thermal-hydraulic input parameters. Simulations were performed using Safety and Performance Analysis Code (SPACE) developed by multiple research institutes in South Korea to predict the thermal hydraulic system behaviors of nuclear power plants. Since existing experimental data were obtained from several tests performed at the small scale, scaling considerations must be addressed during the uncertainty quantification process. (authors)

42 ENGINEERING↗
DOE OSTI2016

On the applicability of surrogate-based Markov chain Monte Carlo-Bayesian inversion to the Community Land Model: Case studies at flux tower sites: SURROGATE-BASED MCMC FOR CLM

The Community Land Model (CLM) has been widely used in climate and Earth system modeling. Accurate estimation of model parameters is needed for reliable model simulations and predictions under current and future conditions, respectively. In our previous work, a subset of hydrological parameters has been identified to have significant impact on surface energy fluxes at selected flux tower sites based on parameter screening and sensitivity analysis, which indicate that the parameters could potentially be estimated from surface flux observations at the towers. To date, such estimates do not exist. In this paper, we assess the feasibility of applying a Bayesian model calibration technique to estimate CLM parameters at selected flux tower sites under various site conditions. The parameters are estimated as a joint probability density function (PDF) that provides estimates of uncertainty of the parameters being inverted, conditional on climatologically-average latent heat fluxes derived from observations. We find that the simulated mean latent heat fluxes from CLM using the calibrated parameters are generally improved at all sites when compared to those obtained with CLM simulations using default parameter sets. Further, our calibration method also results in credibility bounds around the simulated mean fluxes which bracket the measured data. The modes (or maximum a posteriori values) and 95% credibility intervals of the site-specific posterior PDFs are tabulated as suggested parameter values for each site. Analysis of relationships between the posterior PDFs and site conditions suggests that the parameter values are likely correlated with the plant functional type, which needs to be confirmed in future studies by extending the approach to more sites.

Huang, Maoyi↗
DOE OSTI2022

ReNew100: Reliable Power System Operation with 100% Renewable Generation

The ReNew100 project has developed and demonstrated an operator support system (OSS) to operate power systems with 100% renewable power generation from inverter-based resources (IBRs) like wind and solar that significantly reduces the risk of widespread power outages in a simulated operational environment at Technology Readiness Level (TRL) 6. The OSS achieves resilient operation for power systems under changing operation modes including varying combinations of conventional and renewable generation, including cases with 100% renewable generation from wind and solar IBRs. The OSS continuously monitors the N-1 security of the power system, which refers to the ability of the power systems to survive single outages of power system elements, like the loss of a generator or a power line, without causing widespread power outages beyond those expected and planned for. If the OSS identifies that the system is not N-1 secure, an automatic Controller Parameter Optimization (CoPO) developed within Renew100 is activated to optimize the N-1 security of the system by tuning controller parameters within different assets like batteries, wind, and solar plants. The core innovation of ReNew100 is the development of this CoPO as well as the demonstration of the OSS for a real-time simulation of the Hawai'i Island power system. Moreover, Renew100 has developed new model calibration techniques for dynamic power system models and demonstrated them for Hawai'i Island.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Calibration verification for stochastic agent-based disease spread models

Accurate disease spread modeling is crucial for identifying the severity of outbreaks and planning effective mitigation efforts. To be reliable when applied to new outbreaks, model calibration techniques must be robust. However, current methods frequently forgo calibration verification (a stand-alone process evaluating the calibration procedure) and instead use overall model validation (a process comparing calibrated model results to data) to check calibration processes, which may conceal errors in calibration. In this work, we develop a stochastic agent-based disease spread model to act as a testing environment as we test two calibration methods using simulation-based calibration, which is a synthetic data calibration verification method. The first calibration method is a Bayesian inference approach using an empirically-constructed likelihood and Markov chain Monte Carlo (MCMC) sampling, while the second method is a likelihood-free approach using approximate Bayesian computation (ABC). Simulation-based calibration suggests that there are challenges with the empirical likelihood calculation used in the first calibration method in this context. These issues are alleviated in the ABC approach. Despite these challenges, we note that the first calibration method performs well in a synthetic data model validation test similar to those common in disease spread modeling literature. We conclude that stand-alone calibration verification using synthetic data may benefit epidemiological researchers in identifying model calibration challenges that may be difficult to identify with other commonly used model validation techniques.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

A probabilistic inverse prediction method for predicting plutonium processing conditions

In the past decade, nuclear chemists and physicists have been conducting studies to investigate the signatures associated with the production of special nuclear material (SNM). In particular, these studies aim to determine how various processing parameters impact the physical, chemical, and morphological properties of the resulting special nuclear material. By better understanding how these properties relate to the processing parameters, scientists can better contribute to nuclear forensics investigations by quantifying their results and ultimately shortening the forensic timeline. This paper aims to statistically analyze and quantify the relationships that exist between the processing conditions used in these experiments and the various properties of the nuclear end-product by invoking inverse methods. In particular, these methods make use of Bayesian Adaptive Spline Surface models in conjunction with Bayesian model calibration techniques to probabilistically determine processing conditions as an inverse function of morphological characteristics. Not only does the model presented in this paper allow for providing point estimates of a sample of special nuclear material, but it also incorporates uncertainty into these predictions. This model proves sufficient for predicting processing conditions within a standard deviation of the observed processing conditions, on average, provides a solid foundation for future work in predicting processing conditions of particles of special nuclear material using only their observed morphological characteristics, and is generalizable to the field of chemometrics for applicability across different materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Transfer learning driven design optimization for inertial confinement fusion

Transfer learning is a promising approach to create predictive models that incorporate simulation and experimental data into a common framework. In this technique, a neural network is first trained on a large database of simulations and then partially retrained on sparse sets of experimental data to adjust predictions to be more consistent with reality. Previously, this technique has been used to create predictive models of Omega [Humbird et al., IEEE Trans. Plasma Sci. 48, 61–70 (2019)] and NIF [Humbird et al., Phys. Plasmas 28, 042709 (2021); Kustowski et al., Mach. Learn. 3, 015035 (2022)] inertial confinement fusion (ICF) experiments that are more accurate than simulations alone. Here, in this work, we conduct a transfer learning driven hypothetical ICF campaign in which the goal is to maximize experimental neutron yield via Bayesian optimization. The transfer learning model achieves yields within 5% of the maximum achievable yield in a modest-sized design space in fewer than 20 experiments. Furthermore, we demonstrate that this method is more efficient at optimizing designs than traditional model calibration techniques commonly employed in ICF design. Such an approach to ICF design could enable robust optimization of experimental performance under uncertainty.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2019

Bayesian modeling of inconsistent plastic response due to material variability

The advent of fabrication techniques such as additive manufacturing has focused attention on the considerable variability of material response due to defects and other microstructural aspects. This variability motivates the development of an enhanced design methodology that incorporates inherent material variability to provide robust predictions of performance. In this work, we develop plasticity models capable of representing the distribution of mechanical responses observed in experiments using traditional plasticity models of the mean response and recently developed uncertainty quantification (UQ) techniques. To account for material response variability through variations in physical parameters, we adapt a recent Bayesian embedded modeling error calibration technique. We use Bayesian model selection to determine the most plausible of a variety of plasticity models and the optimal embedding of parameter variability. To expedite model selection, we develop an adaptive importance-sampling-based numerical integration scheme to compute the Bayesian model evidence. In conclusion, we demonstrate that the new framework provides predictive realizations that are superior to more traditional ones, and how these UQ techniques can be used in model selection and assessing the quality of calibrated physical parameters.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Development of Upscaling Techniques and Construction of Calibrated Models for Fractured Rocks Using Discrete Fracture Network Approaches

The Pahute Mesa Corrective Action Unit on the Nevada National Security Site (NNSS) contains several fractured aquifers that can potentially provide high-permeability pathways for radionuclides to migrate away from underground nuclear testing locations. Although the geometric properties of fractures, such as length and orientation, can be found using geophysical methods and borehole image analyses, the hydraulic property of fractures (which are primarily influenced by apertures) are often unknown or have a high degree of uncertainty attached to their values. The aperture values have a profound impact on groundwater velocity and are critical to understanding transport scales at Pahute Mesa. Fracture aperture values and their distributions also have dominant control over radionuclide transport with potential for long-range correlations or scale-invariant dynamics. Understanding of the small-scale transport variability in fractures could lead to identification of distinct characteristics on larger scales. Furthermore, upscaling techniques need to be developed to adequately predict transport behavior at field scales by capturing the transport trends of smaller scale networks. This report explores these vital modeling needs to understand the role of fractures in Pahute Mesa. Discrete fracture network (DFN) models are the basis for constructing a well-calibrated model to ascertain aperture values of fractures in lava-flow aquifers. These models are also used to develop and compare the usefulness of several random-walk-based models to perform transport upscaling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Remote Distributed Vibration Sensing Through Opaque Media Using Permanent Magnets

Vibration sensing is critical for a variety of applications from structural fatigue monitoring to understanding the modes of airplane wings. In particular, remote sensing techniques are needed for measuring the vibrations of multiple points simultaneously, assessing vibrations inside opaque metal vessels, and sensing through smoke clouds and other optically challenging environments. Here, in this paper, we propose a method which measures high-frequency displacements remotely using changes in the magnetic field generated by permanent magnets. We leverage the unique nature of vibration tracking and use a calibrated local model technique developed specifically to improve the frequency-domain estimation accuracy. The results show that two-dimensional local models surpass the dipole model in tracking high-frequency motions. A theoretical basis for understanding the effects of electronic noise and error due to correlated variables is generated in order to predict the performance of experiments prior to implementation. Simultaneous measurements of up to three independent vibrating components are shown. The relative accuracy of the magnet-based displacement tracking with respect to the video tracking ranges from 40 to 190 μm when the maximum displacements approach ±5 mm and when sensor-to-magnet distances vary from 25 to 36 mm. Finally, vibration sensing inside an opaque metal vessel and mode shape changes due to damage on an aluminum beam are also studied using the wireless permanent-magnet vibration sensing scheme.

42 ENGINEERING↗
DOE OSTI2016

Proposal of a Novel Approach to Developing Material Models for Micro-scale Composites Based on Testing and Modeling of Macro-scale Composites

The Los Alamos National Laboratory's Weapon Systems Engineering division's Advanced Engineering Analysis group employs material constitutive models of composites for use in simulations of components and assemblies of interest. Experimental characterization, modeling and prediction of the macro-scale (i.e. continuum) behaviors of these composite materials is generally difficult because they exhibit nonlinear behaviors on the meso- (e.g. micro-) and macro-scales. Furthermore, it can be difficult to measure and model the mechanical responses of the individual constituents and constituent interactions in the composites of interest. Current efforts to model such composite materials rely on semi-empirical models in which meso-scale properties are inferred from continuum level testing and modeling. The proposed approach involves removing the difficulties of interrogating and characterizing micro-scale behaviors by scaling-up the problem to work with macro-scale composites, with the intention of developing testing and modeling capabilities that will be applicable to the mesoscale. This approach assumes that the physical mechanisms governing the responses of the composites on the meso-scale are reproducible on the macro-scale. Working on the macro-scale simplifies the quantification of composite constituents and constituent interactions so that efforts can be focused on developing material models and the testing techniques needed for calibration and validation. Other benefits to working with macro-scale composites include the ability to engineer and manufacture—potentially using additive manufacturing techniques—composites that will support the application of advanced measurement techniques such as digital volume correlation and three-dimensional computed tomography imaging, which would aid in observing and quantifying complex behaviors that are exhibited in the macro-scale composites of interest. Ultimately, the goal of this new approach is to develop a meso-scale composite modeling framework, applicable to many composite materials, and the corresponding macroscale testing and test data interrogation techniques to support model calibration.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Application and evaluation of a pattern-based building energy model calibration method using public building datasets

Building performance simulation has been adopted to support decision making in the building life cycle. An essential issue is to ensure a building energy simulation model can capture the reality and complexity of buildings and their systems in both the static characteristics and dynamic operations. Building energy model calibration is a technique that takes various types of measured performance data (e.g., energy use) and tunes key model parameters to match the simulated results with the actual measurements. This study performed an application and evaluation of an automated pattern-based calibration method on commercial building models that were generated based on characteristics of real buildings. A public building dataset that includes high-level building attributes (e.g., building type, vintage, total floor area, number of stories, zip code) of 111 buildings in San Francisco, California, USA, was used to generate building models in EnergyPlus. Monthly level energy use calibrations were then conducted by comparing building model results against the actual buildings' monthly electricity and natural gas consumption. The results showed 57 out of 111 buildings were successfully calibrated against actual buildings, while the remaining buildings showed opportunities for future calibration improvements. Enhancements to the pattern-based model calibration method are identified to expand its use for: (1) central heating, ventilation and air conditioning (HVAC) systems with chillers, (2) space heating and hot water heating with electricity sources, (3) mixed-use building types, and (4) partially occupied buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2016

Regional hydrologic response to climate change in the conterminous United States using high-resolution hydroclimate simulations

Despite the fact that Global Climate Model (GCM) outputs have been used to project hydrologic impacts of climate change using off-line hydrologic models for two decades, many of these efforts have been disjointed applications or at least calibrations have been focused on individual river basins and using a few of the available GCMs. This study improves upon earlier attempts by systematically projecting hydrologic impacts for the entire conterminous United States (US), using outputs from ten GCMs from the latest Coupled Model Intercomparison Project phase 5 (CMIP5) archive, with seamless hydrologic model calibration and validation techniques to produce a spatially and temporally consistent set of current hydrologic projections. The Variable Infiltration Capacity (VIC) model was forced with ten-member ensemble projections of precipitation and air temperature that were dynamically downscaled using a regional climate model (RegCM4) and bias-corrected to 1/24 (~4 km) grid resolution for the baseline (1966 2005) and future (2011 2050) periods under the Representative Concentration Pathway 8.5. Based on regional analysis, the VIC model projections indicate an increase in winter and spring total runoff due to increases in winter precipitation of up to 20% in most regions of the US. However, decreases in snow water equivalent (SWE) and snow-covered days will lead to significant decreases in summer runoff with more pronounced shifts in the time of occurrence of annual peak runoff projected over the eastern and western US. In contrast, the central US will experience year-round increases in total runoff, mostly associated with increases in both extreme high and low runoff. Furthermore, the projected hydrological changes described in this study have implications for various aspects of future water resource management, including water supply, flood and drought preparation, and reservoir operation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

High Accuracy Transistor Compact Model Calibrations

Typically, transistors are modeled by the application of calibrated nominal and range models. These models consists of differing parameter values that describe the location and the upper and lower limits of a distribution of some transistor characteristic such as current capacity. Correspondingly, when using this approach, high degrees of accuracy of the transistor models are not expected since the set of models is a surrogate for a statistical description of the devices. The use of these types of models describes expected performances considering the extremes of process or transistor deviations. In contrast, circuits that have very stringent accuracy requirements require modeling techniques with higher accuracy. Since these accurate models have low error in transistor descriptions, these models can be used to describe part to part variations as well as an accurate description of a single circuit instance. Thus, models that meet these stipulations also enable the calculation of quantification of margins with respect to a functional threshold and uncertainties in these margins. Given this need, new model high accuracy calibration techniques for bipolar junction transistors have been developed and are described in this report.

42 ENGINEERING↗