Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Empirical Absolute Calibration Model for Multiple Pseudo-Invariant Calibration Sites

This work extends an empirical absolute calibration model initially developed for the Libya 4 Pseudo-Invariant Calibration Site (PICS) to five additional Saharan Desert PICS (Egypt 1, Libya 1, Niger 1, Niger 2, and Sudan 1), and demonstrates the efficacy of the resulting models at predicting sensor top-of-atmosphere (TOA) reflectance. It attempts to generate absolute calibration models for these PICS that have an accuracy and precision comparable to or better than the current Libya 4 model, with the intent of providing additional opportunities for sensor calibration. In addition, this work attempts to validate the general applicability of the model to other sites. The method uses Terra Moderate Resolution Imaging Spectroradiometer (MODIS) as the reference radiometer and Earth Observing-1 (EO-1) Hyperion image data to provide a representative hyperspectral reflectance profile of the PICS. Data from a region of interest (ROI) in an “optimal region” of 3% temporal, spatial, and spectral stability within the PICS are used for developing the model. The developed models were used to simulate observations of the Landsat 7 (L7) Enhanced Thematic Mapper Plus (ETM+), Landsat 8 (L8) Operational Land Imager (OLI), Sentinel 2A (S2A) MultiSpectral Instrument (MSI) and Sentinel 2B (S2B) MultiSpectral Instrument (MSI) from their respective launch date through 2018. The models developed for the Egypt 1, Libya 1 and Sudan 1 PICS have an estimated accuracy of approximately 3% and precision of approximately 2% for the sensors used in the study, comparable to the current Libya 4 model. The models developed for the Niger 1 and Niger 2 sites are significantly less accurate with similar precision.

Raut, Bipin↗

Model Calibration with Markov Chain Monte Carlo Tutorial

The purpose of this tutorial is to demonstrate how to use Markov chain Monte Carlo (MCMC) to calibrate a model. By calibration, we mean the selection of model parameters (and, when relevant, structures). A common goal in model development and diagnostics is calibration, or the identification of model structures and parameters which are consistent with data. While models can be calibrated through hand-tuning parameters or minimizing simple error metrics such as root-mean-square-error (RMSE), these approaches can underrepresent the probabilistic nature of the data-generating process, as well as the potential for multiple model configurations to be consistent with the data. Probabilistic uncertainty quantification, which is the topic of this notebook, can address these concerns. This tutorial is presented as an appendix to the e-book: Addressing Uncertainty in MultiSector Dynamics Research.

Markov chain Monte Carlo↗

Building Model Calibration: Validation of GridLAB-D Thermal Dynamics Modeling

This report investigates how well GridLAB-D’s house model characterizes the thermal dynamics of buildings given the overpredicted diurnal electric load swing observed in the Distribution System Operation with Transactive (DSO+T) study. This study seeks to validate GridLAB-D’s house model by calibrating it to data from the well-instrumented Pacific Northwest National Laboratory Lab Homes in Richland, WA. The datasets chosen included multiple pre-cooling and pre-heating testing periods where the indoor air temperature was allowed to float over a multi-hour length of time to mimic diurnal behavior. The multi-season calibrations were evaluated by comparing the heating/cooling electric power, indoor air temperature, and the rise/decay time during temperature float periods with Lab Homes data. The default GridLAB-D assumptions for latent load fraction, air heat capacity, mass heat capacity, window-to-wall-ratio, overall envelope conductance (assumed as NORMAL thermal integrity level), and solar heat gain coefficient were compared with the calibrated model to confirm when the default assumptions were adequate and the impact of calibration on the accuracy of modeling the thermal dynamics of homes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Model Calibration in Watershed Hydrology

Hydrologic models use relatively simple mathematical equations to conceptualize and aggregate the complex, spatially distributed, and highly interrelated water, energy, and vegetation processes in a watershed. A consequence of process aggregation is that the model parameters often do not represent directly measurable entities and must, therefore, be estimated using measurements of the system inputs and outputs. During this process, known as model calibration, the parameters are adjusted so that the behavior of the model approximates, as closely and consistently as possible, the observed response of the hydrologic system over some historical period of time. This Chapter reviews the current state-of-the-art of model calibration in watershed hydrology with special emphasis on our own contributions in the last few decades. We discuss the historical background that has led to current perspectives, and review different approaches for manual and automatic single- and multi-objective parameter estimation. In particular, we highlight the recent developments in the calibration of distributed hydrologic models using parameter dimensionality reduction sampling, parameter regularization and parallel computing.

Yilmaz, Koray K.↗

Model Calibration with Censored Data

Here, the purpose of model calibration is to make the model predictions closer to reality. The classical Kennedy-O'Hagan approach is widely used for model calibration, which can account for the inadequacy of the computer model while simultaneously estimating the unknown calibration parameters. In many applications, the phenomenon of censoring occurs when the exact outcome of the physical experiment is not observed, but is only known to fall within a certain region. In such cases, the Kennedy-O'Hagan approach cannot be used directly, and we propose a method to incorporate the censoring information when performing model calibration. The method is applied to study the compression phenomenon of liquid inside a bottle. The results show significant improvement over the traditional calibration methods, especially when the number of censored observations is large.

97 MATHEMATICS AND COMPUTING↗

Reduced chemistry model calibration using unsteady flames with repetitive extinction and ignition

In this paper, combustion in a narrow channel with an imposed temperature gradient is used to calibrate a reduced chemical mechanism. The focus is placed on unsteady flames with repetitive extinction and ignition (FREI) at high pressure. The reduced mechanism follows a hybrid approach, combining a small fuel-dependent submechanism with a detailed fuel-independent submechanism for the core species chemistry. The fuel-dependent submechanism consists of three species and nine reactions describing both the low and high-temperature fuel decomposition pathways. The sensitivity of the extinction and ignition locations to the fuel-dependent reactions is assessed and multiple reactions are found to affect the FREI behavior. The sensitive reactions are calibrated following a Bayesian approach. The calibrated reduced model is compared to a detailed model and good agreement in ignition delay times and laminar flame speeds is observed. Finally, this illustrates the potential of a micro flow reactor with a controlled temperature profile to test fuels, calibrate chemical models, and infer kinetic data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Geomechanical Simulation of Big Hill Strategic Petroleum Reserve (Model Calibration)

A finite element numerical analysis model has been constructed that consists of a realistic mesh capturing the geometries of Big Hill (BH) Strategic Petroleum Reserve (SPR) site using the multi-mechanism deformation (M-D) salt constitutive model and including data taken daily of the wellhead pressure and level of the oil-brine interface. The salt creep rate is not uniform in the salt dome, and creep test data for BH salt is limited. Therefore, a model calibration is necessary to simulate the geomechanical behavior of the salt dome. Cavern volumetric closures of SPR caverns calculated from sonar survey reports are used for the field baseline measurement. The structure factor, A 2 , and transient strain limit factor, K o , in the M-D constitutive model are used for model calibration. An A 2 value obtained experimentally from the BH salt and K o value of WIPP salt are used as the baseline values. To adjust the magnitude of A 2 and K o , multiplication factors A2F and KOF are defined, respectively. The A2F and KOF values of the salt dome and salt drawdown layer of elements surrounding each SPR cavern have been determined through a number of back fitting analyses. The trendlines of the predictions and sonar data match up well for BH 101, 103, 104, 106, 110, 111, and 113. The prediction curves are close to the sonar data for BH 102 and 114. However, the prediction curves for BH 105, 107, 108, 109, and 112 are not close to the sonar data. An inconsistency was found in the sonar data, i.e. the sonar measurements of cavern volumes increase with time, during some periods for BH 101, 104, 106, 107, and 112. A follow-up report in 2019 will provide a resolution for these issues.

02 PETROLEUM↗

Advancing earth system model calibration: a diffusion-based method

Understanding of climate impact on ecosystems globally requires site-specific model calibration. Here we introduce a novel diffusion-based uncertainty quantification (DBUQ) method for efficient model calibration. DBUQ is a score-based diffusion model that leverages Monte Carlo simulation to estimate the score function and evaluates a simple neural network to quickly generate samples for approximating parameter posterior distributions. DBUQ is stable, efficient, and can effectively calibrate the model given diverse observations, thereby enabling rapid and site-specific model calibration on a global scale. This capability significantly advances Earth system modeling and our understanding of climate impacts on Earth systems. We demonstrate DBUQ's capability in E3SM land model calibration at the Missouri Ozark AmeriFlux forest site. Both synthetic and real-data applications indicate that DBUQ produces accurate parameter posterior distributions similar to those generated by Markov Chain Monte Carlo sampling but with 30X less computing time. This efficiency marks a significant stride in model calibration, paving the way for more effective and timely climate impact analyses.

Liu, Yanfang↗

Model Calibration and Optics Correction Using Orbit Response Matrix in the Fermilab Booster

We have calibrated the lattice model and measured the beta and dispersion functions in Fermilab's fast-ramping Booster synchrotron using the Linear Optics from Closed Orbit (LOCO) method. We used the calibrated model to implement ramped coupling, dispersion, and beta-beating corrections throughout the acceleration cycle, reducing horizontal beta beating from its initial magnitude of {approx}30% to {approx}10%, and essentially eliminating vertical beta-beating and transverse coupling.

43 PARTICLE ACCELERATORS↗

A Method to Test Model Calibration Techniques

This paper describes a method for testing model calibration techniques. Calibration is commonly used in conjunction with energy retrofit audit models. An audit is conducted to gather information about the building needed to assemble an input file for a building energy modeling tool. A calibration technique is used to reconcile model predictions with utility data, and then the 'calibrated model' is used to predict energy savings from a variety of retrofit measures and combinations thereof. Current standards and guidelines such as BPI-2400 and ASHRAE-14 set criteria for 'goodness of fit' and assume that if the criteria are met, then the calibration technique is acceptable. While it is logical to use the actual performance data of the building to tune the model, it is not certain that a good fit will result in a model that better predicts post-retrofit energy savings. Therefore, the basic idea here is that the simulation program (intended for use with the calibration technique) is used to generate surrogate utility bill data and retrofit energy savings data against which the calibration technique can be tested. This provides three figures of merit for testing a calibration technique, 1) accuracy of the post-retrofit energy savings prediction, 2) closure on the 'true' input parameter values, and 3) goodness of fit to the utility bill data. The paper will also discuss the pros and cons of using this synthetic surrogate data approach versus trying to use real data sets of actual buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Model Calibration of Exciter and PSS Using Extended Kalman Filter

Power system modeling and controls continue to become more complex with the advent of smart grid technologies and large-scale deployment of renewable energy resources. As demonstrated in recent studies, inaccurate system models could lead to large-scale blackouts, thereby motivating the need for model calibration. Current methods of model calibration rely on manual tuning based on engineering experience, are time consuming and could yield inaccurate parameter estimates. In this paper, the Extended Kalman Filter (EKF) is used as a tool to calibrate exciter and Power System Stabilizer (PSS) models of a particular type of machine in the Western Electricity Coordinating Council (WECC). The EKF-based parameter estimation is a recursive prediction-correction process which uses the mismatch between simulation and measurement to adjust the model parameters at every time step. Numerical simulations using actual field test data demonstrate the effectiveness of the proposed approach in calibrating the parameters.

Kalsi, Karanjit↗

A Method to Test Model Calibration Techniques: Preprint

This paper describes a method for testing model calibration techniques. Calibration is commonly used in conjunction with energy retrofit audit models. An audit is conducted to gather information about the building needed to assemble an input file for a building energy modeling tool. A calibration technique is used to reconcile model predictions with utility data, and then the 'calibrated model' is used to predict energy savings from a variety of retrofit measures and combinations thereof. Current standards and guidelines such as BPI-2400 and ASHRAE-14 set criteria for 'goodness of fit' and assume that if the criteria are met, then the calibration technique is acceptable. While it is logical to use the actual performance data of the building to tune the model, it is not certain that a good fit will result in a model that better predicts post-retrofit energy savings. Therefore, the basic idea here is that the simulation program (intended for use with the calibration technique) is used to generate surrogate utility bill data and retrofit energy savings data against which the calibration technique can be tested. This provides three figures of merit for testing a calibration technique, 1) accuracy of the post-retrofit energy savings prediction, 2) closure on the 'true' input parameter values, and 3) goodness of fit to the utility bill data. The paper will also discuss the pros and cons of using this synthetic surrogate data approach versus trying to use real data sets of actual buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Comparison of Two Balance Calibration Model Building Methods

Simulated strain-gage balance calibration data is used to compare the accuracy of two balance calibration model building methods for different noise environments and calibration experiment designs. The first building method obtains a math model for the analysis of balance calibration data after applying a candidate math model search algorithm to the calibration data set. The second building method uses stepwise regression analysis in order to construct a model for the analysis. Four balance calibration data sets were simulated in order to compare the accuracy of the two math model building methods. The simulated data sets were prepared using the traditional One Factor At a Time (OFAT) technique and the Modern Design of Experiments (MDOE) approach. Random and systematic errors were introduced in the simulated calibration data sets in order to study their influence on the math model building methods. Residuals of the fitted calibration responses and other statistical metrics were compared in order to evaluate the calibration models developed with different combinations of noise environment, experiment design, and model building method. Overall, predicted math models and residuals of both math model building methods show very good agreement. Significant differences in model quality were attributable to noise environment, experiment design, and their interaction. Generally, the addition of systematic error significantly degraded the quality of calibration models developed from OFAT data by either method, but MDOE experiment designs were more robust with respect to the introduction of a systematic component of the unexplained variance.

DeLoach, Richard↗

Reduced-dimension Bayesian optimization for model calibration of transient vapor compression cycles

Development and calibration of first-principles dynamic models of vapor compression cycles (VCCs) is of critical importance for applications that include control design and fault detection and diagnostics. Nevertheless, the inherent complexity of models that are represented by large systems of differential–algebraic equations leads to significant challenges for model calibration processes that utilize classical gradient-based methods. Bayesian optimization (BO) is a sample-efficient and gradient-free approach using a probabilistic surrogate model and optimal search over a feasible parameter space. Despite the benefits of BO in reducing computational costs, challenges remain in dealing with a high-dimensional calibration task resulting from a large set of parameters that have significant impacts on system behavior and need to be calibrated simultaneously. This paper presents a reduced-dimension BO framework for calibrating transient VCCs models where the calibration space is projected to a low-dimensional subspace for accelerating convergence of the solution algorithm and consequently reducing the number of transient simulations. The proposed approach was demonstrated via two case studies associated with different VCC applications where 10 parameters were calibrated in each case using laboratory measurements. The reduced-dimension BO framework only required 1 / 8 th of the iterations associated with a standard BO method that deals with high-dimensional calibration parameters for converged solutions and yielded comparable accuracy. Furthermore, both calibrated models revealed significant accuracy improvements compared to uncalibrated models.

Ma, Jiacheng↗

Rapid measurement of soluble xylo-oligomers using near-infrared spectroscopy (NIRS) and multivariate statistics: calibration model development and practical approaches to model optimization

Rapid monitoring of biomass conversion processes using techniques such as near-infrared (NIR) spectroscopy can be substantially quicker and less labor-, resource-, and energy-intensive than conventional measurement techniques such as gas or liquid chromatography (GC or LC) due to the lack of solvents and preparation methods, as well as removing the need to transfer samples to an external lab for analytical evaluation. The purpose of this study was to determine the feasibility of rapid monitoring of a biomass conversion process using NIR spectroscopy combined with multivariate statistical modeling, and to examine the impact of (1) subsetting the samples in the original dataset by process location and (2) reducing the spectral range used in the calibration model on model performance. We develop multivariate calibration models for the concentrations of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids at multiple points in a biomass conversion process which produces and then purifies XOS compounds from sugar cane bagasse. A single model using samples from multiple locations in the process stream showed acceptable performance as measured by standard statistical measures. However, compared to the single model, we show that separate models built by segregating the calibration samples according to process location show improved performance. We also show that combining an understanding of the sample spectra with simple multivariate analysis tools can result in a calibration model with a substantially smaller spectral range that provides essentially equal performance to the full-range model. We demonstrate that real-time monitoring of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids concentration at multiple points in a process stream using NIR spectroscopy coupled with multivariate statistics is feasible. Segregation of sample populations by process location improves model performance. Models using a reduced spectral range containing the most relevant spectral signatures show very similar performance to the full-range model, reinforcing the importance of performing robust exploratory data analysis before beginning multivariate modeling.

09 BIOMASS FUELS↗

A Diffusion‐Based Uncertainty Quantification Method to Advance E3SM Land Model Calibration

Abstract Calibrating land surface models and accurately quantifying their uncertainty are crucial for improving the reliability of simulations of complex environmental processes. This, in turn, advances our predictive understanding of ecosystems and supports climate‐resilient decision‐making. Traditional calibration methods, however, face challenges of high computational costs and difficulties in accurately quantifying parameter uncertainties. To address these issues, we develop a diffusion‐based uncertainty quantification (DBUQ) method. Unlike conventional generative diffusion methods, which are computationally expensive and memory‐intensive, DBUQ innovates by formulating a parameterized generative model and approximates this model through supervised learning, which enables quick generation of parameter posterior samples to quantify its uncertainty. DBUQ is effective, efficient, and general‐purpose, making it suitable for site‐specific ecosystem model calibration and broadly applicable for parameter uncertainty quantification across various earth system models. In this study, we applied DBUQ to calibrate the Energy Exascale Earth System Model land model at the Missouri Ozark AmeriFlux forest site. Results indicated that DBUQ produced accurate parameter posterior distributions similar to those from Markov Chain Monte Carlo sampling but with 30 times less computing time. This significant improvement in efficiency suggests that DBUQ can enable rapid, site‐level model calibration at a global scale, enhancing our predictive understanding of climate impacts on terrestrial ecosystems.

54 ENVIRONMENTAL SCIENCES↗

Estimating Material Properties Under Extreme Conditions by Using Bayesian Model Calibration with Functional Outputs

Summary Dynamic material properties experiments provide access to the most extreme temperatures and pressures attainable in a laboratory setting; the data from these experiments are often used to improve our understanding of material models at these extreme conditions. We apply Bayesian model calibration to dynamic material property applications where the experimental output is a function: velocity over time. This framework can accommodate more uncertainties and facilitate analysis of new types of experiments relative to techniques traditionally used to analyse dynamic material experiments. However, implementation of Bayesian model calibration requires more sophisticated statistical techniques, because of the functional nature of the output as well as parameter and model discrepancy identifiability. We propose a novel Bayesian model calibration process to simplify and improve the estimation of the material property calibration parameters. Specifically, we propose scaling the likelihood function by an effective sample size rather than modelling the auto-correlation function to accommodate the functional output. Additionally, we propose sensitivity analyses by using the notion of 'modularization' to assess the effect of experiment-specific nuisance input parameters on estimates of the physical parameters. The Bayesian model calibration framework proposed is applied to dynamic compression of tantalum to extreme pressures, and we conclude that the procedure results in simple, fast and valid inferences on the material properties for tantalum.

36 MATERIALS SCIENCE↗