Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Stochastic modeling and statistical calibration with model error and scarce data

This paper introduces a procedure to assess the predictive accuracy of stochastic models subject to model error and sparse data. Model error is introduced as uncertainty on the coefficients of appropriate polynomial chaos expansions (PCE). The error associated with finite sample size allows us to conceive of these coefficients as statistics of the data that we describe as random variables whose influence on output quantities of interest is evaluated through the extended polynomial chaos expansion (EPCE). A Bayesian data assimilation scheme is introduced to update these expansions by considering the resulting nested chaos expansion as a hierarchical probabilistic model. Stochastic models of quantities of interest (QoI) are thus constructed and efficiently evaluated. Here, the Metropolis–Hastings Markov chain Monte Carlo procedure is used to sample the posterior. Two illustrative analytical and numerical problems are used to demonstrate the proposed approach.

Bayesian inference↗

Sequentially calibrating a Bayesian microsimulation model to incorporate new information and assumptions

Background: Microsimulation models are mathematical models that simulate event histories for individual members of a population. They are useful for policy decisions because they simulate a large number of individuals from an idealized population, with features that change over time, and the resulting event histories can be summarized to describe key population-level outcomes. Model calibration is the process of incorporating evidence into the model. Calibrated models can be used to make predictions about population trends in disease outcomes and effectiveness of interventions, but calibration can be challenging and computationally expensive. Methods: This paper develops a technique for sequentially updating models to take full advantage of earlier calibration results, to ultimately speed up the calibration process. A Bayesian approach to calibration is used because it combines different sources of evidence and enables uncertainty quantification which is appealing for decision-making. We develop this method in order to re-calibrate a microsimulation model for the natural history of colorectal cancer to include new targets that better inform the time from initiation of preclinical cancer to presentation with clinical cancer (sojourn time), because model exploration and validation revealed that more information was needed on sojourn time, and that the predicted percentage of patients with cancers detected via colonoscopy screening was too low. Results: The sequential approach to calibration was more efficient than recalibrating the model from scratch. Incorporating new information on the percentage of patients with cancers detected upon screening changed the estimated sojourn time parameters significantly, increasing the estimated mean sojourn time for cancers in the colon and rectum, providing results with more validity. Conclusions: A sequential approach to recalibration can be used to efficiently recalibrate a microsimulation model when new information becomes available that requires the original targets to be supplemented with additional targets.

60 APPLIED LIFE SCIENCES↗

Multi-Dimensional Calibration of Impact Dynamic Models

NASA Langley, under the Subsonic Rotary Wing Program, recently completed two helicopter tests in support of an in-house effort to study crashworthiness. As part of this effort, work is on-going to investigate model calibration approaches and calibration metrics for impact dynamics models. Model calibration of impact dynamics problems has traditionally assessed model adequacy by comparing time histories from analytical predictions to test at only a few critical locations. Although this approach provides for a direct measure of the model predictive capability, overall system behavior is only qualitatively assessed using full vehicle animations. In order to understand the spatial and temporal relationships of impact loads as they migrate throughout the structure, a more quantitative approach is needed. In this work impact shapes derived from simulated time history data are used to recommend sensor placement and to assess model adequacy using time based metrics and orthogonality multi-dimensional metrics. An approach for model calibration is presented that includes metric definitions, uncertainty bounds, parameter sensitivity, and numerical optimization to estimate parameters to reconcile test with analysis. The process is illustrated using simulated experiment data.

Horta, Lucas G.↗

NEML2 - THE NEW ENGINEERING MATERIAL MODEL LIBRARY, VERSION 2

SF-22-157 NEML2 is an extension of an earlier open source code developed at ANL (SF-xxxx) called NEML. These libraries provide tools for constructing and using models of engineering materials, with a focus on high temperature materials for nuclear reactor applications. The software include tools for setting up material models, calibrating models, storing models for later use in other simulations, and running simple "material point" simulations of the material behavior. The main difference between NEML and NEML2 is the new software has been complete restructured to run on GPUs and other accelerators in order to improve the performance of methods used to train constitutive models against data and to improve the performance of the final models in production environments, like finite element software. While over time we expect NEML2 to become more-or-less feature complete with NEML we are filing a new software disclosure because (1) the library has been complete restructured and (2) we want to host NEML2 in a separate repository.

MESSNER, MARK↗

EFBMC

SAND2026-23986O EFBMC performs elastic Bayesian model calibration by applying Bayesian statistics and functional analysis. The software provides Python, R, and MATLAB scripts that enable users to calibrate models. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Tucker, J. Derek [Sandia National Lab. (SNL-CA), L↗

Melt Pond Conditions on Declining Arctic Sea Ice Over 1979-2016: Model Development, Validation, and Results

A melt pond (MP) distribution equation has been developed and incorporated into the Marginal Ice-Zone Modeling and Assimilation System to simulate Arctic MPs and sea ice over 1979-2016. The equation differs from previous MP models and yet benefits from previous studies for MP parameterizations as well as a range of observations for model calibration. Model results show higher magnitude of MP volume per unit ice area and area fraction in most of the Canada Basin and the East Siberian Sea and lower magnitude in the central Arctic. This is consistent with Moderate Resolution Imaging Spectroradiometer observations, evaluated with Measurements of Earth Data for Environmental Analysis (MEDEA) data, and closely related to top ice melt per unit ice area. The model simulates a decrease in the total Arctic sea ice volume and area, owing to a strong increase in bottom and lateral ice melt. The sea ice decline leads to a strong decrease in the total MP volume and area. However, the Arctic-averaged MP volume per unit ice area and area fraction show weak, statistically insignificant downward trends, which is linked to the fact that MP water drainage per unit ice area is increasing. It is also linked to the fact that MP volume and area decrease relatively faster than ice area. This suggests that overall the actual MP conditions on ice have changed little in the past decades as the ice cover is retreating in response to Arctic warming, thus consistent with the Moderate Resolution Imaging Spectroradiometer observations that show no clear trend in MP area fraction over 2000-2011.

sea ice↗

Analysis of Sting Balance Calibration Data Using Optimized Regression Models

Calibration data of a wind tunnel sting balance was processed using a search algorithm that identifies an optimized regression model for the data analysis. The selected sting balance had two moment gages that were mounted forward and aft of the balance moment center. The difference and the sum of the two gage outputs were fitted in the least squares sense using the normal force and the pitching moment at the balance moment center as independent variables. The regression model search algorithm predicted that the difference of the gage outputs should be modeled using the intercept and the normal force. The sum of the two gage outputs, on the other hand, should be modeled using the intercept, the pitching moment, and the square of the pitching moment. Equations of the deflection of a cantilever beam are used to show that the search algorithm s two recommended math models can also be obtained after performing a rigorous theoretical analysis of the deflection of the sting balance under load. The analysis of the sting balance calibration data set is a rare example of a situation when regression models of balance calibration data can directly be derived from first principles of physics and engineering. In addition, it is interesting to see that the search algorithm recommended the same regression models for the data analysis using only a set of statistical quality metrics.

Ulbrich, Norbert↗

Analysis of Sting Balance Calibration Data Using Optimized Regression Models

Calibration data of a wind tunnel sting balance was processed using a candidate math model search algorithm that recommends an optimized regression model for the data analysis. During the calibration the normal force and the moment at the balance moment center were selected as independent calibration variables. The sting balance itself had two moment gages. Therefore, after analyzing the connection between calibration loads and gage outputs, it was decided to choose the difference and the sum of the gage outputs as the two responses that best describe the behavior of the balance. The math model search algorithm was applied to these two responses. An optimized regression model was obtained for each response. Classical strain gage balance load transformations and the equations of the deflection of a cantilever beam under load are used to show that the search algorithm s two optimized regression models are supported by a theoretical analysis of the relationship between the applied calibration loads and the measured gage outputs. The analysis of the sting balance calibration data set is a rare example of a situation when terms of a regression model of a balance can directly be derived from first principles of physics. In addition, it is interesting to note that the search algorithm recommended the correct regression model term combinations using only a set of statistical quality metrics that were applied to the experimental data during the algorithm s term selection process.

Ulbrich, N.↗

Towards Robust Calibration of the AWSD Reactive Burn Model

Calibration of a reactive burn model for detonation of high explosive is an important step towards predictive hy drodynamic simulations of detonation. A typical calibration consists of varying model parameters (e.g., rate constants, activation energies) until results of hydrodynamic simulations match the experimental data for a certain set of ex periments. Hydrodynamic simulations of the dependence of steady detonation velocity on the radius of a cylindrical high-explosive charge - often used in such calibrations - can be computationally expensive. In this work, we propose a method where such expensive simulations are performed infrequently, and only to parameterize and refine a surrogate model for the dependence of the detonation velocity on calibrated parameters. The method is developed, implemented and applied to an example problem - calibration of the AWSD reactive burn model for important high explosive PBX 9502. Two different flavors of the surrogate model are investigated, and the calibration is performed successfully.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Calibration of Airframe and Occupant Models for Two Full-Scale Rotorcraft Crash Tests

Two full-scale crash tests of an MD-500 helicopter were conducted in 2009 and 2010 at NASA Langley's Landing and Impact Research Facility in support of NASA s Subsonic Rotary Wing Crashworthiness Project. The first crash test was conducted to evaluate the performance of an externally mounted composite deployable energy absorber under combined impact conditions. In the second crash test, the energy absorber was removed to establish baseline loads that are regarded as severe but survivable. Accelerations and kinematic data collected from the crash tests were compared to a system integrated finite element model of the test article. Results from 19 accelerometers placed throughout the airframe were compared to finite element model responses. The model developed for the purposes of predicting acceleration responses from the first crash test was inadequate when evaluating more severe conditions seen in the second crash test. A newly developed model calibration approach that includes uncertainty estimation, parameter sensitivity, impact shape orthogonality, and numerical optimization was used to calibrate model results for the second full-scale crash test. This combination of heuristic and quantitative methods was used to identify modeling deficiencies, evaluate parameter importance, and propose required model changes. It is shown that the multi-dimensional calibration techniques presented here are particularly effective in identifying model adequacy. Acceleration results for the calibrated model were compared to test results and the original model results. There was a noticeable improvement in the pilot and co-pilot region, a slight improvement in the occupant model response, and an over-stiffening effect in the passenger region. This approach should be adopted early on, in combination with the building-block approaches that are customarily used, for model development and test planning guidance. Complete crash simulations with validated finite element models can be used to satisfy crash certification requirements, thereby reducing overall development costs.

Annett, Martin S.↗

Acquisition of Long-Duration, Low-Gravity Slosh Data Utilizing Existing ISS Equipment (SPHERES) for Calibration of CFD Models of Coupled Fluid-Vehicle Behavior

Accurate prediction of coupled fluid slosh and launch vehicle or spacecraft dynamics (e.g., nutation/precessional movement about various axes, attitude changes, ect.) requires Computational Fluid Dynamics (CFD) models calibrated with low-gravity, long duration slosh data. Recently completed investigations of reduced gravity slosh behavior have demonstrated the limitations of utilizing parabolic flights on specialized aircraft with respect to the specific objectives of the experiments. Although valuable data was collected, the benefits of longer duration low-gravity environments were clearly established. The proposed research provides the first data set from long duration tests in zero gravity that can be directly used to benchmark CFD models, including the interaction between the sloshing fluid and the tank/vehicle dynamics. To explore the coupling of liquid slosh with the motion of an unconstrained tank in microgravity, NASA's Kennedy Space Center, Launch Services Program has teamed up with the Florida Institute of Technology (FIT), Massachusetts Institute of Technology (MIT) and the Office of the Chief Technologist (OCT) to perform a series of slosh dynamics experiments on the International Space Station using the SPHERES platform. The Synchronized Position Hold Engage Reorient Experimental Satellites (SPHERES) testbed provides a unique, free-floating instrumented platform on ISS that can be utilized in a manner that would solve many of the limitations of the current knowledge related to propellant slosh dynamics on launch vehicle and spacecraft fuel tanks. The six degree of freedom (6-DOF) motion of the SPHERES free-flyer is controlled by an array of cold-flow C02 thrusters, supplied from a built-in liquid C02 tank. These SPHERES can independently navigate and re-orient themselves within the ISS. The intent of this project is to design an externally mounted tank to be driven inside the ISS by a set of two SPHERES devices (Figure 1 ). The tank geometry simulates a launch vehicle upper stage propellant tank and the maneuvers replicate those of real vehicles. The design includes inertial sensors, data acquisition, image capture and data storage interfaces to the SPHERES VERTIGO computer system on board the flight article assembly. The design also includes mechanical and electronic interfaces to the existing SPHERES hardware, which include self-contained packages that can operate in conjunction with the existing SPHERES electronics.

Schallhorn, Paul↗

Acquisition of Long-Duration, Low-Gravity Slosh Data Utilizing Existing ISS Equipment (SPHERES) for Calibration of CFD Models of Coupled Fluid-Vehicle Behavior

Accurate prediction of coupled fluid slosh and launch vehicle or spacecraft dynamics (e.g., nutation/precessional movement about various axes, attitude changes, ect.) requires Computational Fluid Dynamics (CFD) models calibrated with low-gravity, long duration slosh data. Recently completed investigations of reduced gravity slosh behavior have demonstrated the limitations of utilizing parabolic flights on specialized aircraft with respect to the specific objectives of the experiments. Although valuable data was collected, the benefits of longer duration low-gravity environments were clearly established. The proposed research provides the first data set from long duration tests in zero gravity that can be directly used to benchmark CFD models, including the interaction between the sloshing fluid and the tank/vehicle dynamics. To explore the coupling of liquid slosh with the motion of an unconstrained tank in microgravity, NASA's Kennedy Space Center, Launch Services Program has teamed up with the Florida Institute of Technology (FIT), Massachusetts Institute of Technology (MIT) and the NASA Game Changing Development Program (GCD) to perform a series of slosh dynamics experiments on the International Space Station using the SPHERES platform. The Synchronized Position Hold Engage Reorient Experimental Satellites (SPHERES) testbed provides a unique, free-floating instrumented platform on ISS that can be utilized in a manner that would solve many of the limitations of the current knowledge related to propellant slosh dynamics on launch vehicle and spacecraft fuel tanks. The six degree of freedom (6-DOF) motion of the SPHERES free-flyer is controlled by an array of cold-flow C02 thrusters, supplied from a built-in liquid C02 tank. These SPHERES can independently navigate and re-orient themselves within the ISS. The intent of this project is to design an externally mounted tank to be driven inside the ISS by a set of two SPHERES devices (Figure 1). The tank geometry simulates a launch vehicle upper stage propellant tank and the maneuvers replicate those of real vehicles. The design includes inertial sensors, data acquisition, image capture and data storage interfaces to the SPHERES VERTIGO computer system on board the flight article assembly. The design also includes mechanical and electronic interfaces to the existing SPHERES hardware, which include self-contained packages that can operate in conjunction with the existing SPHERES electronics

Schallhorn, Paul↗

Bayesian optimization for inverse calibration of expensive computer models: A case study for Johnson-Cook model in machining

Inverse model calibration for identifying the constitutive model parameters can be computationally demanding for expensive-to-evaluate simulation models. Here, this paper presents a modified Bayesian optimization (BO) method, denoted as BO-bound, that incorporates theoretical bounds on the quantity of interest. A case study for the inverse calibration of the Johnson Cook (J-C) flow stress model parameters is presented using machining (cutting) force data. The results show fast calibration of the five J-C parameters within 25 simulations. In general, the BO-bound method is applicable for inverse calibration of any expensive simulation models as well as optimization problems with known bounds.

Bayesian optimization↗

A Framework for Parametric and Predictive Uncertainty Quantification in the E3SM Land Model: Assessing Site and Observable Generalizability

Quantifying parametric uncertainty using observations from individual sites provides a critical foundation for Earth system modeling, serving as a necessary first step before scaling up to regional or global applications. This study introduces a novel computational framework designed to enhance model predictability by reducing parametric uncertainty and assessing site and observable generalizability using various observational constraints. The framework integrates five components: Model Simulation, Statistical Emulation, Global Sensitivity Analysis (GSA), Model Calibration, and Model Prediction. Using the E3SM land model, we simulated site-level land-atmosphere carbon and energy fluxes from 2003 to 2007 across five evergreen needleleaf FLUXNET sites, perturbing 26 vegetation-related model parameters. Gaussian process emulators were employed to expedite GSA and model calibration. Four critical parameters that strongly influence selected land-atmosphere fluxes were identified by GSA. Bayesian approaches were used to infer parameter probability distributions leveraging synthetic data and FLUXNET observations. The results reveal that posterior parameter distributions vary significantly across different sites and observables within the same plant functional type. Probabilistic predictions indicate that parameters calibrated at one site can enhance predictive accuracy at other sites, although site heterogeneity may sometimes outweigh parametric uncertainty. Additionally, the probabilistic predictions demonstrate that calibration for one variable can also improve predictability for other variables, thereby maximizing predictive capabilities with limited observations. This framework provides a powerful approach for reducing parametric uncertainty in Earth system models and deepening our understanding of carbon dynamics and energy cycles. Its adaptability makes it a valuable tool for broader applications in Earth system modeling.

54 ENVIRONMENTAL SCIENCES↗

Development and Calibration of a System-Integrated Rotorcraft Finite Element Model for Impact Scenarios

Two full-scale crash tests of an MD-500 helicopter were conducted in 2009 and 2010 at NASA Langley's Landing and Impact Research Facility in support of NASA s Subsonic Rotary Wing Crashworthiness Project. The first crash test was conducted to evaluate the performance of an externally mounted composite deployable energy absorber (DEA) under combined impact conditions. In the second crash test, the energy absorber was removed to establish baseline loads that are regarded as severe but survivable. The presence of this energy absorbing device reduced the peak impact acceleration levels by a factor of three. Accelerations and kinematic data collected from the crash tests were compared to a system-integrated finite element model of the test article developed in parallel with the test program. In preparation for the full-scale crash test, a series of sub-scale and MD-500 mass simulator tests were conducted to evaluate the impact performances of various components and subsystems, including new crush tubes and the DEA blocks. Parameters defined for the system-integrated finite element model were determined from these tests. Results from 19 accelerometers placed throughout the airframe were compared to finite element model responses. The model developed for the purposes of predicting acceleration responses from the first crash test was inadequate when evaluating more severe conditions seen in the second crash test. A newly developed model calibration approach that includes uncertainty estimation, parameter sensitivity, impact shape orthogonality, and numerical optimization was used to calibrate model results for the full-scale crash test without the DEA. This combination of heuristic and quantitative methods identified modeling deficiencies, evaluated parameter importance, and proposed required model changes. The multidimensional calibration techniques presented here are particularly effective in identifying model adequacy. Acceleration results for the calibrated model were compared to test results and the original model results. There was a noticeable improvement in the pilot and copilot region, a slight improvement in the occupant model response, and an over-stiffening effect in the passenger region. One lesson learned was that this approach should be adopted early on, in combination with the building-block approaches that are customarily used, for model development and pretest predictions. Complete crash simulations with validated finite element models can be used to satisfy crash certification requirements, potentially reducing overall development costs.

Annett, Martin S.↗

Calibration of Two-dimensional Floodplain Modeling in the Atchafalaya River Basin Using SAR Interferometry

Two-dimensional (2D) satellite imagery has been increasingly employed to improve prediction of floodplain inundation models. However, most focus has been on validation of inundation extent, with little attention on the 2D spatial variations of water elevation and slope. The availability of high resolution Interferometric Synthetic Aperture Radar (InSAR) imagery offers unprecedented opportunity for quantitative validation of surface water heights and slopes derived from 2D hydrodynamic models. In this study, the LISFLOOD-ACC hydrodynamic model is applied to the central Atchafalaya River Basin, Louisiana, during high flows typical of spring floods in the Mississippi Delta region, for the purpose of demonstrating the utility of InSAR in coupled 1D/2D model calibration. Two calibration schemes focusing on Manning s roughness are compared. First, the model is calibrated in terms of water elevations at a single in situ gage during a 62 day simulation period from 1 April 2008 to 1 June 2008. Second, the model is calibrated in terms of water elevation changes calculated from ALOS PALSAR interferometry during 46 days of the image acquisition interval from 16 April 2008 to 1 June 2009. The best-fit models show that the mean absolute errors are 3.8 cm for a single in situ gage calibration and 5.7 cm/46 days for InSAR water level calibration. The optimum values of Manning's roughness coefficients are 0.024/0.10 for the channel/floodplain, respectively, using a single in situ gage, and 0.028/0.10 for channel/floodplain the using SAR. Based on the calibrated water elevation changes, daily storage changes within the size of approx 230 sq km of the model area are also calculated to be of the order of 107 cubic m/day during high water of the modeled period. This study demonstrates the feasibility of SAR interferometry to support 2D hydrodynamic model calibration and as a tool for improved understanding of complex floodplain hydrodynamics

Hahn Chul Jung↗

Empirically-calibrated H100 node power models for accurate AI training energy estimation

Accurately quantifying the energy use of artificial intelligence (AI) training is critical for infrastructure planning, carbon accounting, and sustainable data center operation, but few studies have directly measured the power consumption of production workloads on contemporary hardware. By combining empirical measurements from Brookhaven National Laboratory during AI training on 8-graphics-processing-unit H100 systems with open-source benchmarking data, we develop statistical models relating computational intensity to node-level power consumption. We measure the gap between manufacturer-rated thermal design power (TDP) and actual power demand during AI training. Our analysis reveals that even computationally intensive workloads operate at only 76% of the 10.2 kW TDP rating. Our architecture-specific model, calibrated to floating-point operations, predicts energy consumption with 11.4% mean absolute percentage error, significantly outperforming TDP-based approaches (27%–37% error). We identified distinct power signatures between transformer and convolutional neural network architectures, with transformers showing characteristic fluctuations that may impact grid stability. These results provide a measurement-grounded basis for improving AI training energy estimates, enabling more reliable infrastructure sizing, cost projections, and environmental impact assessments.

Newkirk, Alex C↗

Prime VI

SAND2025-03757O Prime VI is a distribution-of-disease outbreak model calibration code based on variational inference. It accompanies a publication for submission to Statistics in Medicine journal, and the code will be maintained for open-source use on Sandia's GitLab. The software provides methods for calibrating an epidemiological model to measured case-count data for a multitude of correlated spatial regions. The code solves a Bayesian inverse problem for model calibration where the posterior over-model parameters are approximated through a custom implementation of variational inference. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Safta, Cosmin↗