Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model validation and calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

When physics-informed data analytics outperforms black-box machine learning: A case study in thickness control for additive manufacturing

Aerosol jet printing (AJP) has emerged as a promising noncontact additive manufacturing method for high-resolution printing for a wide range of material systems. A key challenge limiting the broader adoption of AJP in the material science community is the lack of methods to precisely control thickness. Herein, we develop a model-based design of experiment (MBDoE) framework that integrates physics-informed models, nonlinear regression, and information criteria to postulate, select and calibrate the best model to describe and optimize the AJP manufacturing process. Starting with already available data from system commissioning (e.g., prior single variable sensitivity analysis), four candidate physics-informed models are postulated and trained. MBDoE identifies a single additional optimal experiment to validate these predictive models with quantified uncertainties, which are then used to determine the best experimental conditions to control printed film thickness. As a comparative benchmark, the analysis is repeated using the same dataset with nonparametric Gaussian process regression (GPR) model that does not incorporate physical information. Using MBDoE principles, we find that only five experiments are necessary to calibrate the nonlinear physics-informed parametric model, and with said limited data, this model outperforms the black-box machine learning GPR model. This key result underscores an emerging trend in the data science community: incorporating physical information into predictive models often drastically reduces the data requirements. Leveraging MBDoE further increased the data efficiency. By design, the proposed data science framework is general in nature and can be easily extended to other experimental and additive manufacturing systems beyond AJP.

Aerosol jet printing↗
DOE OSTI2023

Development of a Metocean Reference Site near the Massachusetts and Rhode Island Wind Energy Areas

This project developed the first long-term U.S.-based offshore MetOcean Reference Site (MORS-1) by capitalizing on a unique combination of one of the few existing publicly available offshore wind energy metocean observational campaigns in the United States and the only existing research-grade offshore fixed tower. Data collected at MORS-1 has facilitated improved wind resource assessments, improved short-term power production estimates, and reduced costs for sensor validation and calibration efforts, which translate into reduced overall wind energy project risk and cost for developers. Now operational, MORS-1 serves the needs of both industry and researchers using a nonprofit, joint industry-academic partnership model. Led by the Woods Hole Oceanographic Institution, the MORS-1 development effort focused on creating both a recognized organizational structure that will ensure support of the MORS-1 by the wider wind energy industry and research community, and a highly validated data collection and sensor validation facility that will serve as the premier location for cost- and uncertainty-reducing resource characterization and research efforts.

17 WIND ENERGY↗
DOE OSTI2025

Predicting the evolution of biomass bulk density through feedstock preprocessing: Discrete element modeling, regression analysis, and pilot-scale validation

Bulk density is an important material property of biomass feedstocks, influencing handling, storage, transport costs, and conversion efficiency. In this study, predictive regression models for loose and tapped bulk densities of Alamo and Cave-in-Rock switchgrass are developed using a comprehensive dataset generated via calibrated bonded-sphere discrete element method (DEM) simulations. Here, a key contribution of this study is the use of a DEM-based approach, which correlates density with moisture content and particle size distribution parameters and enables analysis across a continuous particle size range, overcoming limitations of purely experimental data. For comparison, regression models are also developed using only experimental data from pilot-scale runs at the Biomass Feedstock National User Facility at Idaho National Laboratory. Validation against pilot-scale data showed reasonable prediction accuracy for both model types, particularly for smaller particle sizes (post-secondary grinding). While the experimental model showed slightly better performance matching the validation data in some cases, the DEM-based model benefits from a much larger dataset, reduced predictor multicollinearity, and continuous parameter coverage, highlighting the utility of validated simulation models for developing robust predictive tools for biomass preprocessing applications.

09 - BIOMASS FUELS↗
DOE OSTI2023

Discrete element model for powder grain interactions under high compressive stress

A reduced order, nonlocal model is proposed for the contact force between initially spherical particles under compression. The model in effect provides the normal component of the interaction force between elements in the discrete element method (DEM). It is applicable to high relative density and large stress in powder compaction. It takes into account the mutual interaction between multiple points of contact, in contrast to the usual assumption in DEM of pair interactions. The mathematical form of the model is derived from a variational formulation that leads to the momentum balance for the forces on each grain. The model is calibrated mainly using detailed three dimensional peridynamic simulations of single grains under compressive loading by rigid plates that move radially with prescribed velocity. This calibration takes into account the large deformation and fracture of the grains. The interaction model also includes terms for the unloading behavior and adhesion. Finally, as validation, the model is applied to test data on the compaction of microcrystalline cellulose bulk powder.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Beyond Point Estimates: Benchmarking Uncertainty Quantification Methods on the AION-1 Astronomical Foundation Model

Foundation models for astronomical surveys offer powerful learned representations that can be transferred to downstream regression tasks such as galaxy property estimation. However, point predictions alone are insufficient for scientific inference; reliable uncertainty quantification (UQ) is essential. We compare seven UQ methods on galaxy property regression using frozen AION-1 foundation-model embeddings, predicting redshift, stellar mass, stellar-population age, gas-phase metallicity, and specific star-formation rate, from Legacy Survey photometry/imaging and DESI spectra, with PROVABGS-derived labels. Distribution-free conformal methods achieve marginal coverage within $\sim$1 pp of the nominal 90% across all properties, while non-conformal baselines (Deep Ensembles, MC~Dropout) fail to calibrate reliably. Among conformal approaches, Conformalized Quantile Regression (CQR) delivers the best coverage in the bin with the poorest model predictions. More importantly, only the Locally Valid and Discriminative (LVD) framework -- particularly when operating on AION-1 embeddings -- also provides finite-sample \emph{local validity}, producing intervals that adapt to each galaxy's local prediction difficulty rather than relying on marginal guarantees alone. These results establish conformal prediction, and LVD in particular, as the preferred UQ framework for uncertainty-aware inference on foundation-model embeddings in astrophysics.

Tame-Narvaez, Karla [Fermilab] (ORCID:000000022249↗
DOE OSTI2026

Probing the matter-dominated expansion with multi-redshift Lyman-$α$ BAO from DESI DR2

We present a multi-redshift Baryon Acoustic Oscillations (BAO) analysis of the DESI Data Release 2 (DR2) Lyman-$α$ (Ly$α$) forest, splitting the forest auto-correlation and its cross-correlation with quasars into three redshift bins. We obtain BAO measurements at effective redshifts $z_{\rm eff} = 2.13$, $2.40$, and $2.81$ with $\sim2.0$--$2.5\%$ precision per bin in the radial and transverse directions, corresponding to $\sim1.1$--$1.2\%$ precision for the isotropic BAO measurement. Using the same data products and modeling framework as the DESI DR2 Ly$α$ BAO analysis, we validate the pipeline on $400$ synthetic datasets and find unbiased BAO recovery with well-calibrated uncertainties. The measurements show an increase in the isotropic dilation parameter $D_V/r_d$ from $30.26\pm0.39$ to $32.22\pm0.47$ and in the Alcock-Paczyński parameter $D_M/D_H$ from $3.96\pm0.15$ to $5.63^{+0.22}_{-0.24}$. The Hubble distance $D_H/r_d$ decreases from $9.40\pm0.20$ to $7.22\pm0.17$, providing a direct measurement of the expansion history consistent with $Λ$CDM and the expected matter-dominated scaling, with $H(z)\propto(1+z)^n$ giving $n=1.34\pm0.16$. The redshift split also provides a self-consistent measurement of clustering evolution: the Ly$α$ forest bias evolves as $(1+z)^γ$ with $γ_α=3.05\pm0.16$, the RSD parameter has a redshift evolution described by $γ_β=-0.97\pm0.26$, and the quasar bias evolves with $γ_Q=1.56\pm0.23$, consistent with independent quasar clustering measurements. Combining these three-bin BAO measurements with DESI DR2 galaxy and quasar BAO measurements yields cosmological constraints consistent with the single-bin Ly$α$ BAO analysis in flat $Λ$CDM and $w_0w_a$CDM and improves curvature constraints by $\sim12\%$ in $Λ$CDM$+Ω_\mathrm{K}$.

Herrera-Alcantar, Hiram K. [Paris, Inst. Astrophys↗
DOE OSTI2023

On the flow-stress model of Preston, Tonks, and Wallace - Observations, parameter constraints, and implementations (Rev. 1)

A detailed discussion about the PTW flow-stress model has been presented, including theoretical considerations, model calibrations to experimental data, and model implementations in LANL ASC hydro-codes. The main findings are: In order to reproduce the intended behavior of the PTW model at high strain rates, the following conditions on the model parameters need to be valid: y 1 ≥ s 0 and y 2 ≥ β ; When the conditions above are not satisfied, PTW and PTW_Mod1 have slightly different behavior in the phonon-drag regime, and should be treated as different models. PTW exhibits a discontinuity above the critical strain rate. PTW_Mod1 does not show such a discontinuity but implies a different strain-rate dependence at high strain rates. Examples of this behavior include older calibrations for stainless steel and depleted uranium; In the thermal-activation regime, some flexibility was introduced in the original PTW model to allow for different rate-dependent behaviors at intermediate strain rates. Example: copper. However, many material calibrations do not require this extra flexibility, and the complexity and ambiguity of the intended behavior can be partially blamed for the inconsistent model implementations across ASC codes; The limit for the material constant p going to zero is well defined and leads to a simplified flow-stress equation, discontinuity free; Modern calibrations of the PTW parameters are done using Impala. Constraints on the PTW parameters are enforced; Implementation of the PTW model in LANL ASC hydro-codes suffered of several shortcom ings. At the time of writing, FLAG and xRAGE contain consistent and correct implemen tations of the PTW and PTW_Mod1 models. Corresponding changes to Pagosa have been suggested.

36 MATERIALS SCIENCE↗
DOE OSTI2021

ACCELERATED CREEP TEST (ACT) QUALIFICATION OF CREEP RESISTANCE USING THE WCS CONSTITUTIVE MODEL AND STEPPED ISOSTRESS METHOD (SSM)

In this study, a qualification of accelerated creep-resistance of Inconel 718 is assessed using the novel Wilshire-Cano-Stewart (WCS) model and the stepped isostress method (SSM) and predictions are made to conventional creep data. Conventional creep testing (CCT) is a long-term continuous process, in fact, the ASME B&PV III requires that 10,000+ hours of experiments must be conducted to each heat for materials employed in boilers and/or pressure vessel components. This process is costly and not feasible for rapid development of new materials. As an alternative, accelerated creep testing techniques have been developed to reduce the time needed to characterize the creep resistance of materials. Most techniques are based upon the time-temperature-stress superposition principle (TTSSP) that predicts minimum-creep-strain-rate (MCSR) and stress-rupture behaviors but lack the ability to predict creep deformation and consider deformation mechanisms that occur for experiments of longer duration. The stepped isostress method (SSM) has been developed which enables the prediction of creep deformation response as well as reduce the time needed for qualification of materials. The SSM approach has been successful for polymer, polymeric composites, and recently has been introduced for metals. In this study, the WCS constitutive model, calibrated to SSM test data, qualifies the creep resistance of Inconel 718 at 750°C and predictions are compared to CCT data. The WCS model has proven to make long-term predictions for stress-rupture, minimum-creep-strain-rate (MCSR), creep deformation, and damage in metallic materials. The SSM varies stress levels after time interval adding damage to the material, which can be tracked by the WCS model. The SSM data is calibrated into the model and the WCS model generates realistic predictions of stress-rupture, MSCR, damage, and creep deformation. The calibrated material constants are used to generate predictions of stress-rupture and are post-audit validated using the National Institute of Material Science (NIMS) database. Similarly, the MCSR predictions are compared from previous studies. Finally the creep deformation predictions are compared with real data and is determined that the results are well in between the expected boundaries. Material characterization and mechanical properties can be determined at a faster rate and with a more cost-effective method. This is beneficial for multiple applications such as in additive manufacturing, composites, spacecraft, and Industrial Gas Turbines (IGT).

36 MATERIALS SCIENCE↗
DOE OSTI2023

Uncertain of uncertainties? A comparison of uncertainty quantification metrics for chemical data sets

Abstract With the increasingly more important role of machine learning (ML) models in chemical research, the need for putting a level of confidence to the model predictions naturally arises. Several methods for obtaining uncertainty estimates have been proposed in recent years but consensus on the evaluation of these have yet to be established and different studies on uncertainties generally uses different metrics to evaluate them. We compare three of the most popular validation metrics (Spearman’s rank correlation coefficient, the negative log likelihood (NLL) and the miscalibration area) to the error-based calibration introduced by Levi et al. ( Sensors 2022 , 22 , 5540). Importantly, metrics such as the negative log likelihood (NLL) and Spearman’s rank correlation coefficient bear little information in themselves. We therefore introduce reference values obtained through errors simulated directly from the uncertainty distribution. The different metrics target different properties and we show how to interpret them, but we generally find the best overall validation to be done based on the error-based calibration plot introduced by Levi et al. Finally, we illustrate the sensitivity of ranking-based methods (e.g. Spearman’s rank correlation coefficient) towards test set design by using the same toy model ferent test sets and obtaining vastly different metrics (0.05 vs. 0.65).

Rasmussen, Maria H.↗
DOE OSTI2022

Medium-Scale Methanol Pool Fire Model Validation

In this work, medium scale (30 cm diameter) methanol pool fires were simulated using the latest fire modeling suite implemented in Sierra/Fuego, a low Mach number multiphysics reacting flow code. The sensitivity of model outputs to various model parameters was studied with the objective of providing model validation. This work also assesses model performance relative to other recently published large eddy simulations (LES) of the same validation case. Two pool surface boundary conditions were simulated. The first was a prescribed fuel mass flux and the second used an algorithm to predict mass flux based on a mass and energy balance at the fuel surface. Gray gas radiation model parameters (absorption coefficients and gas radiation sources) were varied to assess radiant heat losses to the surroundings and pool surface. The radiation model was calibrated by comparing the simulated radiant fraction of the plume to experimental data. The effects of mesh resolution were also quantified starting with a grid resolution representative of engineering type fire calculations and then uniformly refining that mesh in the plume region. Simulation data were compared to experimental data collected at the University of Waterloo and the National Institute of Standards and Technology (NIST). Validation data included plume temperature, radial and axial velocities, velocity temperature turbulent correlations, velocity velocity turbulent correlations, radiant and convective heat fluxes to the pool surface, and plume radiant fraction. Additional analyses were performed in the pool boundary layer to assess simulated flame anchoring and the effect on convective heat fluxes. This work assesses the capability of the latest Fuego physics and chemistry model suite and provides additional insight into pool fire modeling for nonluminous, non-sooting flames.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Warming of the Willamette River, 1850–present: the effects of climate change and river system alterations

Abstract. Using archival research methods, we recovered and combined data from multiple sources to produce a unique, 140-year record of daily water temperature (Tw) in the lower Willamette River, Oregon (1881–1890, 1941–present). Additional daily weather and river flow records from the 1850s onwards are used to develop and validate a statistical regression model of Tw for 1850–2020. The model simulates the time-lagged response of Tw to air temperature and river flow and is calibrated for three distinct time periods: the late 19th, mid-20th, and early 21st centuries. Results show that Tw has trended upwards at 1.1 ∘C per century since the mid-19th century, with the largest shift in January and February (1.3 ∘C per century) and the smallest in May and June (∼ 0.8 ∘C per century). The duration that the river exceeds the ecologically important threshold of 20 ∘C has increased by about 20 d since the 1800s, to about 60 d yr−1. Moreover, cold-water days below 2 ∘C have virtually disappeared, and the river no longer freezes. Since 1900, changes are primarily correlated with increases in air temperature (Tw increase of 0.81 ± 0.25 ∘C) but also occur due to alterations in the river system such as depth increases from reservoirs (0.34 ± 0.12 ∘C). Managed release of water affects Tw seasonally, with an average reduction of up to 0.56 ∘C estimated for September. River system changes have decreased variability (σ) in daily minimum Tw by 0.44 ∘C, increased thermal memory, reduced interannual variability, and reduced the response to short-term meteorological forcing (e.g., heat waves). These changes fundamentally alter the response of Tw to climate change, posing additional stressors on fauna.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Detection of supernova magnitude fluctuations induced by large-scale structure

The peculiar velocities of supernovae and their host galaxies are correlated with the large-scale structure of the Universe, and can be used to constrain the growth rate of structure and test the cosmological model. In this work, we measure the correlation statistics of the large-scale structure traced by the Dark Energy Spectroscopic Instrument Bright Galaxy Survey Data Release 1 sample, and magnitude fluctuations of type Ia supernova from the Pantheon+ compilation across redshifts z < 0.1. We find a detection of the cross-correlation signal between galaxies and type Ia supernova magnitudes. Fitting the normalised growth rate of structure f sigma_8 to the auto- and cross-correlation function measurements we find f sigma_8 = 0.384 +0.094 -0.157, which is consistent with the Planck LambdaCDM model prediction, and indicates that the supernova magnitude fluctuations are induced by peculiar velocities. Using a large ensemble of N-body simulations, we validate our methodology, calibrate the covariance of the measurements, and demonstrate that our results are insensitive to supernova selection effects. We highlight the potential of this methodology for measuring the growth rate of structure, and forecast that the next generation of type Ia supernova surveys will improve f sigma_8 constraints by a further order of magnitude.

Nguyen, A. [Swinburne U., Ctr. Astrophys. Supercom↗
DOE OSTI2021

A machine learning degradation model for electrochemical capacitors operated at high temperature

Electrochemical capacitors (ECs) have only recently been considered as an alternative power source for telemetry sensors of drilling equipment for geothermal or oil and gas exploration. The lifecycle analysis and modelling of ECs is underrepresented in literature in comparison to other storage devices e.g. Li-ion batteries. This paper investigates the degradation of ECs when cycled outside the manufacturer-specified operating temperature envelope and proposes a machine learning-based approach for modelling the degradation. Experimental results show that end of life, defined as a 30% decrease in capacitance, occurs at 1,000 cycles when the environmental temperature exceeds the maximum operating temperature by 30%. The life-cycle test data is then used as an input to a Gaussian process regression (GPR) algorithm to predict the capacitance fade trend. The GPR is validated on a total of nine commercial cells from two different manufacturers, achieving an average root mean squared percent error of less than 2% and a mean calibration score of 93% when referenced to a 95% confidence interval. The model can be utilized to determine the EC degradation rate at a range of operating temperature values.

42 ENGINEERING↗
DOE OSTI2026

Kinematic and dynamical origins of mean-p T fluctuations in heavy-ion collisions

Event-by-event fluctuations of the mean transverse momentum (mean-p T ) provide a sensitive probe of collective dynamics beyond single-particle spectra and anisotropic flow. We present a systematic study of mean-p T fluctuation observables using a Bayesian-calibrated multistage hydrodynamic framework, including quantitative comparisons to RHIC measurements and model-based investigations of beam-energy and kinematic-acceptance effects. The experimental definitions employed by the STAR and ALICE Collaborations are implemented explicitly and found to yield consistent results within controlled limits. We study the centrality and beam-energy dependence of the observable, its sensitivity to key soft-sector ingredients, and the impact of the kinematic p T acceptance. By introducing scaled-p T cuts, we demonstrate that a part of the apparent energy dependence arises from kinematic projection effects, while the remaining trends reflect genuine collective dynamics. Our results establish mean-p T fluctuations as a nontrivial and independent validation of calibrated hydrodynamic descriptions of the quark–gluon plasma.

Event-by-event correlations↗
DOE OSTI2026

Results from the DUNE ND-LAr 2x2 Demonstrator Run 2

The Deep Underground Neutrino Experiment (DUNE) is a cutting-edge, long-baseline experiment under construction in the United States, based on large liquid-argon time projection chambers (LArTPCs). The DUNE Near Detector LArTPC (ND-LAr) will employ a novel modular architecture using a pixelated LArPix charge readout. To validate this design and characterize detector response, the 2×2 demonstrator—an array of eight optically isolated LArTPC modules—was deployed at Fermilab in 2024. During winter 2025, the 2x2 demonstrator was operated for a second data-taking campaign (Run 2) with the aim of studying the low-energy response of the detector. Run 2 focused on calibration and response studies using a suite of deployed radioactive sources. Gamma sources (²²Na, ⁶⁰Co, and ⁸⁸Y) were used to probe module-to-module performance variations, energy resolution, and calibrations. Neutron sources (AmBe and a pulsed neutron generator) enabled studies of neutron interactions in liquid argon, including inelastic scatters and neutron capture signals, relevant for low-energy backgrounds and detector modeling. In addition, the detector was doped with ²²⁰Rn, providing Bi–Po coincidence signals that allow precise calibration of the charge and scintillation response. This poster will present results from these calibration campaigns. These studies provide critical validation of the ND-LAr modular LArTPC concept and inform calibration and reconstruction strategies for the full DUNE near detector.

Mora-Lepin, Luis [Florida State U.] (ORCID:0000000↗
DOE OSTI2024

Modeling delayed thermal runaway in nitric acid-soaked cat litter mixed with radioactive waste

Thermal ignition of radioactive waste within a 55-gallon drum was simulated by using a pressure-dependent waste decomposition model (Hobbs et al. in Process Saf Environ Prot https://doi.org/10.1016/j.psep.2022.09.047, 2022) calibrated with data from full-scale drum experiments (Parker et al. in The thermolytic response of a surrogate RNS waste mixture at the drum scale. Los Alamos National Laboratory Report LA-UR-16-21760, 2016) and validated with experiments from multiple laboratories (Hobbs et al. in Thermal analysis of aged nitric acid-soaked kitty litter in TRU waste drums-23370.WM2023 Conference, Phoenix, AZ, 2023). The acceleration of nitric acid chemistry reacting with an organic cat litter leading to thermal ignition was likely triggered by a restricted vent in the drum. Here, we address whether the form of the rate equation in (Hobbs et al. in Process Saf Environ Prot https://doi.org/10.1016/j.psep.2022.09.047, 2022) is sufficient to extrapolate thermal ignition within aged drums of similar content that have been stored in Texas for over nine years by investigating four different reaction rate forms for waste decomposition. A critical reaction rate reduction analysis is performed on each of these models to determine if delayed thermal runaway within vented aged waste is possible after nine years. We found that a pressure-dependent first-order rate expression not only predicted the accidental ignition of the waste drum, but the form also matches multiple experiments from different laboratories. Even though the waste composition decreases over time, the model predicts that acceleration leading to thermal runaway is possible if the waste is confined, even after 9 years. In conclusion, waste containing oxidizers such as nitric acid should not be mixed with organic adsorbents, especially if the waste is confined.

cookoff↗
DOE OSTI2020

Dealing with Measurement Uncertainties as Nuisance Parameters in Bayesian Model Calibration

In the presence of model discrepancy, the calibration of physics-based models for physical parameter inference is a challenging problem. Lack of identifiability between calibration parameters and model discrepancy requires additional identifiability constraints to be placed on the model discrepancy to obtain unique physical parameter estimates. If these assumptions are violated, the inference for the calibration parameters can be systematically biased. In many applications, such as in dynamic material property experiments, many of the calibration inputs refer to measurement uncertainties. Here, we develop a metric for identifying overfitting of these measurement uncertainties, propose a prior capable of reducing this overfitting, and show how this leads to a diagnostic tool for validation of physical parameter inference. The approach is demonstrated for a benchmark example and applied for a material property application to perform inference on the equation of state parameters of tantalum.

97 MATHEMATICS AND COMPUTING↗