Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Neural Network Prediction of Strong Lensing Systems with Domain Adaptation and Uncertainty Quantification

Modeling strong gravitational lenses is computationally expensive for the complex data from modern and next-generation cosmic surveys. Deep learning has emerged as a promising approach for finding lenses and predicting lensing parameters, such as the Einstein radius. Mean-variance Estimators (MVEs) are a common approach for obtaining aleatoric (data) uncertainties from a neural network prediction. However, neural networks have not been demonstrated to perform well on out-of-domain target data successfully - e.g., when trained on simulated data and applied to real, observational data. In this work, we perform the first study of the efficacy of MVEs in combination with unsupervised domain adaptation (UDA) on strong lensing data. The source domain data is noiseless, and the target domain data has noise mimicking modern cosmology surveys. We find that adding UDA to MVE increases the accuracy on the target data by a factor of about two over an MVE model without UDA. Including UDA also permits much more well-calibrated aleatoric uncertainty predictions. Advancements in this approach may enable future applications of MVE models to real observational data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Finding Real Uncertainties From Physical Simulations

Modeling strong gravitational lenses is computationally expensive for the complex data from modern and next-generation cosmic surveys. Deep learning has emerged as a promising approach for finding lenses and predicting lensing parameters, such as the Einstein radius. Mean-variance Estimators (MVEs) are a common approach for obtaining aleatoric (data) uncertainties from a neural network prediction. However, neural networks have not been demonstrated to perform well on out-of-domain target data successfully - e.g., when trained on simulated data and applied to real, observational data. In this work, we perform the first study of the efficacy of MVEs in combination with unsupervised domain adaptation (UDA) on strong lensing data. The source domain data is noiseless, and the target domain data has noise mimicking modern cosmology surveys. We find that adding UDA to MVE increases the accuracy on the target data by a factor of about two over an MVE model without UDA. Including UDA also permits much more well-calibrated aleatoric uncertainty predictions. Advancements in this approach may enable future applications of MVE models to real observational data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2007

Predicting the Earth encounters of (99942) Apophis

Arecibo delay-Doppler measurements of (99942) Apophis in 2005 and 2006 resulted in a five standard-deviation trajectory correction to the optically predicted close approach distance to Earth in 2029. The radar measurements reduced the volume of the statistical uncertainty region entering the encounter to 7.3% of the pre-radar solution, but increased the trajectory uncertainty growth rate across the encounter by 800% due to the closer predicted approach to the Earth. A small estimated Earth impact probability remained for 2036. With standard-deviation plane-of-sky position uncertainties for 2007-2010 already less than 0.2 arcsec, the best near-term ground-based optical astrometry can only weakly affect the trajectory estimate. While the potential for impact in 2036 will likely be excluded in 2013 (if not 2011) using ground-based optical measurements, approximations within the Standard Dynamical Model (SDM) used to estimate and predict the trajectory from the current era are sufficient to obscure the difference between a predicted impact and a miss in 2036 by altering the dynamics leading into the 2029 encounter. Normal impact probability assessments based on the SDM become problematic without knowledge of the object's physical properties; impact could be excluded while the actual dynamics still permit it. Calibrated position uncertainty intervals are developed to compensate for this by characterizing the minimum and maximum effect of physical parameters on the trajectory. Uncertainty in accelerations related to solar radiation can cause between 82 and 4720 Earth-radii of trajectory change relative to the SDM by 2036. If an actionable hazard exists, alteration by 2-10% of Apophis' total absorption of solar radiation in 2018 could be sufficient to produce a six standard-deviation trajectory change by 2036 given physical characterization; even a 0.5% change could produce a trajectory shift of one Earth-radius by 2036 for all possible spin-poles and likely masses. Planetary ephemeris uncertainties are the next greatest source of systematic error, causing up to 23 Earth-radii of uncertainty. The SDM Earth point-mass assumption introduces an additional 2.9 Earth-radii of prediction error by 2036. Unmodeled asteroid perturbations produce as much as 2.3 Earth-radii of error. We find no future small-body encounters likely to yield an Apophis mass determination prior to 2029. However, asteroid (144898) 2004 VD17, itself having a statistical Earth impact in 2102, will probably encounter Apophis at 6.7 lunar distances in 2034, their uncertainty regions coming as close as 1.6 lunar distances near the center of both SDM probability distributions.

Orbit determination↗
DOE OSTI2025

Surrogate models for linear response

Linear response theory is a well-established method in physics and chemistry for exploring excitations of many-body systems. In particular, the quasiparticle random-phase approximation (QRPA) provides a powerful microscopic framework by building excitations on top of the mean-field vacuum; however, its high computational cost limits model calibration and uncertainty quantification studies. Here, we present two complementary QRPA surrogate models and apply them to study response functions of finite nuclei. One is a reduced-order model that exploits the underlying QRPA structure, while the other utilizes the recently developed parametric matrix model algorithm to construct a map between the system’s Hamiltonian and observables. Our benchmark applications, the calculation of the electric dipole polarizability of 180 Yb and the 𝛽-decay half-life of 80 Ni, show that both emulators can achieve 0.1%–1% accuracy while offering a 6–7 orders of magnitude speedup compared to state-of-the-art QRPA solvers. These results demonstrate that the developed QRPA emulators are well positioned to enable Bayesian calibration and large-scale studies of computationally expensive physics models describing the properties of many-body systems.

Beta decay↗
NASA NTRS2011

A Long-Term Merged Global Ozone Data Set

Using data from a series of space-based ozone measurement systems we are producing a consistent, calibrated ozone time series that can be used for trend analyses and other studies. To produce the total column ozone time series we use data from Total Ozone Mapping Spectrometer (TOMS) instruments on Nimbus 7 and Earth Probe, and data from the Ozone Monitoring Instrument (OMI) flying on the Aura spacecraft. Both total column ozone and the ozone vertical profile data are produced from the Solar Backscatter Ultraviolet (SBUV) instruments on Nimbus 7 and SBUV/2 instruments on a series of NOAA spacecraft. A global zonal mean merged ozone data time series covering the period from 1970-1972 and 1978-2010 has been produced for total column ozone. A similar profile data set has been constructed, but is still in preliminary form due to uncertainty in calibration adjustments as a function of latitude and altitude.

McPeters, Richard D.↗
NASA NTRS2013

Trajectory Reconstruction and Uncertainty Analysis Using Mars Science Laboratory Pre-Flight Scale Model Aeroballistic Testing

As part of the Mars Science Laboratory (MSL) trajectory reconstruction effort at NASA Langley Research Center, free-flight aeroballistic experiments of instrumented MSL scale models was conducted at Aberdeen Proving Ground in Maryland. The models carried an inertial measurement unit (IMU) and a flush air data system (FADS) similar to the MSL Entry Atmospheric Data System (MEADS) that provided data types similar to those from the MSL entry. Multiple sources of redundant data were available, including tracking radar and on-board magnetometers. These experimental data enabled the testing and validation of the various tools and methodologies that will be used for MSL trajectory reconstruction. The aerodynamic parameters Mach number, angle of attack, and sideslip angle were estimated using minimum variance with a priori to combine the pressure data and pre-flight computational fluid dynamics (CFD) data. Both linear and non-linear pressure model terms were also estimated for each pressure transducer as a measure of the errors introduced by CFD and transducer calibration. Parameter uncertainties were estimated using a "consider parameters" approach.

Lugo, Rafael A.↗
DOE OSTI2025

Characterization of uncertainties in electron-argon collision cross sections

Abstract The predictive capability of a plasma discharge model depends on accurate representations of electron-impact collision cross sections, which determine the corresponding reaction rates and electron transport properties. The values of cross sections can be known only approximately either through experiments or simulations and are thus subject to uncertainties. Quantifying the uncertainties in plasma simulations allows us to assess the reliability of simulations and to provide a basis for interpreting discrepancies between simulations and experiments. For such uncertainty quantification of plasma simulations, it is essential to quantify the uncertainties of the underlying cross sections. Although much effort has been committed to calibrate the cross section values, their uncertainties are not well investigated. We characterize uncertainties in electron-argon atom collision cross sections using a Bayesian framework. Six collision processes—elastic momentum transfer, ionization, and four excitations—are characterized with semi-empirical models, which effectively capture the features important to the macroscopic properties of the plasma. A probability model for the uncertain parameters of these semi-empirical models is developed. Specifically, a Gaussian-process likelihood model is proposed to capture discrepancies among data sets, as well as the model-form inadequacies of the semi-empirical models. Two other likelihood models are compared with the proposed Gaussian-process model, to illustrate the importance of the choice of the likelihood model. The cross section models are calibrated using the electron-beam experiments and ab-inito quantum simulations. The resulting calibrated uncertainties capture well the scattering among the data sets. The calibrated cross section models are further validated against swarm-parameter experiments and zero-dimensional Boltzmann equation simulations of widely used cross section datasets.

Chung, Seung Whan (ORCID:0000000302501549)↗
DOE OSTI2024

Computationally efficient and error aware surrogate construction for numerical solutions of subsurface flow through porous media

Limiting the injection rate to restrict the pressure below a threshold at a critical location can be an important goal of simulations that model the subsurface pressure between injection and extraction wells. The pressure is approximated by the solution of Darcy’s partial differential equation for a given permeability field. The subsurface permeability is modeled as a random field since it is known only up to statistical properties. This induces uncertainty in the computed pressure. Solving the partial differential equation for an ensemble of random permeability simulations enables estimating a probability distribution for the pressure at the critical location. These simulations are computationally expensive, and practitioners often need rapid online guidance for real-time pressure management. An ensemble of numerical partial differential equation solutions is used to construct a Gaussian process regression model that can quickly predict the pressure at the critical location as a function of the extraction rate and permeability realization. The Gaussian process surrogate analyzes the ensemble of numerical pressure solutions at the critical location as noisy observations of the true pressure solution, enabling robust inference using the conditional Gaussian process distribution. Our first novel contribution is to identify a sampling methodology for the random environment and matching kernel technology for which fitting the Gaussian process regression model scales as O ( n log n ) instead of the typical O ( n 3 ) rate in the number of samples n used to fit the surrogate. The surrogate model allows almost instantaneous predictions for the pressure at the critical location as a function of the extraction rate and permeability realization. Our second contribution is a novel algorithm to calibrate the uncertainty in the surrogate model to the discrepancy between the true pressure solution of Darcy’s equation and the numerical solution. Finally, although our method is derived for building a surrogate for the solution of Darcy’s equation with a random permeability field, the framework broadly applies to solutions of other partial differential equations with random coefficients.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2018

Terra and Aqua MODIS Intercomparison Using LEO-GEO Double Difference Method

The Moderate Resolution Imaging Spectroradiometer (MODIS) onboard the Terra and Aqua satellites havesuccessfully operated since their launch in 1999 and in 2002, providing more than 18 and 16 years ofcontinuous global observations, respectively. The inter-comparison between the two MODIS instruments can bevery supportive for the instrument calibration and uncertainty assessment. Aqua and Terra MODIS have almostidentical relative spectral response, spatial resolution, and dynamic range for each band. Therefore, a sitedependent correction for a sensor spectral band pair is not necessary for their comparison. However, Terra is inthe morning orbit with an equator crossing time of 10:30 am, and Aqua is in the afternoon orbit with equatorcrossing time of 1:30 pm. Consequently, there is a dearth of simultaneous nadir overpasses (SNOs)between the two satellites. Major challenges in cross-sensor comparison of instruments on different satellitesinclude differences in observation time, solar angle, and view angle over selected pseudo-invariant sites.In this work, the inter-comparisons of thermal emissive bands are performed over a pseudo-invariant target,using the observations from a sensor onboard a geostationary satellite as a bridge. Himawari8 was launched onOctober 7, 2014. The Advanced Himawari Imager (AHI) onboard Himawari8 can be used as a reference tobridge the comparison between Terra and Aqua MODIS. AHI has 16 channels; with spatial resolutions from 0.5km to 2 km at nadir and produces a full disk observations every 10 minutes. The band spectral coveragematchup, comparable spatial resolution and near-simultaneous observation between MODIS and AHI providefeasibility to implement a double difference method. This comparison method minimizes the impact of thedifference in observation time and solar angle. The comparison results will be used as an assessment for MODISinstrument calibration and will be helpful for future enhancement of the L1B product.

Himawari8↗
DOE OSTI2025

Comparison of atomized mass and crater volume in laser ablation

The extent and dynamics of laser ablation are typically studied using crater imaging or by invoking the relationship between atomic emission and the mass removed. The former is a static view of a dynamic process and requires the accumulation of multiple shots in one location. The latter is complex and not absolute without calibration of the optical system with a standard of spectral radiance. We measure the mass of the atomized plume by laser atomic-absorption spectroscopy at 2 µs without external mass calibration; mass uncertainty in laser-ablation atomic absorption spectroscopy (LA-AAS) results from uncertainties in line area fitting, tabulated oscillator strengths, and partition functions as well as a <10% underrepresentation of the mass due to treating the plasma as a single thermodynamic equilibrium. The LA-AAS-measured mass pertains to the atoms in the probed charge states and does not include condensed or molecular species. The ablation efficiency at 300 mbar of helium varies significantly between the two focusing conditions used. A comparison of crater-derived masses and LA-AAS masses suggests that more defocused ablation may result in significant redeposition of material in the crater, distorting the conclusions from drilling studies and crater imaging. More focused ablation conditions result in crater-derived masses that exceed those measured with LA-AAS and suggest melt expulsion or phase explosion.

Merten, Jonathan [Arkansas State University, Jones↗
DOE OSTI2021

A Bayesian Calibration Framework with Embedded Model Error for Model Diagnostics

We study the utility and performance of a Bayesian model error embedding construction in the context of molecular dynamics modeling of metallic alloys, where we embed model error terms in existing interatomic potential model parameters. To alleviate the computational burden of this approach, we propose a framework combining likelihood approximation and Gaussian process surrogates. Here we leverage sparse Gaussian process techniques to construct a hierarchy of increasingly accurate but more expensive surrogate models. This hierarchy is then exploited by multilevel Markov chain Monte Carlo methods to efficiently sample from the target posterior distribution. We illustrate the utility of this approach by calibrating an interatomic potential model for a family of gold-copper alloys. In particular, this case study highlights effective means for dealing with computational challenges with Bayesian model error embedding in large-scale physical models, and the utility of embedded model error for model diagnostics.

Bayesian inference↗
DOE OSTI2025

Unified differentiable digital twin for the IOTA/FAST facility

As the design complexity of modern accelerators grows, there is more interest in using advanced simulations that have fast execution time or produce insights about accelerator state. One notable example of additional information are gradients of physical observables with respect to design parameters produced by differentiable simulations. The IOTA/FAST facility has recently begun a program to implement and experimentally validate a unified start-to-end differentiable digital twin to serve as a virtual accelerator test stand, allowing for rapid prototyping of new software and experiments with minimal beam time costs. In this contribution we will discuss our plans and progress. Specifically, we will cover the selection and benchmarking of both physics and ML codes, the development of generic interfaces between device models and surrogate or physics-based sections, and the export of the parameters through either a deterministic event loop or a fully asynchronous EPICS soft input/output controller. We will also discuss challenges in model calibration and uncertainty quantification, as well as future plans to support larger proton accelerators like PIPII and Booster.

Kuklev, Nikita [Fermilab]↗
DOE OSTI2020

Model Package Report: Plateau to River Groundwater Model Version 8.3

This model package report documents the groundwater flow component of the Plateau to River Groundwater Model (P2R Model), which is a groundwater flow and contaminant fate and transport (F&T) simulation model used to support remedial activities conducted by CH2M HILL Plateau Remediation Company at the Hanford Site in Washington State. The objective of this report is to describe the modeling objectives, conceptualization, model implementation, calibration, sensitivity, uncertainty, configuration control, limitations, and future model enhancements of the groundwater flow component of the P2R Model.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Approach to Precision and Bias Analysis of Interlaboratory Salt Study Results

An interlaboratory study of salt properties measurements was initiated in 2020 by Raluca Scarlatt of UC Berkley and Jake McMurray of Oak Ridge National Laboratory as a DOE-funded NEUP project. The objective of what is referred to as the interlaboratory salt study (ISS) was to assess the quality of molten salt property data and develop consensus standard methods for measuring key property values. Unlike many interlaboratory studies in which the precision of applying a well-defined and well-constrained method is measured, the methods used to measure property values were not specified nor were the measurement conditions controlled. Instead, the approach was to engage participants in measuring the property values of two commonly-used salt mixtures by using any desired measurement techniques. By including measurements made using the same and different methods across institutions, the precisions achieved using specific techniques can be assessed as well as the confidence in the values measured using different techniques. Details of the calibrations and uncertainty provided by the participants will be useful in establishing a best practice for the application of each technique to molten salts.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Regression Convolutional Neural Network for Energy Estimation in NOvA

Regression Convolutional Neural Network for Energy Estimation in NOvA" Abstract: "NOvA (NuMI Off-Axis $\nu_e$ Appearance) is a long baseline neutrino experiment designed to measure neutrino oscillations over a distance of 810 km. NOvA employs a near and far detector to observe $\nu_\mu$ disappearance and $\nu_e$ appearance of neutrinos produced by the NuMI beam at Fermilab. Energy reconstruction is critical for precise measurements of neutrino oscillation parameters and cross sections, which are functions of neutrino energy. Energy estimation remains difficult due to the complexity of detector response and final state particle kinematics. We present a regression-based convolutional neural network (CNN) method that reconstructs neutrino and lepton energies based on raw pixel inputs for NOvA. The trained model is able to reconstruct event energy for different interaction modes and complex final states containing leptons and hadrons. Studies of regression CNN networks show improved energy resolution and reduced sensitivity to calibration scale uncertainties relative to traditional kinematics-based energy reconstruction techniques. The results demonstrate the potential of the regression CNN method for neutrino physics analyses by improving on standard kinematics-based reconstruction.

Zhao, Larry [UC, Irvine (main)]↗
NASA NTRS1983

Advanced techniques for transverse vorticity measurements

A four wire array of probes is used to determine the velocity components, their derivatives, and the transverse vorticity in a small (approximately 1 x 1 mm) spatial domain. The algorithms that define this calculation scheme and the extended considerations: compensating for minor calibration changes, uncertainty considerations, and the determination of excessive pitch angles in the data set, are presented.

Foss, J. F.↗
NASA NTRS1986

Helioseismic observations at Stanford, 1977-1986

Observations of low degree modes of solar oscillations were made at the Wilcox Solar Observatory for more than a decade. The set of observations from 1977 through 1986 are reexamined. The stability of the p-mode frequencies for modes of degree l=2-5 in each year is tested. A marginally significant trend of a decrease in p-mode frequencies of 0.06 microHz per year is found. The continuity of the observed signal at 160.01 minutes are also examined. It was found that the previously reported phase stability is no longer present. However, due to uncertainties in calibration, the reality of the reported signal can not be excluded.

Henning, H. M.↗
NASA NTRS1987

A detailed description of the uncertainty analysis for High Area Ratio Rocket Nozzle tests at the NASA Lewis Research Center

A preliminary uncertainty analysis has been performed for the High Area Ratio Rocket Nozzle test program which took place at the altitude test capsule of the Rocket Engine Test Facility at the NASA Lewis Research Center. Results from the study establish the uncertainty of measured and calculated parameters required for the calculation of rocket engine specific impulse. A generalized description of the uncertainty methodology used is provided. Specific equations and a detailed description of the analysis are presented. Verification of the uncertainty analysis model was performed by comparison with results from the experimental program's data reduction code. Final results include an uncertainty for specific impulse of 1.30 percent. The largest contributors to this uncertainty were calibration errors from the test capsule pressure and thrust measurement devices.

Kenneth J. Davidian↗