Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Multifidelity methods for uncertainty quantification of a nonlocal model for phase changes in materials

This study is devoted to the construction of a multifidelity Monte Carlo (MFMC) method for the uncertainty quantification of a nonlocal, non-mass-conserving Cahn-Hilliard model for phase transitions with an obstacle potential. Here, we are interested in estimating the expected value of an output of interest (OoI) that depends on the solution of the nonlocal Cahn-Hilliard model. As opposed to its local counterpart, the nonlocal model captures sharp interfaces without the need for significant mesh refinement. However, the computational cost of the nonlocal Cahn-Hilliard model is higher than that of its local counterpart with similar mesh refinement, inhibiting its use for outer-loop applications such as uncertainty quantification. The MFMC method augments the desired high-fidelity, high-cost OoI with a set of lower-fidelity, lower-cost OoIs to alleviate the computational burden associated with nonlocality. Most of the computational budget is allocated to sampling the cheap surrogate models to achieve speedup, whereas the high-fidelity model is sparsely sampled to maintain accuracy. For the non-mass-conserving nonlocal Cahn-Hilliard model, the use of the MFMC method results in, for a given computational budget, about an order of magnitude reduction in the mean-squared error of the expected value of the OoI relative to that of the Monte Carlo method.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

GEANT4 parameter tuning using Professor

The GEANT4 toolkit is used extensively in high energy physics to simulate the passage of particles through matter and to predict effects such as detector efficiencies and smearing. GEANT4 uses many underlying models to predict particle interaction kinematics, and uncertainty in these models leads to uncertainty in high energy physics measurements. The GEANT4 collaboration recently made free parameters in some models accessible through partnership with GEANT4 developers. We present a study of the impact of varying parameters in three GEANT4 hadronic physics models on agreement with thin target datasets and describe fits to these datasets using the Professor model tuning framework [1]. We find that varying parameters produces substantially better agreement with some datasets, but that more degrees of freedom are required for full agreement. This work is a first step towards a common framework for propagating uncertainties in GEANT4 models to high energy physics measurements, and we outline future work required to complete that goal.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2008

Uncertainty and Sensitivity Analyses of Duct Propagation Models

This paper presents results of uncertainty and sensitivity analyses conducted to assess the relative merits of three duct propagation codes. Results from this study are intended to support identification of a "working envelope" within which to use the various approaches underlying these propagation codes. This investigation considers a segmented liner configuration that models the NASA Langley Grazing Incidence Tube, for which a large set of measured data was available. For the uncertainty analysis, the selected input parameters (source sound pressure level, average Mach number, liner impedance, exit impedance, static pressure and static temperature) are randomly varied over a range of values. Uncertainty limits (95% confidence levels) are computed for the predicted values from each code, and are compared with the corresponding 95% confidence intervals in the measured data. Generally, the mean values of the predicted attenuation are observed to track the mean values of the measured attenuation quite well and predicted confidence intervals tend to be larger in the presence of mean flow. A two-level, six factor sensitivity study is also conducted in which the six inputs are varied one at a time to assess their effect on the predicted attenuation. As expected, the results demonstrate the liner resistance and reactance to be the most important input parameters. They also indicate the exit impedance is a significant contributor to uncertainty in the predicted attenuation.

Nark, Douglas M.↗
DOE OSTI2024

Validation of Exploding Wire Tests Using Alegra-NG

Exploding wire tests are used to characterize materials undergoing high voltage loading and to validate computational models in a simple configuration. In this report, the materials emphasized are gold, aluminum, copper and nickel wires. Model validation is presented using the nominal model (no uncertainty) in the form of heat maps (per material) that show model bias across scalar quantities and initial voltage. Mesh convergence and uncertainty quantification is also presented.

36 MATERIALS SCIENCE↗
DOE OSTI2020

A Novel Modeling Framework for Computationally Efficient and Accurate Real-Time Ensemble Flood Forecasting With Uncertainty Quantification

A novel modeling framework that simultaneously improves accuracy, predictability, and computational efficiency is presented. It embraces the benefits of three modeling techniques integrated together for the first time: surrogate modeling, parameter inference, and data assimilation. The use of polynomial chaos expansion (PCE) surrogates significantly decreases computational time. Parameter inference allows for model faster convergence, reduced uncertainty, and superior accuracy of simulated results. Ensemble Kalman filters assimilate errors that occur during forecasting. To examine the applicability and effectiveness of the integrated framework, we developed 18 approaches according to how surrogate models are constructed, what type of parameter distributions are used as model inputs, and whether model parameters are updated during the data assimilation procedure. We conclude that (1) PCE must be built over various forcing and flow conditions, and in contrast to previous studies, it does not need to be rebuilt at each time step; (2) model parameter specification that relies on constrained, posterior information of parameters (so-called Selected specification) can significantly improve forecasting performance and reduce uncertainty bounds compared to Random specification using prior information of parameters; and (3) no substantial differences in results exist between single and dual ensemble Kalman filters, but the latter better simulates flood peaks. The use of PCE effectively compensates for the computational load added by the parameter inference and data assimilation (up to ~80 times faster). Therefore, the presented approach contributes to a shift in modeling paradigm arguing that complex, high-fidelity hydrologic and hydraulic models should be increasingly adopted for real-time and ensemble flood forecasting.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2017

Evaluation of the Uncertainty in JP-7 Kinetics Models Applied to Scramjets

One of the challenges of designing and flying a scramjet-powered vehicle is the difficulty of preflight testing. Ground tests at realistic flight conditions introduce several sources of uncertainty to the flow that must be addressed. For example, the scales of the available facilities limit the size of vehicles that can be tested and so performance metrics for larger flight vehicles must be extrapolated from ground tests at smaller scales. To create the correct flow enthalpy for higher Mach number flows, most tunnels use a heater that introduces vitiates into the flow. At these conditions, the effects of the vitiates on the combustion process is of particular interest to the engine designer, where the ground test results must be extrapolated to flight conditions. In this paper, the uncertainty of the cracked JP-7 chemical kinetics used in the modeling of a hydrocarbon-fueled scramjet was investigated. The factors that were identified as contributing to uncertainty in the combustion process were the level of flow vitiation, the uncertainty of the kinetic model coefficients and the variation of flow properties between ground testing and flight. The method employed was to run simulations of small, unit problems and identify which variables were the principal sources of uncertainty for the mixture temperature. Then using this resulting subset of all the variables, the effects of the uncertainty caused by the chemical kinetics on a representative scramjet flow-path for both vitiated (ground) and nonvitiated (flight) flows were investigated. The simulations showed that only a few of the kinetic rate equations contribute to the uncertainty in the unit problem results, and when applied to the representative scramjet flowpath, the resulting temperature variability was on the order of 100 K. Both the vitiated and clean air results showed very similar levels of uncertainty, and the difference between the mean properties were generally within the range of uncertainty predicted.

Norris, A. T.↗
DOE OSTI2020

CALPHAD Uncertainty Quantification and TDBX

CALPHAD uncertainty quantification (UQ) is the foundation of materials design with quantified confidence. We report a framework and software packages to enable CALPHAD UQ assessment and calculation using commercial CALPHAD software (Thermo-Calc). This Bayesian inference framework is coupled with a Markov chain Monte Carlo algorithm to establish uncertainty traces with a given thermodynamic database file (TDB) and corresponding experimental data points. This general framework is demonstrated with the Ni–Cr binary system. The algorithm is firstly validated on synthetic data with known ground truth. Then it is applied to real experimental data to generate posterior traces. We develop a file format named TDBX, which provides a single source of truth by combining the original TDB content and the traces for each assessed Gibbs energy parameter. CALPHAD UQ calculations are performed based on the TDBX file, from which uncertainties for phase boundaries, enthalpy curves, and solidification range are collected as examples of basic design parameters. This TDBX file with corresponding scripts are made open-source. Finally, the combination of CALPHAD UQ assessments and calculations connected by TDBX supports uncertainty-assisted modeling, enabling the integrated application of modern design with uncertainty methodologies to computational materials design.

36 MATERIALS SCIENCE↗
NASA NTRS2018

Intercomparison of Precipitation Estimates over the Arctic Ocean and Its Peripheral Seas from Reanalyses

Precipitation over the Arctic Ocean has a significant impact on the basin-scale freshwater and energy budgets but is one of the most poorly constrained variables in atmospheric reanalyses. Precipitation controls the snow cover on sea ice, which impedes the exchange of energy between the ocean and atmosphere, inhibiting sea ice growth. Thus, accurate precipitation amounts are needed to inform sea ice modeling, especially for the production of thickness estimates from satellite altimetry freeboard data. However, obtaining a quantitative estimate of the precipitation distribution in the Arctic is notoriously difficult because of a number of factors, including a lack of reliable, long-term in situ observations; difficulties in remote sensing over sea ice; and model biases in temperature and moisture fields and associated uncertainty of modeled cloud microphysical processes in the polar regions. Here, we compare precipitation estimates over the Arctic Ocean from eight widely used atmospheric reanalyses over the period 2000–16 (nominally the ‘‘new Arctic’’). We find that the magnitude, frequency, and phase of precipitation vary drastically, although interannual variability is similar. Reanalysis-derived precipitation does not increase with time as expected; however, an increasing trend of higher fractions of liquid precipitation (rainfall) is found. When compared with drifting ice mass balance buoys, three reanalyses (ERA-Interim, MERRA, and NCEP R2) produce realistic magnitudes and temporal agreement with observed precipitation events, while two products [MERRA, version 2 (MERRA-2), and CFSR] show large, implausible magnitudes in precipitation events. All the reanalyses tend to produce overly frequent Arctic precipitation. Future work needs to be undertaken to determine the specific factors in reanalyses that contribute to these discrepancies in the new Arctic.

Mcpartland, Linette N.↗
DOE OSTI2025

Cloud Feedback Uncertainty in the Equatorial Pacific Across CMIP6 Models

Cloud feedback is the largest uncertainty in estimating Equilibrium Climate Sensitivity. In this study we focus on the equatorial Pacific, where CMIP6 model cloud feedback spread is notably large. Cloud radiative effects in this region are relevant for the global climate. Our findings show that models predict a consistent shift towards the ascent regime in response to El Nino-like sea surface warming. Models diverge in terms of the radiative impact due to differences in cloud characteristics in ascent and subsidence regimes. Using the observed relationship between circulation regime and cloud radiative effect, we find a reduction in the regional mean cloud feedback estimate from 0.77 to 0.22 W m -2 K -1 , though this does not substantially lessen the model spread in total feedback. Pathways to reduce this spread include: improving confidence in the regional ocean warming pattern, and using observations and models to understand cloud type and circulation interactions.

CMIP6↗
DOE OSTI2020

Time of Emergence and Large Ensemble Intercomparison for Ocean Biogeochemical Trends

Anthropogenically forced changes in ocean biogeochemistry are underway and critical for the ocean carbon sink and marine habitat. Detecting such changes in ocean biogeochemistry will require quantification of the magnitude of the change (anthropogenic signal) and the natural variability inherent to the climate system (noise). Here we use Large Ensemble (LE) experiments from four Earth system models (ESMs) with multiple emissions scenarios to estimate Time of Emergence (ToE) and partition projection uncertainty for anthropogenic signals in five biogeochemically important upper-ocean variables. We find ToEs are robust across ESMs for sea surface temperature and the invasion of anthropogenic carbon; emergence time scales are 20–30 yr. For the biological carbon pump, and sea surface chlorophyll and salinity, emergence time scales are longer (50+ yr), less robust across the ESMs, and more sensitive to the forcing scenario considered. We find internal variability uncertainty, and model differences in the internal variability uncertainty, can be consequential sources of uncertainty for projecting regional changes in ocean biogeochemistry over the coming decades. In combining structural, scenario, and internal variability uncertainty, this study represents the most comprehensive characterization of biogeochemical emergence time scales and uncertainty to date. Our findings delineate critical spatial and duration requirements for marine observing systems to robustly detect anthropogenic change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Reconstruction and uncertainty quantification of lattice Hamiltonian model parameters from observations of microscopic degrees of freedom

The emergence of scanning probe and electron beam imaging techniques has allowed quantitative studies of atomic structure and minute details of electronic and vibrational structure on the level of individual atomic units. These microscopic descriptors, in turn, can be associated with local symmetry breaking phenomena, representing the stochastic manifestation of the underpinning generative physical model. In this work, we explore the reconstruction of exchange integrals in the Hamiltonian for a lattice model with two competing interactions from observations of microscopic degrees of freedom and establish the uncertainties and reliability of such analysis in a broad parameter-temperature space. In contrast to other approaches, we specifically specify a loss function inherent to thermodynamic systems and utilize it to estimate uncertainty in simulated realizations of different models. As an ancillary task, we develop a machine learning approach based on histogram clustering to predict phase diagrams efficiently using a reduced descriptor space. We further demonstrate that reconstruction is possible well above the phase transition and in the regions of parameter space when the macroscopic ground state of the system is poorly defined due to frustrated interactions. This suggests that this approach can be applied to the traditionally complex problems of condensed matter physics such as ferroelectric relaxors and morphotropic phase boundary systems, spin and cluster glasses, and quantum systems once the local descriptors linked to the relevant physical behaviors are known.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Machine learning enhanced predictions of ICRF heating: Overcoming numerical limitations via data curation

In this work, we present the development of robust surrogate models for Ion Cyclotron Range of Frequencies (ICRF) and High-Harmonic Fast Wave (HHFW) heating predictions in fusion plasmas. Building upon our previous efforts to achieve real-time capable models, we identify the cause of the outliers found using TORIC in certain HHFW heating scenarios. The outliers are observed to be spurious ion Bernstein wave (IBW)-like modes caused by a wavelength control algorithm designed to address challenging scenarios with high perpendicular wavenumbers. The effect arises from the modulation in the perpendicular susceptibility, which can induce sign reversal and IBW-like propagation for scenarios featuring normalized ion Larmor radius λ i ≫ 1. We use TORIC with this algorithm disabled to generate a novel HHFW-NSTX database that is free of outliers. Surrogate models trained on this database, including Random Forest Regressor (RFR), Multi-Layer Perceptrons, and Gaussian Process Regressors (GPR), demonstrate the ability to accurately predict HHFW heating profiles, with regression scores of R 2 ∈[0.93−0.99]. Additionally we demonstrate that it is possible to generalize predictions beyond training data by the use of both RFR and GPR models, enabling the prediction of scenarios previously limited to the original model. GPR models also provide uncertainty quantification, offering insights into model confidence. This work introduces a comprehensive Verification, Validation, and Uncertainty Quantification methodology for surrogate modeling, applicable not only to ICRF heating but also to other RF heating challenges and fusion physics problems. Beyond accelerated inference, these models show effective extrapolation capabilities, providing an alternative for addressing numerical challenges.

Artificial neural networks↗
NASA NTRSDate not supplied

Estimation of Permanent Magnet Synchronous Motor Parameters using a Linear Unknown Input Interval Observer

This paper develops and evaluate a technique to estimate the speed and unknown load torque of a permanent magnet synchronous motor (PMSM). An interval unknown input observer (UIO) for linear time-invariant (LTI) systems is designed and utilized to estimate the PMSM parameters. Interval UIOs are advantageous as they allow for the estimation of both states and unknown inputs, while accounting for varying uncertainty sources, such as model and measurement uncertainties inherent in dynamic systems and processes. First, the nonlinear PMSM model is linearized to transform it to a suitable form for application of the linear interval UIO. Then, the interval UIO is applied to jointly estimate the motor speed and the unknown load torque disturbance. Assuming that the measurement noise and disturbances are bounded, lower and upper bounds are first computed for the unmeasured state (motor speed) and then for the unknown input (load torque). The proposed approach and its limitations are demonstrated for the nonlinear PMSM model derived from its equivalent electrical circuit.

Elinirina I Robinson↗
DOE OSTI2024

Accurate data-driven surrogates of dynamical systems for forward propagation of uncertainty

Stochastic collocation (SC) is a well-known non-intrusive method of constructing surrogate models for uncertainty quantification. In dynamical systems, SC is especially suited for full-field uncertainty propagation that characterizes the distributions of the high-dimensional solution fields of a model with stochastic input parameters. However, due to the highly nonlinear nature of the parameter-to-solution map in even the simplest dynamical systems, the constructed SC surrogates are often inaccurate. Here, this work presents an alternative approach, where we apply the SC approximation over the dynamics of the model, rather than the solution. By combining the data-driven sparse identification of nonlinear dynamics framework with SC, we construct dynamics surrogates and integrate them through time to construct the surrogate solutions. We demonstrate that the SC-over-dynamics framework leads to smaller errors, both in terms of the approximated system trajectories as well as the model state distributions, when compared against full-field SC applied to the solutions directly. We present numerical evidence of this improvement using three test problems: a chaotic ordinary differential equation, and two partial differential equations from solid mechanics.

42 ENGINEERING↗
DOE OSTI2026

REV-INR: Regularized Evidential Implicit Neural Representation for Uncertainty-Aware Volume Visualization

Applications of Implicit Neural Representations (INRs) have emerged as a promising deep learning approach for compactly representing large volumetric datasets. These models can act as surrogates for volume data, enabling efficient storage and on-demand reconstruction via model predictions. However, conventional deterministic INRs only provide value predictions without insights into the model’s prediction uncertainty or the impact of inherent noisiness in the data. This limitation can lead to unreliable data interpretation and visualization due to prediction inaccuracies in the reconstructed volume. Identifying erroneous results extracted from model-predicted data may be infeasible, as raw data may be unavailable due to its large size. To address this challenge, we introduce REV-INR, Regularized Evidential Implicit Neural Representation, which learns to predict data values accurately along with the associated coordinate-level data uncertainty and model uncertainty using only a single forward pass of the trained REV-INR during inference. By comprehensively comparing and contrasting REV-INR with existing well-established deep uncertainty estimation methods, we show that REV-INR achieves the best volume reconstruction quality with robust data (aleatoric) and model (epistemic) uncertainty estimates using the fastest inference time. Consequently, we demonstrate that REV-INR facilitates assessment of the reliability and trustworthiness of the extracted isosurfaces and volume visualization results, enabling analyses to be solely driven by model-predicted data.

Saklani, Shanu [Indian Institute of Technology, Ka↗
NASA NTRS2001

Our Sun IV: The Standard Model and Helioseismology: Consequences of Uncertainties in Input Physics and in Observed Solar Parameters

Helioseismic frequency observations provide an extremely accurate window into the solar interior; frequencies from the Michaelson Doppler Imager (MDI) on the Solar and Heliospheric Observatory (SOHO) spacecraft, enable the adiabatic sound speed and adiabatic index to be inferred with an accuracy of a few parts in 10(exp 4) and the density with an accuracy of a few parts in 10(exp 3). This has become a Serious challenge to theoretical models of the Sun. Therefore, we have undertaken a self-consistent, systematic study of the sources of uncertainties in the standard solar models. We found that the largest effect on the interior structure arises from the observational uncertainties in the photospheric abundances of the elements, which affect the sound speed profile at the level of 3 parts in 10(exp 3). The estimated 4% uncertainty in the OPAL opacities could lead to effects of 1 part in 10(exp 3); the approximately 5%, uncertainty in the basic pp nuclear reaction rate would have a similar effect, as would uncertainties of approximately 15% in the diffusion constants for the gravitational settling of helium. The approximately 50% uncertainties in diffusion constants for the heavier elements would have nearly as large an effect. Different observational methods for determining the solar radius yield results differing by as much as 7 parts in 10(exp 4); we found that this leads to uncertainties of a few parts in 10(exp 3) in the sound speed int the solar convective envelope, but has negligible effect on the interior. Our reference standard solar model yielded a convective envelope position of 0.7135 solar radius, in excellent agreement with the observed value of 0.713 +/- 0.001 solar radius and was significantly affected only by Z/X, the pp rate, and the uncertainties in helium diffusion constants. Our reference model also yielded envelope helium abundance of 0.2424, in good agreement with the approximate range of 0.24 to 0.25 inferred from helioseismic observations; only extreme Z/X values yielded envelope helium abundance outside this range. We found that other current uncertainties, namely, in the solar age and luminosity, in nuclear rates other than the pp reaction, in the low-temperature molecular opacities, and in the low-density equation of state, have no significant effect on the quantities that can be inferred from helioseismic observations. The predicted pre-main-sequence lithium depletion is uncertain by a factor of 2. The predicted neutrino capture rate is uncertain by approximately 30% for the Cl-27 experiment and by approximately 3% for Ga-71 experiments, while the B-8 neutrino flux is uncertain by approximately 30%.

Boothroyd, Arnold I.↗
DOE OSTI2022

Characterization and Valuation of the Uncertainty of Calibrated Parameters in Microsimulation Decision Models

We evaluated the implications of different approaches to characterize the uncertainty of calibrated parameters of microsimulation decision models (DMs) and quantified the value of such uncertainty in decision making. We calibrated the natural history model of CRC to simulated epidemiological data with different degrees of uncertainty and obtained the joint posterior distribution of the parameters using a Bayesian approach. We conducted a probabilistic sensitivity analysis (PSA) on all the model parameters with different characterizations of the uncertainty of the calibrated parameters. We estimated the value of uncertainty of the various characterizations with a value of information analysis. We conducted all analyses using high-performance computing resources running the Extreme-scale Model Exploration with Swift (EMEWS) framework. The posterior distribution had a high correlation among some parameters. The parameters of the Weibull hazard function for the age of onset of adenomas had the highest posterior correlation of -0.958. When comparing full posterior distributions and the maximum-a-posteriori estimate of the calibrated parameters, there is little difference in the spread of the distribution of the CEA outcomes with a similar expected value of perfect information (EVPI) of $\$$653 and $\$$685, respectively, at a willingness-to-pay (WTP) threshold of $\$$66,000 per quality-adjusted life year (QALY). Ignoring correlation on the calibrated parameters’ posterior distribution produced the broadest distribution of CEA outcomes and the highest EVPI of $\$$809 at the same WTP threshold. Different characterizations of the uncertainty of calibrated parameters affect the expected value of eliminating parametric uncertainty on the CEA. Ignoring inherent correlation among calibrated parameters on a PSA overestimates the value of uncertainty.

97 MATHEMATICS AND COMPUTING↗