Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Development of a “Nature Run” for Observing System Simulation Experiments (OSSEs) for Snow Mission Development

Snow is a fundamental component of global and regional water budgets, particularly in mountainous areas and regions downstream that rely on snowmelt for water resources. Land surface models (LSMs) are commonly used to develop spatially distributed estimates of snow water equivalent (SWE) and runoff. However, LSMs are limited by uncertainties in model physics and parameters, among other factors. In this study, we describe the use of model calibration tools to improve snow simulations within the Noah-MP LSM as the first step in an observing system simulation experiment (OSSE). Noah-MP is calibrated against the University of Arizona (UA) SWE product over a western Colorado domain. With spatially varying calibrated parameters, we run calibrated and default Noah-MP simulations for water years 2010–20. By evaluating both simulations against the UA dataset, we show that calibration decreases domain averaged temporal RMSE and bias for snow depth from 0.15 to 0.13 m and from −0.036 to −0.0023 m, respectively, and improves the timing of snow ablation. Increased snow simulation performance also improves estimates of model-simulated runoff in four of six study basins, though only one has statistically significant improvement. Spatially distributed Noah-MP snow parameters perform better than default uniform values. We demonstrate that calibrating variables related to snow albedo calculations and rain–snow partitioning, among other processes, is a necessary step for creating a nature run that reasonably approximates true snow conditions for the OSSEs. Additionally, the inclusion of a snowfall scaling term can address biases in precipitation from meteorological forcing datasets, further improving the utility of LSMs for generating reliable spatiotemporal estimates of snow.

Melissa L. Wrzesien↗
NASA NTRS2021

Understanding Uncertainty of Snow Radiative Transfer Modeling Within a Mixed Deciduous and Evergreen Forest

Satellite-based passive microwave observations provide the best available continuous observational estimates of global snow water storage due to their broad geographic footprint and low sensitivity to clouds and precipitation. However, these observations are subject to substantial uncertainty due to the complex radiative properties of snow and from interference in forested areas. Physical radiative transfer models can be leveraged to improve the fidelity of these observations and as a data-assimilation tool. In this article, the Dense Media Radiative Transfer model with Multiple Layers (DMRT-ML) is used to simulate snow brightness temperatures from data collected from snow pits excavated during a two-day-long field study performed a temperate forest in the Northeast United States. The simulations are evaluated against surface-based radiometer observations collected at the snow pits. The DMRT-ML is configured with varying complexity to determine the snowpack characteristics most essential toward simulating brightness temperature within a temperate forest with complicated snow stratigraphy. In general, the single-layer configurations were not sufficiently complex to accurately simulate snow brightness temperature without significant tuning. The most accurate simulation was a two-layer configuration with a prescribed ice layer separating the snow layers. This simulation had a root-mean-square error <;15 K for the 37-GHz frequency. More complicated snowpack stratigraphy configurations did not substantively improve the results over the two-layer model configuration. The DMRT-ML was also used to examine differences between redundant datasets of density and grain size. It was determined that similar snow data collection and radiative transfer model configuration techniques are critical to ensure cross-study comparability.

Theodore Letcher↗
NASA NTRS1995

Uncertainties for two-dimensional models of solar rotation from helioseismic eigenfrequency splitting

Observed solar p-mode frequency splittings can be used to estimate angular velocity as a function of position in the solar interior. Formal uncertainties of such estimates depend on the method of estimation (e.g., least-squares), the distribution of errors in the observations, and the parameterization imposed on the angular velocity. We obtain lower bounds on the uncertainties that do not depend on the method of estimation; the bounds depend on an assumed parameterization, but the fact that they are lower bounds for the 'true' uncertainty does not. Ninety-five percent confidence intervals for estimates of the angular velocity from 1986 Big Bear Solar Observatory (BBSO) data, based on a 3659 element tensor-product cubic-spline parameterization, are everywhere wider than 120 nHz, and exceed 60,000 nHz near the core. When compared with estimates of the solar rotation, these bounds reveal that useful inferences based on pointwise estimates of the angular velocity using 1986 BBSO splitting data are not feasible over most of the Sun's volume. The discouraging size of the uncertainties is due principally to the fact that helioseismic measurements are insensitive to changes in the angular velocity at individual points, so estimates of point values based on splittings are extremely uncertain. Functionals that measure distributed 'smooth' properties are, in general, better constrained than estimates of the rotation at a point. For example, the uncertainties in estimated differences of average rotation between adjacent blocks of about 0.001 solar volumes across the base of the convective zone are much smaller, and one of several estimated differences we compute appears significant at the 95% level.

Genovese, Christopher R.↗
NASA NTRS2012

A Discussion on Uncertainty Representation and Interpretation in Model-Based Prognostics Algorithms based on Kalman Filter Estimation Applied to Prognostics of Electronics Components

This article discusses several aspects of uncertainty representation and management for model-based prognostics methodologies based on our experience with Kalman Filters when applied to prognostics for electronics components. In particular, it explores the implications of modeling remaining useful life prediction as a stochastic process and how it relates to uncertainty representation, management, and the role of prognostics in decision-making. A distinction between the interpretations of estimated remaining useful life probability density function and the true remaining useful life probability density function is explained and a cautionary argument is provided against mixing interpretations for the two while considering prognostics in making critical decisions.

Celaya, Jose R.↗
DOE OSTI2023

Explainable machine learning model for multi-step forecasting of reservoir inflow with uncertainty quantification

We propose an explainable machine learning (ML) model with uncertainty quantification (UQ) to improve multi-step reservoir inflow forecasting. Traditional ML methods have challenges in forecasting inflows multiple days ahead, and lack explainability and UQ. To address these limitations, we introduce an encoder–decoder long short-term memory (ED-LSTM) network for multi-step forecasting, employ the SHapley Additive exPlanation (SHAP) technique for understanding the influence of hydrometeorological factors on inflow prediction, and develop a novel UQ method for prediction trustworthiness. We apply these methods to forecast 7-day inflow in snow-dominant and rain-driven reservoirs. The results demonstrate the effectiveness of the ED-LSTM model, with high forecasting accuracy for short lead times. Our UQ method provides reliable uncertainty estimates, covering 90% of data with a 90% confidence level. The SHAP analysis reveals the importance of historical inflow and precipitation as influential factors. These findings and methods may support reservoir operators in optimizing water resources management decisions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

High-resolution modeling of indoor radon exposure with uncertainty quantification in Utah

Indoor radon accounts for 37% of population-level exposure to ionizing radiation in the United States. However, radon metrics are typically reported at coarse spatial scales, potentially obscuring meaningful local variation. We developed a high-resolution modeling framework to estimate indoor radon concentrations across Utah while explicitly quantifying predictive uncertainty. A total of 19,497 residential radon measurements collected between 2006 and 2017 were combined with environmental and housing characteristics and analyzed using a geospatial neural network that accommodates spatial dependence and nonlinear associations. Predictions were generated on a uniform hexagonal grid at 0.73 km2 resolution (H3 level 8). Out-of-sample predictions aggregated to the H3 level 8 grid showed good agreement with observed concentrations (Pearson r=0.64), while household-level predictions exhibited more moderate agreement (r=0.45). The model produced well-calibrated uncertainty estimates, with 24.1% of held-out observations exceeding the predicted 75th-percentile threshold. Maps of predicted radon concentrations and the probability of exceeding the U.S. EPA action level of 148 Bq/m3 (4 pCi/L) revealed substantial fine-scale spatial heterogeneity that was not apparent in conventional coarse-resolution summaries, with greater local variability observed in densely monitored urban counties than in sparsely sampled regions. High-resolution radon models that explicitly quantify uncertainty provide a useful framework for characterizing the spatial distribution of indoor radon and identifying areas of elevated exceedance risk. These findings highlight the value of fine-scale monitoring data and uncertainty-aware modeling approaches for radon exposure assessment, environmental risk characterization, and radon-related health research.

Wu, Yunhan [ORNL] (ORCID:0000000178842994)↗
DOE OSTI2022

Choices in land representation materially affect modeled biofuel carbon intensity estimates

Estimates of biofuel carbon intensity are uncertain and depend on modeled land use change (LUC) emissions. While analysts have focused on economic and agronomic assumptions affecting the quantity of land converted, researchers have paid less attention to how models classify land into broad categories and designate some categories as ineligible for LUC. To explore the effect of these land representation attributes, we use three versions of a global human and Earth systems model, GCAM, and compute the “carbon intensity of land-use change” (CI-LUC) from increased U.S. corn ethanol production. We consider uncertainty in model parameters along with the choice of land representation and find the latter is one of the most influential parameters on estimated CI-LUC. A version of the model that protects 90% of non-commercial land reduced estimated CI-LUC by an average of 32% across Monte Carlo trials compared to our baseline model. Another version that mimics the GTAP-BIO-ADV land representation, which protects all non-commercial land, reduced CI-LUC by an average of 19%. The results of this experiment suggest that analyses of LUC that exclude non-commercial land categories or assume more land is protected than empirically justified underestimate biofuel induced LUC GHG emissions.

09 BIOMASS FUELS↗
DOE OSTI2026

SMR safety through HTTF modeling and benchmark efforts for code validation for gas-cooled reactor applications

Accurate modeling and simulation tools for thermal-hydraulics calculations are a key element needed to design and license new advanced reactors including Small Modular Reactors (SMR) and Microreactors. Uncertainties in modeling and simulation can have significant safety and economic implications. The High Temperature Test Facility (HTTF) at Oregon State University (OSU) is a scaled integral effects experiment designed to investigate transient behavior in high-temperature gas-cooled prismatic-block nuclear reactors. High-quality measurement data is available from the HTTF that is suitable for a thermal-hydraulics code validation benchmark for gas-cooled reactor simulations. Here, this paper summarizes individual HTTF modeling efforts to date for tool validation at Idaho National Laboratory (INL), Argonne National Laboratory (ANL), Oregon State University (OSU) and Canadian Nuclear Laboratories (CNL) using system thermal-hydraulics codes, Computational Fluid Dynamics (CFD) codes and system-CFD code couplings. Also, the paper introduces the ongoing OECD Nuclear Energy Agency (NEA) High Temperature Gas Reactor Thermal-Hydraulics (HTGR T/H) benchmark that allows for better comparisons of results between different international modeling teams. The benchmark provides well defined computational problems that include code-to-code comparisons and comparisons to measured data. These problems provide an avenue for quantifying accuracy and identifying sources of uncertainty in thermal-hydraulics calculations, including in measured thermophysical properties, as part of validation for gas-cooled reactor simulation tools.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
DOE OSTI2022

Fiber Uncertainty Visualization for Bivariate Data With Parametric and Nonparametric Noise Models

Visualization and analysis of multivariate data and their uncertainty are top research challenges in data visualization. Constructing fiber surfaces is a popular technique for multivariate data visualization that generalizes the idea of level-set visualization for univariate data to multivariate data. Here, in this paper, we present a statistical framework to quantify positional probabilities of fibers extracted from uncertain bivariate fields. Specifically, we extend the state-of-the-art Gaussian models of uncertainty for bivariate data to other parametric distributions (e.g., uniform and Epanechnikov) and more general nonparametric probability distributions (e.g., histograms and kernel density estimation) and derive corresponding spatial probabilities of fibers. In our proposed framework, we leverage Green's theorem for closed-form computation of fiber probabilities when bivariate data are assumed to have independent parametric and nonparametric noise. Additionally, we present a nonparametric approach combined with numerical integration to study the positional probability of fibers when bivariate data are assumed to have correlated noise. For uncertainty analysis, we visualize the derived probability volumes for fibers via volume rendering and extracting level sets based on probability thresholds. We present the utility of our proposed techniques via experiments on synthetic and simulation datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Boosting efficiency and reducing graph reliance: Basis adaptation integration in Bayesian multi-fidelity networks

The computational cost of high-fidelity numerical models makes outer-loop analysis, which requires repeated interrogation of the model such as uncertainty quantification, computationally demanding. Multi-fidelity methods, which construct a surrogate model using data from an ensemble of models of varying cost and accuracy, can substantially reduce the cost of outer-loop analysis. However, these methods can be difficult to apply when the model ensemble does not admit a clear hierarchy a priori and the correlations between models are low. Consequently, in this paper, we present a multi-fidelity method that leverages dimension reduction to enhance the correlation between models, thereby reducing the amount of data needed to train a surrogate from an unordered ensemble of models. Our method utilizes basis adaptation to build low-dimensional polynomial chaos expansions of each model and employs Multi-fidelity Networks to encode the relationships among models. We show that the resulting method exhibit two notable advantages over its counterpart: (1) enhanced accuracy (both reduced bias and variance); and (2) reduced dependency on the graph structure encoding relationships among models. We demonstrate the approach on an analytical test problem and a challenging finite element model for a spent nuclear fuel. Our method produces a surrogate model that is significantly more accurate than either a single-fidelity surrogate or a multi-fidelity surrogate constructed without basis adaptation.

42 ENGINEERING↗
DOE OSTI2024

An experimental and chemical kinetic modeling study of 4-butoxyheptane combustion

Here, the combustion kinetics of a novel oxygenated bioblendstock for diesel, 4-butoxyheptane (4-BH), was investigated experimentally using a flow reactor and a heated, high-pressure shock tube. The flow reactor experiments employed oxygen as the oxidizer and helium as the diluent with oxidation conducted at atmospheric pressure and 10 bar for temperatures from 400 to 1000 K at 20-K intervals. The fuel, oxidizer, and diluent flow rates were varied at different temperatures to maintain a constant initial fuel mole fraction of 1000 ppm, with stoichiometric equivalence ratio, and a residence time of 2.0 s. The reacted gas was fed to two separate GC systems that could qualitatively and quantitatively detect product species. Additionally, real fuel-air ignition delay time (IDT) data were collected using a heated, high-pressure shock-tube facility. Fuel lean (φ = 0.5) and stoichiometric (φ = 1.0) mixtures were investigated at 10 atm as well as at 30 atm for the fuel lean case for temperatures between 847 and 1259 K. A detailed chemical kinetics mechanism was developed to model the product distribution from the flow reactor and IDTs from the shock tube. The proposed model was able to predict the double NTC behavior in flow reactor experiments reasonably well. Model predictions at low temperatures were observed to be highly sensitive to the rate constants of ketohydroperoxide (KHP) decomposition in the case of the OOH group in α position which were modeled based on existing literature studies on ethers. It was noted that in the absence of theoretical or experimental studies, the rate constants for KHP decomposition used in the literature were empirically set. Additional studies are required to address the gap in model prediction obtained in this study and to reduce the uncertainty in kinetics models for ether oxidation. Predicted product concentrations and IDTs showed some quantitative agreement with experimental data, but the overall reactivity of the IDTs is underpredicted. Additionally, significant deviation is observed for the IDT results at 10 atm for the stoichiometric case with minor deviations for the other cases. The reaction pathways to the missing products were then further analyzed theoretically through quantum-mechanical calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Dimorphos’s Material Properties and Estimates of Crater Size from the DART Impact

On 2022 September 26, the Double Asteroid Redirection Test (DART) spacecraft intentionally collided with Dimorphos, the moon of the binary asteroid system 65803 Didymos. This collision provided the first full-scale test of a kinetic impactor for planetary defense. Images from DART’s DRACO camera revealed Dimorphos to be an oblate spheroid covered in boulders of varying sizes and shapes. Very little was known about Dimorphos prior to DART’s impact, including its shape, structure, and material properties. Approach observations and those following the DART impact have provided crucial knowledge that narrows the parameter space relevant to modeling the impact into Dimorphos. Here we present the results of a suite of hydrocode simulations of the DART impact on Dimorphos. Despite remaining uncertainties, initial models of DART’s kinetic impact provide important information about the results of DART (e.g., potential crater size and morphology, ejecta mass) and the properties of Dimorphos. Simulations here suggest that Dimorphos has near-surface strength ranging from a few Pascals to tens of kPa, which corresponds to crater sizes of ~40–60 m. Simulated crater sizes provide a crucial comparison metric for the European Space Agency Hera mission when it arrives at the Didymos system. Hera’s measurement of crater size in combination with measurement of Dimorphos’s mass will allow us to assess our simulations and provide the information needed to make the DART impact experiment both the first test of a planetary defense mitigation mission and the first full-scale planetary defense simulation validation exercise.

36 MATERIALS SCIENCE↗
NASA NTRS1991

Modeling of Jupiter's millimeter wave emission utilizing laboratory measurements of ammonia (NH3) opacity

The techniques used to make laboratory measurements of the millimeter wave opacity from gaseous ammonia under simulated Jovian conditions are described. The results are applied to a radiative transfer model, which is used to compute Jupiter's millimeter wavelength emission. The absorptivity of gaseous NH3 is measured to reduce one of the largest uncertainties in modeling Jupiter's millimeter wave emission. Several other millimeter wave opacity sources are examined. New expressions are given for computing the absorptivity of NH3, H2O, cloud condensates, and pressure-induced absorption. Jupiter's reliable millimeter wavelength observations are compared with synthetic emission spectra which utilize these new absorption expressions.

Joiner, Joanna↗
NASA NTRS2022

A Framework for Deep Learning Emulation of Numerical Models With a Case Study in Satellite Remote Sensing

Numerical models based on physics represent the state of the art in Earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest generation computers, reducing the ability of modelers to generate simulations for understanding parameter sensitivities and characterizing variability and uncertainty. Thus, surrogate models are often developed to capture the essential attributes of the full-blown numerical models. Recent successes of machine learning methods, especially deep learning (DL), across many disciplines offer the possibility that complex nonlinear connectionist representations may be able to capture the underlying complex structures and nonlinear processes in Earth systems. A difficult test for DL-based emulation, which refers to function approximation of numerical models, is to understand whether they can be comparable to traditional forms of surrogate models in terms of computational efficiency while simultaneously reproducing model results in a credible manner. A DL emulation that passes this test may be expected to perform even better than simple models with respect to capturing complex processes and spatiotemporal dependencies. Here, we examine, with a case study in satellite-based remote sensing, the hypothesis that DL approaches can credibly represent the simulations from a surrogate model with comparable computational efficiency. Our results are encouraging in that the DL emulation reproduces the results with acceptable accuracy and often even faster performance. We discuss the broader implications of our results in light of the pace of improvements in high-performance implementations of DL and the growing desire for higher resolution simulations in the Earth sciences.

Bayesian Deep Learning↗
NASA NTRS2004

Modeling of Isotope Fractionation in Stratospheric CO2, N2O, CH4, and O3: Investigations of Stratospheric Chemistry and Transport, Stratosphere-Troposphere Exchange, and Their Influence on Global Isotope Budgets

We investigated the isotopic fractionation of CH4 and hydrogen (H2) in the stratosphere by incorporating isotope-specific rate coefficients into the Lawrence Livermore National Laboratory (LLNL) 2D model and comparing the model results with new observations from the NASA ER-2 aircraft (funded through a separate task under the Upper Atmosphere Research Program). The model results reveal that fractionation which occurs in the stratosphere has a significant influence on isotope compositions in the free troposphere, an important point which had previously been ignored, unrecognized or unquantified for many long-lived trace gases, including CH4 and H2 which we have focused our efforts on to date. Our analyses of the model results and new isotope observations have also been used to test how well the kinetic isotope effects are known, at least to within the uncertainties in model chemistry and transport. Overall, these results represent an important step forward in our understanding of isotope fractionation in the atmosphere and demonstrate that stratospheric isotope fractionation cannot be ignored in modeling studies which use isotope observations in the troposphere to infer the global budgets of CH4 (an important greenhouse gas) and of H2 (a gas whose atmospheric budget must be better quantified, particularly before a large human perturbation from fuel cell use is realized). Our analyses of model results and observations from the NASA ER-2 aircraft are briefly summarized separately below for CH4, H2, and H2O and for the contribution of these modeling studies to date to our understanding of isotope fractionation for N2O, CO2, and O3 as well.

Boering, Kristie A.↗
NASA NTRS2011

Bridging Empirical and Physical Approaches for Landslide Monitoring and Early Warning

Rainfall-triggered landslides typically occur and are evaluated at local scales, using slope-stability models to calculate coincident changes in driving and resisting forces at the hillslope level in order to anticipate slope failures. Over larger areas, detailed high resolution landslide modeling is often infeasible due to difficulties in quantifying the complex interaction between rainfall infiltration and surface materials as well as the dearth of available in situ soil and rainfall estimates and accurate landslide validation data. This presentation will discuss how satellite precipitation and surface information can be applied within a landslide hazard assessment framework to improve landslide monitoring and early warning by considering two disparate approaches to landslide hazard assessment: an empirical landslide forecasting algorithm and a physical slope-stability model. The goal of this research is to advance near real-time landslide hazard assessment and early warning at larger spatial scales. This is done by employing high resolution surface and precipitation information within a probabilistic framework to provide more physically-based grounding to empirical landslide triggering thresholds. The empirical landslide forecasting tool, running in near real-time at http://trmm.nasa.gov, considers potential landslide activity at the global scale and relies on Tropical Rainfall Measuring Mission (TRMM) precipitation data and surface products to provide a near real-time picture of where landslides may be triggered. The physical approach considers how rainfall infiltration on a hillslope affects the in situ hydro-mechanical processes that may lead to slope failure. Evaluation of these empirical and physical approaches are performed within the Land Information System (LIS), a high performance land surface model processing and data assimilation system developed within the Hydrological Sciences Branch at NASA's Goddard Space Flight Center. LIS provides the capabilities to quantify uncertainty from model inputs and calculate probabilistic estimates for slope failures. Results indicate that remote sensing data can provide many of the spatiotemporal requirements for accurate landslide monitoring and early warning; however, higher resolution precipitation inputs will help to better identify small-scale precipitation forcings that contribute to significant landslide triggering. Future missions, such as the Global Precipitation Measurement (GPM) mission will provide more frequent and extensive estimates of precipitation at the global scale, which will serve as key inputs to significantly advance the accuracy of landslide hazard assessment, particularly over larger spatial scales.

Kirschbaum, Dalia↗
DOE OSTI2023

Probabilistic Evaluation of Geomechanical Risks in CO2 Storage: An Exploration of Caprock Integrity Metrics Using a Multilaminate Model

The probabilistic uncertainty assessment of geomechanical risk—specifically, caprock failure—attributable to CO2 injection, as presented in a simplified hypothetical geological model, was the focus of this study. Our approach amalgamates the implementation of a multilaminate model, the creation of a response surface model in conjunction with the Box–Behnken sampling design, the execution of associated numerical modeling experiments, and the utilization of Monte Carlo simulations. Probability distributions to encapsulate the inherent variability (elastic and mechanical properties of the caprock and reservoir) and uncertainty in prediction estimates (vertical displacement, total strain, and F value) were employed. Our findings reveal that the Young modulus of the caprock is a key factor controlling equivalent total strain but is insufficient as a stand-alone indicator of caprock integrity. It is confirmed that the caprock can accommodate significant deformation without failure, if it possesses a low Young’s modulus and high mechanical strength properties, such as the friction angle and uniaxial compressive strength. Similarly, vertical displacement was found to be an unreliable indicator for caprock integrity, as caprock failure can occur across a broad spectrum of vertical displacements, particularly when both the Young modulus and mechanical strength properties have wide ranges. This study introduces the F value as the most dependable indicator for caprock failure, although it is a theoretical attribute (the shortest distance between the Mohr circle and the nearest failure envelope used to measure the sensitivity to failure) and not physically measurable in the field. Deviatoric stress levels were found to vary based on stress regimes, with the maximum levels observed under extensive and compressive stress regimes. In conjunction with the use of the response surface method, this study demonstrates the efficacy of the multilaminate framework and the Mohr–Coulomb constitutive model in providing a simplified, yet effective, probabilistic model of the mechanical behavior of caprock failure, reducing mathematical and computational complexities.

Energy & Fuels↗