Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Sensitivity of Surface Flux Simulations to Hydrologic Parameters Based on an Uncertainty Quantification Framework Applied to the Community Land Model

Uncertainties in hydrologic parameters could have significant impacts on the simulated water and energy fluxes and land surface states, which will in turn affect atmospheric processes and the carbon cycle. Quantifying such uncertainties is an important step toward better understanding and quantification of uncertainty of integrated earth system models. In this paper, we introduce an uncertainty quantification (UQ) framework to analyze sensitivity of simulated surface fluxes to selected hydrologic parameters in the Community Land Model (CLM4) through forward modeling. Thirteen flux tower footprints spanning a wide range of climate and site conditions were selected to perform sensitivity analyses by perturbing the parameters identified. In the UQ framework, prior information about the parameters was used to quantify the input uncertainty using the Minimum-Relative-Entropy approach. The quasi-Monte Carlo approach was applied to generate samples of parameters on the basis of the prior pdfs. Simulations corresponding to sampled parameter sets were used to generate response curves and response surfaces and statistical tests were used to rank the significance of the parameters for output responses including latent (LH) and sensible heat (SH) fluxes. Overall, the CLM4 simulated LH and SH show the largest sensitivity to subsurface runoff generation parameters. However, study sites with deep root vegetation are also affected by surface runoff parameters, while sites with shallow root zones are also sensitive to the vadose zone soil water parameters. Generally, sites with finer soil texture and shallower rooting systems tend to have larger sensitivity of outputs to the parameters. Our results suggest the necessity of and possible ways for parameter inversion/calibration using available measurements of latent/sensible heat fluxes to obtain the optimal parameter set for CLM4. This study also provided guidance on reduction of parameter set dimensionality and parameter calibration framework design for CLM4 and other land surface models under different hydrologic and climatic regimes.

54 ENVIRONMENTAL SCIENCES↗

Evaluating the Potential and Challenges of an Uncertainty Quantification Method for Long Short–Term Memory Models for Soil Moisture Predictions

Recently, recurrent deep networks have shown promise to harness newly available satellite–sensed data for long–term soil moisture projections. However, to be useful in forecasting, deep networks must also provide uncertainty estimates. Here we evaluated Monte Carlo dropout with an input–dependent data noise term (MCD+N), an efficient uncertainty estimation framework originally developed in computer vision, for hydrologic time series predictions. MCD+N simultaneously estimates a heteroscedastic input–dependent data noise term (a trained error model attributable to observational noise) and a network weight uncertainty term (attributable to insufficiently constrained model parameters). Although MCD+N has appealing features, many heuristic approximations were employed during its derivation, and rigorous evaluations and evidence of its asserted capability to detect dissimilarity were lacking. To address this, we provided an in–depth evaluation of the scheme's potential and limitations. We showed that for reproducing soil moisture dynamics recorded by the Soil Moisture Active Passive (SMAP) mission, MCD+N indeed gave a good estimate of predictive error, provided that we tuned a hyperparameter and used a representative training data set. The input–dependent term responded strongly to observational noise, while the model term clearly acted as a detector for physiographic dissimilarity from the training data, behaving as intended. However, when the training and test data were characteristically different, the input–dependent term could be misled, undermining its reliability. Additionally, due to the data–driven nature of the model, data noise also influences network weight uncertainty, and therefore the two uncertainty terms are correlated. Altogether, this approach has promise, but care is needed to interpret the results.

54 ENVIRONMENTAL SCIENCES↗

Estimating Uncertainty in Simulated ENSO Statistics

Abstract Large ensembles of model simulations are frequently used to reduce the impact of internal variability when evaluating climate models and assessing climate change induced trends. However, the optimal number of ensemble members required to distinguish model biases and climate change signals from internal variability varies across models and metrics. Here we analyze the mean, variance and skewness of precipitation and sea surface temperature in the eastern equatorial Pacific region often used to describe the El Niño–Southern Oscillation (ENSO), obtained from large ensembles of Coupled model intercomparison project phase 6 climate simulations. Leveraging established statistical theory, we develop and assess equations to estimate, a priori, the ensemble size or simulation length required to limit sampling‐based uncertainties in ENSO statistics to within a desired tolerance. Our results confirm that the uncertainty of these statistics decreases with the square root of the time series length and/or ensemble size. Moreover, we demonstrate that uncertainties of these statistics are generally comparable when computed using either pre‐industrial control or historical runs. This suggests that pre‐industrial runs can sometimes be used to estimate the expected uncertainty of statistics computed from an existing historical member or ensemble, and the number of simulation years (run duration and/or ensemble size) required to adequately characterize the statistic. This advance allows us to use existing simulations (e.g., control runs that are performed during model development) to design ensembles that can sufficiently limit diagnostic uncertainties arising from simulated internal variability. These results may well be applicable to variables and regions beyond ENSO.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty Quantification for Multiphase Computational Fluid Dynamics Closure Relations with a Physics-Informed Bayesian Approach

Multiphase Computational Fluid Dynamics (MCFD) based on the two-fluid model is considered a promising tool to model complex two-phase flow systems. MCFD simulation can predict local flow features without resolving interfacial information. As a result, the MCFD solver relies on closure relations to describe the interaction between the two phases. Those empirical or semi-mechanistic closure relations constitute a major source of uncertainty for MCFD predictions. In this paper, we leverage a physics-informed uncertainty quantification (UQ) approach to inversely quantify the closure relations’ model form uncertainty in a physically consistent manner. This proposed approach considers the model form uncertainty terms as stochastic fields that are additive to the closure relation outputs. Combining dimensionality reduction and Gaussian processes, the posterior distribution of the stochastic fields can be effectively quantified within the Bayesian framework with the support of experimental measurements. As this UQ approach is fully integrated into the MCFD solving process, the physical constraints of the system can be naturally preserved in the UQ results. Here, in a case study of adiabatic bubbly flow, we demonstrate that this UQ approach can quantify the model form uncertainty of the MCFD interfacial force closure relations, thus effectively improving the simulation results with relatively sparse data support.

42 ENGINEERING↗

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗

Upscaling Uncertainty with Dynamic Discrepancy for a Multi-Scale Carbon Capture System

Uncertainties from model parameters and model discrepancy from small-scale models impact the accuracy and reliability of predictions of large-scale systems. Inadequate representation of these uncertainties may result in inaccurate and overconfident predictions during scale-up to larger systems. Hence, multiscale modeling efforts must accurately quantify the effect of the propagation of uncertainties during upscaling. Using a Bayesian approach, we calibrate a small-scale solid sorbent model to thermogravimetric (TGA) data on a functional profile using chemistry-based priors. Crucial to this effort is the representation of model discrepancy, which uses a Bayesian smoothing splines (BSS-ANOVA) framework. Our uncertainty quantification (UQ) approach could be considered intrusive as it includes the discrepancy function within the chemical rate expressions; resulting in a set of stochastic differential equations. Such an approach allows for easily propagating uncertainty by propagating the joint model parameter and discrepancy posterior into the larger-scale system of rate expressions. In conclusion, the broad UQ framework presented here could be applicable to virtually all areas of science where multiscale modeling is used. Supplementary materials for this article are available online.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Calculating Interval Uncertainties for Calibration Standards That Drift with Time

Calibrated values of many devices exhibit predictable drift over time. To provide an uncertainty statement valid over the entire calibration interval, one must account for drift. In this article, a method of accounting for drift is proposed based on guidance in the Guide to Expression of Uncertainty in Measurement. An additional uncertainty term is computed using a linear regression of historical measurement data, which is included along with the time-of-test uncertainty. This method is evaluated by analyzing its average out-of-tolerance (OOT) rate using a Monte Carlo simulation, which results in the desired 5% average OOT rate when the total uncertainty is expanded to a 95% confidence interval.

47 OTHER INSTRUMENTATION↗

Recent advances in the quantification of uncertainties in reaction theory

Uncertainty quantification has become increasingly more prominent in nuclear physics over the past several years. In few-body reaction theory, there are four main sources that contribute to the uncertainties in the calculated observables: the effective potentials, approximations made to the few-body problem, structure functions, and degrees of freedom left out of the model space. In this work, we illustrate some of the features that can be obtained when modern statistical tools are applied in the context of nuclear reactions. This work consists of a summary of the progress that has been made in quantifying theoretical uncertainties in this domain, focusing primarily on those uncertainties coming from the effective optical potential as well as their propagation within various reaction theories. We use, as the central example, reactions on the doubly-magic stable nucleus 40 Ca, namely neutron and proton elastic scattering and single-nucleon transfer 40 Ca(d,p) 41 Ca. First, we show different optimization schemes used to constrain the optical potential from differential cross sections and other experimental constraints; we then discuss how these uncertainties propagate to the transfer cross section, comparing two reaction theories. Finally, we finish by laying out our future plans.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Robust two-colour pyrometry uncertainty analysis to acquire spatially-resolved measurements

Two-colour pyrometry (2CP) has been used over several decades to study engine-relevant combustion processes, but results are generally regarded as qualitative or semi-quantitative. In many current 2CP systems, large measurement errors are introduced by parallax because the two measured wavelengths are not from the same line of sight. Here this work presents a spatially-resolved 2CP system with the objective of quantifying and reducing measurement uncertainty. An optical setup that eliminates parallax in 2CP is used together with pixel-by-pixel calibration of the camera sensor to increase measurement accuracy. Primary uncertainty terms are identified, and an error propagation analysis is performed to compute uncertainties in the final results of soot temperature, soot concentration parameter, KL, and soot mass. These methodologies are applied to investigate an auto-igniting fuel spray in a constant pressure flow rig at diesel-like conditions of high ambient pressure and temperature. Results show bias uncertainty of around 200 K (≈10%) for temperature and about 40%–60% for KL. High uncertainty was found to occur on the diffusion flame front where both optical thickness and soot concentrations are small. However, these uncertain measurement zones with relatively low soot concentrations contribute minimally to the total soot mass present in the reacting jet during the temporal evolution of the flame.

42 ENGINEERING↗

Disaggregating measurement uncertainty from population variability and Bayesian treatment of uncensored results

In making low-level radioactivity measurements of populations, it is commonly observed that a substantial portion of net results are negative. Furthermore, the observed variance of the measurement results arises from a combination of measurement uncertainty and population variability. This paper presents a method for disaggregating measurement uncertainty from population variability to produce a probability density function (PDF) of possibly true results. To do this, simple, justifiable, and reasonable assumptions are made about the relationship of the measurements to the measurands (the 'true values'). The measurements are assumed to be unbiased, that is, that their average value is the average of the measurands. Using traditional estimates of each measurement's uncertainty to disaggregate population variability from measurement uncertainty, a PDF of measurands for the population is produced. Then, using Bayes's theorem, the same assumptions, and all the data from the population of individuals, a prior PDF is computed for each individual's measurand. These PDFs are non-negative, and their average is equal to the average of the measurement results for the population. The uncertainty in these Bayesian posterior PDFs is all Berkson with no remaining classical component. The methods are applied to baseline bioassay data from the Hanford site. The data include 90Sr urinalysis measurements on 128 people, 137Cs in vivo measurements on 5,337 people, and 239Pu urinalysis measurements on 3,270 people. The method produces excellent results for the 90Sr and 137Cs measurements, since there are nonzero concentrations of these global fallout radionuclides in people who have not been occupationally exposed. The method does not work for the 239Pu measurements in non-occupationally exposed people because the population average is essentially zero.

61 RADIATION PROTECTION AND DOSIMETRY↗

Majorization formulation of uncertainty in quantum mechanics

Heisenberg's uncertainty principle is formulated for a set of generalized measurements within the framework of majorization theory, resulting in a partial uncertainty order on probability vectors that is stronger than those based on quasientropic measures. The theorem that emerges from this formulation guarantees that the uncertainty of the results of a set of generalized measurements without a common eigenstate has an inviolable lower bound which depends on the measurement set but not the state. A corollary to this theorem yields a parallel formulation of the uncertainty principle for generalized measurements corresponding to the entire class of quasientropic measures. Optimal majorization bounds for two and three mutually unbiased bases in two dimensions are calculated. Similarly, the leading term of the majorization bound for position and momentum measurements is calculated which provides a strong statement of Heisenberg's uncertainty principle in direct operational terms. Another theorem provides a majorization condition for the least-uncertain generalized measurement of a given state with interesting physical implications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Theoretical uncertainty quantification for heavy-ion fusion

Despite recent advances and focus on rigorous uncertainty quantification for microscopic models of quantum many-body systems, the uncertainty on the dynamics of those systems has been underexplored. To address this, we have used time-dependent Hartree-Fock to examine the model uncertainty for a collection of low-energy, heavy-ion fusion reactions. Fusion reactions at near-barrier energies represent a rich test-bed for the dynamics of quantum many-body systems owing to the complex interplay of collective excitation, transfer, and static effects that determine the fusion probability of a given system. The model uncertainty is sizable for many of the systems studied and the primary contribution arises from static properties that are ill-constrained, such as the neutron radius of neutron-rich nuclei. Furthermore, these large uncertainties motivate the use of information from reactions to better constrain existing models and to infer static properties from reaction data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Complete quantification of parametric uncertainties in ( d , p ) transfer reactions

Deuteron-induced transfer reactions are a popular probe in nuclear structure and nuclear astro physics studies. The interpretation of these transfer measurements relies on reaction theory that takes as input effective interactions between the nucleons and the target nucleus. Previous work quantified the uncertainty associated with the optical potentials between the nucleons and the target. In this study, we extend that work by also including the parameters of the mean field associated with the overlap function of the final bound state, thus obtaining the full parametric uncertainty on transfer observables. We use Bayesian Markov Chain Monte Carlo simulations to obtain parameter posterior distributions. We use elastic-scattering cross sections to constrain the optical potential parameters and use the asymptotic normalization coefficient of the final state to constrain the bound state interaction. We then propagate these posteriors to the transfer angular distributions and obtain confidence intervals for this observable. We study (d,p) reactions on 14 C, 16 O, and 48 Ca at energies in the range $E$ $d$ = 7 - 24 MeV. Our results show a strong reduction in uncertainty by using the asymptotic normalization coefficient as a constraint, particularly for those reactions most sensitive to ambiguities in the mean field. For those reactions, the importance of constraining the bound state interaction is equal to that of constraining the optical potentials. Furthermore, the case of 14 C is an outlier because the cross section is less sensitive to the nuclear interior. When minimal constraints are used on the parameters of the nucleon-target interaction, the 1σ uncertainties on the differential cross sections are large (~ 500-100%). However, if elastic-scattering data and the asymptotic normalization coefficient are used in the analysis, with an error of 10% (5%), this uncertainty reduces to ~ 30% (~ 15%).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Direct Comparison between Bayesian and Frequentist Uncertainty Quantification for Nuclear Reactions

Until recently, uncertainty quantification in low energy nuclear theory was typically performed using frequentist approaches. However in the last few years, the field has shifted toward Bayesian statistics for evaluating confidence intervals. Although there are statistical arguments to prefer the Bayesian approach, no direct comparison is available. In this work, we compare, directly and systematically, the frequentist and Bayesian approaches to quantifying uncertainties in direct nuclear reactions. Starting from identical initial assumptions, we determine confidence intervals associated with the elastic and the transfer process for both methods, which are evaluated against data via a comparison of the empirical coverage probabilities. Expectedly, the frequentist approach is not as flexible as the Bayesian approach in exploring parameter space and often ends up in a different minimum. We also show that the two methods produce significantly different correlations. In the end, the frequentist approach produces significantly narrower uncertainties on the considered observables than the Bayesian. Lastly, our study demonstrates that the uncertainties on the reaction observables considered here within the Bayesian approach represent reality more accurately than the much narrower uncertainties obtained using the standard frequentist approach.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Characterizing Interaction Uncertainty in Human-Machine Teams

With the increasing use and adoption of artificial intelligence (AI), the reliability of modern data systems will be driven by a tighter teaming between human experts and intelligent machine teammates. As in the case of human-human teams, the success of human-machine teams will also rely on clear communication about mutual goals and actions. In this paper, we combine related literature from cognitive psychology, human-machine teaming, uncertainty in data analysis, and multi-agent systems to propose a new form of uncertainty: interaction uncertainty for characterizing bidirectional communication in human-machine teams. We map the causes and effects of interaction uncertainty and outline potential ways to mitigate uncertainty for mutual trust in a high-consequence real-world scenario.

uncertainty, data analytics, interaction, trust, h↗

Navigating Uncertainty: Challenges in Visualizing Ensemble Data and Surrogate Models for Decision Systems

Uncertainty visualization plays a critical role in transforming ensemble simulation data into actionable insights by effectively communicating various dimensions of uncertainty within a system. The emergence of artificial intelligence-driven surrogate models trained on multirun ensemble data offers a transformative opportunity to replace computationally intensive simulations with fast estimates, enabling users to explore data spaces with unprecedented depth and interactivity. However, integrating ensemble data and surrogate models into decision-making workflows and tools introduces novel challenges for uncertainty visualization. These include reconciling and clearly communicating the unique uncertainties associated with ensembles and their surrogate model estimates, and leveraging these approximations to inform actionable decisions. This work explores these challenges in the context of high-dimensional data visualization, bridging discrete datasets with their continuous representations and addressing the complexities of systems that support iterative navigation between input and output spaces. We evaluate the role of uncertainty visualization in fostering intuitive, actionable interactions and identify critical hurdles in advancing this frontier of computational simulation.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models

Uncertainty visualization is a key component in translating important insights from ensemble simulation data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models trained on ensemble data, we can substitute computationally expensive simulations, which allows users to interact with more aspects of data spaces than ever before. However, the use of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble data↗

Carbon cycle confidence and uncertainty: Exploring variation among soil biogeochemical models

Emerging insights into factors responsible for soil organic matter stabilization and decomposition are being applied in a variety of contexts, but new tools are needed to facilitate the understanding, evaluation, and improvement of soil biogeochemical theory and models at regional to global scales. To isolate the effects of model structural uncertainty on the global distribution of soil carbon stocks and turnover times we developed a soil biogeochemical testbed that forces three different soil models with consistent climate and plant productivity inputs. The models tested here include a first-order, microbial implicit approach (CASA-CNP), and two recently developed microbially explicit models that can be run at global scales (MIMICS and CORPSE). When forced with common environmental drivers, the soil models generated similar estimates of initial soil carbon stocks (roughly 1,400 Pg C globally, 0–100 cm), but each model shows a different functional relationship between mean annual temperature and inferred turnover times. Subsequently, the models made divergent projections about the fate of these soil carbon stocks over the 20th century, with models either gaining or losing over 20 Pg C globally between 1901 and 2010. Single-forcing experiments with changed inputs, temperature, and moisture suggest that uncertainty associated with freeze-thaw processes as well as soil textural effects on soil carbon stabilization were larger than direct temperature uncertainties among models. Finally, the models generated distinct projections about the timing and magnitude of seasonal heterotrophic respiration rates, again reflecting structural uncertainties that were related to environmental sensitivities and assumptions about physicochemical stabilization of soil organic matter. Here, by providing a computationally tractable and numerically consistent framework to evaluate models we aim to better understand uncertainties among models and generate insights about factors regulating the turnover of soil organic matter.

54 ENVIRONMENTAL SCIENCES↗