Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Characterizing the Uncertainty of Measurement of Traceable Isotope Ratios with Bayesian Statistical Techniques

Analytical techniques such as multicollector—inductively coupled plasma—mass spectrometry (MC-ICP-MS) are routinely employed at SRNL, other National Laboratories, and in academia to determine the precise isotopic composition of diverse natural and anthropogenic samples (e.g., rocks and nuclear materials). Quantifying and reporting uncertainty in such analyses, while regularly performed, have a rigorous statistical foundation. The Guide to the Expression of Uncertainty in Measurement 4 (GUM) outlines conventional techniques used to assess such uncertainty. As the accessibility and speed of statistical computing increase, there is a need to modernize conventional techniques. For example, Supplement 1 to the 3rd to the GUM suggests the use of approximation methods as an updated approach to the GUM.

McLarty, Ellis C.↗
DOE OSTI2023

Improving and Assessing the Quality of Uncertainty Quantification in Deep Learning

Deep learning (DL) models have enjoyed increased attention in recent years because of their powerful predictive capabilities. While many successes have been achieved, standard deep learning methods suffer from a lack of uncertainty quantification (UQ). While the development of methods for producing UQ from DL models is an active area of current research, little attention has been given to the quality of the UQ produced by such methods. In order to deploy DL models to high-consequence applications, high-quality UQ is necessary. This report details the research and development conducted as part of a Laboratory Directed Research and Development (LDRD) project at Sandia National Laboratories. The focus of this project is to develop a framework of methods and metrics for the principled assessment of UQ quality in DL models. This report presents an overview of UQ quality assessment in traditional statistical modeling and describes why this approach is difficult to apply in DL contexts. An assessment on relatively simple simulated data is presented to demonstrate that UQ quality can differ greatly between DL models trained on the same data. A method for simulating image data that can then be used for UQ quality assessment is described. A general method for simulating realistic data for the purpose of assessing a model’s UQ quality is also presented. A Bayesian uncertainty framework for understanding uncertainty and existing metrics is described. Research that came out of collaborations with two university partners are discussed along with a software toolkit that is currently being developed to implement the UQ quality assessment framework as well as serve as a general guide to incorporating UQ into DL applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Optical potential uncertainties on exclusive tens-of-MeV Ar cross sections

Large liquid argon time projection chamber (LArTPC) neutrino detectors, such as those planned for the Deep Underground Neutrino Experiment (DUNE), show considerable promise as a platform for next-generation measurements of supernova neutrinos. Thanks to the neutron excess in $^{40}$Ar as well as the detailed tracking possible with LArTPCs, these detectors are expected to be uniquely capable of measuring supernova electron neutrinos with high statistics and minimal backgrounds. However, these technological advantages come at the price of complexities in data interpretation; reconstruction of the incident energies of supernova neutrinos in a future LArTPC-based analysis will be subject to a variety of systematic uncertainties related to nuclear interaction modeling. In this talk, we present a study of a subset of these uncertainties as implemented in the MARLEY event generator used by DUNE and other LArTPC neutrino experiments. Variations to the optical potential used in the MARLEY nuclear de-excitation model are applied to the calculation of exclusive tens-of-MeV neutrino-nucleus cross sections for the first time, and the impact on observables of interest for supernova neutrino detection is examined. We also discuss prospects for quantifying other sources of uncertainty on the MARLEY neutrino interaction model.

El-Haj, Luca Abu↗
DOE OSTI2023

Model-based quantification of margins and uncertainties in metal additive manufacturing for process design and qualification

Laser powder bed fusion (LPBF) Additive Manufacturing (AM) has the potential to enable the production of components with novel designs and material properties unachievable otherwise. However, process repeatability is a challenge, making qualification ill-defined and greatly reducing the utility of what could be an important manufacturing technology. In this work, a combination of modeling, uncertainty quantification (UQ), and experimentation are used in an effort to predict and bound the range of possible outcomes of the LPBF process. Quantities of interest predicted are melt pool dimensions, microstructure features, and mechanical distortions. A combination of high fidelity thermal-fluid models, microstructure growth models, and reduced fidelity, rapid thermal and mechanical models are used. Uncertainty propagation techniques are used to predict probability distributions of quantities of interest from estimates of process uncertainties. Repeated experiments are done to quantify observed probability distributions and compared to predicted distributions to determine if predictions are precise and accurate. Novel modeling methods are microstrucutre characterization techniques are also discussed. It is found that high fidelity models do a generally good job bounding experimentally observed melt pool morphologies for both bead-on-plate and powder bed cases. Microstructure models are able to bound a number of experimentally observed microstructure statistics, but with low precision due to challenges with calibrating the microstructure growth model parameters. A developed modified inherent strain distortion model does not accurately predict observed distortions. A lumped laser distortion model shows promise in being both accurately and precisely bounding observed outcomes from the deflection comb build, but requires further evaluation on more builds and geometries.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Uncertainty Quantification and Sensitivity Analysis of Low-Dimensional Manifold via Co-Kurtosis PCA in Combustion Modeling

For multi-scale multi-physics applications e.g., the turbulent combustion code Pele, robust and accurate dimensionality reduction is crucial to solving problems at exascale and beyond. A recently developed technique, Co-Kurtosis based Principal Component Analysis (CoK-PCA) which leverages principal vectors of co-kurtosis, is a promising alternative to traditional PCA for complex chemical systems. To improve the effectiveness of this approach, we employ Artificial Neural Networks for reconstructing thermo-chemical scalars, species production rates, and overall heat release rates corresponding to the full state space. Our focus is on bolstering confidence in this deep learning based non-linear reconstruction through Uncertainty Quantification (UQ) and Sensitivity Analysis (SA). UQ involves quantifying uncertainties in inputs and outputs, while SA identifies influential inputs. One of the noteworthy challenges is the computational expense inherent in both endeavors. To address this, we employ the Monte Carlo methods to effectively quantify and propagate uncertainties in our reduced spaces while managing computational demands. Our research carries profound implications not only for the realm of combustion modeling but also for a broader audience in UQ. By showcasing the reliability and robustness of CoK-PCA in dimensionality reduction and deep learning predictions, we empower researchers and decision-makers to navigate complex combustion systems with greater confidence.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Assessing Uncertainty in Modeling Stress Corrosion Cracking

This report summarizes the collaboration between Sandia National Laboratories (SNL) and the Nuclear Regulatory Commission (NRC) to improve the state of knowledge on chloride induced stress corrosion cracking (CISCC). The foundation of this work relied on using SNL’s CISCC computer code to assess the current state of knowledge for probabilistically modeling CISCC on stainless steel canisters. This work is presented as three tasks. The first task is exploring and independently comparing crack growth rate (CGR) models typically used in CISCC modeling by the research community. The second task is implementing two of the more conservative CGR models from the first task into SNL’s full CISCC code to understand the impact of the different CGR models on a full probabilistic analysis while studying uncertainty from three key input parameters. The combined work of the first two tasks showed that properly measuring salt deposition rates is impactful to reducing uncertainty when modeling CISCC. The work in Task 2 also showed how probabilistic CGR models can be more appropriate at capturing aleatory uncertainty when modeling SCC. Lastly, appropriate and realistic input parameters relevant for CISCC modeling were documented in the last task as a product of the simulations considered in the first two tasks.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Theoretical and methodological challenges in hierarchical Bayesian inference for model-form uncertainty

This report describes challenges associated with the hierarchical Bayesian approach to inform model-form uncertainty (MFU) representations, which are parameterized modifications to a mathematical models’ governing equations to express uncertainty in form of the equations. To inform model-form uncertainties, hierarchical Bayesian inference is often employed. Here, the MFU parameters are distributed parametrically, and the hyperparameters of the parametric distribution are informed through Bayesian inference, with the aim of determining the MFU parameter distribution that best agrees with calibration data. In practice, however, we have found the hierarchical Bayesian approach falls short of this aim. We discuss theoretical and methodological challenges of the approach, and we present several numerical demonstrations of these challenges. To conclude, we suggest promising alternative approaches for future investigation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Uncertainty and Sensitivity Analysis Methods and Applications in the GDSA Framework (FY2025)

The Spent Fuel and Waste Science and Technology Campaign (SFWST) of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE) is conducting research and development on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two priorities for SFWST are design concept development and disposal system modeling. These priorities are directly addressed in the Geologic Disposal Safety Assessment (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, GDSA Framework, for evaluating disposal system performance for nuclear waste in geologic media. This report describes specific activities in the Fiscal Year (FY) 2025 associated with the GDSA Uncertainty and Sensitivity Analysis Methods work package. This report fulfills the GDSA Uncertainty and Sensitivity Analysis Methods work package (SF-25SN01030407) level 3 milestone, Uncertainty and Sensitivity Analysis Methods and Applications in GDSA Framework (FY2025) (M3SF-25SN010304072). This work was closely coordinated with the other Sandia National Laboratory GDSA work packages: the GDSA Framework Development work package (SF-25SN01030408), the GDSA Repository Systems Analysis work package (SF-25SN01030409), and the GDSA PFLOTRAN Development work package (SF-25SN01030410). This report builds on developments reported in previous GDSA Framework milestones, particularly M3SF-24SN010304072.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Uncertainty Quantification for Smooth Functional Data with Application to Material Properties

This document outlines a method for processing functional output (i.e., curves) for the ultimate purpose of sampling curves under specified input conditions for use in modeling and simulation uncertainty quantification (UQ) studies. A set of benchmark curves sufficiently representative of the relevant scenario(s) being simulated are provided to the process and formatted as described in Section 1. Principal Component Analysis (PCA) is utilized to discover the components of uncertainty in the benchmark curves and is outlined in Section 2. Section 3 describes the application of uncertainty quantification to the PCA results for the purpose of sampling curves to be used in UQ analysis. Section 4 applies these techniques to an example benchmark dataset. Concluding remarks are provided in the final section.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Quantifying Uncertainties in Earth's Energy Budget by Cloud Feedback and Ocean Heat Uptake Using E3SM-Slab Ocean Configurations

In order to improve predictive skills of Earth System Model, we need to better understand processes that control Earth's energy budget via ocean, atmosphere, and cryosphere interactions. Simulated energy budget in comprehensive Earth System Models shows a wide range, leading to large uncertainties in predicting Earth system dynamic and thermodynamic variations and associated social-economic impacts. Uncertainties in cloud feedbacks have been identified as the main cause of the large inter-model spread, but oceanic adjustments, especially those associated with ocean heat uptake (OHU) and the Atlantic Meridional Overturning Circulation (AMOC), also play an important role. In this proposed work, we focus on understanding the individual and combined roles of cloud feedbacks and ocean adjustments on modulating Earth's energy balance. This research is motivated by our overarching hypothesis that oceanic adjustment is a key source of uncertainty, in addition to those associated with the cloud feedbacks; further, the ocean adjustment and associated OHU work through the cloud feedbacks to modulate Earth's energy budget and temperature variations. We test this hypothesis using numerical experiments where we systematically enable and disable cloud feedbacks in conjunction with perturbations to OHU.

58 GEOSCIENCES↗
DOE OSTI2025

NUMI Flux Systematic Uncertainties

The Imaging Cosmic And Rare Underground Signals (ICARUS) detector is a 476 t active liquid argon time projection chamber neutrino detector at Fermilab. ICARUS lies 795 m downstream and 5.75◦ off-axis from the Neutrinos at the Main Injector (NuMI) beam. To create a neutrino beam NuMI directs pulsed beam of 120 GeV protons onto a graphite target to create hadrons, which are then focused by magnetic horns and allowed to decay into neutrinos. At the ICARUS off-axis angle the neutrino flux originates from the decays of unfocused/antifocused pions decays and from high-transverse momentum kaon decays. These contributions allow ICARUS to observe a significant flux of (anti-)electron and (anti-)muon neutrinos in a kinematic region relevant to the upcoming DUNE experiment. These factors also introduce various model uncertainties that have not been studied in detail by existing on-axis experiments. This poster will explore the systematic uncertainties in the NuMI flux at ICARUS that arise from uncertainties on hadron interaction cross sections and beamline operation conditions.

Alrahman, Fatima Abd [Houston U.]↗
DOE OSTI2026

Uncertainty quantification for inverse problems with application to ptychographic reconstruction

Inverse problems in imaging are commonly solved by optimization or learned surrogates that return a single reconstruction, while uncertainty information is often unavailable. In many experimental settings, however, uncertainty is required to assess reliability, guide downstream analysis, and prioritize additional measurements. In this note, we present a compact uncertainty-quantification framework based on local objective curvature, and then specialize it to ptychographic reconstruction. We further show how repeated reconstructions can be aggregated in a statistically principled way, including a practical implementation path for PtychoNN.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Extension of SCALE/Sampler’s sensitivity index for the assessment of cross section, fission yield, and decay data uncertainties

Accurate prediction of nuclide compositions and neutron and gamma sources and spectra for fresh and spent nuclear fuel through computational modeling and simulations is the basis for safeguards instruments design, optimization, and calibration, and for validation of the measured responses. The accuracy of these simulations can be significantly impacted by uncertainties in input parameters to the applied computer code. Input parameters are, for example, dimensions, material compositions, and temperatures of the model. Additionally, important but sometimes neglected input parameters for simulations of nuclear systems are the nuclear data that include nuclear reaction cross sections, fission product yields, and decay data. It has been shown that uncertainties of calculated results are dominated by uncertainties of these nuclear data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Quantum surrogate models for uncertainty quantification

Surrogate models are a critical ingredient to computation-based design and validation of many DOE mission-relevant physical systems. When first-principles computation of properties of a physical systems becomes pro hibitive, surrogate models are the only path towards achieving tasks such as uncertainty quantification (UQ), exploration of design space, and validation of design choices. In this project we have developed and demonstrated a new surro gate modeling paradigm for complex models that is data-driven, non-intrusive, and has the potential to be versatile and equipped with performance guaran tees. This combination of features is absent in existing surrogate modeling tools. The framework we have developed in this project exploits a quantum-classical correspondence to establish a quantum system that mimics the dynamics of the classical Hamiltonian system from which data in the form of temporal snapshots is provided. Since quantum dynamics propagates distributions over observables, the framework is naturally suited to propagation of epistemic uncertainties in the form of distributions over initial state and parametric uncertainties. In this project, we take the first step in establishing this novel framework by deriving a quantization and de-quantization procedure, demonstrating the accuracy of the quantum surrogate models these define using two model systems, and defining the next steps in maturing the framework towards a tool applicable to Sandia mission-relevant problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Micro2Macro: Origins of Climate Change Uncertainty

Where we are: Global Earth system models (ESMs) are essential tools for seasonal-to decadal environmental predictions, which decision-makers across government and industry require. However, uncertainties originating at the microphysical scale, i.e., in processes occurring on scales smaller than typical ESM grid boxes, remain a major challenge. While resolution continues to improve in our predictive models, we will need to parameterize microphysical processes that contribute the bulk of prediction uncertainty for the foreseeable future. Microphysical uncertainties contribute broadly to remaining limitations on Earth system predictability on seasonal and decadal time scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Prioritizing Uncertainties in Hydrogen Contribution to Risk in Post-Crash Outcomes for Rail

This report presents analysis from Sandia National Laboratories predicting contributions to risk associated with the use of hydrogen technology for rail. Event sequence diagrams are used to describe possible accident scenarios and progressions. Initiating event frequencies and branch event probabilities for each scenario are quantified with uncertainty using distributions fit to Federal Railroad Administration and U.S. Department of Transportation Pipeline and Hazardous Materials Safety Administration data on applicable accidents from 2000 to 2020. Uncertainty is propagated through the event sequence diagram to estimate the frequency and conditional probability of accident end states. The analysis identifies four scenarios with significant contributions to risk from hydrogen that are predicted to occur relatively frequently, which may inform priorities for reducing uncertainty. These scenarios are 1) overpressure events resulting from collisions with hydrogen release due to mechanical damage and delayed ignition, 2) jet fire events resulting from collisions with hydrogen release due to mechanical damage and immediate ignition, 3) jet fires resulting from fire or explosion initiating events involving the hydrogen tank and correct operation of the thermally-activated pressure relief device (TPRD) subsequent to the thermal insult, and 4) pressure burst resulting from fire or explosion initiating events involving the hydrogen tank and failure of the TPRD. Delayed and immediate hydrogen ignition probabilities are identified as being highly uncertain and potential candidates for reducing conservatism in the predicted frequencies for these two scenarios.

08 HYDROGEN↗
DOE OSTI2020

Systematic Uncertainties of the NOvA Neutrino Oscillation Analysis

NOvA is a two detector long-baseline neutrino oscillation experiment using Fermilab’s 700 kW NuMI muon neutrino beam. It studies the disappearance of muon (anti)neutrinos and the appearance of electron (anti)neutrinos in the beam over a distance of 810 km between the detectors. The observations can be used to constrain neutrino oscillation parameters: $\theta_{23}, \Delta m_{32}^2$ and $\delta_{CP}$ in the standard 3 active neutrinos paradigm. Although statistical uncertainties currently dominate in these measurements, understanding the major sources of systematic uncertainties and their correlations is vital for both the interpretation and precision of the results and also for further improvements of the analysis. This note presents details of the systematic uncertainties affecting NOvA's neutrino oscillation analysis results and how we evaluate them by generating systematically shifted predictions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Robust Control of Wave Energy Converters Using Unstructured Uncertainty

In the design of ocean wave energy converters, proper control design is essential to the maximization of the power generation performance for the device. However, in realistic applications, this control design must be undertaken in the presence of model uncertainty. This paper considers the use of robust control theory to optimize the nominal performance for a wave energy converter in stochastic waves, subject to the constraint that the controller be stability-robust to unstructured uncertainties. We formulate the problem as a multi-objective optimal control problem, in which the primary objective is the maximization of power generation for the nominal system, and the competing objective is the norm of the uncertainty input/output channel. This optimal control problem is nonconvex, and we therefore propose an iterative algorithm that can be used to arrive at a local optimal solution. This iterative approach employs the concept of Iterative Convex Overbounding, in the context of the classical Method of Centers. Here, the methodology is demonstrated on a model of a single, buoy- type wave energy converter.

16 TIDAL AND WAVE POWER↗