SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Dakota, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis: Version 6.13 User's Manual

The Dakota toolkit provides a flexible and extensible interface between simulation codes and iterative analysis methods. Dakota contains algorithms for optimization with gradient and nongradient-based methods; uncertainty quantification with sampling, reliability, and stochastic expansion methods; parameter estimation with nonlinear least squares methods; and sensitivity/variance analysis with design of experiments and parameter study methods. These capabilities may be used on their own or as components within advanced strategies such as surrogate-based optimization, mixed integer nonlinear programming, or optimization under uncertainty. By employing object-oriented design to implement abstractions of the key components required for iterative systems analyses, the Dakota toolkit provides a flexible and extensible problem-solving environment for design and performance analysis of computational models on high performance computers. This report serves as a user’s manual for the Dakota software and provides capability overviews and procedures for software execution, as well as a variety of example studies.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Science and Engineering of Cybersecurity by Uncertainty quantification and Rigorous Experimentation (SECURE) (Final Report)

This report summarizes the activities performed as part of the Science and Engineering of Cybersecurity by Uncertainty quantification and Rigorous Experimentation (SECURE) Grand Challenge LDRD project. We provide an overview of the research done in this project, including work on cyber emulation, uncertainty quantification, and optimization. We present examples of integrated analyses performed on two case studies: a network scanning/detection study and a malware command and control study. We highlight the importance of experimental workflows and list references of papers and presentations developed under this project. We outline lessons learned and suggestions for future work.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Dakota, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis: Version 6.15 User's Manual

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Nuclear Data to Reduce Uncertainties in Reactor Antineutrino Measurements

The large quantities of antineutrinos produced through the decay of fission fragments in nuclear reactors provide an opportunity to study the properties of these particles and investigate their use in reactor monitoring. The reactor antineutrino spectra are measured using specialized, large area detectors that detect antineutrinos through inverse beta decay, electron elastic scattering, or coherent elastic neutrino nucleus scattering; although, inverse beta decay is the only demonstrated method so far. Reactor monitoring takes advantage of the differences in the antineutrino yield and spectra resulting from uranium and plutonium fission providing an opportunity to estimate the fissile material composition in the reactor. Recent experiments reveal a deviation between the measured and calculated antineutrino flux and spectra (the reactor anomaly) indicating either the existence of yet undiscovered neutrino physics, uncertainties in the reactor source term calculation, incorrect nuclear data, or a combination of all three. To address the nuclear data that impact the antineutrino spectrum calculations and measurements, an international group of over 180 experts in antineutrino physics, reactor analysis, detector development, and nuclear data came together during the Workshop on Nuclear Data for Reactor Antineutrino Measurements (WoNDRAM) to discuss nuclear data needs and achieve concordance on a set of recommended priorities for nuclear data improvements. Three topical sessions focused on the reactor source term, the antineutrino spectrum, and the detector response, provided a forum to gain consensus amongst the participants on the most important data improvements to address two goals: 1) understand the reactor anomaly and 2) improve the ability to monitor reactors using antineutrinos. This report summarizes the outcomes of the workshop discussions and the recommendations for nuclear data efforts that reduce reactor antineutrino measurement uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

Dakota, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis (V.6.16 User's Manual)

The Dakota toolkit provides a flexible and extensible interface between simulation codes and iterative analysis methods. Dakota contains algorithms for optimization with gradient and nongradient-based methods; uncertainty quantification with sampling, reliability, and stochastic expansion methods; parameter estimation with nonlinear least squares methods; and sensitivity/variance analysis with design of experiments and parameter study methods. These capabilities may be used on their own or as components within advanced strategies such as surrogate-based optimization, mixed integer nonlinear programming, or optimization under uncertainty. By employing object-oriented design to implement abstractions of the key components required for iterative systems analyses, the Dakota toolkit provides a flexible and extensible problem-solving environment for design and performance analysis of computational models on high performance computers. This report serves as a user's manual for the Dakota software and provides capability overviews and procedures for software execution, as well as a variety of example studies.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Parameter Calibration for Johnson Cook and Preston-Tonks-Wallace Material Strength Models with Uncertainty Quantification

In this study we perform a Bayesian calibration of the parameters in the Johnson Cook (JC) material strength model, with uncertainty, using experiments with for a range of low and medium strain rates. For the parameter calibration, we used a variational Bayesian approach with experimental data from Hopkinson bar and quasi-static tests done on Oxygen Free High Conductivity (OFHC) copper. The estimated parameter values matched well with experimental data for a modest range of strain rates and temperatures. Through this method, we also recovered uncertainty and correlation information for the estimated parameter values. We also compared our results to a calibration of parameters in the Preston-Tonks-Wallace (PTW) material strength model, using the same variational Bayesian method. The parameters estimated for both models provided good agreement with the experimental data.

36 MATERIALS SCIENCE↗

DOE OSTI2022

The Impact of Specificity on Human Interpretations of State Uncertainty

The goal of this project was test how different representations of state uncertainty impact human decision making. Across a series of experiments, we sought to answer fundamental questions about human cognitive biases and how they are impacted by visual and numerical information. The results of these experiments identify problems and pitfalls to avoid when for presenting algorithmic outputs that include state uncertainty to human decision makers. Our findings also point to important areas for future research that will enable system designers to minimize biases in human interpretation for the outputs of artificial intelligence, machine learning, and other advanced analytic systems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

A Decision Theoretic Approach To Optimizing Machine Learning Decisions with Prediction Uncertainty

While the use of machine learning (ML) classifiers is widespread, their output is often not part of any follow-on decision-making process. To illustrate, consider the scenario where we have developed and trained an ML classifier to find malicious URL links. In this scenario, network administrators must decide whether to allow a computer user to visit a particular website, or to instead block access because the site is deemed malicious. It would be very beneficial if decisions such as these could be made automatically using a trained ML classifier. Unfortunately, due to a variety of reasons discussed herein, the output from these classifiers can be uncertain, rendering downstream decisions difficult. Herein, we provide a framework for: (1) quantifying and propagating uncertainty in ML classifiers; (2) formally linking ML outputs with the decision-making process; and (3) making optimal decisions for classification under uncertainty with single or multiple objectives.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Preliminary Results for Using Uncertainty and Out-of-distribution Detection to Identify Unreliable Predictions.

As machine learning (ML) models are deployed into an ever-diversifying set of application spaces, ranging from self-driving cars to cybersecurity to climate modeling, the need to carefully evaluate model credibility becomes increasingly important. Uncertainty quantification (UQ) provides important information about the ability of a learned model to make sound predictions, often with respect to individual test cases. However, most UQ methods for ML are themselves data-driven and therefore susceptible to the same knowledge gaps as the models themselves. Specifically, UQ helps to identify points near decision boundaries where the models fit the data poorly, yet predictions can score as certain for points that are under-represented by the training data and thus out-of-distribution (OOD). One method for evaluating the quality of both ML models and their associated uncertainty estimates is out-of-distribution detection (OODD). We combine OODD with UQ to provide insights into the reliability of the individual predictions made by an ML model.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Approach to Analyzing VTR Core Performance Sensitivities to Fuel Manufacturing Uncertainties and Application to Fuel Slug Diameter

This report documents the initial effort to characterize sensitivity of VTR core performance to fuel manufacturing uncertainties. The effects of variation in the as-fabricated fuel slug diameter on VTR neutronics performance are evaluated, using both high-fidelity Monte Carlo (OpenMC) and the main core design solver (DIF3D) for all cases. This work and follow-on work will inform the VTR Project’s fuel manufacturing processes and associated acceptable criteria, as well as detailed uncertainty analysis in later stages of VTR development and deployment. In addition, this work demonstrates the approach to performing such evaluations and provides a basis for reducing the scope of calculations in future sensitivity analysis.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2021

Uncertainty Analysis for a Criticality Benchmark [Slides]

This presentation discusses how KRUSTY was analyzed with LANL’s MCNP neutron transport code, Monte Carlo N-Particle. In the Monte Carlo method, neutrons are born in fission events and fly around the geometry having events (e.g., scatter, capture, fission, escape) according to the natural probabilities. “Natural probabilities” are given as neutron cross sections , which are measured and evaluated nuclear data. One of the goals of the benchmark project is to improve the nuclear cross sections (and the codes that use them). In this work, the response of interest is called k eff , which describes the neutron multiplication in a near critical system. Like most quantities, k eff is not measured directly; it is only inferred. In summation, MCNP results for k eff matched the measurements extremely well. The evaluated uncertainties are asymmetric and smaller than 0.00100 (e.g., + 0.00080 / – 0.00062). The largest uncertainties are due to alignment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Harnessing Uncertainty through Functional Data Analysis in Gas Breakthrough Data

Detecting subsurface explosions from radionuclide gas migration through rock fractures is an effective way to identify nuclear activity. Los Alamos National Laboratory (LANL) has developed simulation methods, based on data from the 1962 Hardhat underground nuclear test, to predict gas breakthrough times at the surface. However, these methods rely on an imperfect understanding of the relationship between rock damage and fracture permeability. Our clinic project studies methods for predicting breakthrough curves that characterize total mass produced as a function of time, as well as quantifying the uncertainty associated with these predictions. The model that is currently employed to relate damage to permeability uses an empirically motivated power-law expression, with a range of parameter values that are compatible with the experimental Hardhat data. We develop emulators, built from functional data analysis techniques and trained on simulation data, that rapidly predict the gas breakthrough curve given a damage field and given the parameter values of the power-law equation. Using Bayesian regression, we address the problem of uncertainty quantification in our emulators. Finally, in order to test the robustness of the model, we further validate it on a damage field representing different physical conditions.

58 GEOSCIENCES↗

DOE OSTI2022

Uncertainty Aware Deep Learning for Particle Accelerators

Standard deep learning models for classification and regression applications are ideal for capturing complex system dynamics. However, their predictions can be arbitrarily inaccurate when the input samples are not similar to the training data. Implementation of distance aware uncertainty estimation can be used to detect these scenarios and provide a level of confidence associated with their predictions. In this paper, we present results from using Deep Gaussian Process Approximation (DGPA) methods for errant beam prediction at Spallation Neutron Source (SNS) accelerator (classification) and we provide an uncertainty aware surrogate model for the Fermi National Accelerator Lab (FNAL) Booster Accelerator Complex (regression).

Rajput, Kishansingh↗

DOE OSTI2024

The Delicate Balance Redux: The Role of Nuclear Forces, Damage Limitation and Uncertainty in Future U.S.-China Crises

What is the impact of damage limitation capabilities like counterforce and missile defenses on deterrence, when their efficacy in stopping an adversary nuclear attack is uncertain? This is a key unanswered question to understand “how much is enough” for the United States to deter China and Russia in future nuclear crises. In this paper we extend an established, single move game theory model to capture the dynamics of two players in a nuclear crisis having varying damage limitation capabilities with uncertain effectiveness. Our model formalizes the logic of the “delicate balance” school of deterrence, which states that leverage in a crisis is driven by the risk each player can take with their combined strategic forces, and that those risks carry uncertainty as nuclear forces are hard to deliver against technologically advanced adversaries. Our model shows that damage limitation capabilities—even those with significant uncertainty around them like cyber or electronic warfare—can drive bargaining outcomes in an array of nuclear crises. We then apply these bargaining outcomes to the expected U.S.-China strategic balance as China builds out its nuclear force through 2035. We apply published force exchange models to determine the expected damage each side will be able to deliver, and we use these values to determine the likelihood that the U.S. can prevail in crises of varying stakes. Last, we show that U.S. policymakers have an array of options to improve future bargaining outcomes, evaluating how additional nuclear forces trade against improvements in damage limitation.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

DOE OSTI2020

Neutrino Interaction Model and Uncertainties for MicroBooNE Analyses

The MicroBooNE experiment is searching for an excess of electron-like events at low neutrino energy, as well as making the first high-statistics measurements of neutrino interactions on argon. Interpretation of these results requires a reliable model of neutrino interaction physics with well-motivated uncertainties. This note describes the neutrino interaction model and uncertainties adopted for use in MicroBooNE’s cross section measurements and low-energy excess search.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

Elimination LArTPC Simulation Uncertainty

Liquid Argon Time Projection Chambers (LArTPC) are essential for detecting muons and neutrinos by capturing electrons released during particle collisions, which drift toward wire planes under an electric field and induce currents measured to reconstruct particle paths. However, LArTPCs face challenges from effects such as electron-ion recombination, electron diffusion, and electron attenuation, complicating data simulation. The Short Baseline Neutrino (SNB) detector aims to measure neutrinos before oscillation occurs. To bridge the gap between simulation and actual data, we propose modifying the amplitude and width of signals on the TPC wires, addressing uncertainties by adjusting signal characteristics to better match observed data. A Gaussian fit to current waveforms produces hits with associated charge and width, and by comparing data and simulated values, discrepancies highlight areas where the model fails. Initial results indicate the current modification algorithm may increase divergence between simulation and data, necessitating further refinement. A discovered bug in the WireModMakeHist_plug.cpp file, which incorrectly computed simulation and data ratios, underscores the need for precise algorithm adjustments. Future work involves correcting code errors, fine-tuning the model, and conducting multiple simulation runs to enhance statistical confidence and reduce uncertainties, ultimately aiming for accurate LArTPC operation and reliable neutrino detection.

Mkrtchyan, Ka'ren↗

DOE OSTI2024

A Review of Parameter Ranges for Uncertainty Estimation for Decomposing Carbon Fiber Epoxy Composites

Carbon fiber epoxy composites are increasingly used in systems requiring a material that is both strong and light weight, as in airplanes, cars, and pressure vessels. In fire environments, carbon fiber epoxy composites are a fuel source subject to oxidation. This literature review seeks to provide material properties as well as uncertainty bounds for those properties for computational models of decomposing carbon fiber epoxy composites. The goal is to guide analysts when measurements are lacking and increase credibility of uncertainty quantification ranges.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Quantifying model prediction sensitivity to model-form uncertainty

Computational and mathematical models are essential to understanding complex systems and phenomena. However, when developing such models, limited knowledge and/or resources necessitates the use of simplifying assumptions. It is therefore crucial to quantify the impact of such simplifying assumptions on the reliability and accuracy of resulting model predictions. This work develops a first-of-its-kind approach to quantify the impact of physics modeling assumptions on predictions. Here, we leverage the emerging field of model-form uncertainty (MFU) representations, which are parameterized modifications to modeling assumptions, in combination with grouped Sobol’ indices to quantitatively measure an assumption’s importance. Specifically, we compute the grouped Sobol’ index for the MFU representation’s parameters as a single importance measure of the assumption for which the MFU representation characterizes uncertainty. To ensure this approach is robust to the subjective choice of how to parameterize a MFU representation, we establish bounds for the difference between sensitivity results for two different MFU representations based on differences in model prediction statistics. The capabilities associated with this approach are demonstrated on three exemplar problems: an upscaled subsurface contaminant transport problem, ablation modeling for hypersonic flight, and nuclear waste repository modeling. We found that our grouped approach is able to assess the impact of modeling assumptions on predictions and offers computational advantages over classical Sobol’ index computation while providing more interpretable results.

97 MATHEMATICS AND COMPUTING↗