SEARCH · Engineering Papers

Results for “uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Uncertainty Analysis for a Criticality Benchmark [Slides]

This presentation discusses how KRUSTY was analyzed with LANL’s MCNP neutron transport code, Monte Carlo N-Particle. In the Monte Carlo method, neutrons are born in fission events and fly around the geometry having events (e.g., scatter, capture, fission, escape) according to the natural probabilities. “Natural probabilities” are given as neutron cross sections , which are measured and evaluated nuclear data. One of the goals of the benchmark project is to improve the nuclear cross sections (and the codes that use them). In this work, the response of interest is called k eff , which describes the neutron multiplication in a near critical system. Like most quantities, k eff is not measured directly; it is only inferred. In summation, MCNP results for k eff matched the measurements extremely well. The evaluated uncertainties are asymmetric and smaller than 0.00100 (e.g., + 0.00080 / – 0.00062). The largest uncertainties are due to alignment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

A Grand Challenge "Uncertainty Project" to Accelerate Advances in Earth System Predictability: AI-Enabled Concepts and Applications

This proposal is emerging from GISS ModelE3 ESM development in the area of cloud physics, so we begin with an example of research needs/gaps from that work. Here, some of our greatest development concerns arise where we lack fundamental process-level understanding, as in ice formation. Namely, it is currently unclear what is the main process that is forming the majority of ice crystals in commonly occurring convection, apparently via secondary ice production at warm temperatures. We are keenly awaiting laboratory data for candidate mechanisms, which is not yet in hand to crucially establish their efficiency. Our progress is also hampered by a lack of uncertainty characterization in currently available measurements of ice crystal number size distributions. Furthermore, the same multiplication process may be responsible for a majority of ice crystals in many extratropical mixed-phase clouds, whose variable representation in CMIP6 ESMs may be a leading cause of differences in cloud phase feedback and ECS. Yet we have been required to deliver an ESM with the cloud physics knowledge at hand. The proposed grand challenge project is AI-enabled via application of machine learning (ML) to climate model and observational data streams (focal area 3), and applications include AI-guided observing system design and model/component/parameterization selection (areas 1 and 2). The project is structurally agnostic as to whether model or observing system components use AI approaches or not, but uncertainties must be estimated and propagatable in both.

58 GEOSCIENCES↗

DOE OSTI2021

Develop a weather-aware climate model to understand and predict extremes and associated power outages and renewable energy shortages with uncertainty-aware and physics-informed machine learning

Focal Area(s): The focus area is predictive modeling through the use of AI techniques and AI-derived model components with a particular emphasis on extreme weather in Atmospheric Science and power outages and shortages in Energy Science. Science Challenge: Predicting weather extremes (e.g., heavy precipitation, strong wind, and large hailstones), and weather-related power system outages and shortages can mitigate economic losses, save lives, support renewables integration, and improve power system resiliency. However, currently, the poor reliability and large uncertainty associated with the weather extreme prediction in the current climate models make the problem intractable. The key challenges are: (1) physical factors like green-house gases (GHGs), aerosols, and land use and land cover (LULC) can significantly impact extreme storms, but the understanding of these impacts is limited, particularly globally; (2) the convective permitting resolutions needed to model severe convective storms and their impacts are computationally prohibitive with global climate models (GCMs); (3) interactions between weather extremes and power system outages are complex and subject to great uncertainty. Current outage prediction models are short lead (~ 3 days), which do not allow for long-time planning of energy production and distribution. Moreover, we have limited capacity to predict weather events leading to sustained shortages in a renewable-energy-dominated power system. These challenges drive motivation for mechanistic understanding and reliable and efficient predictive modeling of extremes and their impacts from the sub-seasonal to long term projections.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Development of Explainable, Knowledge-Guided AI Models to Enhance the E3SM Land Model Development and Uncertainty Quantification

Focal Area(s): (2)Predictive modeling using AI techniques and AI-derived model components; use of AI and other tools to design a prediction system comprising of a hierarchy of models. (3) Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge- guided AI. Science Challenge: The Energy Exascale Earth System Model (E3SM) is a fully coupled, state-of-the-science Earth system model that uses code optimized for DOE's advanced computers to address the most critical scientific questions facing our nation and society (Golaz et al., 2019). The E3SM Land model (ELM) is designed to understand how the changes in terrestrial land surfaces will interact with other Earth system components and has been used to understand hydrologic cycles, biogeophysics, and ecosystem dynamics. In spite of great successes, the ELM has several known issues that restrain rapid improvements. For example, the ELM uses equilibrium models to simulate dynamic land-climate interactions and it requires long model spin-up time to identify suitable initial conditions for transient simulations. The ELM lacks built-in uncertainty mechanisms that can improve the robustness of model predictions. The ELM is a holistic, deterministic model system with a rigid design, and in many situations, it is hard to modify the ELM system to incorporate new theory/hypothesis and new data across scales to address emerging science problems (such as predicting the impacts of water cycle extremes). In addition, The ELM is technically optimized for traditional CPU-centric computers and it cannot fully utilize the current and incoming leadership computers for model simulations and uncertainty quantification (UQ). The success of artificial intelligence (AI) has inspired scientists to use AI models to discover intrinsic features from simulation data (Chattopadhyay et al., 2020) and observational data (Reichstein et al., 2019) to gain further process understanding of Earth science problems. However, autonomous AI model training through deep learning usually requires a huge amount of annotated data. To overcome the limitations from the data and computing resources, knowledge-guided AI models are necessary where human-knowledge is ingested in model construction (Banino et al., 2018) and training process (Silver et al., 2016) for efficient learning. Herein, we present a new way that leverages the process understanding from the ELM to guide AI model development for the ELM enhancement and UQ. We hope this study can inspire further Earth and environmental system model developments and transformations.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

YAHFC: A Code Framework to Model Nuclear Reactions and Estimate Correlated Uncertainties

Reaction modeling is a key ingredient in designing experiments and interpreting their results, and is an essential component in the process of evaluating nuclear data and assembling nuclear data libraries used in nuclear technology applications. Typically, experimental data are available only for a handful of reaction channels and theory models are used to fill in the gaps. In addition, theory is often called upon as the arbitrator between discrepant data. Most importantly, theory and modeling are required for an accurate determination of uncertainties in the evaluated data and the correlations between the multiple channels. A fast, accurate, and flexible modeling capability has been developed at LLNL with the code system YAHFC (Yet Another Hauser-Feshbach Code). YAHFC is a Monte Carlo, Hauser-Feshbach code framework, making full use of dynamic memory allocation, derived types, and parallel computing. YAHFC can generate events to simulate experiments and is guiding experiments designed to measure inelastic neutron scattering from actinide targets. YAHFC is also being used to analyze decays from surrogate experiments, thereby enabling the inference of reaction cross sections inaccessible by direct measurement. Finally, by modeling nuclear reactions with constraints from experimental data, YAHFC can deliver complete nuclear data libraries, with evaluated uncertainties, using the modernized Generalized Nuclear Data Structure (GNDS).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

Dakota A Multilevel Parallel Object-Oriented Framework for Design Optimization Parameter Estimation Uncertainty Quantification and Sensitivity Analysis (V.6.14) (User's Manual)

The Dakota toolkit provides a flexible and extensible interface between simulation codes and iterative analysis methods. Dakota contains algorithms for optimization with gradient and nongradient-based methods; uncertainty quantification with sampling, reliability, and stochastic expansion methods; parameter estimation with nonlinear least squares methods; and sensitivity/variance analysis with design of experiments and parameter study methods. These capabilities may be used on their own or as components within advanced strategies such as surrogate-based optimization, mixed integer nonlinear programming, or optimization under uncertainty. By employing object-oriented design to implement abstractions of the key components required for iterative systems analyses, the Dakota toolkit provides a flexible and extensible problem-solving environment for design and performance analysis of computational models on high performance computers. This report serves as a users manual for the Dakota software and provides capability overviews and procedures for software execution, as well as a variety of example studies.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Neural Density Estimation and Uncertainty Quantification for ChemCam Spectra [Slides]

The ChemCam instrument of Curiosity uses laser-induced breakdown spectroscopy (LIBS). It fires a laser at target and vaporizes rock surfaces, creating a plasma. Three spectrographs divide the plasma light into wavelengths for chemical analysis: ultraviolet, violet, and visible near-infrared. Regression methods (SVR, PCR, CNN) have been employed for calibration (prediction of the elemental composition of samples); however, labeled ChemCam samples are limited. Here, we focus on unsupervised learning and employ generative models from ChemCam analysis. Further, we use labels (supervised) in combination to the generative model to compute uncertainties related to predictions. We report generative modeling can be successfully applied to model real-world data. Normalizing flow models can be efficiently constructed on latent spaces for fast downstream inference. Unsupervised and supervised learning can be combined to form an uncertainty quantification framework.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2020

Dakota, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis: Version 6.13 User's Manual

The Dakota toolkit provides a flexible and extensible interface between simulation codes and iterative analysis methods. Dakota contains algorithms for optimization with gradient and nongradient-based methods; uncertainty quantification with sampling, reliability, and stochastic expansion methods; parameter estimation with nonlinear least squares methods; and sensitivity/variance analysis with design of experiments and parameter study methods. These capabilities may be used on their own or as components within advanced strategies such as surrogate-based optimization, mixed integer nonlinear programming, or optimization under uncertainty. By employing object-oriented design to implement abstractions of the key components required for iterative systems analyses, the Dakota toolkit provides a flexible and extensible problem-solving environment for design and performance analysis of computational models on high performance computers. This report serves as a user’s manual for the Dakota software and provides capability overviews and procedures for software execution, as well as a variety of example studies.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Science and Engineering of Cybersecurity by Uncertainty quantification and Rigorous Experimentation (SECURE) (Final Report)

This report summarizes the activities performed as part of the Science and Engineering of Cybersecurity by Uncertainty quantification and Rigorous Experimentation (SECURE) Grand Challenge LDRD project. We provide an overview of the research done in this project, including work on cyber emulation, uncertainty quantification, and optimization. We present examples of integrated analyses performed on two case studies: a network scanning/detection study and a malware command and control study. We highlight the importance of experimental workflows and list references of papers and presentations developed under this project. We outline lessons learned and suggestions for future work.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Dakota, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis: Version 6.15 User's Manual

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Nuclear Data to Reduce Uncertainties in Reactor Antineutrino Measurements

The large quantities of antineutrinos produced through the decay of fission fragments in nuclear reactors provide an opportunity to study the properties of these particles and investigate their use in reactor monitoring. The reactor antineutrino spectra are measured using specialized, large area detectors that detect antineutrinos through inverse beta decay, electron elastic scattering, or coherent elastic neutrino nucleus scattering; although, inverse beta decay is the only demonstrated method so far. Reactor monitoring takes advantage of the differences in the antineutrino yield and spectra resulting from uranium and plutonium fission providing an opportunity to estimate the fissile material composition in the reactor. Recent experiments reveal a deviation between the measured and calculated antineutrino flux and spectra (the reactor anomaly) indicating either the existence of yet undiscovered neutrino physics, uncertainties in the reactor source term calculation, incorrect nuclear data, or a combination of all three. To address the nuclear data that impact the antineutrino spectrum calculations and measurements, an international group of over 180 experts in antineutrino physics, reactor analysis, detector development, and nuclear data came together during the Workshop on Nuclear Data for Reactor Antineutrino Measurements (WoNDRAM) to discuss nuclear data needs and achieve concordance on a set of recommended priorities for nuclear data improvements. Three topical sessions focused on the reactor source term, the antineutrino spectrum, and the detector response, provided a forum to gain consensus amongst the participants on the most important data improvements to address two goals: 1) understand the reactor anomaly and 2) improve the ability to monitor reactors using antineutrinos. This report summarizes the outcomes of the workshop discussions and the recommendations for nuclear data efforts that reduce reactor antineutrino measurement uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

Dakota, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis (V.6.16 User's Manual)

The Dakota toolkit provides a flexible and extensible interface between simulation codes and iterative analysis methods. Dakota contains algorithms for optimization with gradient and nongradient-based methods; uncertainty quantification with sampling, reliability, and stochastic expansion methods; parameter estimation with nonlinear least squares methods; and sensitivity/variance analysis with design of experiments and parameter study methods. These capabilities may be used on their own or as components within advanced strategies such as surrogate-based optimization, mixed integer nonlinear programming, or optimization under uncertainty. By employing object-oriented design to implement abstractions of the key components required for iterative systems analyses, the Dakota toolkit provides a flexible and extensible problem-solving environment for design and performance analysis of computational models on high performance computers. This report serves as a user's manual for the Dakota software and provides capability overviews and procedures for software execution, as well as a variety of example studies.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Parameter Calibration for Johnson Cook and Preston-Tonks-Wallace Material Strength Models with Uncertainty Quantification

In this study we perform a Bayesian calibration of the parameters in the Johnson Cook (JC) material strength model, with uncertainty, using experiments with for a range of low and medium strain rates. For the parameter calibration, we used a variational Bayesian approach with experimental data from Hopkinson bar and quasi-static tests done on Oxygen Free High Conductivity (OFHC) copper. The estimated parameter values matched well with experimental data for a modest range of strain rates and temperatures. Through this method, we also recovered uncertainty and correlation information for the estimated parameter values. We also compared our results to a calibration of parameters in the Preston-Tonks-Wallace (PTW) material strength model, using the same variational Bayesian method. The parameters estimated for both models provided good agreement with the experimental data.

36 MATERIALS SCIENCE↗

DOE OSTI2022

The Impact of Specificity on Human Interpretations of State Uncertainty

The goal of this project was test how different representations of state uncertainty impact human decision making. Across a series of experiments, we sought to answer fundamental questions about human cognitive biases and how they are impacted by visual and numerical information. The results of these experiments identify problems and pitfalls to avoid when for presenting algorithmic outputs that include state uncertainty to human decision makers. Our findings also point to important areas for future research that will enable system designers to minimize biases in human interpretation for the outputs of artificial intelligence, machine learning, and other advanced analytic systems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

A Decision Theoretic Approach To Optimizing Machine Learning Decisions with Prediction Uncertainty

While the use of machine learning (ML) classifiers is widespread, their output is often not part of any follow-on decision-making process. To illustrate, consider the scenario where we have developed and trained an ML classifier to find malicious URL links. In this scenario, network administrators must decide whether to allow a computer user to visit a particular website, or to instead block access because the site is deemed malicious. It would be very beneficial if decisions such as these could be made automatically using a trained ML classifier. Unfortunately, due to a variety of reasons discussed herein, the output from these classifiers can be uncertain, rendering downstream decisions difficult. Herein, we provide a framework for: (1) quantifying and propagating uncertainty in ML classifiers; (2) formally linking ML outputs with the decision-making process; and (3) making optimal decisions for classification under uncertainty with single or multiple objectives.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Preliminary Results for Using Uncertainty and Out-of-distribution Detection to Identify Unreliable Predictions.

As machine learning (ML) models are deployed into an ever-diversifying set of application spaces, ranging from self-driving cars to cybersecurity to climate modeling, the need to carefully evaluate model credibility becomes increasingly important. Uncertainty quantification (UQ) provides important information about the ability of a learned model to make sound predictions, often with respect to individual test cases. However, most UQ methods for ML are themselves data-driven and therefore susceptible to the same knowledge gaps as the models themselves. Specifically, UQ helps to identify points near decision boundaries where the models fit the data poorly, yet predictions can score as certain for points that are under-represented by the training data and thus out-of-distribution (OOD). One method for evaluating the quality of both ML models and their associated uncertainty estimates is out-of-distribution detection (OODD). We combine OODD with UQ to provide insights into the reliability of the individual predictions made by an ML model.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Approach to Analyzing VTR Core Performance Sensitivities to Fuel Manufacturing Uncertainties and Application to Fuel Slug Diameter

This report documents the initial effort to characterize sensitivity of VTR core performance to fuel manufacturing uncertainties. The effects of variation in the as-fabricated fuel slug diameter on VTR neutronics performance are evaluated, using both high-fidelity Monte Carlo (OpenMC) and the main core design solver (DIF3D) for all cases. This work and follow-on work will inform the VTR Project’s fuel manufacturing processes and associated acceptable criteria, as well as detailed uncertainty analysis in later stages of VTR development and deployment. In addition, this work demonstrates the approach to performing such evaluations and provides a basis for reducing the scope of calculations in future sensitivity analysis.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2021

Uncertainty Analysis for a Criticality Benchmark [Slides]

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗