Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensitivity and Uncertainty Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Assessing the sensitivity of land-atmosphere coupling strength to boundary and surface layer parameters in the WRF model over Amazon

Modeling tools can be used to diagnose regional land-atmosphere (L-A) coupling strength in the absence of sufficient observations, but subject to uncertainties associated with parameters in model physical parameterizations. Different sensitivity analysis (SA) approaches may lead to different conclusions about the underlying sensitivities. In this study, we quantify simulation uncertainties related to parameter perturbations, and use different approaches to conduct parameter SA on the WRF model pertaining to L-A coupling strength for simulations over the Amazon region. A total of twenty parameters from the Yonsei University (YSU) planetary boundary layer (PBL) and the revised MM5 surface layer (SL) schemes were selected in this analysis. Three different SA methods, the Morris One-at-A-Time (MOAT) method, the Multivariate Adaptive Regression Splines (MARS) method, and the Sobol’ method, were employed to analyze seven WRF-simulated variables and five L-A coupling metrics. Results show that 1) parameter perturbations cause large simulation uncertainties which are comparable to those in the observations; 2) three different SA methods give consistent L-A coupling strength outcomes; 3) six out of the twenty parameters contribute 80%–95% of the total variance in the metrics analyzed, and first-order effects dominate over interaction effects; 4) the twelve variables/metrics of interest show similar sensitivity patterns to the selected parameters, which is consistent across all the methods used. Physical mechanisms for how the sensitive parameters act in determining the L-A coupling strength and associated variables also are illustrated. Our results will help quantifying L-A coupling strength and establishing a basis for parameter calibration over the Amazon region.

Wang, Chen↗
DOE OSTI2022

PyApprox: Enabling efficient model analysis

PyApprox is a Python-based one-stop-shop for probabilistic analysis of scientific numerical models. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent the most popular methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. Simple interfaces are provided for the most commonly-used algorithms to limit a user’s need to tune the various hyper-parameters of each algorithm. However, more advanced work flows that require customization of hyper-parameters is also supported. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of different algorithms for a wide range of model analyses. This paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in ground water.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Verification of the sensitivity and uncertainty-based criticality safety validation techniques: ORNL’s SCALE case study

The use of sensitivity and uncertainty-based techniques has been well-developed in the neutronic community for criticality safety applications. Sensitivity techniques calculate the first-order relative variations in keff due to relative cross-section variations by isotope, reaction type, and incident neutron energy. The result is a vector of sensitivity coefficients which is folded with prior cross-section uncertainties to calculate the so-called similarity indices. Similarity indices are integral quantities which serve as useful mathematical measures for assessing the relevance of existing or new experiments to given application conditions, representing design systems for which the models are to be validated. Despite their importance for a wide range of validation activities, the peer-reviewed literature is non-existent on the development of rigorous verification analysis for their calculated values. Thus, this manuscript proposes a simple non-intrusive method to calculate similarity indices, serving as an independent verification tool for their evaluation. The manuscript derives the theoretical basis for the proposed verification analysis. Next, the verification analysis is applied to the ORNL’s SCALE code suite which employs adjoint-based methods to calculate similarity indices. Numerical experiments using a number of well-known benchmark experiments are employed to verify the calculation of the similarity indices.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

A Bayesian Multi-fidelity Neural Network to Predict Nonlinear Frequency Backbone Curves

The use of structural mechanics models during the design process often leads to the development of models of varying fidelity. Often low-fidelity models are efficient to simulate but lack accuracy, while the high-fidelity counterparts are accurate with less efficiency. Here, this paper presents a multi-fidelity surrogate modeling approach that combines the accuracy of a high-fidelity finite element model with the efficiency of a low-fidelity model to train an even faster surrogate model that parameterizes the design space of interest. The objective of these models is to predict the nonlinear frequency backbone curves of the Tribomechadynamics Research Challenge benchmark structure which exhibits simultaneous nonlinearities from frictional contact and geometric nonlinearity. The surrogate model consists of an ensemble of neural networks that learn the mapping between low and high-fidelity data through nonlinear transformations. Bayesian neural networks are used to assess the surrogate model's uncertainty. Once trained, the multi-fidelity neural network is used to perform sensitivity analysis to assess the influence of the design parameters on the predicted backbone curves. Additionally, Bayesian calibration is performed to update the input parameter distributions to correlate the model parameters to the collection of experimentally measured backbone curves.

42 ENGINEERING↗
DOE OSTI2021

SAM Co-Development to Support Fluoride-salt-cooled High-temperature Reactor Design and Licensing (CRADA 2018-18177 Final Report)

This project aims to raise the SAM code's technical and commercial maturity level to enable the Kairos Power ("Kairos") to use SAM to support its KP-FHR design analysis and licensing application. Argonne National Laboratory ("Argonne") has actively developed and maintained SAM, a modern system-level analysis tool for advanced nonlight water reactors safety analysis. Kairos is currently actively pursuing development of an FHR design and associated technology, and consequently requires a pedigreed safety analysis tool. The purpose of this project is to increase the maturity of the SAM code for the modeling and simulation of the KP-FHR design, thus enabling its use in safety analyses that support licensing application. Argonne will primarily be responsible for software design, development, and testing; while Kairos will be responsible for software requirements, assessment of software capabilities, needs, gaps, and priorities, and development of proprietary models. The research and development activities for the joint SAM development project include: a series of identification and prioritization studies on design characteristics, event sequences, relevant phenomena, and software capabilities; SAM capability enhancements for specific KP-FHR systems and components; performing code verification and validations; integrating uncertainty quantification (UQ), model calibration, and sensitivity analysis (SA) techniques in safety analyses; and raising the software quality rigor level for commercial-grade applications.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Material Interactions in Severe Accidents – Benchmarking the MELCOR V2.2 Eutectics Model for a BWR-3 Mark-I Station Blackout: Part II – Uncertainty Analysis

Single case comparisons between severe accident simulations can provide detailed insights into severe accident model behavior, however, they cannot offer insights into model uncertainty, sensitivity to uncertain parameters, or underlying model biases.Here in this analysis, the single case benchmark comparison of the MELCOR material interaction models for a station blackout (SBO) scenario of a boiling water reactor (BWR) using representative Fukushima Daiichi Unit 1 boundary conditions is expanded to include an uncertainty analysis. As part of this uncertainty analysis, 1200 simulations are performed for each material interaction model (2400 total), with random sampling of 14 uncertain MELCOR input parameters. Input parameters are selected for their impact on models representing core degradation processes. These include candling, fuel rod failure, debris quenching and dryout. The analysis performed here is not a traditional “best-estimate” uncertainty analysis that uses best-estimate parameters or identifies best-estimate figure of merit distributions. Instead, it is an exploratory uncertainty analysis that identifies and interrogates underlying model form biases of the two material interaction models (eutectics and interactive materials models). Uniform distributions are applied to all uncertain parameters to ensure coverage of the model parameter uncertainty space. Key findings from this study include underlying model form biases exhibited by material interaction models, and notable differences in accident progression outcomes between the material interaction models. This uncertainty study extends and confirms the conclusions from the first part of this study, which compared the impact of material interaction modeling on simulation of a short-term station blackout scenario with representative Fukushima Daiichi Unit I boundary conditions. In particular, this study confirms that the eutectics model generally exhibits accelerated degradation and failure of fuel components, the core plate, and the lower head. The eutectics model also has a tendency to exhibit a greater degree of core degradation, greater debris mass formation, and larger debris mass ejection. Finally, the eutectics model exhibits higher maximum temperatures for fuel, cladding, particulate debris, oxidic molten pool, and metallic molten pool components than the interactive materials model; interactive materials model simulations exhibit a soft “limitation” on maximum temperatures that is related to the temperature at which material relocation occurs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Search for Electron Neutrinos in Multiple Topologies with the MicroBooNE Experiment

This note presents the status of the measurement of electron neutrinos from the Fermilab Booster Neutrino Beamline (BNB) with the MicroBooNE experiment. The analysis is aimed at investigating the nature of the low energy excess of electromagnetic activity observed by the MiniBooNE experiment. The $ν_e$ event selection relies on topological and calorimetric information to characterise particles produced in these interactions, leveraging the Pandora multi-algorithm reconstruction framework as well as custom particle identification and pattern recognition tools. Results presented in this note use 5.88 × 10 20 protons on target of data collected between 2015 and 2018. These include the performance of particle identification tools for $\mu/p$ and $e/\gamma$ separation, along with electromagnetic shower calibration with the largest sample of $\pi^0$ events measured on argon. Progress towards the completion of this analysis is shown through the measurement of high-energy charged-current $ν_e$ interactions and their kinematic distributions using both inclusive (1eX) and exclusive (1$e$0$p$0$\pi$ and 1$e$N$p$0$\pi$) channels. Measurements of charged-current $ν_µ$ interactions aimed at constraining flux and cross-section systematic uncertainties are also shown. We present the analysis’ preliminary sensitivity of an electron-like signal hypothesis to the MiniBooNE excess which includes flux, cross-section, and detector systematic uncertainties.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Mu2e Run I Sensitivity Projections for the Neutrinoless Conversion Search in Aluminum

The Mu2e experiment at Fermilab will search for the neutrinoless conversion in the field of an aluminum nucleus. The Mu2e data-taking plan assumes two running periods, Run I and Run II, separated by an approximately two-year-long shutdown. This paper presents an estimate of the expected Mu2e Run I search sensitivity and includes a detailed discussion of the background sources, uncertainties of their prediction, analysis procedures, and the optimization of the experimental sensitivity. The expected Run I discovery sensitivity is , with a total expected background of events. In the absence of a signal, the expected upper limit is at 90% CL. This represents a three order of magnitude improvement over the current experimental limit of at 90% CL set by the SINDRUM II experiment.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Experimental Ignition Delay Time Measurements and Chemical Kinetics Modeling of Hydrogen/Ammonia/Natural Gas Fuels

In recent years, hydrogen-carrying compounds have accrued interest as an alternative to traditional fossil fuels due to their function as zero-emission fuels. As such, there is interest in investigating hydrogen-carrying compounds to improve understanding of the fuels' characteristics for use in high pressure systems. In the current study, the oxidation of ammonia/natural gas/hydrogen mixtures was carried out to study carbon monoxide (CO) formation profiles as well as the ignition delay times (IDTs) behind reflected shock waves in order to refine chemical kinetic models. Experiments were carried out in the University of Central Florida's shock tube facility by utilizing chemiluminescence to obtain OH* emission and laser absorption spectroscopy to obtain CO profiles over a temperature range between 1200 K and 1800 K with an average pressure of 2.2 atm. Experimental mixtures included both neat and combination natural gas/hydrogen with ammonia addition, with all mixtures except one having an equivalence ratio of 1. Results were then compared with the GRI 3.0 mechanism, as well as the newly developed UCF 2022 mechanism utilizing chemkin-pro software. In general, both models were able to capture the trend in auto-ignition delay times and CO time histories for natural gas and ammonia mixtures. However, for ammonia–hydrogen mixtures, GRI 3.0 failed to predict ignition delay times, whereas the UCF 2022 mechanism was able to capture the IDTs within the uncertainty limits of the experiments. A sensitivity analysis was conducted for different mixtures to understand the important reactions at the experimental conditions. Lastly, a reaction pathway analysis was carried out to understand important ammonia decomposition pathways in the presence of hydrogen and natural gas.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Autoignition Delay Time Measurements and Chemical Kinetic Modeling of Hydrogen/Ammonia/Natural Gas Mixtures

Abstract In recent years, hydrogen-carrying compounds have accrued interest as an alternative to traditional fossil fuels due to their function as zero-emission fuels. As such, there is interest in investigating hydrogen-carrying compounds to improve understanding of the fuels’ characteristics for use in high-pressure systems. In the current study, the oxidation of ammonia/natural gas/hydrogen mixtures was carried out to study CO formation profiles as well as the ignition delay times behind reflected shock waves in order to refine chemical kinetic models. Experiments were carried out in the University of Central Florida’s shock tube facility by utilizing chemiluminescence to obtain OH* emission and laser absorption spectroscopy to obtain CO profiles. Experimental results were then compared with the GRI 3.0 mechanism, as well as the proprietary UCF 2022 mechanism utilizing CHEMKIN-Pro software. In general, both models were able to capture the trend in autoignition delay times and CO time histories for natural gas and ammonia mixtures. However, for ammonia-hydrogen mixtures, GRI 3.0 failed to predict ignition delay times whereas the UCF 2022 mechanism was able to capture the IDTs within the uncertainty limits of the experiments. A sensitivity analysis was conducted for different mixtures to understand the important reactions at the experimental conditions. Finally, a reaction pathway analysis was carried out to understand important ammonia decomposition pathways in the presence of hydrogen and natural gas.

Baker, Jessica B.↗
DOE OSTI2026

TSEUQLib

TSEUQLib (Taylor Series Expansion Uncertainty Quantification Library): Conduct UQ and sensitivity analysis with the Taylor series expansion surrogate model.

Balcer, Matthew↗
DOE OSTI2020

UQTk User Manual (V.3.1.0)

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.1.0 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

UQTk Version 3.1.1 User Manual

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.1.1 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

UQTk Version 3.1.2 User Manual

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.1.2 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Global Framework for Emulation of Nuclear Calculations

We introduce a hierarchical framework that combines ab initio many-body calculations with a Bayesian neural network, developing emulators capable of accurately predicting nuclear properties across isotopic chains simultaneously and being applicable to different regions of the nuclear chart. We benchmark our developments using the oxygen isotopic chain, achieving accurate results for ground-state energies and nuclear charge radii, while providing robust uncertainty quantification. Our framework enables global sensitivity analysis of nuclear binding energies and charge radii with respect to the low-energy constants that describe the nuclear force.

FOS: Computer and information sciences↗
DOE OSTI2022

Analysis of SCALE Criticality and Sensitivity Calculations for Reflected HEU Cylinders [Slides]

The SCALE code package offers multiple nuclear data libraries supporting Monte Carlo transport, with sensitivity and uncertainty methods derived from MC transport solutions. Several libraries are multigroup, which introduce bias differing by system. Previous work has shown poor S/U results in several reflector materials: ICSBEP benchmark HMF-084 was selected to analyze biases and S/U method applicability to a variety of reflectors. Prior and ongoing work found inaccuracies in CSAS and TSUNAMI results, which were further investigated utilizing the HEU-MET-FAST-084 ICSBEP critical benchmark, chosen for its geometrical simplicity and variety of reflector materials. Perturbation of reflector thickness across various reflector materials allowed for an assortment of materials is to be tested swiftly for each sequence and method. Observation was an increasing bias of MG $k_{eff}$ relative to CE, in both direction and magnitude. IFP produced extremely reliable results. >85% of CLUTCH cases were found satisfactory.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Diffuse back-illumination temperature imaging (DBI-TI), a novel soot thermometry technique

To meet stringent emissions regulations on soot emissions, it is critical to further advance the fundamental understanding of in-cylinder soot formation and oxidation processes. Among several optical techniques for soot quantification, diffuse back-illumination extinction imaging (DBI-EI) has recently gained traction mainly due to its ability to compensate for beam steering, which if not addressed, can cause unacceptably high measurement uncertainty. Until now, DBI-EI has only been used to measure the amount of soot along the line of sight, and here, we extend the capabilities of a DBI-EI setup to also measure in-cylinder soot temperature. This proof of concept of diffuse back-illumination temperature imaging (DBI-TI) as a soot thermometry technique is presented by implementing DBI-TI in a single cylinder, heavy-duty, optical diesel engine to provide 2-D line-of-sight integrated soot temperature maps. The potential of DBI-TI to be an accurate thermometry technique for use in optical engines is analyzed. The achievable accuracy is due in part to simultaneous measurement of the soot extinction, which circumvents the uncertainty in dispersion coefficients that depend on the optical properties of soot and the wavelength of light utilized. Analysis shows that DBI-TI provides temperature estimates that are closer to the mass-averaged soot temperature when compared to other thermometry techniques that are more sensitive to soot temperature closer to the detector. Furthermore, uncertainty analysis and Monte Carlo (MC) simulations provide estimates of the temperature measurement errors associated with this technique. The MC simulations reveal that for the light intensities and optical densities encountered in these experiments, the accuracy of the DBI-TI technique is comparable or even better than other established optical thermometry techniques. Thus, DBI-TI promises to be an easily implementable extension to the existing DBI-EI technique, thereby extending its ability to provide comprehensive line-of-sight integrated information on soot.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗