Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

EMPIRICAL VALIDATION OF MULTI-ZONE BUILDING AND HVAC SYSTEM MODELS UNDER UNCERTAINTY

This study implemented a framework of empirical validation of building energy models under uncertainty to a set of controlled experiments that aim to validate multi-zone building and HVAC system models. Energy models were created through iterative acquisitions of information and data and uses measurement data from various types of sensors as both inputs and as observations to validate predictions. Experimental and modeling uncertainties were quantified and propagated accordingly, and probabilistic accuracy metrics were used to evaluate the agreement between model predictions and observations under uncertainty. Sensitivity analysis was performed to identify the most influential uncertainties that will be prioritized to be addressed in the next steps. Current results of two cooling tests show an overall good agreement between predictions and observations on a set of HVAC system outputs despite considerable and influential uncertainty in DX cooling coil COP. Agreements on zone-level responses vary notably among individual rooms, likely because of significant uncertainties in room radiation heat gain and system supply air.

Li, Qi↗
DOE OSTI2021

State of Stress Uncertainty Quantification and Geomechanical Risk Analysis for Subsurface Engineering

All subsurface stress measurement methods available for deep subsurface applications are indirect and involve a significant amount of uncertainty. Quantifying these uncertainties is critical for applications where the state of stress is a component of a risk analysis with significant safety, environmental, and economic considerations. A publicly available and open source tool called the State of Stress Analysis Tool (SOSAT) has been developed to aid in performing a Bayesian uncertainty quantification and geomechanical risk analysis using many types of commonly available data. A new feature of this tool is using data from the FutureGen 2.0 site. The new feature of the tool was uses information about the absence or presence of borehole breakouts to constrain the state of stress. This new feature allows the user to specify probability distributions for the relevant parameters such as the drilling mud pressure, temperature, and the formation strength properties. The tool computes the posterior joint probability distribution of the horizontal principal stresses. Using random samples from this posterior distribution the tool then computes the probability of activating a critically oriented fault at a range of pore pressures. This latter feature can be used to aid in the assessment of the risk of induced seismicity and leakage in geologic carbon sequestration and enhanced geothermal systems.

Burghardt, Jeffrey A.↗
DOE OSTI2020

Sensitivity and Uncertainty Quantification of Transition Scenario Simulations

This report documents the first collective attempt at developing and applying capabilities to quantify uncertainties, assess parametric sensitivities, and optimize multiple parameters and metrics in fuel cycle simulations generated by the SA&I Campaign. To do this, external codes that were designed to perform sensitivity analysis and uncertainty quantification (SA&UQ) needed to be coupled to the SA&I Campaign’s nuclear fuel cycle simulators (NFCS). In FY20, two approaches were pursued: 1) coupling Cyclus to an ORNL-internal code called MOT (Metaheuristic Optimization Tool) and 2) coupling DYMOND to the opensource SA&UQ tool kit Dakota. The primary objective of having these NFCS/SA&UQ coupled capabilities is to better inform DOE-NE and other stakeholders on the results generated from the NFCS. For a given set of fuel cycle strategies, policies, and technology assumptions that make up a fuel cycle scenario, these NFCS have traditionally been used by the SA&I Campaign to provide quantitative answers in terms of year-by-year mass flows, infrastructure requirements, costs, etc. With these newly developed coupled capabilities, the SA&I Campaign can now efficiently simulate hundreds or thousands of these scenarios, sample large ranges of parameters and assumptions, and use the unique features of the SA&UQ tools to process the data. This enables providing answers with known and propagated uncertainties, determining the sensitivity of important metrics to different parameters and assumptions, quantifying how much fuel cycle and technology parameters impact each other, and producing optimized fuel cycle strategies for single and multiple variables. To demonstrate these new capabilities, the Cyclus/MOT was used to model several scenarios ranging from simple fleet retirements to transitions to advanced reactors. Specifically, for a transition scenario from LWRs to SFRs and advanced LWRs, uncertainty quantification, sensitivity analysis, and optimization studies were applied to cases involving single and multiple parameter (input) and single and multiple metric (output) variations. In addition, a similar transition scenario was modeled to demonstrate how to optimize the reprocessing capacity parameter to minimize two performance metrics while taking into account uncertainties from two other parameters. Lastly, a depletion module based on SCALE/ORIGEN was added in Cyclus to simulate the third scenario that was designed to quantify the impact of the modeling assumption that all LWR used nuclear fuel have the same burnup. The newly developed DYMOND/Dakota capability was also applied to a transition scenario from the existing fleet to small modular reactors and fast reactors. This particular scenario involves not only explicit isotopic depletion via ORIGEN-2, but also includes multirecycling and utilizing the criticality search feature to determine the fresh fuel composition of recycled fuel, a feature unique to the DYMOND NFCS. A large database of simulations were run with 4 main parameters that were sampled: start date of reprocessing, reprocessing capacity, energy demand growth rate, and advanced reactor share of the fleet. The 4 main metrics were uranium consumption, enrichment requirements, waste generation, and levelized cost of electricity using data from the Cost Basis Report. The demonstrated SA&UQ results include those that inform on how to choose parameters to avoid “failed” scenarios, Sobol’ indices that inform on the importance of various parameters individually and synergistically, and Analysis of Variance (ANOVA) studies that decompose parameter ranges into groups and informs on whether variations are statistically significant.

Feng, B.↗
DOE OSTI2026

Transient uncertainty quantification and Global Sensitivity Analysis of the open-source Molten Chloride Reactor Experiment (MCRE) using GP-PCA surrogate models

Uncertainties in the thermophysical properties of molten salts impact both the steady-state and transient behavior of Molten Salt Reactors (MSRs). In this work, we aim to quantify the influence of such uncertainties on the transient operation of the Molten Chloride Reactor Experiment (MCRE), utilizing the open-source specifications provided for this reactor. Seven representative transient scenarios are considered. For each scenario, we evaluate the impact of thermophysical property uncertainties on four key multiphysics model output variables of interest (VoIs): maximum power density, maximum fuel temperature, maximum reflector temperature, and average fuel velocity magnitude. In addition, we perform a Global Sensitivity Analysis (GSA) by computing Sobol’ indices for the uncertain input parameters to determine their contribution to the variability of each VoI. Conducting GSA is computationally intensive due to the large number of required evaluations of the high-fidelity multiphysics model. To mitigate this cost, we develop a surrogate modeling framework that combines Gaussian Process (GP) regression with Principal Component Analysis (PCA), enabling efficient sample generation for the GSA. Our results show that for energy-related VoIs, thermal conductivity is the dominant contributor to uncertainty. In contrast, for flow-related VoIs, density and dynamic viscosity are the primary sources of uncertainty. The specific heat of the fuel salt was found to play a secondary role in the transient analyses.

42 - ENGINEERING↗
NASA NTRS1992

An improved approach for flight readiness certification: Methodology for failure risk assessment and application examples, volume 1

An improved methodology for quantitatively evaluating failure risk of spaceflight systems to assess flight readiness and identify risk control measures is presented. This methodology, called Probabilistic Failure Assessment (PFA), combines operating experience from tests and flights with engineering analysis to estimate failure risk. The PFA methodology is of particular value when information on which to base an assessment of failure risk, including test experience and knowledge of parameters used in engineering analyses of failure phenomena, is expensive or difficult to acquire. The PFA methodology is a prescribed statistical structure in which engineering analysis models that characterize failure phenomena are used conjointly with uncertainties about analysis parameters and/or modeling accuracy to estimate failure probability distributions for specific failure modes. These distributions can then be modified, by means of statistical procedures of the PFA methodology, to reflect any test or flight experience. Conventional engineering analysis models currently employed for design of failure prediction are used in this methodology. The PFA methodology is described and examples of its application are presented. Conventional approaches to failure risk evaluation for spaceflight systems are discussed, and the rationale for the approach taken in the PFA methodology is presented. The statistical methods, engineering models, and computer software used in fatigue failure mode applications are thoroughly documented.

Moore, N. R.↗
NASA NTRS1992

An improved approach for flight readiness certification: Methodology for failure risk assessment and application examples. Volume 2: Software documentation

An improved methodology for quantitatively evaluating failure risk of spaceflight systems to assess flight readiness and identify risk control measures is presented. This methodology, called Probabilistic Failure Assessment (PFA), combines operating experience from tests and flights with engineering analysis to estimate failure risk. The PFA methodology is of particular value when information on which to base an assessment of failure risk, including test experience and knowledge of parameters used in engineering analyses of failure phenomena, is expensive or difficult to acquire. The PFA methodology is a prescribed statistical structure in which engineering analysis models that characterize failure phenomena are used conjointly with uncertainties about analysis parameters and/or modeling accuracy to estimate failure probability distributions for specific failure modes, These distributions can then be modified, by means of statistical procedures of the PFA methodology, to reflect any test or flight experience. Conventional engineering analysis models currently employed for design of failure prediction are used in this methodology. The PFA methodology is described and examples of its application are presented. Conventional approaches to failure risk evaluation for spaceflight systems are discussed, and the rationale for the approach taken in the PFA methodology is presented. The statistical methods, engineering models, and computer software used in fatigue failure mode applications are thoroughly documented.

Moore, N. R.↗
NASA NTRS1992

An improved approach for flight readiness certification: Methodology for failure risk assessment and application examples. Volume 3: Structure and listing of programs

An improved methodology for quantitatively evaluating failure risk of spaceflight systems to assess flight readiness and identify risk control measures is presented. This methodology, called Probabilistic Failure Assessment (PFA), combines operating experience from tests and flights with engineering analysis to estimate failure risk. The PFA methodology is of particular value when information on which to base an assessment of failure risk, including test experience and knowledge of parameters used in engineering analyses of failure phenomena, is expensive or difficult to acquire. The PFA methodology is a prescribed statistical structure in which engineering analysis models that characterize failure phenomena are used conjointly with uncertainties about analysis parameters and/or modeling accuracy to estimate failure probability distributions for specific failure modes. These distributions can then be modified, by means of statistical procedures of the PFA methodology, to reflect any test or flight experience. Conventional engineering analysis models currently employed for design of failure prediction are used in this methodology. The PFA methodology is described and examples of its application are presented. Conventional approaches to failure risk evaluation for spaceflight systems are discussed, and the rationale for the approach taken in the PFA methodology is presented. The statistical methods, engineering models, and computer software used in fatigue failure mode applications are thoroughly documented.

Moore, N. R.↗
NASA NTRS2016

Lessons from Climate Modeling on the Design and Use of Ensembles for Crop Modeling

Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Model ensembles↗
DOE OSTI2025

Uncertainty quantification in MELCOR Safety analysis of ARIES reactor designs

MELCOR-TMAP is a combined thermal-hydraulics and tritium tracking code developed to simulate severe accident scenarios in fission and fusion power plants. Here, we demonstrate the results of MELCOR-TMAP analyses on historical ARIES program reference designs. By coupling MELCOR-TMAP with the open source RAVEN probabilistic risk analysis framework’s Bayesian UQ capabilities, we also demonstrate key uncertainties in material properties with the highest impact on tritium inventory and plant risk.

70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Monte Carlo Dropout Uncertainty Quantification of Long Short-Term Memory Autoencoder Anomaly Detection in a Liquid Sodium Cold Trap

Advanced high-temperature fluid reactors, such as sodium-cooled fast reactors (SFRs) and molten salt–cooled reactors (MSCRs), require coolant purification systems to prevent fluid contamination and local freezing that can lead to plugging. Liquid sodium purification can be achieved with a cold trap, where the sodium temperature is reduced to a near-freezing point to precipitate out impurities. Automation of monitoring of the cold trap performance with machine learning algorithms can aid in early detection of incipient anomalies. An efficient approach to loss-of-coolant–type anomaly detection in a cold trap monitored with more than two dozen thermal-hydraulic sensors consists of a long short-term memory (LSTM) autoencoder. This work develops the uncertainty quantification of the LSTM autoencoder performance for cold trap anomaly detection using the Monte Carlo (MC) dropout method. The MC dropout methodology creates a distribution of sister distributions that all slightly differ from each other because of random neurons being turned off for testing. The variances of the sister network distributions are used to make an uncertainty interval. Our analysis shows that the uncertainty in the autoencoder performance is largest near the peak of the anomaly signal. Using the MC dropout method, we investigate the uncertainty in the anomaly detection with missing sensor inputs. This capability allows the reactor operator to evaluate resilience of the anomaly detection system and to make informed decisions about continuity of operation in the event of sensor failure.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Energetics of surface melt in West Antarctica

We use reanalysis data and satellite remote sensing of cloud properties to examine how meteorological conditions alter the surface energy balance to cause surface melt that is detectable in satellite passive microwave imagery over West Antarctica. This analysis can detect each of the three primary mechanisms for inducing surface melt at a specific location: thermal blanketing involving sensible heat flux and/or longwave heating by optically thick cloud cover, all-wave radiative enhancement by optically thin cloud cover, and föhn winds. We examine case studies over Pine Island and Thwaites glaciers, which are of interest for ice shelf and ice sheet stability, and over Siple Dome, which is more readily accessible for field work. During January 2015 over Siple Dome we identified a melt event whose origin is an all-wave radiative enhancement by optically thin clouds. During December 2011 over Pine Island and Thwaites glaciers, we identified a melt event caused mainly by thermal blanketing from optically thick clouds. Over Siple Dome, those same 2011 synoptic conditions yielded a thermal-blanketing-driven melt event that was initiated by an impulse of sensible heat flux and then prolonged by cloud longwave heating. The December 2011 synoptic conditions also generated föhn winds at a location on the Ross Ice Shelf adjacent to the Transantarctic Mountains, and we analyze this case with additional support from automatic weather station data. In contrast, a late-summer thermal blanketing period over Pine Island and Thwaites glaciers during February 2013 showed surface melt initiated by cloud longwave heating and then prolonged by enhanced sensible heat flux. One limitation thus far with this type of analysis involves uncertainties in the cloud optical properties. Nevertheless, with improvements this type of analysis can enable quantitative prediction of atmospheric stress on the vulnerable Antarctic ice shelves in a steadily warming climate.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2016

Exploration Flight Test 1 Afterbody Aerothermal Environment Reconstruction

The Exploration Flight Test 1 vehicle included roughly 100 near surface thermocouples on the after body of the vehicle. The temperature traces at each of these instruments have been used to perform inverse environment reconstruction to determine the aerothermal environment experienced during re-entry of the vehicle. This paper provides an overview of the reconstructed environments and identifies critical aspects of the environment. These critical aspects include transition and reaction control system jet influence. A blind test of the process and reconstruction tool was also performed to build confidence in the reconstructed environments. Finally, an uncertainty quantification analysis was also performed to identify the impact of each of the uncertainties on the reconstructed environments.

Hyatt, Andrew J.↗
NASA NTRS2021

Risk Assessment Metrics for NASA Fission Reactor Applications

Risk assessment is an important part of many NASA activities. In August 2019, the White House issued NSPM-20, which defines acceptable levels of risk for nuclear launches, but does not prescribe the particular methodologies or metrics that are to be used for comparison to the defined acceptance criteria. There are a variety of metrics that are possible and can be readily generated by a probabilistic risk assessment (PRA). This paper will explore alternative metrics that can be provided, along with some discussion of their characteristics and important factors to consider during a space fission reactor risk analysis.

Probabilistic Risk Assessment↗
DOE OSTI2025

Surrogate-driven Variance-based Sensitivity Analysis of Thermal Storage Tanks in Integrated Energy Systems

Sensitivity analysis and uncertainty quantification are essential steps for enhancing the accuracy of computational models by identifying and mitigating uncertainties. This study focuses on these steps for the Thermal Energy Delivery System at Idaho National Laboratory, specifically targeting the thermocline tank. Using a Modelica/Dymola simulation model, the study perturbed various design parameters and boundary conditions, including shape factor, porosity, outlet temperature, inlet mass flow rate, and system pressure, to predict and quantify uncertainty in the tank’s ax- ial temperature. A dataset of over 1,000 simulations was generated, and surrogate models were developed using the pyMAISE (Michigan Artificial Intelligence Standard Environment) library, which is an Automatic Machine Learning library for nuclear engineering applications. The optimal model, a feedforward neural network with two hidden layers, achieved an R2 score above 0.99 and a mean absolute error below 1 Kelvin. Sensitivity analyses using Sobol indices and Fourier amplitude sensitivity testing methods on this surrogate model revealed that the inlet mass flow rate at initial timestamps and porosity significantly impacts predicted temperatures across all sensors and time steps.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Preliminary investigation of an uncertainty budget for uranium isotope ratio analysis using a liquid sampling—atmospheric pressure glow discharge—orbitrap mass spectrometer system

The liquid sampling-atmospheric pressure glow discharge (LS-APGD) ionization source has proven to be an effective analysis tool for making uranium isotope ratio measurements when coupled to high-resolution mass spectrometers, such as the Orbitrap. While previous studies have shown the capabilities of the LS-APGD for isotope ratio determination, a systematic evaluation of the measurement uncertainty of the technique has not been conducted. To this end, the International Standards Organizations (ISO) guidelines to the expression of uncertainty in measurement (GUM analysis) have been applied to generate an uncertainty budget. For this work, a preliminary assessment derived from the GUM analysis was performed. The uncertainty in the instrument blank determination has been identified as a primary factor contributing to measurement uncertainty for the LS-APGD-Orbitrap method. These findings for the specific test case of uranium isotopic analysis will be invaluable in applications across the breadth of isotope ratio mass spectrometry performed on this unique instrumental platform.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
NASA NTRS1991

On robustness analysis with non-diagonally structured uncertainty

The authors study the structured singular value for a class of robustness analysis problems in which the uncertainty is allowed to be nondiagonally structured, and the norm of each block is individually considered. The results extend the previous work conducted for problems where each uncertainty block is assumed to be a scalar. Computations of this generalized notion via both the similarity and nonsimilarity scaling methods are investigated. It is shown in particular that under certain circumstances the structured singular value defined here coincides with a vector-induced norm.

Chen, Jie↗
DOE OSTI2022

Study of a Proposed fissionTPC Measurement of 233 U(n,f)/ 235 U(n,f) Cross Section Ratio

A review of the available 233 U( n, f )/ 235 U( n, f ) cross section ratio data compared to the ENDF evaluation in the fast neutron energy range, 0.1–20 MeV, shows that discrepancies exist between some of the various measurements and the evaluation. The discrepancies vary and a function of incident neutron energy and range between 1–5%. In this document we review two potential options for performing new measurements of the cross section ratio to potentially resolve these discrepancies. The two options are compared and contrasted in terms of measurement accuracy and cost. The first option would utilize the fissionTPC, which was designed specifically to achieve measurement uncertainties of better than 1% to resolve a similar data–evaluation discrepancy in the 239 Pu( n, f ) cross section. While this would seem to be an ideal option in this case also, there are challenges. The fissionTPC is a complex instrument and the cost of maintenance and operations are significant. Furthermore, some of the fissionTPC equipment is nearing the end of its useful life which presents a risk to completion of a measurement campaign. The second option is to use a dual-fission chamber, which is the more traditional approach to these types of measurements. The cost is estimated to be about half that of a fissionTPC measurement, while the much simpler design of the detector reduces overall risk. The trade-off is the measurement uncertainty, which would be on order of 1–3% with a careful measurement and analysis. This uncertainty however may not be good enough to fully resolve the discrepancies. The objective of a new measurement would be the improvement in the ENDF evaluation with the end goal of improving the accuracy of models and simulations at the end of the nuclear data pipeline. An understanding of the sensitivity of these models to the data uncertainties would help guide the choice of measurement techniques.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗