Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗
NASA NTRS2017

Lognormal Uncertainty Estimation for Failure Rates

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain. Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This presentation will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗
NASA NTRS2013

TPSAS-NF1676L-17243-DND

This presentation captures ERA Project's effort in using integrated cost-schedule-risk analysis tool, identifying and capturing explicit relationships between program funds, schedule, and discrete risks. The project team merged a myriad of cost and schedule data for timely, objective, uncertainty analysis of the ITD's budget and schedule. The project team conducted detailed schedule uncertainty analysis showing schedule activities and how their interrelationships were impacted, representing an impressive advance beyond routine Gantt charts. Furthermore, the ERA Project collected discrete risk events including their impacts to costs and/or schedule and interwove these risks into cost and schedule logic networks, providing the foundation to conduct cost and schedule analyses. The team integrated this data into the analysis model, providing probabilistic results that were then used by the ERA Project's senior management for decision-making purposes. The ERA Project management team, through technical and pathfinder expertise in integrating cost, schedule, risk, and technical content, consistently provided risk-informed recommendations to Implementing Centers and ISRP senior management which ultimately ensured the successful ARMD Key Decision Point (KDP) review of the ERA Phase 2 ITD Portfolio and increased the likelihood of achieving technical objectives within cost and schedule constraints.

Gaudy M Bezos-O'Connor↗
DOE OSTI2022

Challenges and Lessons Learned in Applying Sensitivity Analysis to Building Stock Energy Models

Uncertainty Analysis (UA) and Sensitivity Analysis (SA) offer essential tools to determine the limits of inference of a model and explore the factors which have the most effect on the model outputs. However, despite a well established body of work applying UA and SA to models of individual buildings, a review of the literature relating to energy models for larger groups of buildings undertaken by Fennell et al. (2019) highlighted very limited application at larger scales. This contribution describes the efforts undertaken by a group of research teams in the context of IEA-EBC Annex 70 working with a diverse set of Building Stock Models (BSMs) to apply global sensitivity analysis methods and compare their results. Since BSMs are a class of model defined by their output and coverage rather than their structure and inputs, they represent a diverse set of modelling approaches. Key challenges for the application of SA are identified and explored, including the influence of model form, input data types and model outputs. This study combines results from 7 different modelling teams, each using different models across a range of urban areas to explore these challenges and begin the process of developing standardised workflows for SA of BSMs.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗
NASA NTRS2017

Sensitivity Analysis and Uncertainty Quantification of a Mars Ascent Vehicle Concept

The design of a conceptual Mars ascent vehicle is a challenging problem. In order to aid the vehicle and mission concept design it is important to understand the driving design parameters and the expected performance in the presence of model errors and uncertainties. An existing six degree of freedom simulation model is analyzed on a statistical basis using the methods available in the Design Analysis Kit for Optimization and Terascale Applications toolkit. The methods utilized include conventional Monte Carlo techniques, metamodeling via polynomial chaos expansions, and global variance-based sensitivity analyses. Two additional analysis methods referred to as “Monte Carlo filtering” and ”Classification trees” are used to determine which uncertain parameters are driving the performance of the vehicle. Monte Carlo filtering provides a methodology to determine which parameters cause qualitatively different behavior while the classification trees use heuristics to partition the input space and assign probabilities to each partition. These methods serve as qualitative descriptors of model sensitivity while variance-based global sensitivity analysis seeks a quantitative mapping from total output variance to the variance of individual inputs. Application of these techniques to several outputs of a Mars ascent vehicle concept simulation indicates that only a select few input factors dominate their variance.

Noyes, Connor↗
DOE OSTI2023

Develop and Connect TRISO Failure Analysis and Uncertainty Quantification to Fission Product Release Calculation Capability

The U.S. Department of Energy’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program aims to develop predictive capabilities by applying computational methods to the analysis and design of advanced reactor and fuel cycle systems. This program has been providing engineering-scale support for the development of BISON, a high-fidelity and high-resolution fuel performance tool. Stress-based failure probability has been developed and analyzed to assess the integrity of tri-structural isotropic (TRISO) fuel particles during fuel life cycles. While simple, stress-based approaches to failure probability leveraging the Weibull statistical distribution entails a number of drawbacks when stress concentration occurs near crack tips, including finite element mesh size dependency. In this report, we use an interaction integral approach to the computation of stress intensity factors in functionally graded materials (FGM) for axisymmetric models. The inner pyrolytic carbon (IPyC) cracking induced silicon carbide (SiC) failure is one of the dominated failure modes in TRISO failure analysis. In this study, we consider a crack in the IPyC layer perpendicular to the SiC layer. The interface between these two TRISO layers is considered to be porous, which we simulate considering a transition of mechanical properties over the porous length. These aspects are considered in the computation of stress intensity factor (SIF) from a fracture mechanics approach and compared with the known stress-based failure probability approach.

42 ENGINEERING↗
NASA NTRS2016

Substructure Versus Property-Level Dispersed Modes Calculation

This paper calculates the effect of perturbed finite element mass and stiffness values on the eigenvectors and eigenvalues of the finite element model. The structure is perturbed in two ways: at the "subelement" level and at the material property level. In the subelement eigenvalue uncertainty analysis the mass and stiffness of each subelement is perturbed by a factor before being assembled into the global matrices. In the property-level eigenvalue uncertainty analysis all material density and stiffness parameters of the structure are perturbed modified prior to the eigenvalue analysis. The eigenvalue and eigenvector dispersions of each analysis (subelement and property-level) are also calculated using an analytical sensitivity approximation. Two structural models are used to compare these methods: a cantilevered beam model, and a model of the Space Launch System. For each structural model it is shown how well the analytical sensitivity modes approximate the exact modes when the uncertainties are applied at the subelement level and at the property level.

Stewart, Eric C.↗
NASA NTRS2010

Using MERRA Gridded Innovations for Quantifying Uncertainties in Analysis Fields and Diagnosing Observing System Inhomogeneities

MERRA is a NASA reanalysis for the satellite era using a major new version of the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5). The project focuses on historical analyses of the hydrological cycle on a broad range of weather and climate time scales and places the NASA EOS suite of observations in a climate context. The characterization of uncertainty in reanalysis fields is a commonly requested feature by users of such data. While intercomparison with reference data sets is common practice for ascertaining the realism of the datasets, such studies typically are restricted to long term climatological statistics and seldom provide state dependent measures of the uncertainties involved. In principle, variational data assimilation algorithms have the ability of producing error estimates for the analysis variables (typically surface pressure, winds, temperature, moisture and ozone) consistent with the assumed background and observation error statistics. However, these "perceived error estimates" are expensive to obtain and are limited by the somewhat simplistic errors assumed in the algorithm. The observation minus forecast residuals (innovations) by-product of any assimilation system constitutes a powerful tool for estimating the systematic and random errors in the analysis fields. Unfortunately, such data is usually not readily available with reanalysis products, often requiring the tedious decoding of large datasets and not so-user friendly file formats. With MERRA we have introduced a gridded version of the observations/innovations used in the assimilation process, using the same grid and data formats as the regular datasets. Such dataset empowers the user with the ability of conveniently performing observing system related analysis and error estimates. The scope of this dataset will be briefly described. We will present a systematic analysis of MERRA innovation time series for the conventional observing system, including maximum-likelihood estimates of background and observation errors, as well as global bias estimates. Starting with the joint PDF of innovations and analysis increments at observation locations we propose a technique for diagnosing bias among the observing systems, and document how these contextual biases have evolved during the satellite era covered by MERRA.

da Silva, Arlindo↗
DOE OSTI2025

Environmental life cycle assessment methods applied to amine-ionic liquid hybrid CO 2 absorbents

A hybrid solvent mixture of triethyl(octyl)phosphonium cyanopyrrolide [P2228][2-CNPyr] and aqueous monoethanolamine (MEA) has the potential for absorbing CO 2 from post combustion flue gas. However, previous studies have found that the production of phosphonium based ionic liquids (IL) had significantly higher potential environmental impacts compared to MEA. Literature attributes these higher environmental impacts to the phosphine and phosgene-based intermediates required to produce the phosphonium ion of the ionic liquid. This study proposes a novel synthesis pathway that eliminates the need for phosphine and phosgene intermediates in the production of [P2228][2-CNPyr]. The environmental impacts of producing 1kg of the ionic liquid through this novel synthesis route was evaluated using the TRACI 2.1 methodology within the life cycle assessment (LCA) framework. Additionally, the environmental impacts for the production of 1kg of a hybrid solvent was also evaluated and compared against MEA. The life cycle inventory for the production of the IL and its hybrid solvent were calculated based on the stoichiometry and then scaled up. This study found that the IL and its hybrid solvents had higher environmental impacts among 9 of the 10 environmental impact categories calculated by the TRACI 2.1 methodology, except for the ecotoxicity potential. A sensitivity analysis indicated that these solvents were more sensitive to the assumptions of the material requirements of the phosphonium cation than the overall energy or transportation requirements. Despite this sensitivity, both the solvents demonstrated a lower Ecotoxicity Potential compared to MEA, the rest of the environmental impacts were still found to be higher than that of MEA, thereby underscoring the need to investigate novel synthesis routes for the production of phosphonium cation. The uncertainty analysis performed confirmed the findings that the IL has a higher environmental impact potentials across all categories except ecotoxicity potential. The uncertainty analysis also confirms that the phosphonium cation is a major hotspot in production route of these solvents and a source of uncertainty in the model compared to the anion. Altogether, this study underscores the need for investigating novel green chemistry pathway for the synthesis of phosphonium based ionic liquids, such as [P2228][2-CNPyr], to ensure that the these ILs can be a truly green alternative to MEA by not only offering superior CO₂ capture capacity compared to MEA but also being sustainably produced.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Post-Fukushima Research and Development Strategy for MELCOR

Numerous MELCOR modeling improvements and analyses have been performed in the time since the severe accidents at Fukushima Daiichi Nuclear Power Station that occurred in March 2011. This report briefly summarizes the related accident reconstruction and uncertainty analysis efforts. It further discusses a number of potential pursuits to further advance MELCOR modeling and analysis of the severe accidents at Fukushima Daiichi and severe accident modeling in general. Proposed paths forward include further enhancements to identified MELCOR models primarily impacting core degradation calculations, and continued application of uncertainty analysis methods to improve model performance and a develop deeper understanding of severe accident progression.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

Uncertainty evaluation for twist drilling stability model

This paper describes the first uncertainty analysis for drilling stability using a frequency-domain drilling stability model. The stability model inputs include: the modal parameters for the torsional-axial vibration mode from the twist drill-holder-spindle axial frequency response function; and the mechanistic coefficients that relate the torque and thrust force to chip area for the selected drill-workpiece material combination. Furthermore, Monte Carlo simulation is applied to propagate the input uncertainties to output uncertainty in the predicted stability map, which separates stable from unstable (chatter) zones in the spindle speed-chip width parameter space. Additionally, the mean stability boundary and its 95% confidence intervals are determined for five cases: varying all four inputs simultaneously and varying them individually. This enables the individual sensitivities to be compared. Experimental results from drilling tests are included for comparison to the prediction. Additionally, Matlab code is provided to implement the stability model and Monte Carlo uncertainty analysis.

42 ENGINEERING↗
DOE OSTI2024

Multilevel Monte Carlo Estimators For Derivative-Free Optimization Under Uncertainty

Optimization is a key tool for scientific and engineering applications; however, in the presence of models affected by uncertainty, the optimization formulation needs to be extended to consider statistics of the quantity of interest. Optimization under uncertainty (OUU) deals with this endeavor and requires uncertainty quantification analyses at several design locations; i.e., its overall computational cost is proportional to the cost of performing a forward uncertainty analysis at each design location. An OUU workflow has two main components: an inner loop strategy for the computation of statistics of the quantity of interest, and an outer loop optimization strategy tasked with finding the optimal design, given a merit function based on the inner loop statistics. Here, in this work, we propose to alleviate the cost of the inner loop uncertainty analysis by leveraging the so-called multilevel Monte Carlo (MLMC) method, which is able to allocate resources over multiple models with varying accuracy and cost. The resource allocation problem in MLMC is formulated by minimizing the computational cost given a target variance for the estimator. We consider MLMC estimators for statistics usually employed in OUU workflows and solve the corresponding allocation problem. For the outer loop, we consider a derivative-free optimization strategy implemented in the SNOWPAC library; our novel strategy is implemented and released in the Dakota software toolkit. We discuss several numerical test cases to showcase the features and performance of our approach with respect to its Monte Carlo single fidelity counterpart.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Coal Fired Power Plant Configuration and Operation Impact on Plant Effluent Contaminants and Conditions

The primary objective of this project is to characterize coal contaminants in coal-fired power plant wastewater as a function of coal type, unit configurations, and unit operation profile with uncertainty analysis. This project was in response to the U.S. Department of Energy (DOE) Solicitation DE-FOA-0001842. The project duration was between September 01, 2018, and December 31, 2021 (no-cost extension filed, due to the Covid-19 pandemic restrictions, and approved). Field and lab test program was conducted with the main goal to characterize coal contaminants in coal-fired power plant wastewater as a function of coal type, unit configurations, and unit operation profile with uncertainty analysis. In this project, the team of Lehigh University (prime recipient) and Western Kentucky University identified two suitable Thermoelectric Power Plants (TTPs) firing bituminous and sub-bituminous coals respectively, designed test plans, and performed sample collection. Sampling included coal from each TTPs power generation units, Wet Flue Gas Desulfurization (WFGD) slurry material and waste-water samples taken from the outlet of the water treatment tank prior to discharge and other pertinent locations. Coal samples are dried, crushed, and pulverized according to the American Society for Testing and Materials (ASTM) methods. The prepared coal samples are analyzed for normal proximate and ultimate analysis tests in addition to the toxic metals and anions according to ASTM methods. The FGD slurry materials are analyzed for toxic metals and anions according to Electric Power Research Institute (EPRI) or Environmental Protection Agency (EPA) methods, as appropriate. The wastewater samples from the water treatment tank outlet are analyzed for toxic metals and anions according to EPA methods. The effluent species analyzed include mercury, arsenic, selenium, nitrate/nitrite, bromide, and chlorine. This project provided results of effluent conditions as a function of coal type, unit configuration, and unit operation profile, and identified the levels of uncertainty in the effluent results.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2020

Goldsim Modeling of Vadose Zone Transport for E-Area Naval Reactor Component Disposal Areas: Model Description and Benchmarking

This report documents the development of a GoldSim® model of flow and radionuclide transport to the water table through the Naval Reactor Components Disposal Area (NRCDA) waste disposal sites and underlying vadose zones. The model is designed to be used for Monte Carlo uncertainty analysis in support of the E-Area Performance Assessment (PA). This report describes the model and shows results obtained from benchmarking the model to best-estimate deterministic results obtained using a PORFLOW model of NRCDA vadose zone transport. The PORFLOW model is three-dimensional while the GoldSim model is a simplified one-dimensional treatment. Nevertheless, the GoldSim model was able to accurately reproduce PORFLOW results with some adjustment to the nominal dispersion coefficient and vadose zone flow area used as “tuning” parameters. An example of the results obtained comparing GoldSim and PORFLOW calculation of releases of I-129, Tc-99, C-14 and Ni-59 from waste disposal containers at the 643-26E site is shown in Figure 1 below. For all of the test cases evaluated, GoldSim predicted peak concentrations within 6% of the PORFLOW values and peak times agreed within 8% with the majority of the results in better agreement. The close agreement between the two models provides confidence that GoldSim will give results accurately reflecting the behavior of releases from the NRCDA under off-normal operating conditions for sensitivity and uncertainty analysis

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

A Comprehensive Analysis of Uncertainties in Warm-Rain Parameterizations in Climate Models Based on In Situ Measurements

Abstract Because of the coarse grid size of Earth system models (ESMs), representing warm-rain processes in ESMs is a challenging task involving multiple sources of uncertainty. Previous studies evaluated warm-rain parameterizations mainly according to their performance in emulating collision–coalescence rates for local droplet populations over a short period of a few seconds. The representativeness of these local process rates comes into question when applied in ESMs for grid sizes on the order of 100 km and time steps on the order of 20–30 min. We evaluate several widely used warm-rain parameterizations in ESM application scenarios. In the comparison of local and instantaneous autoconversion rates, the two parameterization schemes based on numerical fitting to stochastic collection equation (SCE) results perform best. However, because of Jessen’s inequality, their performance deteriorates when grid-mean, instead of locally resolved, cloud properties are used in their simulations. In contrast, the effect of Jessen’s inequality partly cancels the overestimation problem of two semianalytical schemes, leading to an improvement in the ESM-like comparison. In the assessment of uncertainty due to the large time step of ESMs, it is found that the rainwater tendency simulated by the SCE is roughly linear for time steps smaller than 10 min, but the nonlinearity effect becomes significant for larger time steps, leading to errors up to a factor of 4 for a time step of 20 min. After considering all uncertainties, the grid-mean and time-averaged rainwater tendency based on the parameterization schemes is mostly within a factor of 4 of the local benchmark results simulated by SCE.

Meteorology & Atmospheric Sciences↗
NASA NTRS1977

Monte Carlo analysis of uncertainty propagation in a stratospheric model. 1: Development of a concise stratospheric model

A concise model has been developed to analyze uncertainties in stratospheric perturbations, yet uses a minimum of computer time and is complete enough to represent the results of more complex models. The steady state model applies iteration to achieve coupling between interacting species. The species are determined from diffusion equations with appropriate sources and sinks. Diurnal effects due to chlorine nitrate formation are accounted for by analytic approximation. The model has been used to evaluate steady state perturbations due to injections of chlorine and NO(X).

Rundel, R. D.↗
NASA NTRS1995

Analysis of uncertainty in force balance calibration

In order to reduce errors encountered in the measurement and identification of loads using force balances, a third-order forward polynomial relation between loads and output voltages is proposed. This full third-order model represents an alternative to the second-order model currently in use at NASA Langley Research Center (LaRC) and many other installations worldwide. The new model requires the identification of 84 coefficients (including the 28 used presently) for each of the six outputs. The existing LaRC calibration loading sequence is insufficient for identification of many of these 504 coefficients because critical three-load combinations are absent. Accordingly, a new loading sequence that permits the identification of all 504 coefficients has been developed and is described fully. It is apparent from numerical tests that the new third-order model is clearly superior to second-order models in the presence of small amounts of random measurement noise, assuming that there are indeed higher-order interactions between loads. As the amount of noise increases, however, a third-order model becomes less attractive due to its ability to match the noise itself more faithfully than a second-order model. Numerical results suggest that the transition occurs when the magnitude of random noise becomes of the same order as that of the physical higher-order interactions.

Bursal, Faruk H.↗