Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Dynamic Testing of a High-Specific-Torque Concentric Magnetic Gear

This presentation presents measurements of the efficiency of NASA's 2nd magnetic gear prototype. A detailed discussion of the test rig used to make these measurements was presented, including a thorough uncertainty analysis. The reported uncertainties are 95% confidence intervals that include the effects of temperature and parasitic loads. The prototype's response was measured at output speeds between 124 rpm and 744 rpm for a controlled output torque of 10 Nm (8% of the prototype's maximum torque). After correcting for tare losses, the prototype's efficiency was found to decrease from 90.0% to 83.0% as speed increased. If the efficiency is extrapolated to a typical operating condition (85% of maximum torque) using the good assumption that energy loss is approximately independent of the transmitted torque,the expected efficiency would be 99.0% to 98.4%, which exceeds the state of the art for these speeds.

Scheidler, Justin↗

High Speed Testing of a High Efficiency Concentric Magnetic Gear

This presentation presents measurements of the efficiency of NASA's 2nd magnetic gear prototype. A detailed discussion of the test rig used to make these measurements was presented, including a thorough uncertainty analysis. The reported uncertainties are 95% confidence intervals that include the effects of temperature and parasitic loads. The prototype's response was measured at output speeds between 124 rpm and 744 rpm for a controlled output torque of 10 Nm (8% of the prototype's maximum torque). After correcting for tare losses, the prototype's efficiency was found to decrease from 90.0% to 83.0% as speed increased. If the efficiency is extrapolated to a typical operating condition (85% of maximum torque) using the good assumption that energy loss is approximately independent of the transmitted torque,the expected efficiency would be 99.0% to 98.4%, which exceeds the state of the art for these speeds.

Scheidler, Justin↗

Towards an Optimal Estimation Retrieval of Cirrus Cloud Optical and Microphysical Properties Using Hyperspectral Shortwave Instruments and A Fast Radiative Transfer Algorithm

Cirrus cloud retrieval products (here, cloud optical depth, effective particle size, and cloud top height) are important inputs into numerical weather and climate models. Uncertainties in such retrieval products, as a matter of course, propagate downstream, impacting model calculations. Improvements in high-quality global cirrus cloud optical and microphysical data products from satellite observations are needed to understand and reduce retrieval uncertainties. Hyperspectral shortwave instruments produce high-resolution and information-dense spectra, thus offering the opportunity to reduce uncertainties in retrieval products. We are in the process of developing a retrieval that uses the very fast Principal Component Radiative Transfer Model in the solar spectral region (PCRTM-Solar) in the forward model calculations. This retrieval will use measured reflectances from the NASA Earth Surface Mineral Dust Source Investigation (EMIT) and the forthcoming Climate Absolute Radiance and Refractivity Observatory Pathfinder (CLARREO-Pathfinder) instruments. In this manuscript we present progress towards a reference retrieval employing a widely used, verified, accurate, yet computationally slower radiative transfer modeling technique. The reference retrieval, while too slow for using the complete hyperspectral measurement, will allow us to study the behavior of retrieval products and help us verify results from our in-development fast retrieval. Both retrievals will use the optimal estimation retrieval framework. In this manuscript we present results from an uncertainty analysis considering three uncertainty sources for a cirrus cloud retrieval in the form of error covariance matrices: reflectance uncertainty due to water vapor, the reflectance uncertainty due to ice crystal scattering assumptions, and the instrument measurement uncertainty. Results show that the uncertainty due to habit selection is the largest, while that due to water vapor is at most 0.6% relative to channel reflectance. As a first step, the retrieval is being designed for single layer ice clouds over open ocean water.

Cirrus cloud↗

Uncertainty of Passive Imager Cloud Optical Property Retrievals to Instrument Radiometry and Model Assumptions: Examples from MODIS

The optical and microphysical structure of clouds is of fundamental importance for understanding a variety of cloud radiation and precipitation processes. With the advent of MODIS on the NASA EOS Terra and Aqua platforms, simultaneous global-daily 1 km retrievals of cloud optical thickness (COT) and effective particle radius (CER) are provided, as well as the derived water path (WP). The cloud product (MOD06/MYD06 for MODIS Terra and Aqua, respectively) provides separate retrieval datasets for various two-channel retrievals, typically a VISNIR channel paired with a 1.6, 2.1, and 3.7 m spectral channel. The MOD06 forward model is derived from on a homogeneous plane-parallel cloud. In Collection 5 processing (completed in 2007 with a modified Collection 5.1 completed in 2010), pixel-level retrieval uncertainties were calculated for the following non-3-D error sources: radiometry, surface spectral albedo, and atmospheric corrections associated with model analysis uncertainties (water vapor only). The latter error source includes error correlation across the retrieval spectral channels. Estimates of uncertainty in 1 aggregated (Level-3) means were also provided assuming unity correlation between error sources for all pixels in a grid for a single day, and zero correlation of error sources from one day to the next. I n Collection 6 (expected to begin in late summer 2013) we expanded the uncertainty analysis to include: (a) scene-dependent calibration uncertainty that depends on new band and detector-specific Level 1B uncertainties, (b) new model error sources derived from the look-up tables which includes sensitivities associated with wind direction over the ocean and uncertainties in liquid water and ice effective variance, (c) thermal emission uncertainties in the 3.7 m band associated with cloud and surface temperatures that are needed to extract reflected solar radiation from the total radiance signal, (d) uncertainty in the solar spectral irradiance at 3.7 m, and (e) addition of stratospheric ozone uncertainty in visible atmospheric corrections. A summary of the approach and example Collection 6 results will be shown.

Cloud Properties Observations↗

SCALE Sensitivity Tutorial [Slides]

In sensitivity analysis, we seek to quantify the degree to which fundamental data (i.e., nuclear data) influence a system’s response. In uncertainty analysis, we seek to quantify the degree to which uncertainty in fundamental data contributes to uncertainty in a system’s response. In SCALE, the TSUNAMI suite provides tools for sensitivity and uncertainty analysis, similarity analysis, and nuclear data and covariance adjustment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ASCoT 3: Nonlinear Principal Components Analysis and Uncertainty Quantification in Early Concept Spacecraft Flight Software Cost Estimation

For mission planners and evaluators alike, value in cost models comes from a mean or median prediction, an understanding of the uncertainty on that prediction, and an understanding of model performance. Here we apply advanced statistical and machine learning methods to spacecraft flight software cost, effort, and SLOC estimation, and present the results in the latest version of the Analogy Software Cost Tool (ASCoT). We present in- and out-of-sample performance metrics for our models, each of which incorporate some amount of epistemic uncertainty. ASCoT, hosted on the One NASA Cost Engineering (ONCE) database via the Online NASA Space Estimation Tool (ONSET), was first showcased in 2016 as a number of analogy-based models and methods (kNN and Clustering) to support early project formulation. This ASCoT update improves upon the previous analogic methods by incorporating uncertainty in the data transformations. In particular, we use a Nonlinear Principal Components Analysis (NLPCA) to deal with ordinal data.

Robotic Spacecraft↗

A game-theoretic approach to nuclear fuel cycle transition analysis under uncertainty

We present a novel methodology for optimizing nuclear fuel cycle transitions that incorporates a game-theoretic approach and captures interactions among multiple decision makers. The methodology is demonstrated using a two-person sequential game with uncertainty, where the two players represent a policy maker and an electric utility company, though the method generalizes to any number and type of individual decision making entities. Coupled with a sophisticated nuclear fuel cycle simulator, rich transition scenarios may be analyzed to identify robust transition strategies. These strategies explicitly treat uncertainties using a stochastic programming approach, devising optimal near-term hedging strategies that simultaneously consider all possible states of the world, maintaining flexibility to allow for intelligent recourse decisions once uncertainties are resolved. In the demonstration game, reactor technology and fuel cycle scheme adopted by the electric utility are shown to depend on both the policy maker’s decisions and the distributions over uncertain technological and economic outcomes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantifying uncertainty in analysis of shockless dynamic compression experiments on platinum. II. Bayesian model calibration

Dynamic shockless compression experiments provide the ability to explore material behavior at extreme pressures but relatively low temperatures. Typically, the data from these types of experiments are interpreted through an analytic method called Lagrangian analysis. Here, in this work, alternative analysis methods are explored using modern statistical methods. Specifically, Bayesian model calibration is applied to a new set of platinum data shocklessly compressed to 570 GPa. Several platinum equation-of-state models are evaluated, including traditional parametric forms as well as a novel non-parametric model concept. The results are compared to those in Paper I obtained by inverse Lagrangian analysis. The comparisons suggest that Bayesian calibration is not only a viable framework for precise quantification of the compression path, but also reveals insights pertaining to trade-offs surrounding model form selection, sensitivities of the relevant experimental uncertainties, and assumptions and limitations within Lagrangian analysis. The non-parametric model method, in particular, is found to give precise unbiased results and is expected to be useful over a wide range of applications. The calibration results in estimates of the platinum principal isentrope over the full range of experimental pressures to a standard error of 1.6%, which extends the results from Paper I while maintaining the high precision required for the platinum pressure standard.

Brown, Justin Lee↗

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗

Lognormal Uncertainty Estimation for Failure Rates

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain. Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This presentation will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗

TPSAS-NF1676L-17243-DND

This presentation captures ERA Project's effort in using integrated cost-schedule-risk analysis tool, identifying and capturing explicit relationships between program funds, schedule, and discrete risks. The project team merged a myriad of cost and schedule data for timely, objective, uncertainty analysis of the ITD's budget and schedule. The project team conducted detailed schedule uncertainty analysis showing schedule activities and how their interrelationships were impacted, representing an impressive advance beyond routine Gantt charts. Furthermore, the ERA Project collected discrete risk events including their impacts to costs and/or schedule and interwove these risks into cost and schedule logic networks, providing the foundation to conduct cost and schedule analyses. The team integrated this data into the analysis model, providing probabilistic results that were then used by the ERA Project's senior management for decision-making purposes. The ERA Project management team, through technical and pathfinder expertise in integrating cost, schedule, risk, and technical content, consistently provided risk-informed recommendations to Implementing Centers and ISRP senior management which ultimately ensured the successful ARMD Key Decision Point (KDP) review of the ERA Phase 2 ITD Portfolio and increased the likelihood of achieving technical objectives within cost and schedule constraints.

Gaudy M Bezos-O'Connor↗

Challenges and Lessons Learned in Applying Sensitivity Analysis to Building Stock Energy Models

Uncertainty Analysis (UA) and Sensitivity Analysis (SA) offer essential tools to determine the limits of inference of a model and explore the factors which have the most effect on the model outputs. However, despite a well established body of work applying UA and SA to models of individual buildings, a review of the literature relating to energy models for larger groups of buildings undertaken by Fennell et al. (2019) highlighted very limited application at larger scales. This contribution describes the efforts undertaken by a group of research teams in the context of IEA-EBC Annex 70 working with a diverse set of Building Stock Models (BSMs) to apply global sensitivity analysis methods and compare their results. Since BSMs are a class of model defined by their output and coverage rather than their structure and inputs, they represent a diverse set of modelling approaches. Key challenges for the application of SA are identified and explored, including the influence of model form, input data types and model outputs. This study combines results from 7 different modelling teams, each using different models across a range of urban areas to explore these challenges and begin the process of developing standardised workflows for SA of BSMs.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗

Sensitivity Analysis and Uncertainty Quantification of a Mars Ascent Vehicle Concept

The design of a conceptual Mars ascent vehicle is a challenging problem. In order to aid the vehicle and mission concept design it is important to understand the driving design parameters and the expected performance in the presence of model errors and uncertainties. An existing six degree of freedom simulation model is analyzed on a statistical basis using the methods available in the Design Analysis Kit for Optimization and Terascale Applications toolkit. The methods utilized include conventional Monte Carlo techniques, metamodeling via polynomial chaos expansions, and global variance-based sensitivity analyses. Two additional analysis methods referred to as “Monte Carlo filtering” and ”Classification trees” are used to determine which uncertain parameters are driving the performance of the vehicle. Monte Carlo filtering provides a methodology to determine which parameters cause qualitatively different behavior while the classification trees use heuristics to partition the input space and assign probabilities to each partition. These methods serve as qualitative descriptors of model sensitivity while variance-based global sensitivity analysis seeks a quantitative mapping from total output variance to the variance of individual inputs. Application of these techniques to several outputs of a Mars ascent vehicle concept simulation indicates that only a select few input factors dominate their variance.

Noyes, Connor↗

Develop and Connect TRISO Failure Analysis and Uncertainty Quantification to Fission Product Release Calculation Capability

The U.S. Department of Energy’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program aims to develop predictive capabilities by applying computational methods to the analysis and design of advanced reactor and fuel cycle systems. This program has been providing engineering-scale support for the development of BISON, a high-fidelity and high-resolution fuel performance tool. Stress-based failure probability has been developed and analyzed to assess the integrity of tri-structural isotropic (TRISO) fuel particles during fuel life cycles. While simple, stress-based approaches to failure probability leveraging the Weibull statistical distribution entails a number of drawbacks when stress concentration occurs near crack tips, including finite element mesh size dependency. In this report, we use an interaction integral approach to the computation of stress intensity factors in functionally graded materials (FGM) for axisymmetric models. The inner pyrolytic carbon (IPyC) cracking induced silicon carbide (SiC) failure is one of the dominated failure modes in TRISO failure analysis. In this study, we consider a crack in the IPyC layer perpendicular to the SiC layer. The interface between these two TRISO layers is considered to be porous, which we simulate considering a transition of mechanical properties over the porous length. These aspects are considered in the computation of stress intensity factor (SIF) from a fracture mechanics approach and compared with the known stress-based failure probability approach.

42 ENGINEERING↗

Substructure Versus Property-Level Dispersed Modes Calculation

This paper calculates the effect of perturbed finite element mass and stiffness values on the eigenvectors and eigenvalues of the finite element model. The structure is perturbed in two ways: at the "subelement" level and at the material property level. In the subelement eigenvalue uncertainty analysis the mass and stiffness of each subelement is perturbed by a factor before being assembled into the global matrices. In the property-level eigenvalue uncertainty analysis all material density and stiffness parameters of the structure are perturbed modified prior to the eigenvalue analysis. The eigenvalue and eigenvector dispersions of each analysis (subelement and property-level) are also calculated using an analytical sensitivity approximation. Two structural models are used to compare these methods: a cantilevered beam model, and a model of the Space Launch System. For each structural model it is shown how well the analytical sensitivity modes approximate the exact modes when the uncertainties are applied at the subelement level and at the property level.

Stewart, Eric C.↗

Using MERRA Gridded Innovations for Quantifying Uncertainties in Analysis Fields and Diagnosing Observing System Inhomogeneities

MERRA is a NASA reanalysis for the satellite era using a major new version of the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5). The project focuses on historical analyses of the hydrological cycle on a broad range of weather and climate time scales and places the NASA EOS suite of observations in a climate context. The characterization of uncertainty in reanalysis fields is a commonly requested feature by users of such data. While intercomparison with reference data sets is common practice for ascertaining the realism of the datasets, such studies typically are restricted to long term climatological statistics and seldom provide state dependent measures of the uncertainties involved. In principle, variational data assimilation algorithms have the ability of producing error estimates for the analysis variables (typically surface pressure, winds, temperature, moisture and ozone) consistent with the assumed background and observation error statistics. However, these "perceived error estimates" are expensive to obtain and are limited by the somewhat simplistic errors assumed in the algorithm. The observation minus forecast residuals (innovations) by-product of any assimilation system constitutes a powerful tool for estimating the systematic and random errors in the analysis fields. Unfortunately, such data is usually not readily available with reanalysis products, often requiring the tedious decoding of large datasets and not so-user friendly file formats. With MERRA we have introduced a gridded version of the observations/innovations used in the assimilation process, using the same grid and data formats as the regular datasets. Such dataset empowers the user with the ability of conveniently performing observing system related analysis and error estimates. The scope of this dataset will be briefly described. We will present a systematic analysis of MERRA innovation time series for the conventional observing system, including maximum-likelihood estimates of background and observation errors, as well as global bias estimates. Starting with the joint PDF of innovations and analysis increments at observation locations we propose a technique for diagnosing bias among the observing systems, and document how these contextual biases have evolved during the satellite era covered by MERRA.

da Silva, Arlindo↗

Environmental life cycle assessment methods applied to amine-ionic liquid hybrid CO 2 absorbents

A hybrid solvent mixture of triethyl(octyl)phosphonium cyanopyrrolide [P2228][2-CNPyr] and aqueous monoethanolamine (MEA) has the potential for absorbing CO 2 from post combustion flue gas. However, previous studies have found that the production of phosphonium based ionic liquids (IL) had significantly higher potential environmental impacts compared to MEA. Literature attributes these higher environmental impacts to the phosphine and phosgene-based intermediates required to produce the phosphonium ion of the ionic liquid. This study proposes a novel synthesis pathway that eliminates the need for phosphine and phosgene intermediates in the production of [P2228][2-CNPyr]. The environmental impacts of producing 1kg of the ionic liquid through this novel synthesis route was evaluated using the TRACI 2.1 methodology within the life cycle assessment (LCA) framework. Additionally, the environmental impacts for the production of 1kg of a hybrid solvent was also evaluated and compared against MEA. The life cycle inventory for the production of the IL and its hybrid solvent were calculated based on the stoichiometry and then scaled up. This study found that the IL and its hybrid solvents had higher environmental impacts among 9 of the 10 environmental impact categories calculated by the TRACI 2.1 methodology, except for the ecotoxicity potential. A sensitivity analysis indicated that these solvents were more sensitive to the assumptions of the material requirements of the phosphonium cation than the overall energy or transportation requirements. Despite this sensitivity, both the solvents demonstrated a lower Ecotoxicity Potential compared to MEA, the rest of the environmental impacts were still found to be higher than that of MEA, thereby underscoring the need to investigate novel synthesis routes for the production of phosphonium cation. The uncertainty analysis performed confirmed the findings that the IL has a higher environmental impact potentials across all categories except ecotoxicity potential. The uncertainty analysis also confirms that the phosphonium cation is a major hotspot in production route of these solvents and a source of uncertainty in the model compared to the anion. Altogether, this study underscores the need for investigating novel green chemistry pathway for the synthesis of phosphonium based ionic liquids, such as [P2228][2-CNPyr], to ensure that the these ILs can be a truly green alternative to MEA by not only offering superior CO₂ capture capacity compared to MEA but also being sustainably produced.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Post-Fukushima Research and Development Strategy for MELCOR

Numerous MELCOR modeling improvements and analyses have been performed in the time since the severe accidents at Fukushima Daiichi Nuclear Power Station that occurred in March 2011. This report briefly summarizes the related accident reconstruction and uncertainty analysis efforts. It further discusses a number of potential pursuits to further advance MELCOR modeling and analysis of the severe accidents at Fukushima Daiichi and severe accident modeling in general. Proposed paths forward include further enhancements to identified MELCOR models primarily impacting core degradation calculations, and continued application of uncertainty analysis methods to improve model performance and a develop deeper understanding of severe accident progression.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗