Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty Propagation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Sizing and Topology Design of an Aeroelastic Wingbox Under Uncertainty

The goals of this work are to use a nested optimizer to conduct simultaneous sizing (inner level) and topology (outer level) design of a wingbox, considering uncertainties in the safety factors used to define the aeroelastic constraints. These uncertainties, propagated via sampling-driven polynomial chaos, are explicitly introduced at the inner level of the method, during gradient-based sizing optimization, resulting in a stochastic optimal sizing distribution. Measures of robustness in the total structural mass are then passed to the outer level, where a global optimizer evolves the topology parameters. The results demonstrate design choices needed to improve robustness in the face of uncertain safety factors, and the various physical mechanisms driving this process.

Stanford, Bret K.↗
NASA NTRS2020

Multi Model Monte Carlo with Python (MXMCPy)

Multi Model Monte Carlo with Python (\mxmc {}) is a software package developed as a general capability for computing the statistics of outputs from an expensive, high-fidelity model by leveraging faster, low-fidelity models for speedup. Motivated by uncertainty propagation problems where classical Monte Carlo (MC) simulation is computationally intractable, various multi-model MC approaches have recently emerged that yield unbiased estimators with significantly reduced variance relative to MC for the same cost. These existing methods include multi-level Monte Carlo (MLMC), multi-fidelity Monte Carlo (MFMC), and approximate control variates (ACV). Given a fixed computational budget and a collection of models with varying cost/accuracy, each method seeks a sample allocation strategy across the models that results in an estimator with optimal variance reduction. \mxmc {} is a versatile tool that enables convenient access to many existing multi-model MC approaches within one modular and extensible package. With \mxmc {}, users can easily compare existing methods to determine the best choice for their particular problem, while developers have a basis for implementing and sharing new variance reduction approaches. This report introduces the \mxmc {} software, providing a summary of the problem-solving workflow for users as well as a brief overview of the code layout for developers.

Geoffrey F Bomarito↗
NASA NTRS2020

Improved LOLA Elevation Maps for South Pole Landing Sites: Error Estimates and Their Impact on Illumination Conditions

We present new high-resolution topographic models of 4 high-priority lunar south pole landing sites based exclusively on the laser altimetry data acquired by the Lunar Orbiter Laser Altimeter (LOLA) onboard the Lunar Reconnaissance Orbiter. By iteratively adjusting the LOLA tracks to the LOLA-based digital elevation model (LDEM) in a self-consistent fashion, we reduce the orbital geolocation errors by over a factor of 10 such that the new ground track geolocation uncertainty is ~10–20 ​cm horizontally and ~2–4 ​cm vertically over each 16 ​× ​16 km region. These new and improved 5 ​m/pix LDEMs will be useful to constrain higher-resolution topographic models derived from imagery, which are not as well controlled geodetically and which can be hindered by shadows. We developed a method to estimate surface height uncertainty in the new LDEMs, which accounts for the reduced orbital errors and interpolation errors by assuming a fractal behavior for the short-scale topography. The LDEM surface height and slope uncertainties have typical RMS values of ~0.30–0.50 ​m and ~1.5–2.5°, respectively. Finally, we examine how height uncertainties propagate to variations in horizon elevation and thus the predicted illumination conditions at these polar latitudes, and we show how this error characterization can inform landing site studies.

Michael K Barker↗
NASA NTRSDate not supplied

Advanced Turboprop Transport Aircraft Modeling for the Electrified Powertrain Flight Demonstration Project

The objective of this study is to establish models for state of the art, representative regional non-electrified turboprop configurations in the 19 to 50 passenger capability range and assess performance impacts from advanced aircraft technologies. Two of these models will serve as reference baseline configurations for comparison to electrified aircraft propulsion (EAP) demonstrator concepts for the Electrified Powertrain Flight Demonstration (EPFD) project. The other two non-electrified configurations will primarily assess the impacts of advanced technologies on fuel consumption and CO₂ emissions. This paper details an aircraft synthesis and performance analysis approach using the General Aviation Synthesis Program (GASP) which is used to establish baseline performance capabilities, calibrate airplane and engine models using published manufacturer data and conduct technology sensitivity studies. Advanced technologies are selected from the categories of propulsion, aerodynamics, and flight systems. A GASP-Monte Carlo simulation framework for uncertainty propagation is used to obtain performance distributions of the expected fuel burn, weight reduction and CO₂ emissions reductions from advanced aircraft technologies. Significant fuel burn savings from application of aerodynamics and propulsion technologies was observed.

Dahlia D.V. Pham↗
NASA NTRS2023

A Community Convention for Ecological Forecasting: Output Files and Metadata Version 1.0

This paper summarizes the open community conventions developed by the Ecological Forecasting Initiative (EFI) for the common formatting and archiving of ecological forecasts and the metadata associated with these forecasts. Such open standards are intended to promote interoperability and facilitate forecast communication, distribution, validation, and synthesis. For output files, we first describe the convention conceptually in terms of global attributes, forecast dimensions, forecasted variables, and ancillary indicator variables. We then illustrate the application of this convention to the two file formats that are currently preferred by the EFI, netCDF (network common data form), and comma-separated values (CSV), but note that the convention is extensible to future formats. For metadata, EFI's convention identifies a subset of conventional metadata variables that are required (e.g., temporal resolution and output variables) but focuses on developing a framework for storing information about forecast uncertainty propagation, data assimilation, and model complexity, which aims to facilitate cross-forecast synthesis. The initial application of this convention expands upon the Ecological Metadata Language (EML), a commonly used metadata standard in ecology. To facilitate community adoption, we also provide a Github repository containing a metadata validator tool and several vignettes in R and Python on how to both write and read in the EFI standard. Lastly, we provide guidance on forecast archiving, making an important distinction between short-term dissemination and long-term forecast archiving, while also touching on the archiving of code and workflows. Overall, the EFI convention is a living document that can continue to evolve over time through an open community process.

Michael C. Dietze↗
NASA NTRS2024

Sizing and Performance Analysis of a MW-Class Electrified Aircraft Propulsion (EAP) System for a Parallel Hybrid Turboprop Concept

Aircraft electrification has emerged as a pivotal research and development focus in the 21st century, gaining international momentum as a strategic approach to curtail fuel consumption and emissions in the civil aviation sector. Through the Electrified Powertrain Flight Demonstration (EPFD) project, NASA is collaborating with industry partners to develop and demonstrate Megawatt (MW) class Electrified Aircraft Propulsion (EAP) systems using regional turboprops, as well as single-aisle commercial transports. With the rapid emergence of novel EAP concepts, current efforts are focused on developing the capabilities to evaluate the impacts of electrification on vehicle-level performance. This requires parametric modeling at the conceptual design stage, using uncertainty propagation techniques to account for the high variability in EAP system architecture. This paper details an integrated approach to parametric sizing of multi-MW EAP systems in a large turboprop freighter concept with a parallel hybrid configuration. The primary goal is to assess vehicle-level performance sensitivities, such as range and fuel burn reduction, to variations in electrical system component-level performance metrics, including specific power, efficiency, and energy density, based on near-term EAP technology levels.

electrified aircraft propulsion↗
NASA NTRSDate not supplied

Proposed Reliability-Based Damage Tolerance Guidelines for Space Systems

Deterministic damage tolerance guidelines for highly reusable and efficiently designed launch systems can be challenging to meet and result in overly conservative assessments for tightly controlled manufacturing processes. Deterministic approaches may be unconservative when the structure is workmanship sensitive and there is a wide spread in fracture properties. Reliability-based damage tolerance assessments targeting a component reliability over the service life commensurate to mission risk posture is a promising alternative. Low production rates, short fleets, and lack of standards or guidance has slowed down widespread adoption of this method. Guidance for the robust application of reliability-based damage tolerance for space systems are proposed. These guidelines cover the treatment of uncertainty in damage tolerance analysis, the collection of data to develop probabilistic distributions, uncertainty propagation methods, and types of hardware.

Reliability-Based Damage Tolerance↗
NASA NTRS2024

Summary and Annotated Bibliography of Measurement Error Corrections with Potential Application in Future Quesst Mission Community Noise Studies

This document is motivated by likely needs of the Quesst mission community response tests, which will culminate in data collection and estimation of dose-response regression relationships for consideration by domestic and international aviation regulators. Furthermore, basic research questions evaluating interactions between rates of community annoyance, dose levels, and indicators of the presence of rattle, vibration, and startle hinge on hypothesis testing in the context of regression models. For a variety of reasons, noise doses may be known only imprecisely and may not reflect the actual level experienced by responding subjects. These differences between true dose and estimated dose, be they systematic or random, constitute covariate measurement error. Available statistics literature speaks to the impacts of measurement error on regression models, both in terms of bias in estimated coefficients and predicted values, and in terms of the loss of statistical power for hypothesis testing. Given the particulars of a categorical annoyance response variable and a continuous noise dose predictor variable subject to measurement error during testing, the emphasis of this report is on findings and methods pertinent to generalized linear (and mixed) models likely to be employed during the Quesst mission community tests. We reach the following conclusions: 1. Of four reviewed methods, structural Bayesian measurement error models and simulation extrapolation (SIMEX) may be the most readily applicable to Quesst mission community noise study objectives. 2. If warranted, a linear measurement model can help model systematic sources of measurement error that the classical measurement error does not. 3. For its ready implementation and small additional input requirements, simulation extrapolation may be ideally suited for addressing secondary research questions involving interactions between annoyance, noise dose, and other factors through hypothesis testing. 4. For their flexibility and ability to propagate uncertainty, structural Bayesian hierarchical models have great appeal for mission purposes; some care may be needed in developing appropriate probability models describing actual noise exposure during testing. An annotated bibliography logs additional papers and resources that may be of value to analysts in other projects and disciplines.

Dose-Response Model↗
DOE OSTI2025

A Risk-Informed Approach to Trustworthiness Assessment in Digital Twins-Based Autonomous Control

In autonomous control systems, digital twins (DTs) are used to perform diagnostic and prognostic functions. The trustworthiness of these DTs is dependent on quality and coverage of the training data, model accuracy and integrity of sensor data. This work introduces a methodology to determine the trustworthiness of a DT system given faulty sensor data using a risk informed approach. Bayesian Belief Networks (BBNs) are used to propagate uncertainties and determine the probability of trustable recommendations. The decision to trust the control action provided by the DT is based on the DT output, expert opinion, and severity of problems. The performance of DTs is reliant on the data they are trained on. When they encounter out of distribution data, the trustworthiness of the recommendations decreases. To address this issue, we include an expert component that provides input on sensor degradation. For this, we utilize a generative artificial intelligence (AI) model, such as Generative Pretrained Transformer (GPT). The GPT functions as an expert with broad knowledge. The GPT is fine-tuned to understand and discriminate sensor degradation scenarios using manufactured data. This methodology is demonstrated through a case study on a Nearly Autonomous Management and Control System (NAMAC) during a steady state scenario. Various sensor degradation types with different severity levels are considered. Degraded sensor data is processed by the DT system and the fine-tuned GPT. Finally, using the BBN, we combine the GPT information and the DT output with its sources of uncertainty. This provides an output regarding the trustworthiness of the DT recommendation.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Microstructural Topology as a Prescriptor for Quantum Coherence: Towards A Unified Framework for Decoherence in Superconducting Qubits

In superconducting quantum circuits, decoherence improvements are frequently obtained through process interventions that simultaneously modify surface chemistry, microstructural topology, and device geometry, leaving mechanistic attribution structurally underdetermined. Predictive materials engineering requires measurable structural statistics to be separated from geometry-dependent coupling coefficients into independently testable factors. We introduce the concept of classical and quantum microstructure. In that context, we formulate a channel-wise separable framework for decoherence in superconducting transmon qubits in which each loss channel is described by a reduced prescriptor. Here, a channel-specific microstructural state variable is determined independently of device geometry, and a geometry-dependent coupling functional is computable from field solutions without reference to surface chemistry. We derive this product form from a spatially resolved kernel representation and establish a perturbative separability criterion that defines the regime where independent variation of the variables is valid. The framework specifies five prescriptor classes for dominant loss pathways in transmon-class devices. Falsifiability is operationalized through a pre-committed 2x2 experimental protocol in which the variables must satisfy independent ratio checks within propagated uncertainty. A Minimum-Dataset Specification standardizes reporting for cross-laboratory inference. Part I establishes the conceptual and mathematical architecture; coordinated experimental validation is reserved for Part II.

Dravid, Vinayak P. [Northwestern U.]↗
NASA NTRS2019

Approach for Propagating Radiometric Data Uncertainties Through NASA Ocean Color Algorithms

Spectroradiometric satellite observations of the ocean are commonly referred to as “ocean color” remote sensing. NASA has continuously collected, processed, and distributed ocean color datasets since the launch of the Sea-viewing Wide-field-of-view Sensor (SeaWiFS) in 1997. While numerous ocean color algorithms have been developed in the past two decades that derive geophysical data products from sensor-observed radiometry, few papers have clearly demonstrated how to estimate measurement uncertainty in derived data products. As the uptake of ocean color data products continues to grow with the launch of new and advanced sensors, it is critical that pixel-by-pixel data product uncertainties are estimated during routine data processing. Knowledge of uncertainties can be used when studying long-term climate records, or to assist in the development and performance appraisal of bio-optical algorithms. In this method paper we provide a comprehensive overview of how to formulate first-order first-moment (FOFM) calculus for propagating radiometric uncertainties through a selection of bio-optical models. We demonstrate FOFM uncertainty formulations for the following NASA ocean color data products: chlorophyll-a pigment concentration (Chl), the diffuse attenuation coefficient at 490 nm (K(sub d,490)), particulate organic carbon (POC), normalized fluorescent line height (nflh), and inherent optical properties (IOPs). Using a quality-controlled in situ hyperspectral remote sensing reflectance (R(sub rs,i)) dataset, we show how computationally inexpensive, yet algebraically complex, FOFM calculations may be evaluated for correctness using the more computationally expensive Monte Carlo approach. We compare bio-optical product uncertainties derived using our test R(sub rs) dataset assuming spectrally-flat, uncorrelated relative uncertainties of 1, 5, and 10%. We also consider spectrally dependent, uncorrelated relative uncertainties in R(sub rs). The importance of considering spectral covariances in R(sub rs), where practicable, in the FOFM methodology is highlighted with an example SeaWiFS image. We also present a brief case study of two POC algorithms to illustrate how FOFM formulations may be used to construct measurement uncertainty budgets for ecologically-relevant data products. Such knowledge, even if rudimentary, may provide useful information to end-users when selecting data products or when developing their own algorithms.

Bio-optics↗
DOE OSTI2021

Propagation of Input Uncertainties in Numerical Simulations of Laser Powder Bed Fusion

Laser powder bed fusion has the potential of redefining state-of-the-art processing and production methods, but defect formation and inconsistent build quality have limited the implementation of this process. Numerical models are widely used to study this process and predict the formation of these defects. Presently, the uncertainties of model input parameters and thermophysical properties used by these numerical simulations have not been investigated. In the present study, the uncertainty in these input parameters and material properties are quantified for laser powder bed fusion, with and without a simulated powder bed, to determine their influence on the predictive accuracy of an experimentally validated numerical model. Accounting for all possible sources of uncertainty quickly becomes computationally expensive on account of the curse of dimensionality. Uncertainty in laser absorption, solid, and liquid specific heat of the metal were found to have the largest effect on model prediction reliability with or without the use of a powder bed. Results also illustrate that accounting for these three uncertain parameters still captures the majority of model prediction uncertainty. Furthermore, the methodology of this study may be used to understand the uncertainty in as-built microstructure through propagation to microstructure prediction models, or applied under processing conditions where high Péclet numbers are observed and the thermal convection and fluid flow within the molten pool are substantial.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Propagating sample variance uncertainties in redshift calibration: simulations, theory, and application to the COSMOS2015 data

ABSTRACT Cosmological analyses of galaxy surveys rely on knowledge of the redshift distribution of their galaxy sample. This is usually derived from a spectroscopic and/or many-band photometric calibrator survey of a small patch of sky. The uncertainties in the redshift distribution of the calibrator sample include a contribution from shot noise, or Poisson sampling errors, but, given the small volume they probe, they are dominated by sample variance introduced by large-scale structures. Redshift uncertainties have been shown to constitute one of the leading contributions to systematic uncertainties in cosmological inferences from weak lensing and galaxy clustering, and hence they must be propagated through the analyses. In this work, we study the effects of sample variance on small-area redshift surveys, from theory to simulations to the COSMOS2015 data set. We present a three-step Dirichlet method of resampling a given survey-based redshift calibration distribution to enable the propagation of both shot noise and sample variance uncertainties. The method can accommodate different levels of prior confidence on different redshift sources. This method can be applied to any calibration sample with known redshifts and phenotypes (i.e. cells in a self-organizing map, or some other way of discretizing photometric space), and provides a simple way of propagating prior redshift uncertainties into cosmological analyses. As a worked example, we apply the full scheme to the COSMOS2015 data set, for which we also present a new, principled SOM algorithm designed to handle noisy photometric data. We make available a catalogue of the resulting resamplings of the COSMOS2015 galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Uncertainty Quantification and Error Propagation in the Enthalpy and Entropy of Surface Reactions Arising from a Single DFT Functional

Accounting for parametric uncertainty in models is essential for quantifying the models’ predictive ability. Recently, approaches have been introduced to estimate parametric uncertainty in kinetic models while accounting for correlations among energy parameters. However, correlations have been estimated indirectly and correlations in entropies have not been accounted for. For surface-catalyzed microkinetic models of >C2 (more than two carbon-containing) molecules, which consist of thousands of reaction steps and intermediate surface species, first-principles density functional theory (DFT) is costly, and thus, estimation of thermochemistry and reaction barriers requires surrogate methods of DFT, such as group additivity and Brønsted–Evans–Polanyi relationships, respectively. For such parametrization, model uncertainty is unclear. This work develops a framework to overcome these gaps using group additivity and a single DFT functional. We estimate correlations in parameters of kinetic models and quantify uncertainty for thermochemistry, reaction barriers, reaction paths, and ultimately reaction rates, accounting also for the contribution of entropic uncertainty. Furthermore, the approach is illustrated on propane combustion and ethane oxidative dehydrogenation reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2010

Development of an Uncertainty Model for the National Transonic Facility

This paper introduces an uncertainty model being developed for the National Transonic Facility (NTF). The model uses a Monte Carlo technique to propagate standard uncertainties of measured values through the NTF data reduction equations to calculate the combined uncertainties of the key aerodynamic force and moment coefficients and freestream properties. The uncertainty propagation approach to assessing data variability is compared with ongoing data quality assessment activities at the NTF, notably check standard testing using statistical process control (SPC) techniques. It is shown that the two approaches are complementary and both are necessary tools for data quality assessment and improvement activities. The SPC approach is the final arbiter of variability in a facility. Its result encompasses variation due to people, processes, test equipment, and test article. The uncertainty propagation approach is limited mainly to the data reduction process. However, it is useful because it helps to assess the causes of variability seen in the data and consequently provides a basis for improvement. For example, it is shown that Mach number random uncertainty is dominated by static pressure variation over most of the dynamic pressure range tested. However, the random uncertainty in the drag coefficient is generally dominated by axial and normal force uncertainty with much less contribution from freestream conditions.

Walter, Joel A.↗
DOE OSTI2021

Quantifying the propagation of parametric uncertainty on flux balance analysis

Flux balance analysis (FBA) and associated techniques operating on stoichiometric genome-scale metabolic models play a central role in quantifying metabolic flows and constraining feasible phenotypes. At the heart of these methods lie two important assumptions: (i) the biomass precursors and energy requirements neither change in response to growth conditions nor environmental/genetic perturbations, and (ii) metabolite production and consumption rates are equal at all times (i.e., steady-state). Despite the stringency of these two assumptions, FBA has been shown to be surprisingly robust at predicting cellular phenotypes. In this paper, we formally assess the impact of these two assumptions on FBA results by quantifying how uncertainty in biomass reaction coefficients, and departures from steady-state due to temporal fluctuations could propagate to FBA results. In the first case, conditional sampling of parameter space is required to re-weigh the biomass reaction so as the molecular weight remains equal to 1 g mmol –1 , and in the second case, metabolite (and elemental) pool conservation must be imposed under temporally varying conditions. Results confirm the importance of enforcing the aforementioned constraints and explain the robustness of FBA biomass yield predictions.

59 BASIC BIOLOGICAL SCIENCES↗