Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,801 records · Page 100
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Use of In Situ and Airborne Multiangle Data to Assess MODIS and Landsat-Based Estimates of Directional Reflectance and Albedo

The quantification of uncertainty in satellite-derived global surface albedo products is a critical aspect in producing complete, physically consistent, and decadal land property data records for studying ecosystem change. A challenge in validating albedo measurements acquired from space is the ability to overcome the spatial scaling errors that can produce disagreements between satellite and field-measured values. Here, we present the results from an accuracy assessment of MODIS and Landsat-TM albedo retrievals, based on collocated comparisons with tower and airborne Cloud Absorption Radiometer (CAR) measurements collected during the 2007 Cloud and Land Surface Interaction Campaign (CLASIC). The initial focus was on evaluating intersensor consistency through comparisons of intrinsic bidirectional reflectance estimates. Local and regional assessments were then performed to obtain estimates of the resulting scaling uncertainties, and to establish the accuracy of albedo reconstructions during extended periods of precipitation. In general, the satellite derived estimates met the accuracy requirements established for the high-quality MODIS operational albedos at 500 m (the greater of 0.02 units or +/-10% of surface measured values). However, results reveal a high degree of variability in the root-mean-square error (RMSE) and bias of MODIS visible (0.3-0.7 μm) and Landsat-TM shortwave (0.3-5.0 μm) albedos; where, in some cases, retrieval uncertainties were found to be in excess of 15%. Results suggest that an overall improvement in MODIS shortwave albedo retrieval accuracy of 7.8%, based on comparisons between MODIS and CAR albedos, resulted from the removal of sub-grid scale mismatch errors when directly scaling-up the tower measurements to the MODIS satellite footprint.

biosphere↗
NASA NTRS2022

NESC Peer Review of Exploration Systems Development (ESD) Integrated Vehicle Modal Test, Model Correlation, Development Flight Instrumentation (DFI) and Flight Loads Readiness; Uncertainty Propagation for Model Validation Sub-task

This report details a sub-task (regarding Uncertainty Propagation for Model Validation) from a NASA Engineering and Safety Center assessment that is a multi-year activity spanning the complete development of the Space Launch System integrated vehicle structural dynamic models, and the development of the certification of flight readiness for the Artemis 1 and Artemis 2 vehicles and their variants.

Exploration Systems Development; Development Fligh↗
NASA NTRSDate not supplied

Applicability of a Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

As improvements are made to the accuracy and reliability of modeling and simulation techniques, certification by analysis becomes a more attractive alternative compared to traditional aircraft flight testing. Certification by analysis is especially cost-effective when one considers modifications to a previously certified aircraft. However, it is important that the models and methods used are applicable and accurate throughout the intended use domain. A framework for estimating the performance and associated uncertainty was introduced in an earlier paper. The factors and limitations of this framework for estimating the performance and associated model form uncertainty are explored to determine the range of applicability of the framework, particularly with respect to model form, process and sensor noise, and quality of available flight test data. This paper focuses on the general limitations and applicability of the framework and not the applicability of the individual methods to a range of modified configurations, which requires a large number of modified configurations and is an area for future work. The effects of these factors on the performance and uncertainty results are demonstrated using NASA’s Generic Transport Model aircraft.

uncertainty quantification↗
NASA NTRSDate not supplied

Flow Characterization of the NASA Langley Unitary Plan WindTunnel, Test Section 2: Computational Results

Flow in the empty Unitary Planform Wind Tunnel at the NASA Langley Research Center issimulated with computational fluid dynamics methods. The objectives are to assess CFD’s truepredictive capability and to generate flow-field maps upstream of the tunnel’s test section foruse in associated vehicle tests. Multiple CFD solvers, grid adaption methods, and turbulencemodels are used by five teams doing the simulations. The simulation domain is as large aspractical: from the start of the settling chamber, just downstream of the last set of turningvanes, to well downstream of the test section. Simulations are done at three Mach numbers andseveral Reynolds numbers that cover most of the tunnel’s operating range. The sensitivity ofthe CFD solutions to simulation process details, including turbulence model, spatial resolutionand settling-chamber inflow velocity profile, is characterized. Significant sensitivities in somedetails of the predicted test section flow are described. CFD predicts that details of flow inthe settling chamber can affect the flow in the test section. Turning of the flow through thetunnel contraction and past nozzle-block hardware generates streamwise vortices, some ofwhich survive into the core of the test section, principally at low Mach number. Preliminarycomparisons to experimental measurements are given. The major flow characteristics andthe dynamical vortices predicted by CFD exist in the experiment. Several details in CFD andexperiment are observed to differ, including the effects of the vortices and features that appearto be Mach waves in the test section. Sensitivity to grid resolution and turbulence modelingis noted in the vortices; no potential cause for the differences in Mach waves has yet beenidentified in the CFD sensitivity studies.

wind tunnel↗
NASA NTRSDate not supplied

Improving Multi-Model Trajectory Simulation Estimators using Model Selection and Tuning

Multi-model Monte Carlo methods have been demonstrated to be an efficient and accurate alternative to standard Monte Carlo (MC) in the model-based propagation of uncertainty in entry, descent, and landing (EDL) applications. These multi-model MC methods fuse predictions from low-fidelity models with the high-fidelity EDL model of interest to produce unbiased statistics with a fraction of the computational cost. The accuracy and efficiency of the multi-model MC methods are dependent upon the magnitude of correlations of the low-fidelity models with the high-fidelity model, but also upon the correlation amongst the low-fidelity models, and their relative computational cost. Because of this layer of complexity, the question of how to optimally select the set of low-fidelity models has remained open. In this work, methods for optimal model construction and tuning are investigated as a means to increase the speed and precision of trajectory simulation for EDL. Specifically, the focus is on the inclusion of low-fidelity model tuning within the sample allocation optimization that accompanies multi-model MC methods. Preliminary results indicate that low-fidelity model tuning can significantly improve efficiency and precision of trajectory simulations and provide an increased edge to multi-model MC methods when compared to standard MC. The challenges and potential benefits to exploring a fully iterative and comprehensive optimization strategy in future work are highlighted.

uncertainty quantification↗
NASA NTRSDate not supplied

Improving Multi-Model Trajectory Simulation Estimators using Model Selection and Tuning

Multi-model Monte Carlo methods have been demonstrated to be an efficient and accurate alternative to standard Monte Carlo (MC) in the model-based propagation of uncertainty in entry, descent, and landing (EDL) applications. These multi-model MC methods fuse predictions from low-fidelity models with the high-fidelity EDL model of interest to produce unbiased statistics with a fraction of the computational cost. The accuracy and efficiency of the multi-model MC methods are dependent upon the magnitude of correlations of the low-fidelity models with the high-fidelity model, but also upon the correlation among the low-fidelity models, and their relative computational cost. Because of this layer of complexity, the question of how to optimally select the set of low-fidelity models has remained open. In this work, methods for optimal model construction and tuning are investigated as a means to increase the speed and precision of trajectory simulation for EDL. Specifically, the focus is on the inclusion of low-fidelity model tuning within the sample allocation optimization that accompanies multi-model MC methods. Preliminary results indicate that low-fidelity model tuning can significantly improve efficiency and precision of trajectory simulations and provide an increased edge to multi-model MC methods when compared to standard MC. The challenges and potential benefits to exploring a fully iterative and comprehensive optimization strategy in future work are highlighted.

uncertainty quantification↗
NASA NTRSDate not supplied

Model Calibration for Cancer Risk Projections According to Uncertain Data

This paper presents forward and inverse formulations for the calibration of computational models according to uncertain data. Uncertainty in the data might be caused by a poor metrology system, measurement noise, missing or uncontrollable input variables, or by the inability to directly measure the inputs and/or outputs of interest. The forward approach performs the calibration in the space of the model’s output thereby requiring repeated model simulations. Conversely, the inverse approach leverages an ensemble of solutions to an inverse problem in order to perform the calibration in the space of the model’s parameters. As such, the computational demands of the inverse approach are considerably lower. These strategies are applied to the calibration of a radiation model that in-forms cancer risk projections for future deep space missions.

uncertainty quantification↗
NASA NTRS2022

A Framework for Deep Learning Emulation of Numerical Models With a Case Study in Satellite Remote Sensing

Numerical models based on physics represent the state of the art in Earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest generation computers, reducing the ability of modelers to generate simulations for understanding parameter sensitivities and characterizing variability and uncertainty. Thus, surrogate models are often developed to capture the essential attributes of the full-blown numerical models. Recent successes of machine learning methods, especially deep learning (DL), across many disciplines offer the possibility that complex nonlinear connectionist representations may be able to capture the underlying complex structures and nonlinear processes in Earth systems. A difficult test for DL-based emulation, which refers to function approximation of numerical models, is to understand whether they can be comparable to traditional forms of surrogate models in terms of computational efficiency while simultaneously reproducing model results in a credible manner. A DL emulation that passes this test may be expected to perform even better than simple models with respect to capturing complex processes and spatiotemporal dependencies. Here, we examine, with a case study in satellite-based remote sensing, the hypothesis that DL approaches can credibly represent the simulations from a surrogate model with comparable computational efficiency. Our results are encouraging in that the DL emulation reproduces the results with acceptable accuracy and often even faster performance. We discuss the broader implications of our results in light of the pace of improvements in high-performance implementations of DL and the growing desire for higher resolution simulations in the Earth sciences.

Bayesian Deep Learning↗
NASA NTRS2022

Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

Flight testing has been the historical standard for determining aircraft airworthiness - however, increases in the cost of flight testing and the accuracy of inexpensive CFD promote certification by analysis to reduce or replace flight testing. A framework is introduced to predict the performance in the special case of a modification to an existing, previously certified aircraft. This framework uses a combination of existing flight test or high fidelity data of the original aircraft as well as lower fidelity data of the original and modified configurations. Two methods are presented which estimate the model form uncertainty of the modified configuration, which is then used to conduct non-deterministic simulations. The framework is applied to an example aircraft system with simulated flight test data to demonstrate the ability to predict the performance and associated uncertainty of modified aircraft configurations. However, it is important that the models and methods used are applicable and accurate throughout the intended use domain. The factors and limitations of the framework are explored to determine the range of applicability of the framework. The effects of these factors on the performance and uncertainty results are demonstrated using the example aircraft system. The framework is then applied to NASA’s X-57 Maxwell and each of its modifications. The estimated performance and associated uncertainties are then compared to the airworthiness criteria to evaluate the potential of the framework as a component to the certification by analysis process.

Uncertainty Quantification↗
NASA NTRSDate not supplied

Bayesian Model Selection for Reducing Bloat and Overfitting in Genetic Programming for Symbolic Regression

When performing symbolic regression using genetic programming, overfitting and bloat can negatively impact generalizability and interpretability of the resulting equations as well as increase computation times. A Bayesian fitness metric is introduced and its impact on bloat and overfitting during population evolution is studied and compared to common alternatives in the literature. The proposed approach was found to be more robust to noise and data sparsity in numerical experiments, guiding evolution to a level of complexity appropriate to the dataset. Further evolution of the population resulted not in overfitting or bloat, but rather in slight simplifications in model form. The ability to identify an equation of complexity appropriate to the scale of noise in the training data was also demonstrated. In general, the Bayesian model selection algorithm was shown to be an effective means of regularization which resulted in less bloat and overfitting when any amount of noise was present in the training data.

Uncertainty quantification↗
NASA NTRS2022

Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

Flight testing has been the historical standard for determining aircraft airworthiness. However, increases in the cost of flight testing and the accuracy of inexpensive CFD encourage the adoption of certification by analysis to reduce or replace flight testing. A framework is introduced to predict the performance in the special case of a modification to an existing, previously certified aircraft. This framework uses a combination of existing flight tests or high fidelity data of the original aircraft as well as lower fidelity data from CFD or wind tunnel testing of the original and modified configurations to create 6-DOF flight dynamics models. Two methods are presented which generate an updated flight dynamics model and estimate the model form uncertainty for the modified aircraft configuration using knowledge of the original aircraft. This updated dynamics model and uncertainty estimate are then used to conduct non-deterministic simulations with wind turbulence included. The framework is applied to an example aircraft system to demonstrate the ability to predict the performance and associated model from the uncertainty of modified aircraft configurations.

uncertainty quantification↗
NASA NTRSDate not supplied

Quantifying Emergent Fluid Dynamics Using Reynolds-Interpolated Fluid Reduced-order Models

Fluid reduced-order models (ROMs) which capture the flow physics within the problem's physical domain are usually constrained in accuracy to only the parameter points, e.g. Reynolds and Mach numbers, at which reference data was provided. Interpolation-focused quantity-of-interest ROMs are often structured differently and fail to provide flow volume data with the same quality - if at all. In this paper, techniques which reside at the intersection of these two ROM schools - flow physics ROMs which can be interpolated within a parameter space of interest - are explored. Using a combination of existing and novel techniques, emergent physics are identified using a fluid ROM at parameter points which are not provided in the ROM's training data.

uncertainty quantification↗
NASA NTRSDate not supplied

Sampling Functions from Gaussian Processes and Structured Covariance Gaussian Networks

When learning aerodynamic models from data, it is critical to incorporate estimates of model uncertainty. This motivates the design of probabilistic aerodynamic databases which can be sampled to generate physically and statistically plausible aerodynamic models. In this talk we discuss how to sample deterministic functions from two different kinds of probabilistic models and demonstrate their use. First, Gaussian Process Regressors (GPRs) are a widely used probabilistic kernel-based model which can be thought of as Gaussian distributions over functions. GPRs are generally trained by maximizing the marginal likelihood of seeing the training data over the kernel parameter space. Sample functions are easily generated by drawing points from the Gaussian distribution at desired input points. However, when the points are not known ahead of time, the classical sampling approach is not possible since successive function samples will generate different function realizations. We present an approach for sampling consistent function evaluations from a GPR over multiple samples. Second, we describe a neural network architecture which learns a conditional Gaussian distribution by maximizing the marginal likelihood at each point in the input space. We then discuss and compare several options for generating sample functions which match this distribution. Finally, we demonstrate the use of these probabilistic aerodynamic models in an atmospheric reentry simulation.

Gaussian process regression↗

Refine your search to explore more results.