SEARCH · Engineering Papers

Results for “uncertainty Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

All sources NASA NTRS DOE OSTI

NASA NTRS2020

Toward Comprehensive Uncertainty Predictions for Remote Imaging Spectroscopy

Remote imaging spectroscopy’s role in Earth science will grow in the coming decade as a series of globe-spanning spectroscopy missions launch from NASA, ESA, and other agencies. The nature of remote imaging spectroscopy will change, advancing from short regional studies to address global multi-year questions. The diversity of data will also grow with exposure to a wider range of biomes and atmospheric conditions. To execute these new investigations we must reconcile diverse observing conditions to derive consistent global maps. To this end, rig- orous uncertainty quantification and propagation enables an optimal synthesis of data accounting for observing conditions and data quality. Understanding data uncertainties is also important for principled hypothesis testing, information content assessment, and informed decision making by end users. We survey prior efforts in uncer- tainty quantification for imaging spectroscopy, and describe methods for validating the accuracy of uncertainty predictions. We conclude with a discussion of remaining challenges and promising avenues for future research.

Susiluoto, Jouni↗

NASA NTRS2011

Detailed Uncertainty Analysis of the Ares I A106 Liftoff/Transition Database

The Ares I A106 Liftoff/Transition Force and Moment Aerodynamics Database describes the aerodynamics of the Ares I Crew Launch Vehicle (CLV) from the moment of liftoff through the transition from high to low total angles of attack at low subsonic Mach numbers. The database includes uncertainty estimates that were developed using a detailed uncertainty quantification procedure. The Ares I Aerodynamics Panel developed both the database and the uncertainties from wind tunnel test data acquired in the NASA Langley Research Center s 14- by 22-Foot Subsonic Wind Tunnel Test 591 using a 1.75 percent scale model of the Ares I and the tower assembly. The uncertainty modeling contains three primary uncertainty sources: experimental uncertainty, database modeling uncertainty, and database query interpolation uncertainty. The final database and uncertainty model represent a significant improvement in the quality of the aerodynamic predictions for this regime of flight over the estimates previously used by the Ares Project. The maximum possible aerodynamic force pushing the vehicle towards the launch tower assembly in a dispersed case using this database saw a 40 percent reduction from the worst-case scenario in previously released data for Ares I.

Hanke, Jeremy L.↗

NASA NTRS2013

Validating an Air Traffic Management Concept of Operation Using Statistical Modeling

Validating a concept of operation for a complex, safety-critical system (like the National Airspace System) is challenging because of the high dimensionality of the controllable parameters and the infinite number of states of the system. In this paper, we use statistical modeling techniques to explore the behavior of a conflict detection and resolution algorithm designed for the terminal airspace. These techniques predict the robustness of the system simulation to both nominal and off-nominal behaviors within the overall airspace. They also can be used to evaluate the output of the simulation against recorded airspace data. Additionally, the techniques carry with them a mathematical value of the worth of each prediction-a statistical uncertainty for any robustness estimate. Uncertainty Quantification (UQ) is the process of quantitative characterization and ultimately a reduction of uncertainties in complex systems. UQ is important for understanding the influence of uncertainties on the behavior of a system and therefore is valuable for design, analysis, and verification and validation. In this paper, we apply advanced statistical modeling methodologies and techniques on an advanced air traffic management system, namely the Terminal Tactical Separation Assured Flight Environment (T-TSAFE). We show initial results for a parameter analysis and safety boundary (envelope) detection in the high-dimensional parameter space. For our boundary analysis, we developed a new sequential approach based upon the design of computer experiments, allowing us to incorporate knowledge from domain experts into our modeling and to determine the most likely boundary shapes and its parameters. We carried out the analysis on system parameters and describe an initial approach that will allow us to include time-series inputs, such as the radar track data, into the analysis

Statistical emulation↗

NASA NTRS2016

Exploration Flight Test 1 Afterbody Aerothermal Environment Reconstruction

The Exploration Flight Test 1 vehicle included roughly 100 near surface thermocouples on the after body of the vehicle. The temperature traces at each of these instruments have been used to perform inverse environment reconstruction to determine the aerothermal environment experienced during re-entry of the vehicle. This paper provides an overview of the reconstructed environments and identifies critical aspects of the environment. These critical aspects include transition and reaction control system jet influence. A blind test of the process and reconstruction tool was also performed to build confidence in the reconstructed environments. Finally, an uncertainty quantification analysis was also performed to identify the impact of each of the uncertainties on the reconstructed environments.

Hyatt, Andrew J.↗

NASA NTRS2023

The Impact and Estimation of Uncertainty Correlation for Multi-Angle Polarimetric Remote Sensing of Aerosols and Ocean Color

Multi-angle polarimetric (MAP) measurements contain rich information for characterization of aerosol microphysical and optical properties that can be used to improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere-ocean system, although uncertainty correlation among measurements is generally ignored due to lack of knowledge on its strength and characterization. In this work, we provide a practical framework to evaluate the impact of the angular uncertainty correlation from retrieval results and a method to estimate correlation strength from retrieval fitting residuals. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on neural network forward models, is used to conduct the retrievals and uncertainty quantification. In addition, we also discuss a flexible approach to include a correlated uncertainty model in the retrieval algorithm. The impact of angular correlation on retrieval uncertainties is discussed based on synthetic AirHARP and HARP2 measurements using a Monte Carlo uncertainty estimation method. Correlation properties are estimated using auto-correlation functions based on the fitting residuals from both synthetic AirHARP and HARP2 data and real AirHARP measurement, with the resulting angular correlation parameters found to be larger than 0.9 and 0.8 for reflectance and DoLP, respectively, which correspond to correlation angles of 10° and 5°. Although this study focuses on angular correlation from HARP instruments, the methodology to study and quantify uncertainty correlation is also applicable to other instruments with angular, spectral, or spatial correlations, and can help inform laboratory calibration and characterization of the instrument uncertainty structure.

PACE↗

NASA NTRS2010

Quantification of the Uncertainties for the Ares I A106 Ascent Aerodynamic Database

A detailed description of the quantification of uncertainties for the Ares I ascent aero 6-DOF wind tunnel database is presented. The database was constructed from wind tunnel test data and CFD results. The experimental data came from tests conducted in the Boeing Polysonic Wind Tunnel in St. Louis and the Unitary Plan Wind Tunnel at NASA Langley Research Center. The major sources of error for this database were: experimental error (repeatability), database modeling errors, and database interpolation errors.

Houlden, Heather P.↗

NASA NTRS2024

Development of a Data Fusion Methodology for Lineload Aerodynamic Databases for a Launch Vehicle during Liftoff and Transition

The need for databases for the distributed loading on launch vehicles during the early portion of flight necessitates the use of expensive computational flows in regimes where wake effects dominate. While also being expensive, this is a regime that computational tools tend to historically have problems simulating accurately. To help tackle this problem, a method of data fusion to combine computational results to wind tunnel derived force and moment data is developed. Using this method, significant reduction in computational costs and increases in confidence of the final product is possible and has been used to generate several databases for the Space Launch System (SLS) at NASA. While the full details of database generation are not part of this work, the crucial method at its core is developed here. Two SLS geometries are used throughout the work to demonstrate the techniques. These are two of the larger geometries and represent both planned crewed missions to the Moon as well as potential cargo missions to deep space. The method uses principal component analysis (PCA) to generate a reduced ordered model (ROM) to help fill in the full parameter space. Other similar techniques are explored, but were not found to have a significant result on the predictions of the ROM. Because the full number of components are kept to generate the model, this lack of difference is expected. This method is then extended to ensure that predicted surfaces match trusted force and moment data derived from wind tunnel testing. This extension is done by setting up a constrained optimization problem in order to minimize the deviation from the surface resolved computational data while still integrating to the desired values. When generating the constrained optimization problem, a weighting factor to balance these competing needs is introduced. The work compares previously introduced weighting terms from similar work to the proposed terms and shows that the previously used terms do not have as desirable behavior in this flow regime. This method is then expanded by developing a technique to incorporate uncertainty quantification into the developed data fusion methodology. This expansion takes a two pronged approach. One examines transferring the uncertainties in the force and moment database and characterizes how those adjustments change the predicted lineloads. The second looks at model form error and looks how rebuilding the model using slightly different data changes the predictions. These two terms are then combined in order to create an uncertainty model that takes both effects into account. The limitations of the proposed methods is then discussed as well as possible techniques to address these shortcomings.

Launch Vehicles↗

NASA NTRS2014

Assessment of Satellite Ocean Colour Radiometry and Derived Geophysical Products

Standardization of methods to assess and assign quality metrics to satellite ocean color radiometry and derived geophysical products has become paramount with the inclusion of the marine reflectance and chlorophyll-a concentration (Chla) as essential climate variables (ECV; [1]) and the recognition that optical remote sensing of the oceans can only contribute to climate research if and when a continuous succession of satellite missions can be shown to collectively provide a consistent, long-term record with known uncertainties. In 20 years, the community has made significant advancements toward that objective, but providing a complete uncertainty budget for all products and for all conditions remains a daunting task. In the retrieval of marine water-leaving radiance from observed top-of-atmosphere radiance, the sources of uncertainties include those associated with propagation of sensor noise and radiometric calibration and characterization errors, as well as a multitude of uncertainties associated with the modeling and removal of effects from the atmosphere and sea surface. This chapter describes some common approaches used to assess quality and consistency of ocean color satellite products and reviews the current status of uncertainty quantification in the field. Its focus is on the primary ocean color product, the spectrum of marine reflectance Rrs, but uncertainties in some derived products such as the Chla or inherent optical properties (IOPs) will also be considered.

Ocean↗

NASA NTRSDate not supplied

Design Under Uncertainty for Conceptual Aircraft Design Leveraging Analytical Gradients

The purpose of this paper is to extend previously demonstrated methodologies for design under uncertainty, leveraging analytical gradients to higher fidelity analysis for use in conceptual aircraft design. Previous work developed methods to generate analytical derivatives through polynomial chaos expansion, eliminating the need to estimate derivatives via complex step or finite difference. In this research, the authors build upon the methods to include physics-based aircraft design codes for aircraft design under uncertainty. This extends the previous work’s case study, which employed analytical aerodynamics and Breguet range estimations for wing design, to a higher fidelity level. In addition, this work extends previous work on interface development between the Uncertainty Quantification with Polynomial Chaos Expansion (UQPCE) software and Model-Based Systems Analysis and Engineering (MBSA&E) frameworks. This paper will discuss the development work necessary to perform multidisciplinary design under uncertainty as well as demonstrate the mechanics of interfacing UQPCE and conceptual aircraft design tools such as NASA’s Aviary code. In a case study, a conceptual aircraft design under uncertainty was conducted and compared against a traditional deterministic design. When given information about the uncertainty space from UQPCE, the optimizer was able to shape the output distribution and produce a more robust design

UQ↗

NASA NTRSDate not supplied

Design Under Uncertainty for Conceptual Aircraft Design Leveraging Analytical Gradients

UQ↗

NASA NTRS2019

Operational and Technical Updates to the Object Reentry Survival Analysis Tool

The Object Reentry Survival Analysis Tool (ORSAT) has been used in the NASA Orbital Debris Program Office for over 25 years to estimate risk due to uncontrolled reentry of spacecraft and rocket bodies. Development over the last 3 years has included: a major change to the treatment of carbon fiber- and glass fiber-reinforced plastics (CFRP and GFRP, respectively); an updated atmospheric model; a new model for computing casualty area around an impacting debris object; and a newly-implemented scheme to determine the breakup altitude of a reentry object. Software also was written to automatically perform parameter sweeps in ORSAT to allow for uncertainty quantification and sensitivity analysis for components with borderline demisability. These updates have improved the speed and fidelity of the reentry analysis performed using ORSAT, and have allowed for improved engineering understanding by estimating the uncertainty for each component’s survivability. A statistical model for initial conditions captures the latitude bias in population density, a large improvement over the previous inclination-based latitude-averaged models. A sample spacecraft has been analyzed with standard techniques using ORSAT 6.2.1 and again using all the updated models; we will demonstrate the variation in the total debris casualty area and overall expectation of casualty.

Ostrom, C.↗

NASA NTRSDate not supplied

Design Under Uncertainty with Design-Dependent Uncertain Variables

Uncertainty quantification (UQ) can provide a more robust understanding of a system, leading to better informed decisions earlier in the design process. The additional information that UQ provides can be leveraged during a design optimization process known as design under uncertainty that, when incorporated with multidisciplinary design and optimization, can become computationally infeasible due to the large number of responses required for meaningful results. Previous work addressed reducing the computational expense in design under uncertainty by incorporating analytic derivatives throughout polynomial chaos expansion. Although this allows design under uncertainty to be feasible for more systems, some multidisciplinary systems have design-dependent uncertain variables. This paper details an implementation of design dependent uncertain variables in a manner than preserves derivatives required for efficient gradient-based optimization throughout the process. Two analytic examples of design-dependent uncertain variables are given: the first transforms a uniform uncertain variable with one design variable and the second transforms a normal uncertain variable with two design variables. The polynomial chaos expansion (PCE) results are comparable to both the Monte Carlo (MC) results and the analytic results for the two examples. A case study that maximizes the lift-to-drag ratio with a design-dependence between the wing leading edge sweep angle and uncertain parameter percentage of laminar flow is compared to a MC and alternative optimization formulations. This paper demonstrates that design-dependent uncertain variables are valid and hold throughout PCE.

Joanna N Schmidt↗

NASA NTRSDate not supplied

Design Under Uncertainty with Design-Dependent Uncertain Variables

robust design↗

NASA NTRS2016

Development and Use of Engineering Standards for Computational Fluid Dynamics for Complex Aerospace Systems

Computational fluid dynamics (CFD) and other advanced modeling and simulation (M&S) methods are increasingly relied on for predictive performance, reliability and safety of engineering systems. Analysts, designers, decision makers, and project managers, who must depend on simulation, need practical techniques and methods for assessing simulation credibility. The AIAA Guide for Verification and Validation of Computational Fluid Dynamics Simulations (AIAA G-077-1998 (2002)), originally published in 1998, was the first engineering standards document available to the engineering community for verification and validation (V&V) of simulations. Much progress has been made in these areas since 1998. The AIAA Committee on Standards for CFD is currently updating this Guide to incorporate in it the important developments that have taken place in V&V concepts, methods, and practices, particularly with regard to the broader context of predictive capability and uncertainty quantification (UQ) methods and approaches. This paper will provide an overview of the changes and extensions currently underway to update the AIAA Guide. Specifically, a framework for predictive capability will be described for incorporating a wide range of error and uncertainty sources identified during the modeling, verification, and validation processes, with the goal of estimating the total prediction uncertainty of the simulation. The Guide's goal is to provide a foundation for understanding and addressing major issues and concepts in predictive CFD. However, this Guide will not recommend specific approaches in these areas as the field is rapidly evolving. It is hoped that the guidelines provided in this paper, and explained in more detail in the Guide, will aid in the research, development, and use of CFD in engineering decision-making.

Lee, Hyung B.↗

NASA NTRSDate not supplied

Flow Characterization of the NASA Langley Unitary Plan Wind Tunnel, Test Section 2: Computational Results

This is an abstract for an invited paper at the AIAA Aviation Conference, June 2021. The work described here is part of an effort of coordinated experiments in the Unitary Plan Wind Tunnel (UPWT) facility at the NASA Langley Research Center (LaRC) and matching CFD simulations. The primary goal of the work is to assess the productivity and true predictive accuracy of CFD, absent any guidance from experiment, in the high supersonic speed range as compared to experiments performed at the NASA LaRC’s UPWT facility. This report concerns CFD simulation of the primary flow-path in the empty wind tunnel, including the settling chamber, nozzle, test section, and some of the tunnel downstream of the test section. The Mach number in the test section ranges from M~2.4 to M~4.6, and the required area ratio variation is achieved by translation of a nozzle block which constricts the area of a loosely S-shaped throat. Flow past protuberances in the settling chamber and into this S-bend throat are predicted by CFD to generate streamwise vorticity that may, or may not, persist through the throat and into the test section as coherent vortices. Some flow conditions are notably unsteady at frequencies well below those of turbulence, due to unsteady separated flow ahead of the nozzle block. The bulk flow moves at velocities ranging from 'walking speed' in the settling chamber to M~4.6 in the test section. Heat transfer to the settling chamber walls and buoyancy are significant at high Mach number. Subtle variations in surface curvature in the nozzle generate Mach waves that propagate into the test section. CFD of the empty tunnel serves two purposes. Firstly, the full-tunnel simulations are used to provide upstream boundary conditions for CFD of vehicle aerodynamics which are generally performed in a domain confined to the wind tunnel test section; these companion studies are addressed in other papers. Secondly, it is a challenging test for CFD to resolve all of the empty tunnel flow phenomena relevant to flow in the test section. It requires a more complete definition of geometry than was originally anticipated. In addition, it requires good spatial and temporal accuracy, and turbulence modeling that performs well on specific phenomena such as corner flows. The boundary conditions and solution algorithms must perform well from incompressible to almost hypersonic speeds. The final state of the pre-test CFD was a product of an iterative self-improvement process. The initial simulations of the empty tunnel were deficient in many respects, but hints to those deficiencies were recognized in the solutions, and remedies were implemented. Possible further improvements will be studied in the post-test phase when comparisons with experimental data are possible. The CFD was performed by five separate collaborative teams using four different flow solvers: FUN3D, Overflow, Star-CCM+ and USM3D. The level of effort of these teams varied significantly, but each made important contributions to the goals of the work. A concerted effort to use uncertainty quantification methods (UQ) in CFD is also a goal of this work. To this end, variations in CFD results due to grid refinement, turbulence modeling, and boundary conditions have been characterized. Code-to-code variation is another means of assessing CFD uncertainty. All CFD solvers predict similarity among the primary flow features; these include the variation of Mach number due to changes in Reynolds number, and the bulk flow angularity due to tunnel-wall curvature. All CFD solvers also predict similar trends in secondary flows, such as the downwash in the side-wall boundary layers. Three of the high-spatial resolution simulations give similar predictions of a complex secondary flow phenomena, streamwise vortices generated in the S-bend throat that persist into the side-wall boundary layers of the test section. Two of the highest-resolution simulations, run with the same turbulence model in different CFD solvers, gave encouragingly similar predictions of a complex tertiary flow phenomenon, small transient "sprites" of upwash flows, resulting from vortices that presumably originate in the separated flow near the leading edge of the nozzle block. While the CFD was done in a "blind pre-test" mode, requests from the experimental team for CFD results pertaining to unsteadiness and total temperature variations in the test section resulted in CFD runs that included a cooled wall in settling chamber. This then led to a change in the standard practice for running the Overflow results, which would not have occurred without this "release" of this experimental information. CFD was also used to guide some measurements. The paper will focus on establishing the consensus among CFD results and understanding differences among those results. Initial findings from the efforts to characterize CFD uncertainty have been done and will be included in the paper.

Robert Edward Childs↗

NASA NTRSDate not supplied

Point One Percent

The presentation is for the AIAA SciTech 2025 conference. It will be used as an introduction at the beginning of the session entitled "Shared Opportunities in Uncertainty Quantification in Support of CFD Validation" (Session APA-28/GT-09) . The author will participate in a panel discussion that will be part of the session.

data uncertainty↗

NASA NTRS2018

Combined Error and Uncertainty Estimates for CFD Problems

Given input sources of uncertainty, non-intrusive uncertainty propagation methods quantify the uncertainty in output quantities of interest (QoI) by performing a nite number of CFD (Computational Fluid Dynamics) instance realizations needed in the calculation of output statistics. It is well known that this introduces multiple sources of error. CFD codes often utilize finite-dimensional approximation (grids, basis functions, etc.) thus incurring CFD numerical errors often approximately reinterpreted as a statistical bias. Uncertainty propagation methods calculate uncertainty statistics for output quantities of interest using a numerical method (e.g. deterministic quadrature, sampling, etc.) thus incurring UQ (Uncertainty Quantification) numerical errors. Importance of quantifying these errors in large scale scientific computing: How accurate is an output statistic?; How should additional computational resources be invested to further reduce the error in a statistic?

Posteriori↗

NASA NTRSDate not supplied

From Exploration Flight Test-1 to Artemis II--A NASA Langley's Orion Aerosciences Overview

The Orion Aerosciences program at NASA Langley has played a central role in advancing the aerodynamic and aeroheating prediction capabilities required for the Orion crew vehicle’s return from deep space. This presentation provides a technical overview of aerosciences contributions spanning Exploration Flight Test-1 (EFT-1), Artemis I, and the ongoing post-flight analysis of Artemis II. EFT-1 provided the first high-energy entry dataset for Orion, enabling critical validation of aerodynamic force and moment predictions, static and dynamic stability characteristics, and aeroheating environments at relevant flight Mach and Reynolds numbers. Flight-derived pressure data were used to refine the Flush Air Data System (FADS) methodology for atmospheric density reconstruction and to improve Best Estimated Trajectory (BET) solutions. The EFT-1 data also offered key insights into heat shield performance, including char layer recession, in-depth thermal response, and material retention behavior under flight conditions, informing updates to both thermal response models and uncertainty quantification practices. Building on EFT-1, Artemis I extended the database to true lunar-return conditions. Observations of heat shield performance, including localized char loss, bondline response, and recession variability, provided an unprecedented opportunity to reassess Thermal Protection System (TPS) and aeroheating modeling assumptions. Aerodynamic reconstruction efforts incorporated improved FADS calibration, enhanced atmospheric modeling, and refined force and moment databases to reduce trajectory and load uncertainties. Aeroheating comparisons between pre-flight predictions and flight data enabled targeted model updates, particularly in transitional flow environments and wake heating regions. For Artemis II, these lessons were systematically incorporated into the pre-flight prediction process. Updates included refined aerodynamic databases anchored to flight-validated corrections, improved density estimation and BET methodologies using enhanced database interpolation algorithm and FADS modeling, and revised aeroheating design environments informed by Artemis I material response observations. By the time of the workshop, Artemis II post-flight analysis will be underway, and preliminary findings will be presented where available, including early comparisons of aerodynamic reconstruction, atmospheric density estimation, and thermal protection system performance relative to updated predictions. Collectively, this body of work is a testament to the dedicated and multidisciplinary team whose sustained efforts have contributed to the program’s success and to the progressive maturation of Orion aerosciences modeling through numerical modeling, ground and flight data assimilation. The integrated advancement of aerodynamics, trajectory reconstruction, FADS-based density estimation, and aeroheating analysis has reduced predictive uncertainty and strengthened confidence for future crewed lunar and deep-space missions.

Orion↗