SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

All sources NASA NTRS DOE OSTI

NASA NTRS2016

Uncertainty Analysis of NASA Glenn's 8- by 6-Foot Supersonic Wind Tunnel

An analysis was performed to determine the measurement uncertainty of the Mach Number of the 8- by 6-foot Supersonic Wind Tunnel at the NASA Glenn Research Center. This paper details the analysis process used, including methods for handling limited data and complicated data correlations. Due to the complexity of the equations used, a Monte Carlo Method was utilized for this uncertainty analysis. A summary of the findings are presented as pertains to understanding what the uncertainties are, how they impact various research tests in the facility, and methods of reducing the uncertainties in the future.

uncertainty↗

NASA NTRS2016

Uncertainty of Wheat Water Use: Simulated Patterns and Sensitivity to Temperature and CO2

Projected global warming and population growth will reduce future water availability for agriculture. Thus, it is essential to increase the efficiency in using water to ensure crop productivity. Quantifying crop water use (WU; i.e. actual evapotranspiration) is a critical step towards this goal. Here, sixteen wheat simulation models were used to quantify sources of model uncertainty and to estimate the relative changes and variability between models for simulated WU, water use efficiency (WUE, WU per unit of grain dry mass produced), transpiration efficiency (Teff, transpiration per kg of unit of grain yield dry mass produced), grain yield, crop transpiration and soil evaporation at increased temperatures and elevated atmospheric carbon dioxide concentrations ([CO2]). The greatest uncertainty in simulating water use, potential evapotranspiration, crop transpiration and soil evaporation was due to differences in how crop transpiration was modelled and accounted for 50 of the total variability among models. The simulation results for the sensitivity to temperature indicated that crop WU will decline with increasing temperature due to reduced growing seasons. The uncertainties in simulated crop WU, and in particularly due to uncertainties in simulating crop transpiration, were greater under conditions of increased temperatures and with high temperatures in combination with elevated atmospheric [CO2] concentrations. Hence the simulation of crop WU, and in particularly crop transpiration under higher temperature, needs to be improved and evaluated with field measurements before models can be used to simulate climate change impacts on future crop water demand.

Sensitivity↗

NASA NTRS2016

On the Calculation of Uncertainty Statistics with Error Bounds for CFD Calculations Containing Random Parameters and Fields

This chapter discusses the ongoing development of combined uncertainty and error bound estimates for computational fluid dynamics (CFD) calculations subject to imposed random parameters and random fields. An objective of this work is the construction of computable error bound formulas for output uncertainty statistics that guide CFD practitioners in systematically determining how accurately CFD realizations should be approximated and how accurately uncertainty statistics should be approximated for output quantities of interest. Formal error bounds formulas for moment statistics that properly account for the presence of numerical errors in CFD calculations and numerical quadrature errors in the calculation of moment statistics have been previously presented in [8]. In this past work, hierarchical node-nested dense and sparse tensor product quadratures are used to calculate moment statistics integrals. In the present work, a framework has been developed that exploits the hierarchical structure of these quadratures in order to simplify the calculation of an estimate of the quadrature error needed in error bound formulas. When signed estimates of realization error are available, this signed error may also be used to estimate output quantity of interest probability densities as a means to assess the impact of realization error on these density estimates. Numerical results are presented for CFD problems with uncertainty to demonstrate the capabilities of this framework.

Uncertainty↗

NASA NTRS2017

Methods for Probabilistic Uncertainty Analysis and Bayesian Analysis with Examples of Statistically Analyzing Data to Revise MMOD Risk Estimates and Compare Models

Probabilistic methods are presented for characterizing and quantifying uncertainties in models and model predictions. Techniques are given for constructing specific uncertainty distributions based on available information. Alternative techniques are given for propagating uncertainties in model inputs to obtain the uncertainty in the model result or prediction. Bayesian techniques are also described for utilizing data and information to update and revise model results and predictions. The focus is on applications with numerous specific examples given. The use of data to revise Micrometeoroid and Orbital Debris (MMOD) risk prediction models are among the examples given.

Risk↗

NASA NTRS2019

Evaluating the Uncertainty of Terrestrial Water Budget Components over High Mountain Asia

This study explores the uncertainties in terrestrial water budget estimation over High Mountain Asia (HMA) using a suite of uncoupled land surface model (LSM) simulations. The uncertainty in the water balance components of precipitation (P), evapotranspiration (ET), runoff (R), and terrestrial water storage (TWS) is significantly impacted by the uncertainty in the driving meteorology, with precipitation being the most important boundary condition. Ten gridded precipitation datasets along with a mix of model-, satellite-, and gauge-based products, are evaluated first to assess their suitability for LSM simulations over HMA. The datasets are evaluated by quantifying the systematic and random errors of these products as well as the temporal consistency of their trends. Though the broader spatial patterns of precipitation are generally well captured by the datasets, they differ significantly in their means and trends. In general, precipitation datasets that incorporate information from gauges are found to have higher accuracy with low Root Mean Square Errors and high correlation coefficient values. An ensemble of LSM simulations with selected subset of precipitation products is then used to produce the mean annual fluxes and their uncertainty over HMA in P, ET, and R to be 2.11 ± 0.45, 1.26 ± 0.11, and 0.85 ± 0.36 mm per day, respectively. The mean annual estimates of the surface mass (water) balance components from this model ensemble are comparable to global estimates from prior studies. However, the uncertainty/spread of P, ET, and R is significantly larger than the corresponding estimates from global studies. A comparison of ET, snow cover fraction, and changes in TWS estimates against remote sensing-based references confirms the significant role of the input meteorology in influencing the water budget characterization over HMA and points to the need for improving meteorological inputs.

Terrestrial water budget↗

NASA NTRSDate not supplied

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

Current Environmental Control and Life Support System (ECLSS) development and test activities are not generating data fast enough to provide statistically-supportable precise Orbital Replacement Unit (ORU) failure rate estimates for future missions. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches – namely regular resupply and rapid abort capabilities – will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of operations on board the International Space Station (ISS), a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass for future missions. A Bayesian failure rate estimation approach, such as the one currently implemented by the ISS Program, can help reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior failure rate estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, these subjective (and often inaccurate) prior estimates currently have a strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Supportability↗

NASA NTRSDate not supplied

Minimum-Variance Control Allocation Considering Parametric Model Uncertainty

The control allocation problem was investigated for linear dynamical systems with known parametric uncertainty. Minimizing a cost function that penalizes the variance of the error in achieving commanded forces and moments on the vehicle resulted in a special case of the weighted pseudo-inverse allocator. Rather than an engineer designing the weighting matrix, it is computed from the covariances of the control effectiveness parameters. This minimum-variance allocator balances the effectiveness of the control inputs against the corresponding levels of uncertainty. The approach was demonstrated using simulations of aircraft with realistic uncertainty levels operating in open-loop and closed-loop configurations. Results showed that when model uncertainty is known, significant, and unevenly distributed amongst the controls, the minimum-variance allocator more often achieves the intended forces and moments on the vehicle in comparison to other allocators, which can lead to increased performance, reliability, and safety during flight tests. The cost for this robustness is a diminished achievable moment space for the vehicle.

Control allocation↗

NASA NTRSDate not supplied

Uncertainty Quantification of CFD Model Assumptions Against Sonic Boom Noise Prediction of a Commercial Supersonic Transport

This paper presents the results of uncertainty modeling of sonic boom noise generation from commercial supersonic transport considering the Spalart-Allmaras (SA) turbulence modeling parameters as well as Mach number, angle of attack and altitude. Sample generation and analysis for this uncertainty model was performed by UQPCE, which is a software package developed at the NASA Langley Research Center. To build the uncertainty model, 42 cases of sonic boom noise calculation were performed. Computation of the ground noise can be briefly summarized in two steps. First, the near field pressure waveforms are sampled from CFD calculation using the NASA Langley’s FUN3D solver. Second, this information is passed to an atmospheric propagation code, sBOOM, which solves an augmented Burger’s equation and simulates how the near field waveforms will change while passing through the atmosphere. The ground signature is further processed to obtain the perceived loudness, PLdB. Having a high spatial resolution near the shockwave in the CFD calculation is critical in sonic boom noise prediction. Because the variation in the input parameters for the current uncertainty quantification (UQ) study is likely to lead to change in shock location, angle and strength, the grid adaptation for shock capturing is independently applied for each condition. The final mesh used in the CFD calculation consists of approximately 420 million cells. The pressure signatures are sampled at three, four and five body lengths away from the aircraft to make sure the three dimensional effects around the aircraft are resolved. The results of the UQ analysis shows that within the three aleatory variables, the angle of attack had the most impact against ground noise, followed by the altitude and the Mach number. Between the two SA model parameters, the Kármán constant (𝜅) was significantly more important than the turbulent Prandtl number (𝜎), but these two parameters were only marginally significant in the overall prediction variance in ground noise. The UQ procedure explained in this paper can be widely applied to other model parameters.

Uncertainty Quantification↗

NASA NTRSDate not supplied

Uncertainty Quantification of CFD Model Assumptions Against Sonic Boom Noise Prediction of a Commercial Supersonic Transport

This paper presents the results of uncertainty modeling of sonic boom noise generation from commercial supersonic transport considering the Spalart-Allmaras (SA) turbulence modeling parameters as well as Mach number, angle of attack and altitude. Sample generation and analysis for this uncertainty model was performed by UQPCE, which is a software package developed at the NASA Langley Research Center. To build the uncertainty model, 42 cases of sonic boom noise calculation were performed. Computation of the ground noise can be briefly summarized in two steps. First, the near field pressure waveforms are sampled from CFD calculation using the NASA Langley’s FUN3D solver. Second, this information is passed to an atmospheric propagation code, sBOOM, which solves an augmented Burger’s equation and simulates how the near field waveforms will change while passing through the atmosphere. The ground signature is further processed to obtain the perceived loudness, PLdB. Having a high spatial resolution near the shock wave in the CFD calculation is critical in sonic boom noise prediction. Because the variation in the input parameters for the current uncertainty quantification (UQ) study is likely to lead to change in shock location, angle and strength, the grid adaptation for shock capturing is independently applied for each condition. The final mesh used in the CFD calculation consists of approximately 420 million cells. The pressure signatures are sampled at three, four and five body lengths away from the aircraft to make sure the three dimensional effects around the aircraft are resolved. The results of the UQ analysis shows that within the three aleatory variables, the angle of attack had the most impact against ground noise, followed by the altitude and the Mach number. Between the two SA model parameters, the Kármán constant (𝜅) was significantly more important than the turbulent Prandtl number (𝜎), but these two parameters were only marginally significant in the overall prediction variance in ground noise. The UQ procedure explained in this paper can be widely applied to other model parameters.

Uncertainty Quantifications↗

NASA NTRS2022

Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

Flight testing has been the historical standard for determining aircraft airworthiness - however, increases in the cost of flight testing and the accuracy of inexpensive CFD promote certification by analysis to reduce or replace flight testing. A framework is introduced to predict the performance in the special case of a modification to an existing, previously certified aircraft. This framework uses a combination of existing flight test or high fidelity data of the original aircraft as well as lower fidelity data of the original and modified configurations. Two methods are presented which estimate the model form uncertainty of the modified configuration, which is then used to conduct non-deterministic simulations. The framework is applied to an example aircraft system with simulated flight test data to demonstrate the ability to predict the performance and associated uncertainty of modified aircraft configurations. However, it is important that the models and methods used are applicable and accurate throughout the intended use domain. The factors and limitations of the framework are explored to determine the range of applicability of the framework. The effects of these factors on the performance and uncertainty results are demonstrated using the example aircraft system. The framework is then applied to NASA’s X-57 Maxwell and each of its modifications. The estimated performance and associated uncertainties are then compared to the airworthiness criteria to evaluate the potential of the framework as a component to the certification by analysis process.

Uncertainty Quantification↗

NASA NTRSDate not supplied

Structured Covariance Gaussian Networks for Orion Crew Module Aerodynamic Uncertainty Quantification

In this paper we propose a new approach for nonlinear regression and uncertainty quantification. The method is based on a pair of neural networks which parameterize mean and dense covariance functions of a multivariate Gaussian process, trained together to maximize the log-likelihood of observing the given data. The covariance matrix is made positive definite at every input by construction. We also propose a sampling approach that produces viable surrogate function realizations from the Gaussian process. We call the proposed model a Structured Covariance Gaussian Network (SCGN). We illustrate the use of SCGNs for learning an aerodynamic response surface with built-in uncertainty for the Orion crew module. We find that SCGN provides an efficient and systematic way to learn nonlinear functional relationships and dense covariances. We compare results to a baseline Gaussian process regressor and observe that the SCGN provides comparable uncertainty descriptions with improved scalability to dataset size. The sample functions generated by SCGN are fast to evaluate online and are therefore convenient for use in trajectory simulations. These results suggest that SCGN may be a viable computational method for aerodynamic uncertainty quantification.

machine learning↗

NASA NTRSDate not supplied

Structured Covariance Gaussian Networks for Orion Crew Module Aerodynamic Uncertainty Quantification

machine learning↗

NASA NTRSDate not supplied

Uncertainty Modeling for Mars Ascent Vehicle’s Aerodatabase Development

The design of the Mars Ascent Vehicle - Mars Sample Return (MAV-MSR) trajectories requires an accurate assessment of flight performance. Typically, these trajectories are developed by flight mechanics analysis to meet complex mission requirements and then flight performance assessed through Monte Carlo simulations. Consequently, it is crucial to develop an aerodynamic aerodatabase as an input model for flight mechanics analysis to provide static and dynamic force and moment coefficients under specific flight conditions. The force and moment coefficients in the MAV aerodatabase are determined using the FUN3D computational fluid dynamics solver. Firstly, an overview of the aerodatabase is presented to demonstrate its applicability to trajectory-defined simulations. This effort is followed by an initial attempt to quantify uncertainties in the force and moment coefficients necessary for updating the current aerodatabase. The uncertainty model identifies uncertainty adders and multipliers for coefficient-based forces and moments through a direct comparison between FUN3D and wind tunnel test data from NASA Marshall Space Center's 14x14 inch Trisonic Wind Tunnel. These uncertainties aim to encompass various changes in Mach number, angle of attack, and aerodynamic roll angle.

Uncertainty analysis↗

NASA NTRSDate not supplied

Uncertainty Modeling for Mars Ascent Vehicle’s Aerodynamic Database Development

Uncertainty analysis↗

NASA NTRSDate not supplied

Atmospheric Variability and Measurement Uncertainty: Pitfalls in Averaging in situ Data

Satellite measurements and atmospheric models, two essential components of the integrated global observing system, provide crucial tools for monitoring and predicting regional and global foci, spanning numerous Earth Science fields. Unfortunately, models can lack the spatial and temporal resolution needed to resolve finer scale structure. Satellite measurements also have similar tempo-spatial restriction issues, but additionally can only measure certain species and can have biases that must be evaluated. Ground measurement networks are critical components of this system, by providing both independent inputs of species needed by models (including those that satellites do not provide) and assisting with investigation of biases in satellite products. Similarly, aircraft measurements play a vital role in closing the gaps between satellite measurements, model products, and ground monitoring networks by providing high accuracy, high-resolution data on local to regional spatial scales. Therefore, both ground-based and airborne observations are widely used to assess model predictions and satellite observations. One of the great challenges in using both ground and aircraft data in this fashion is matching the data temporally and spatially to the model/satellite data. A meaningful comparison with model or satellite requires a solid assessment of the variability of the in-situ measurements, which include both the instrument uncertainty and the statistical uncertainty due to atmospheric variability. While instrument uncertainty is generally more straightforwardly characterized, it can be challenging to accurately capture this variability uncertainty as it often presents in a non-Gaussian manner (e.g. emission plumes, frontal passages). We will present results examining spatial and temporal variability over a selection of scales relevant to satellite measurements and models of several in situ measurement species spanning both airborne and ground measurements. The extent of non-Gaussian variability will be quantified, and we will discuss additional statistical parameters that help assess the fitness of gaussian variability assumption when temporally or spatially averaging.

satellite validation↗

DOE OSTI2022

Uncertainty Quantification of Bifacial Performance Modeling: Preprint

Analysis on uncertainty in the annual energy of PV systems that can be attributed to parameters of particular importance to bifacial PV modules is presented. Monte Carlo simulations are used to evaluate the effect of uncertain module bifaciality factors, module transmission fractions, albedo values, and ground clearance. The analyses cover a wide spectrum of potential PV array archetypes through variation of installation parameters. The results of the Monte Carlo analysis reveal that the uncertainty is largely dependent on albedo uncertainty, but more simulations are needed to identify trends across system archetypes. The simulations are aimed at attributing an annual energy uncertainty factor for bifacial considerations that can be applied in post-processing of project probability of exceedance analysis.

energy modeling↗

DOE OSTI2024

Economic Parameter Uncertainty Quantification Demonstration

HERON has recently added uncertainty quantification capabilities for economic parameters. Users may now associate a distribution with certain cash flow parameters to simulate uncertainty in cost or other economic inputs. For example, a user may want to capture the uncertainty of capital expenditures of an advanced nuclear power plant because public data is hard to find or is not available yet. This new addition allows users to account for that uncertainty.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

MOOSE ProbML: Parallelizable Probabilistic Machine Learning and Uncertainty Quantification Capabilities

The Multiphysics Object Oriented Simulation Environment (MOOSE) is a widely used open- source finite element software for performing multiphysics multiscale simulations in a massively parallel fashion. Recently, the computational team at Idaho National Laboratory (INL) has implemented Probabilistic Machine Learning (ProbML) capabilities in MOOSE—in a parallelized fashion—and enable active learning with large-scale computational models for tasks such as surrogate model development, scale bridging, forward/inverse uncertainty quantification (UQ), Bayesian optimization, etc. This presentation summarizes these developments in MOOSE along with demonstrations on several real applications relevant to nuclear energy. At the fundamental level, samplers like Monte Carlo/Latin Hypercube, variance reduction, parallelized Markov Chain Monte Carlo (MCMC) support uncertainty propagation in both forward and inverse settings. These samplers can be integrated with the Gaussian processes (GP) suite in MOOSE, which offer several variants like scalar GPs, multi-output GPs, and deep GPs, to enable active learning. These GPs can be tuned using gradient-based optimization methods like Adam and its variants or gradient-free methods like the elliptical slice sampler (a variant of MCMC adept under Gaussian settings) for more complex covariance kernels or likelihoods whose gradient computations can be cumbersome. A variety of batch acquisition functions permit parallelized evaluation of the computational model and support different learning objectives with high efficiency like Bayesian inference, global surrogate development, optimization, etc. Furthermore, libtorch integration supports training, evaluation, and re-training of neural networks and other complex machine learning models in active learning settings. The impacts of these developments are shown on several real applications: (1) nuclear fuel inverse UQ and model inadequacy assessment using the Kennedy O’Hagan framework; (2) uncertainty aware surrogate modeling for additive manufacturing to predict field quantities; (3) nuclear reactor rare events analysis; and (4) complex fluid flow prediction using a global surrogate with quantified prediction uncertainty. Finally, the outlook of MOOSE ProbML is discussed for both outer-loop and inner-loop computations in the broad view to accelerate fuels and materials qualification, address gaps in knowledge and data, and assess new reactor/fuel systems.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗