Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

The Relation Between Atmospheric Humidity and Temperature Trends for Stratospheric Water

We analyze the relation between atmospheric temperature and water vapor-a fundamental component of the global climate system-for stratospheric water vapor (SWV). We compare measurements of SWV (and methane where available) over the period 1980-2011 from NOAA balloon-borne frostpoint hygrometer (NOAA-FPH), SAGE II, Halogen Occultation Experiment (HALOE), Microwave Limb Sounder (MLS)/Aura, and Atmospheric Chemistry Experiment Fourier Transform Spectrometer (ACE-FTS) to model predictions based on troposphere-to-stratosphere transport from ERA-Interim, and temperatures from ERA-Interim, Modern Era Retrospective-Analysis (MERRA), Climate Forecast System Reanalysis (CFSR), Radiosonde Atmospheric Temperature Products for Assessing Climate (RATPAC), HadAT2, and RICHv1.5. All model predictions are dry biased. The interannual anomalies of the model predictions show periods of fairly regular oscillations, alternating with more quiescent periods and a few large-amplitude oscillations. They all agree well (correlation coefficients 0.9 and larger) with observations for higherfrequency variations (periods up to 2-3 years). Differences between SWV observations, and temperature data, respectively, render analysis of the model minus observation residual difficult. However, we find fairly well-defined periods of drifts in the residuals. For the 1980s, model predictions differ most, and only the calculation with ERA-Interim temperatures is roughly within observational uncertainties. All model predictions show a drying relative to HALOE in the 1990s, followed by a moistening in the early 2000s. Drifts to NOAA-FPH are similar (but stronger), whereas no drift is present against SAGE II. As a result, the model calculations have a less pronounced drop in SWV in 2000 than HALOE. From the mid-2000s onward, models and observations agree reasonably, and some differences can be traced to problems in the temperature data. These results indicate that both SWV and temperature data may still suffer from artifacts that need to be resolved in order to answer the question whether the large-scale flow and temperature field is sufficient to explain water entering the stratosphere.

Fueglistaler, S.↗
NASA NTRSDate not supplied

Green Aviation: Review, Aspirations, and Operational Improvements

Air traffic affects the environment locally, regionally and globally. Estimates show that aviation is responsible for 13% of transportation-related fossil fuel consumption and 2% of all anthropogenic CO2 emissions. Although there is considerable decline in air traffic due to COVID pandemic, Federal Aviation Administration (FAA) expects domestic air traffic to grow at an annual rate of 2.0 % over the next 20 years. Global air traffic is expected to grow more rapidly than domestic air traffic at an annual rate of 4.8% from 2011 to 2030. The desire to accommodate growing air traffic needs while limiting the impact of aviation on the environment has led to research in green aviation with the goals of better scientific understanding, utilization of alternative fuels, introduction of new aircraft technology, and rapid operational changes. Greenhouse gases, nitrogen oxides, and contrails generated by air traffic affect the climate in different and uncertain ways. Understanding the changes requires a hierarchy of models to deal with multiple disciplines, time scales ranging from few minutes to few hundred years and uncertainties in modeling parameters affecting both science and policy. This talk reviews earlier work at Ames on the modeling approach and an integrated capability to design aircraft operations based on a trade-off between fuel consumption, environmental goals and stakeholder values.

Green Aviation↗
NASA NTRS2022

Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

Flight testing has been the historical standard for determining aircraft airworthiness - however, increases in the cost of flight testing and the accuracy of inexpensive CFD promote certification by analysis to reduce or replace flight testing. A framework is introduced to predict the performance in the special case of a modification to an existing, previously certified aircraft. This framework uses a combination of existing flight test or high fidelity data of the original aircraft as well as lower fidelity data of the original and modified configurations. Two methods are presented which estimate the model form uncertainty of the modified configuration, which is then used to conduct non-deterministic simulations. The framework is applied to an example aircraft system with simulated flight test data to demonstrate the ability to predict the performance and associated uncertainty of modified aircraft configurations. However, it is important that the models and methods used are applicable and accurate throughout the intended use domain. The factors and limitations of the framework are explored to determine the range of applicability of the framework. The effects of these factors on the performance and uncertainty results are demonstrated using the example aircraft system. The framework is then applied to NASA’s X-57 Maxwell and each of its modifications. The estimated performance and associated uncertainties are then compared to the airworthiness criteria to evaluate the potential of the framework as a component to the certification by analysis process.

Uncertainty Quantification↗
NASA NTRS2017

Methods for Probabilistic Uncertainty Analysis and Bayesian Analysis with Examples of Statistically Analyzing Data to Revise MMOD Risk Estimates and Compare Models

Probabilistic methods are presented for characterizing and quantifying uncertainties in models and model predictions. Techniques are given for constructing specific uncertainty distributions based on available information. Alternative techniques are given for propagating uncertainties in model inputs to obtain the uncertainty in the model result or prediction. Bayesian techniques are also described for utilizing data and information to update and revise model results and predictions. The focus is on applications with numerous specific examples given. The use of data to revise Micrometeoroid and Orbital Debris (MMOD) risk prediction models are among the examples given.

Risk↗
NASA NTRS2011

Uncertainty Assessments of 2D and Axisymmetric Hypersonic Shock Wave - Turbulent Boundary Layer Interaction Simulations at Compression Corners

This paper is one of a series of five papers in a special session organized by the NASA Fundamental Aeronautics Program that addresses uncertainty assessments for CFD simulations in hypersonic flow. Simulations of a shock emanating from a compression corner and interacting with a fully developed turbulent boundary layer are evaluated herein. Mission relevant conditions at Mach 7 and Mach 14 are defined for a pre-compression ramp of a scramjet powered vehicle. Three compression angles are defined, the smallest to avoid separation losses and the largest to force a separated flow engaging more complicated flow physics. The Baldwin-Lomax and the Cebeci-Smith algebraic models, the one-equation Spalart-Allmaras model with the Catrix-Aupoix compressibility modification and two-equation models including Menter SST, Wilcox k-omega 98, and Wilcox k-omega 06 turbulence models are evaluated. Each model is fully defined herein to preclude any ambiguity regarding model implementation. Comparisons are made to existing experimental data and Van Driest theory to provide preliminary assessment of model form uncertainty. A set of coarse grained uncertainty metrics are defined to capture essential differences among turbulence models. Except for the inability of algebraic models to converge for some separated flows there is no clearly superior model as judged by these metrics. A preliminary metric for the numerical component of uncertainty in shock-turbulent-boundary-layer interactions at compression corners sufficiently steep to cause separation is defined as 55%. This value is a median of differences with experimental data averaged for peak pressure and heating and for extent of separation captured in new, grid-converged solutions presented here. This value is consistent with existing results in a literature review of hypersonic shock-turbulent-boundary-layer interactions by Roy and Blottner and with more recent computations of MacLean.

Gnoffo, Peter A.↗
NASA NTRS1980

Precision orbit analyses in support of the Seasat altimeter experiment

It is noted that major improvements have been made in the Goddard Space Flight Center (GSFC) geodynamic models for Seasat. It is pointed out that the dominant error source in Seasat ephemeris computation is currently the uncertainty in modeling the earth's gravity field. Attention is also given to significant errors arising from atmospheric drag and solar radiation pressure modeling. It is noted that a comparison of GSFC and Naval Surface Weapons Center (NSWC) Seasat ephemerides indicate the presence of an unexplained difference of about 4 m in the location of the center of mass along the Z axis. This difference is consistent with that obtained with earlier geoid and station coordinated comparisons performed by other investigators. It is expected that future combinations of Seasat and GEOS-3 altimeter data, together with laser and Unified S-Band tracking data, will ultimately produce a gravity field which allows computations of a global Seasat ephemeris with an rms radial accuracy of about 50 cm.

Marsh, J. G.↗
NASA NTRS1987

A detailed description of the uncertainty analysis for High Area Ratio Rocket Nozzle tests at the NASA Lewis Research Center

A preliminary uncertainty analysis has been performed for the High Area Ratio Rocket Nozzle test program which took place at the altitude test capsule of the Rocket Engine Test Facility at the NASA Lewis Research Center. Results from the study establish the uncertainty of measured and calculated parameters required for the calculation of rocket engine specific impulse. A generalized description of the uncertainty methodology used is provided. Specific equations and a detailed description of the analysis are presented. Verification of the uncertainty analysis model was performed by comparison with results from the experimental program's data reduction code. Final results include an uncertainty for specific impulse of 1.30 percent. The largest contributors to this uncertainty were calibration errors from the test capsule pressure and thrust measurement devices.

Kenneth J. Davidian↗
NASA NTRS1987

A detailed description of the uncertainty analysis for high area ratio rocket nozzle tests at the NASA Lewis Research Center

A preliminary uncertainty analysis was performed for the High Area Ratio Rocket Nozzle test program which took place at the altitude test capsule of the Rocket Engine Test Facility at the NASA Lewis Research Center. Results from the study establish the uncertainty of measured and calculated parameters required for the calculation of rocket engine specific impulse. A generalized description of the uncertainty methodology used is provided. Specific equations and a detailed description of the analysis is presented. Verification of the uncertainty analysis model was performed by comparison with results from the experimental program's data reduction code. Final results include an uncertainty for specific impulse of 1.30 percent. The largest contributors to this uncertainty were calibration errors from the test capsule pressure and thrust measurement devices.

Davidian, Kenneth J.↗
NASA NTRS2010

Evaluating the Utility of Remotely-Sensed Soil Moisture Retrievals for Operational Agricultural Drought Monitoring

Soil moisture is a fundamental data source used by the United States Department of Agriculture (USDA) International Production Assessment Division (IPAD) to monitor crop growth stage and condition and subsequently, globally forecast agricultural yields. Currently, the USDA IPAD estimates surface and root-zone soil moisture using a two-layer modified Palmer soil moisture model forced by global precipitation and temperature measurements. However, this approach suffers from well-known errors arising from uncertainty in model forcing data and highly simplified model physics. Here we attempt to correct for these errors by designing and applying an Ensemble Kalman filter (EnKF) data assimilation system to integrate surface soil moisture retrievals from the NASA Advanced Microwave Scanning Radiometer (AMSR-E) into the USDA modified Palmer soil moisture model. An assessment of soil moisture analysis products produced from this assimilation has been completed for a five-year (2002 to 2007) period over the North American continent between 23degN - 50degN and 128degW - 65degW. In particular, a data denial experimental approach is utilized to isolate the added utility of integrating remotely-sensed soil moisture by comparing EnKF soil moisture results obtained using (relatively) low-quality precipitation products obtained from real-time satellite imagery to baseline Palmer model runs forced with higher quality rainfall. An analysis of root-zone anomalies for each model simulation suggests that the assimilation of AMSR-E surface soil moisture retrievals can add significant value to USDA root-zone predictions derived from real-time satellite precipitation products.

Bolten, John D.↗
NASA NTRSDate not supplied

Automated Probabilistic Finite Element Model Calibration Tool Based on Uncertainty Quantification and Machine Learning

Qualification and certification of safety critical parts is a hurdle to the adoption of metallic additively manufactured components for aerospace vehicle applications. Challenges include variability in part properties due to inconsistent defect distribution and microstructure. Understanding of the process through finite element modeling (FEM), and process control through in-situ monitoring, may result in significant improvements; however, solutions useful to manufacturers will require large volumes of data and automated data utilization. Toward this end, a generalizable automated FEM calibration paradigm is developed. This paradigm leverages existing and novel tools from machine learning and uncertainty quantification to enable the automatic calibration of FEMs without requiring prior knowledge of the model performance across input parameter space, including meshing and solver settings, which can require time consuming manual model probing or cause noisy and inconsistent predictions. The result is a probabilistic distribution of calibrated and validated FEM input parameters targeting measured data.

Additive manufacturing model calibration finite el↗
NASA NTRS1991

Interannual variations of ozone - Interpretation of 4 years of satellite observations of total ozone

Observations show that the monthly zonal mean total ozone between 1978 and 1982 varies by as much as 5 percent with respect to the 4-year average. These variations have been analyzed with the aid of a two-dimensional chemistry transport model. Observed temperatures and meridional stream functions, calculated from data, were used as inputs for the model. Deviations of the model-calculated total ozone from the 4-year mean were compared with the observed variations. It is shown that a substantial part of the observed variability of total ozone is reproduced by the model, despite uncertainties in the heating rates and without any special attempts to obtain consistent eddy diffusion or otherwise to tune the model. Results indicate that the temperature dependence of the ozone gas phase chemistry plays a negligible role in explaining the observed interannual variations in total ozone. A large part of the variability can be explained by the year-to-year differences in the transport circulation. The variability of the diabatic circulation is shown to be largely independent of the ozone fluctuations and to be a consequence of the observed temperature variations.

Schneider, Hans R.↗
NASA NTRS2017

Precomputing Process Noise Covariance for Onboard Sequential Filters

Process noise is often used in estimation filters to account for unmodeled and mismodeled accelerations in the dynamics. The process noise covariance acts to inflate the state covariance over propagation intervals, increasing the uncertainty in the state. In scenarios where the acceleration errors change significantly over time, the standard process noise covariance approach can fail to provide effective representation of the state and its uncertainty. Consider covariance analysis techniques provide a method to precompute a process noise covariance profile along a reference trajectory using known model parameter uncertainties. The process noise covariance profile allows significantly improved state estimation and uncertainty representation over the traditional formulation. As a result, estimation performance on par with the consider filter is achieved for trajectories near the reference trajectory without the additional computational cost of the consider filter. The new formulation also has the potential to significantly reduce the trial-and-error tuning currently required of navigation analysts. A linear estimation problem as described in several previous consider covariance analysis studies is used to demonstrate the effectiveness of the precomputed process noise covariance, as well as a nonlinear descent scenario at the asteroid Bennu with optical navigation.

onboard↗
NASA NTRS2022

Development of a “Nature Run” for Observing System Simulation Experiments (OSSEs) for Snow Mission Development

Snow is a fundamental component of global and regional water budgets, particularly in mountainous areas and regions downstream that rely on snowmelt for water resources. Land surface models (LSMs) are commonly used to develop spatially distributed estimates of snow water equivalent (SWE) and runoff. However, LSMs are limited by uncertainties in model physics and parameters, among other factors. In this study, we describe the use of model calibration tools to improve snow simulations within the Noah-MP LSM as the first step in an observing system simulation experiment (OSSE). Noah-MP is calibrated against the University of Arizona (UA) SWE product over a western Colorado domain. With spatially varying calibrated parameters, we run calibrated and default Noah-MP simulations for water years 2010–20. By evaluating both simulations against the UA dataset, we show that calibration decreases domain averaged temporal RMSE and bias for snow depth from 0.15 to 0.13 m and from −0.036 to −0.0023 m, respectively, and improves the timing of snow ablation. Increased snow simulation performance also improves estimates of model-simulated runoff in four of six study basins, though only one has statistically significant improvement. Spatially distributed Noah-MP snow parameters perform better than default uniform values. We demonstrate that calibrating variables related to snow albedo calculations and rain–snow partitioning, among other processes, is a necessary step for creating a nature run that reasonably approximates true snow conditions for the OSSEs. Additionally, the inclusion of a snowfall scaling term can address biases in precipitation from meteorological forcing datasets, further improving the utility of LSMs for generating reliable spatiotemporal estimates of snow.

Melissa L. Wrzesien↗
NASA NTRS2021

Understanding Uncertainty of Snow Radiative Transfer Modeling Within a Mixed Deciduous and Evergreen Forest

Satellite-based passive microwave observations provide the best available continuous observational estimates of global snow water storage due to their broad geographic footprint and low sensitivity to clouds and precipitation. However, these observations are subject to substantial uncertainty due to the complex radiative properties of snow and from interference in forested areas. Physical radiative transfer models can be leveraged to improve the fidelity of these observations and as a data-assimilation tool. In this article, the Dense Media Radiative Transfer model with Multiple Layers (DMRT-ML) is used to simulate snow brightness temperatures from data collected from snow pits excavated during a two-day-long field study performed a temperate forest in the Northeast United States. The simulations are evaluated against surface-based radiometer observations collected at the snow pits. The DMRT-ML is configured with varying complexity to determine the snowpack characteristics most essential toward simulating brightness temperature within a temperate forest with complicated snow stratigraphy. In general, the single-layer configurations were not sufficiently complex to accurately simulate snow brightness temperature without significant tuning. The most accurate simulation was a two-layer configuration with a prescribed ice layer separating the snow layers. This simulation had a root-mean-square error <;15 K for the 37-GHz frequency. More complicated snowpack stratigraphy configurations did not substantively improve the results over the two-layer model configuration. The DMRT-ML was also used to examine differences between redundant datasets of density and grain size. It was determined that similar snow data collection and radiative transfer model configuration techniques are critical to ensure cross-study comparability.

Theodore Letcher↗
NASA NTRS1995

Uncertainties for two-dimensional models of solar rotation from helioseismic eigenfrequency splitting

Observed solar p-mode frequency splittings can be used to estimate angular velocity as a function of position in the solar interior. Formal uncertainties of such estimates depend on the method of estimation (e.g., least-squares), the distribution of errors in the observations, and the parameterization imposed on the angular velocity. We obtain lower bounds on the uncertainties that do not depend on the method of estimation; the bounds depend on an assumed parameterization, but the fact that they are lower bounds for the 'true' uncertainty does not. Ninety-five percent confidence intervals for estimates of the angular velocity from 1986 Big Bear Solar Observatory (BBSO) data, based on a 3659 element tensor-product cubic-spline parameterization, are everywhere wider than 120 nHz, and exceed 60,000 nHz near the core. When compared with estimates of the solar rotation, these bounds reveal that useful inferences based on pointwise estimates of the angular velocity using 1986 BBSO splitting data are not feasible over most of the Sun's volume. The discouraging size of the uncertainties is due principally to the fact that helioseismic measurements are insensitive to changes in the angular velocity at individual points, so estimates of point values based on splittings are extremely uncertain. Functionals that measure distributed 'smooth' properties are, in general, better constrained than estimates of the rotation at a point. For example, the uncertainties in estimated differences of average rotation between adjacent blocks of about 0.001 solar volumes across the base of the convective zone are much smaller, and one of several estimated differences we compute appears significant at the 95% level.

Genovese, Christopher R.↗
NASA NTRS2012

A Discussion on Uncertainty Representation and Interpretation in Model-Based Prognostics Algorithms based on Kalman Filter Estimation Applied to Prognostics of Electronics Components

This article discusses several aspects of uncertainty representation and management for model-based prognostics methodologies based on our experience with Kalman Filters when applied to prognostics for electronics components. In particular, it explores the implications of modeling remaining useful life prediction as a stochastic process and how it relates to uncertainty representation, management, and the role of prognostics in decision-making. A distinction between the interpretations of estimated remaining useful life probability density function and the true remaining useful life probability density function is explained and a cautionary argument is provided against mixing interpretations for the two while considering prognostics in making critical decisions.

Celaya, Jose R.↗
NASA NTRS1991

Modeling of Jupiter's millimeter wave emission utilizing laboratory measurements of ammonia (NH3) opacity

The techniques used to make laboratory measurements of the millimeter wave opacity from gaseous ammonia under simulated Jovian conditions are described. The results are applied to a radiative transfer model, which is used to compute Jupiter's millimeter wavelength emission. The absorptivity of gaseous NH3 is measured to reduce one of the largest uncertainties in modeling Jupiter's millimeter wave emission. Several other millimeter wave opacity sources are examined. New expressions are given for computing the absorptivity of NH3, H2O, cloud condensates, and pressure-induced absorption. Jupiter's reliable millimeter wavelength observations are compared with synthetic emission spectra which utilize these new absorption expressions.

Joiner, Joanna↗
NASA NTRS2022

A Framework for Deep Learning Emulation of Numerical Models With a Case Study in Satellite Remote Sensing

Numerical models based on physics represent the state of the art in Earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest generation computers, reducing the ability of modelers to generate simulations for understanding parameter sensitivities and characterizing variability and uncertainty. Thus, surrogate models are often developed to capture the essential attributes of the full-blown numerical models. Recent successes of machine learning methods, especially deep learning (DL), across many disciplines offer the possibility that complex nonlinear connectionist representations may be able to capture the underlying complex structures and nonlinear processes in Earth systems. A difficult test for DL-based emulation, which refers to function approximation of numerical models, is to understand whether they can be comparable to traditional forms of surrogate models in terms of computational efficiency while simultaneously reproducing model results in a credible manner. A DL emulation that passes this test may be expected to perform even better than simple models with respect to capturing complex processes and spatiotemporal dependencies. Here, we examine, with a case study in satellite-based remote sensing, the hypothesis that DL approaches can credibly represent the simulations from a surrogate model with comparable computational efficiency. Our results are encouraging in that the DL emulation reproduces the results with acceptable accuracy and often even faster performance. We discuss the broader implications of our results in light of the pace of improvements in high-performance implementations of DL and the growing desire for higher resolution simulations in the Earth sciences.

Bayesian Deep Learning↗