Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Uncertainty Quantification of Global Net Methane Emissions From Terrestrial Ecosystems Using a Mechanistically Based Biogeochemistry Model

Quantification of methane (CH4) emissions from wetlands and its sinks from uplands is still fraught with large uncertainties. Here, a methane biogeochemistry model was revised, parameterized, and verified for various wetland ecosystems across the globe. The model was then extrapolated to the global scale to quantify the uncertainty induced from four different types of uncertainty sources including parameterization, wetland type distribution, wetland area distribution, and meteorological input. We found that global wetland emissions are 212 ± 62 and 212 ± 32 Tg CH4 year−1 (1Tg = 1012 g) due to uncertain parameters and wetland type distribution, respectively, during 2000–2012. Using two wetland distribution data sets and three sets of climate data, the model simulations indicated that the global wetland emissions range from 186 to 212 CH4 year−1 for the same period. The parameters were the most significant uncertainty source. After combining the global methane consumption in the range of −34 to −46 Tg CH4 year−1, we estimated that the global net land methane emissions are 149–176 Tg CH4 year−1 due to uncertain wetland distribution and meteorological input. Spatially, the northeast United States and Amazon were two hotspots of methane emission, while consumption hotspots were in the Eastern United States and eastern China. During 1950–2016, both wetland emissions and upland consumption increased during El Niño events and decreased during La Niña events. This study highlights the need for more in situ methane flux data, more accurate wetland type, and area distribution information to better constrain the model uncertainty.

wetland methane emission↗

High Latitude Atmospheric Rivers: Teleconnections and Impacts

Atmospheric rivers (ARs) are long, narrow synoptic scale features that act as moisture transport vehicles by moving water vapor poleward. They are typically found in storm tracks and often have profound implications for regional hydroclimate. For high latitude locales such as Antarctica and the Arctic, ARs are fewer in number but often have an outsized impact by either producing significant snow accumulation events, or, depending on their thermal characteristics, initiating melt events on ice sheets, ice shelves, and sea ice. In this study, we apply both reanalysis and climate model data to evaluate high latitude ARs for both the Arctic and Antarctic in the context of teleconnections and modes of variability. Specifically, we fold in both MERRA-2 and ERA5 reanalysis as well as historical and climate change simulations from the CESM2 (Community Earth System Model, Version 2) and E3SMv2 (Energy Exascale Earth System Model, v2) with multiple ensemble members to better understand natural variability versus climate change signals. An overview of AR climatology and impacts will be presented, including a baseline uncertainty quantification analysis using data from ARTMIP (the Atmospheric River Tracking Method Intercomparison Project). AR impacts during specific modes of variability will be characterized by diagnosing precipitation and boundary layer temperature associated with Ars influencing the cryosphere. Modes of variability investigated include the SAM (Southern Annular Mode), PDO (Pacific Decadal Oscillation), PSA2 (Pacific South American Mode 2), the IOD (Indian Ocean Dipole), and the AO (Arctic Oscillation).

Atmospheric Rivers↗

Effects of Heat Transfer Coefficient Variation on Nuclear Thermal Propulsion Engine Performance

A physics-based Nuclear Thermal Propulsion (NTP) Testing Reference Design (TRD) power balance model was coded in Simulink to investigate engine performance for various design and parameter modifications. Since the primary mode of heat transfer in NTP engines is convective, the convective heat transfer coefficient (HTC) is a key parameter that requires accurate representation. The industry standard Westinghouse correlation has an uncertainty of ±20% which was investigated in this study. The results showed that a 20% decrease in the HTC led to a 4.14% increase in maximum fuel temperature while a 20% decrease in the HTC led to a 1.81% decrease in maximum fuel temperature suggesting that narrowing the uncertainty of this correlation through experimental work would be a critical step in the development of NTP engines. Furthermore, a maximum fuel temperature relationship with specific impulse was developed for the TRD engine which showed potential engine operation between specific impulse values of 715 and 900 seconds with minimal changes to the engine design. This graph could be useful for high level vehicle performance estimations for fuel types with different maximum operating temperatures.

Heat Transfer Coefficient↗

Effects of Varying the Heat Transfer Coefficient on Engine Performance

A physics-based Nuclear Thermal Propulsion (NTP) Testing Reference Design (TRD) power balance model was coded in Simulink to investigate engine performance for various design and parameter modifications. Since the primary mode of heat transfer in NTP engines is convective, the convective heat transfer coefficient (HTC) is a key parameter that requires accurate representation. The industry standard Westinghouse correlation has an uncertainty of ±20% which was investigated in this study. The results showed that a 20% decrease in the HTC led to a 4.14% increase in maximum fuel temperature while a 20% decrease in the HTC led to a 1.81% decrease in maximum fuel temperature suggesting that narrowing the uncertainty of this correlation through experimental work would be a critical step in the development of NTP engines. Furthermore, a maximum fuel temperature relationship with specific impulse was developed for the TRD engine which showed potential engine operation between specific impulse values of 715 and 900 seconds with minimal changes to the engine design. This graph could be useful for high level vehicle performance estimations for fuel types with different maximum operating temperatures.

Heat Transfer Coefficient↗

A Rat Body Phantom for Radiation Analysis

To reduce the uncertainties associated with estimating the biological effects of ionizing radiation in tissue, researchers rely on laboratory experiments in which mono-energetic, single specie beams are applied to cell cultures, insects, and small animals. To estimate the radiation effects on astronauts in deep space or low Earth orbit, who are exposed to mixed field broad spectrum radiation, these experimental results are extrapolated and combined with other data to produce radiation quality factors, radiation weighting factors, and other risk related quantities for humans. One way to reduce the uncertainty associated with such extrapolations is to utilize analysis tools that are applicable to both laboratory and space environments. The use of physical and computational body phantoms to predict radiation exposure and its effects is well established and a wide range of human and non-human phantoms are in use today. In this paper, a computational rat phantom is presented, as well as a description of the process through which that phantom has been coupled to existing radiation analysis tools. Sample results are presented for two space radiation environments.

Qualls, Garry D.↗

Probabilistic Fatigue Damage Prognosis Using a Surrogate Model Trained Via 3D Finite Element Analysis

Utilizing inverse uncertainty quantification techniques, structural health monitoring can be integrated with damage progression models to form probabilistic predictions of a structure's remaining useful life. However, damage evolution in realistic structures is physically complex. Accurately representing this behavior requires high-fidelity models which are typically computationally prohibitive. In the present work, a high-fidelity finite element model is represented by a surrogate model, reducing computation times. The new approach is used with damage diagnosis data to form a probabilistic prediction of remaining useful life for a test specimen under mixed-mode conditions.

Leser, Patrick E.↗

Impact of environmental attributes on the uncertainty in MAIAC/MODIS AOD retrievals: A comparative analysis

This work examines the impact of different environmental attributes on the uncertainty in satellite-based Aerosol Optical Depth (AOD) retrieval against the benchmark Aerosol Robotic Network (AERONET) AOD measurements at 21 sites across North Africa, California and Germany, in the years 2007–2017. As a first step, we studied the effects of spatial averaging the Multi-Angle Implementation of Atmospheric Correction (MAIAC) AOD retrievals, and of temporal averaging the AERONET AOD around the satellite (Aqua) overpass, on the agreement between the two products. AERONET AOD averaging over a time-window of ±15 min around the satellite overpass and the 1 ×1 km2 spatial grid of MAIAC were found to provide the best AOD retrieval performance. Next, MAIAC AOD were stratified according to different co-measured environmental attributes (aerosol loading, dominant particle size, vegetation cover, and prevailing particle type) and analyzed against the AERONET AOD. The envelope of the expected retrieval error varied considerably among different environmental attributes categories, with more accurate AOD retrievals obtained over highly vegetated areas (i.e. less surface reflectance) than over arid areas. Moreover, the retrieval accuracy was found to be sensitive to the aerosol loading and particle size, with a large bias between the MAIAC and AERONET AOD during high aerosol loading of coarse particles. In addition, the retrieval accuracy of MAIAC AOD was found to depend on the aerosol type due to the aerosol model assumptions regarding their optical properties.

AOD RETRIEVAL↗

Variance Decomposition of MEDLI2 Reconstructed Heating Using Neural Networks

The Mars Entry, Descent, and Landing Instrumentation (MEDLI2) sensor suite collected data during entry of the Mars 2020 Perseverance rover into Mars’ atmosphere. This suite included a network of MEDLI2 Instrumented Sensor Plugs (MISPs). Each MISP was comprised of a cylinder made of Thermal Protection System (TPS) material with 1-3 embedded thermocouples (TCs), and it was flush mounted into the heatshield or backshell. Data from these in-depth TCs were used to reconstruct the aeroheating environment of the vehicle throughout entry. Surface heating was posed as an inverse problem, with the goal of estimating the surface heating by minimizing an objective function of the difference between MISP temperature measurements during flight and the temperature predictions derived from the Fully Implicit Ablation and Thermal response (FIAT) program. Given an aerothermal environment, FIAT calculates the material response and provides in-depth temperatures throughout the TPS material. To achieve the reverse, an internal tool called FIAT_Opt runs through multiple different environments until the output temperature at the TC depth closely matches the flight data. 95% confidence intervals on the reconstructed surface heating were obtained using Monte Carlo analysis, in which uncertainties in the thermocouple depth and the TPS material properties (e.g., density, thermal conductivity, heat capacity, emissivity) based on flight-lot material testing were included. A variance decomposition method using Sobol indices was employed to assess the sensitivity of the reconstructed peak heating to the TC placement and material property uncertainties. Variance decomposition was found to require tens of thousands of FIAT_Opt runs in order for the Sobol indices to converge. With a single FIAT_Opt run taking on the order of 40 minutes, the required number of computations would take months to complete, even if using multiple CPUs. To mitigate this problem, three machine learning models (ridge regression with cross-validation, random forest regression, and a deep neural network) were trained and tested using the 2000 Monte Carlo runs that were already completed. A subset of 1600 runs were used to train the model (i.e., training set), while the remaining 400 runs were used as the test set. The predictions from the deep neural network (DNN) on the test set showed nearly perfect agreement to the actual values computed with FIAT_Opt (R2 > 0.99). Using the DNN as a surrogate model, the variance decomposition using 50,000 runs was completed within minutes. The resulting Sobol indices showed that the reconstructed peak surface heating was most sensitive to the uncertainties in the thermal conductivity (ST = 0.37) and heat capacity (ST = 0.26). This method can be leveraged to provide requirements for material property measurements needed to improve the accuracy of surface heating prediction and ultimately lead to the reduction of design margins in the future. This presentation will include background on the MEDLI2 suite; the method used for inverse heating estimation; the way that material property uncertainties were accounted for using Monte Carlo analysis; a brief background on variance decomposition; the motivation for using machine learning in this context; how a neural network was trained on the data to enable variance decomposition in a fraction of the time; and the variance decomposition results for one of the MISPs.

Hannah Alpert↗

Robustness Analysis of Integrated LPV-FDI Filters and LTI-FTC System for a Transport Aircraft

This paper proposes an analysis framework for robustness analysis of a nonlinear dynamics system that can be represented by a polynomial linear parameter varying (PLPV) system with constant bounded uncertainty. The proposed analysis framework contains three key tools: 1) a function substitution method which can convert a nonlinear system in polynomial form into a PLPV system, 2) a matrix-based linear fractional transformation (LFT) modeling approach, which can convert a PLPV system into an LFT system with the delta block that includes key uncertainty and scheduling parameters, 3) micro-analysis, which is a well known robust analysis tool for linear systems. The proposed analysis framework is applied to evaluating the performance of the LPV-fault detection and isolation (FDI) filters of the closed-loop system of a transport aircraft in the presence of unmodeled actuator dynamics and sensor gain uncertainty. The robustness analysis results are compared with nonlinear time simulations.

Khong, Thuan H.↗

Uncertainty Optimization Applied to the Monte Carlo Analysis of Planetary Entry Trajectories

Recently, strong evidence of liquid water under the surface of Mars and a meteorite that might contain ancient microbes have renewed interest in Mars exploration. With this renewed interest, NASA plans to send spacecraft to Mars approx. every 26 months. These future spacecraft will return higher-resolution images, make precision landings, engage in longer-ranging surface maneuvers, and even return Martian soil and rock samples to Earth. Future robotic missions and any human missions to Mars will require precise entries to ensure safe landings near science objective and pre-employed assets. Potential sources of water and other interesting geographic features are often located near hazards, such as within craters or along canyon walls. In order for more accurate landings to be made, spacecraft entering the Martian atmosphere need to use lift to actively control the entry. This active guidance results in much smaller landing footprints. Planning for these missions will depend heavily on Monte Carlo analysis. Monte Carlo trajectory simulations have been used with a high degree of success in recent planetary exploration missions. These analyses ascertain the impact of off-nominal conditions during a flight and account for uncertainty. Uncertainties generally stem from limitations in manufacturing tolerances, measurement capabilities, analysis accuracies, and environmental unknowns. Thousands of off-nominal trajectories are simulated by randomly dispersing uncertainty variables and collecting statistics on forecast variables. The dependability of Monte Carlo forecasts, however, is limited by the accuracy and completeness of the assumed uncertainties. This is because Monte Carlo analysis is a forward driven problem; beginning with the input uncertainties and proceeding to the forecasts outputs. It lacks a mechanism to affect or alter the uncertainties based on the forecast results. If the results are unacceptable, the current practice is to use an iterative, trial-and-error approach to reconcile discrepancies. Therefore, an improvement to the Monte Carlo analysis is needed that will allow the problem to be worked in reverse. In this way, the largest allowable dispersions that achieve the required mission objectives can be determined quantitatively.

Olds, John↗

Reliability Analysis in the Presence of Aleatory Uncertainty

This paper proposes a method for modeling a system’s response using data. In contrast to approaches that identify a limit state function, we focus on the case in which not all uncertain parameters affecting the response are observable and the measured response is corrupted by noise. To this end, the system response is not characterized by a limit state function but instead by a Random Predictor Model (RPM) having a nonparametric structure. Consequently, the resulting failure probability is not a scalar but a random variable. This variable accounts for the aleatory contributions of the model-form uncertainty and the measurement noise into the response. Furthermore, we propose a framework that enables trading off the predicted range of failure probabilities resulting from such an analysis with a measure of risk. In this context, risk is the percentage of all predicted outcomes the analyst is willing to ignore. The reliability analysis of an aeroelastic structure subject to flutter is used to illustrate the ideas proposed.

Crespo, L. G.↗

Antarctic Sea Ice Thickness and Snow-to-Ice Conversion from Atmospheric Reanalysis and Passive Microwave Snow Depth

Passive microwave snow depth, ice concentration, and ice motion estimates are combined with snowfall from the European Centre for Medium Range Weather Forecasting (ECMWF) reanalysis (ERA-40) from 1979-200 1 to estimate the prevalence of snow-to-ice conversion (snow-ice formation) on level sea ice in the Antarctic for April-October. Snow ice is ubiquitous in all regions throughout the growth season. Calculated snow- ice thicknesses fall within the range of estimates from ice core analysis for most regions. However, uncertainties in both this analysis and in situ data limit the usefulness of snow depth and snow-ice production to evaluate the accuracy of ERA-40 snowfall. The East Antarctic is an exception, where calculated snow-ice production exceeds observed ice thickness over wide areas, suggesting that ERA-40 precipitation is too high there. Snow-ice thickness variability is strongly controlled not just by snow accumulation rates, but also by ice divergence. Surprisingly, snow-ice production is largely independent of snow depth, indicating that the latter may be a poor indicator of total snow accumulation. Using the presence of snow-ice formation as a proxy indicator for near-zero freeboard, we examine the possibility of estimating level ice thickness from satellite snow depths. A best estimate for the mean level ice thickness in September is 53 cm, comparing well with 51 cm from ship-based observations. The error is estimated to be 10-20 cm, which is similar to the observed interannual and regional variability. Nevertheless, this is comparable to expected errors for ice thickness determined by satellite altimeters. Improvement in satellite snow depth retrievals would benefit both of these methods.

Markus, Thorsten↗

Atmospheric moisture measurements - A microwave radiometer-radiosonde comparison

Measurements of the thermal emission of the sky at three frequencies (20.7, 22.2, and 31.4 GHz) with the NASA/Goddard Space Flight Center Crustal Dynamics Project MW Water Vapor Radiometer are reported. These measurements are compared with brightness temperatures inferred from measurements from VAISALA radiosonde packages launched every 3 hr during the experiment period. An error analysis for the radiosonde-inferred brightness temperatures is performed under the assumption of reasonable random uncertainties for the pressure, temperature, and humidity measurements and propagation of these uncertainties through the analysis algorithm. For the assumed uncertainties, the dominant contribution to the total uncertainty comes from the temperature measurement (66-88 percent), whereas the relative humidity measurement contributes only 2-8 percent, except in the vicinity of the water vapor line, where the contribution is 10-20 percent.

England, Martin N.↗

Development Strategies for Uncertainty Quantification to Enable Aircraft Certification by Analysis

Aircraft Certification by Analysis (CbA) is a broad term that describes the process by which engineering analysis tools are used to supplement flight testing to demonstrate compliance with regulatory requirements. For each requirement that is to be met through this process, the analysis tools must be sufficiently accurate to ensure that an equivalent level of safety is obtained as if the aircraft to be certified had been flight tested for the requirement. In recent decades, the ability of analysis tools to accurately predict aircraft performance has improved dramatically, leading to increasing interest and limited early adoption of Certification by Analysis across the aerospace industry. However, rigorously demonstrating the credibility of analysis tools remains a challenge for many types of certification requirements, yet is necessary for widespread adoption of CbA approaches in the future. The field of uncertainty quantification is well-suited to address this problem, but will require substantial advances in order to achieve the ambitious industry goals for Certification by Analysis. The objective of this position paper is to highlight gaps in the current technical and programmatic state of uncertainty quantification. Four main categories – Mindset & Awareness, Tools & Capabilities, Data and Benchmarks for V&V, and Applied Research & Established Processes – will be introduced. Each of these categories contains several shortcomings and impediments which, if overcome, will enable more widespread possibilities for Certification by Analysis in the 2040-2050 timeframe.

Uncertainty Quantification↗

An Initial Analysis of the Pixel-Level Uncertainties in Global MODIS Cloud Optical Thickness and Effective Particle Size Retrievals

Moderate Resolution Imaging Spectroradiometer (MODIS) retrievals of cloud optical thickness and effective particle radius employ well-known solar reflectance techniques using pre-calculated reflectance look-up tables. We evaluate the quantitative uncertainty in simultaneous retrievals of cloud optical thickness and particle size for this type of algorithm. The technique uses sensitivity calculations derived from the reflectance look-up tables, coupled with estimates for the effect of various error terms on the uncertainty in inferring the actual cloud-top reflectance. The error terms include the effects of instrument calibration, surface spectral albedo, and atmospheric corrections on both water and ice cloud retrievals. Because particle shapes in ice clouds are highly variable, the effect of particle shape is analyzed separately with a more approximate method. Results will deal exclusively with pixel-level uncertainties associated with plane-parallel clouds; real-world radiative departures from a plane-parallel model are an additional consideration. While we demonstrate the uncertainty technique with operational 1 km MODIS retrievals from the Terra and Aqua satellite platforms, the technique is applicable to any reflectance-based satellite- or air-borne sensor retrieval using similar spectral channels.

Platnick, S.↗

Casper-1, Part 6: Uncertainty Quantification, Factor Effects, and Outlier Analysis for an On-Board Airplane Trajectory Prediction Function

This report presents data analysis results for a simulation-based approach named CASPEr (Characterization of Airplane State Prediction Error) to characterize the performance of onboard energy state and automation mode prediction functions for terminal area arrival and approach phases of flight over a wide range of conditions. In particular, the results include quantification of energy state (i.e., altitude and airspeed) prediction performance, models for prediction performance as a function of initial energy state (i.e., initial altitude, airspeed, and weight) and weather factors, and analysis of outlier prediction performance. Wind speed, wind direction, and wind gradient were found to be major factors in energy state prediction performance. Initial energy and gust intensity were also significant factors in airspeed prediction performance. Furthermore, the results suggest that errors in automation mode prediction may be a major contributor to outlier prediction performance.

Torres-Pomales, Wilfredo↗

Uncertainty Estimates for Sonic-Boom Pressure Signatures and Loudness Carpets

A non-intrusive uncertainty quantification method is applied to computational analysis of supersonic, low-boom aircraft. The mean and standard deviation statistics of the pressure waveforms and loudness metrics are evaluated through use of numerical quadrature. The probability density function (p.d.f.) of these outputs is evaluated via kernel density estimation. The simulations use an inviscid, embedded-boundary Cartesian-mesh flow solver in the nearfield combined with an augmented Burgers’ equation solver for propagation in the farfield. The results show that the p.d.f. of the waveform is bimodal at shocks, which makes the mean and standard deviation statistics inappropriate. Despite this limitation, we show that the moment statistics can provide effective assessment of discrepancies when comparing with experimental data. This is demonstrated by presenting uncertainty analysis of a wind-tunnel test and showing that we significantly improve the predictions when we include the test uncertainties in the simulation. Normal distributions are obtained for the ground signature and loudness metrics, which is primarily due to the careful shaping of the low-boom waveform. Separation of variables and error control are used to reduce computational cost. We demonstrate that this is an efficient approach in the sense of balancing numerical errors in the statistics quadrature with discretization errors in the solvers.

ARMD↗