Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Efficient method for approximating nonlinear dynamics: applications to uncertainty propagation and estimation

High-order Taylor series expansions can be used to model nonlinear dynamics at the cost of integrating a large set of variational equations to obtain high-order state-transition tensors (STTs). This paper presents an innovative technique for approximating the high-order STTs that reduces significantly the computational cost by retaining only the dominant secular terms. We propagate the low-order partial derivatives of Kepler’s equation, which only requires the integration of six additional equations to extend an n-th order approximation to order (n + 1). The approximation stems from the Lindstedt-Poincare procedure and exploits the stability properties of orbital motion. Since the method makes no dynamical assumptions, it can accommodate any source of orbital perturbations. We show how the approximation of the second-order STT significantly increases the accuracy of the linear method for uncertainty propagation with only a small computational overhead. Finally, we derive a high-order approximate extended Kalman filter that implements the proposed approximation of the STT and improves the performance of linear filters. Examples of application with different perturbation sources include the heliocentric orbit of an asteroid, an orbiter around Europa, and an Earth-orbiting satellite.

Park, Ryan S↗

Dealing with Ion LET Uncertainties: An Application of Generalized Linear Models

Although most SEE rate estimation methods presume a fit to SEE cross section vs. LET, fitting SEE data is challenging because the data are not compatible with the assumptions of many common fitting techniques (e.g. linear regression. The difficulty of fitting such data is compounded when the LET of the ion responsible for an SEE is uncertain. We modify a Generalized Linear Model SEE data fitting methodology to accommodate uncertain LET and apply the method to the problem of backside heavy-ion SEE testing to demonstrate the utility of the method, explore the dependence of systematic errors that arise from improper treatment of LET uncertainty and develop guidelines for minimizing such systematic errors when proper treatment is not possible. Additional applications are suggested and assessed for suitability of treatment by the model.

Single-event effects↗

Evaluating and Constraining Models’ Stratocumulus and Cumulus Cloud Feedbacks in the Tropics using Satellite Observations to Reduce Uncertainties in Future Climate Projections

Low-cloud feedbacks are thought to be the greatest source of uncertainty in climate projections on the centennial scale. Past research has mainly focused on the global low-cloud feedback as a whole whereas only a few studies have examined separated contributions from the two main low cloud categories: stratocumulus (Sc) and shallow cumulus (Cu). Here we aim to evaluate and constrain Sc and Cu cloud feedbacks in models using satellite observations to ultimately reduce their contribution to the spread in equilibrium climate sensitivity. We utilize the Cumulus and Stratocumulus CloudSat-CALIPSO Dataset (CASCCAD) recently developed by Cesana et al. (2019), which discriminates Sc from Cu clouds. This algorithm – based on cloud morphological characteristics at the orbital level – outperforms previous cloud-type classifications stemming from passive-sensor measurements. We investigate the observed relationship between the Sc and Cu cloud cover in tropical subsidence oceanic regions and their link to the primary low-cloud controlling factors (sea surface temperature, estimated inversion strength). To gain further insight into the Sc-Cu cloud partitioning, we explore the Sc-Cu relationship during the four meteorological seasons (DJF, MAM, JJA, SON) as well as on monthly timescale. We find a substantial negative correlation between the Sc and Cu cloud cover on annual, seasonal and monthly timescales. We finally evaluate how well climate models of the Coupled Model Intercomparison Project phase 5 (CMIP5) and phase 6 (CMIP6) agree with the observations. These results establish a framework to advance model parameterizations of the underlying physical processes driving the stratocumulus and shallow cumulus clouds (turbulence and convection).

Cloud feedbacks↗

Impact of environmental attributes on the uncertainty in MAIAC/MODIS AOD retrievals: A comparative analysis

This work examines the impact of different environmental attributes on the uncertainty in satellite-based Aerosol Optical Depth (AOD) retrieval against the benchmark Aerosol Robotic Network (AERONET) AOD measurements at 21 sites across North Africa, California and Germany, in the years 2007–2017. As a first step, we studied the effects of spatial averaging the Multi-Angle Implementation of Atmospheric Correction (MAIAC) AOD retrievals, and of temporal averaging the AERONET AOD around the satellite (Aqua) overpass, on the agreement between the two products. AERONET AOD averaging over a time-window of ±15 min around the satellite overpass and the 1 ×1 km2 spatial grid of MAIAC were found to provide the best AOD retrieval performance. Next, MAIAC AOD were stratified according to different co-measured environmental attributes (aerosol loading, dominant particle size, vegetation cover, and prevailing particle type) and analyzed against the AERONET AOD. The envelope of the expected retrieval error varied considerably among different environmental attributes categories, with more accurate AOD retrievals obtained over highly vegetated areas (i.e. less surface reflectance) than over arid areas. Moreover, the retrieval accuracy was found to be sensitive to the aerosol loading and particle size, with a large bias between the MAIAC and AERONET AOD during high aerosol loading of coarse particles. In addition, the retrieval accuracy of MAIAC AOD was found to depend on the aerosol type due to the aerosol model assumptions regarding their optical properties.

AOD RETRIEVAL↗

Uncertainties, Limits, and Benefits of Climate Change Mitigation for Soil Moisture Drought in Southwestern North America

Over the last two decades, southwestern North America (SWNA) has been in the grip of one of the most severe droughts of the last 1,200 years, with one third to nearly one half of its severity attributable to climate change. We analyze how the risk of extreme soil moisture droughts in SWNA, analogous to the most severe 21-year (≥ in magnitude to 2000–2020) and single-year (≥ in magnitude to 2002) events of the last several decades, changes in projections from Phase 6 of the Coupled Model Intercomparison Project. By the end of the 21st century, SWNA experiences robust (R ≥ 0.80) soil moisture drying and substantial increases in extreme single-year drought risk that scale strongly with warming, spanning an 8%–26% probability of occurrence across +2–4 K. Notably, our results show that 21-year droughts analogous to 2000–2020 are up to 5 times more likely than extreme single-year droughts under all levels of warming (≈50%). These high levels of 21-year drought risk are largely invariant across scenarios because of large spring precipitation declines in half the models, shifting SWNA into a drier mean state. Despite projections of this sweeping and ostensibly inevitable increase in 21-year drought risk, climate mitigation reduces their severity by reducing the magnitude of extreme single-year droughts during these events. Our results emphasize both the importance of preparing SWNA for imminent increases in persistent drought events and constraining projected precipitation uncertainty to better resolve future long-term drought risk.

drought↗

Understanding Uncertainty of Snow Radiative Transfer Modeling Within a Mixed Deciduous and Evergreen Forest

Satellite-based passive microwave observations provide the best available continuous observational estimates of global snow water storage due to their broad geographic footprint and low sensitivity to clouds and precipitation. However, these observations are subject to substantial uncertainty due to the complex radiative properties of snow and from interference in forested areas. Physical radiative transfer models can be leveraged to improve the fidelity of these observations and as a data-assimilation tool. In this article, the Dense Media Radiative Transfer model with Multiple Layers (DMRT-ML) is used to simulate snow brightness temperatures from data collected from snow pits excavated during a two-day-long field study performed a temperate forest in the Northeast United States. The simulations are evaluated against surface-based radiometer observations collected at the snow pits. The DMRT-ML is configured with varying complexity to determine the snowpack characteristics most essential toward simulating brightness temperature within a temperate forest with complicated snow stratigraphy. In general, the single-layer configurations were not sufficiently complex to accurately simulate snow brightness temperature without significant tuning. The most accurate simulation was a two-layer configuration with a prescribed ice layer separating the snow layers. This simulation had a root-mean-square error <;15 K for the 37-GHz frequency. More complicated snowpack stratigraphy configurations did not substantively improve the results over the two-layer model configuration. The DMRT-ML was also used to examine differences between redundant datasets of density and grain size. It was determined that similar snow data collection and radiative transfer model configuration techniques are critical to ensure cross-study comparability.

Theodore Letcher↗

Automated Probabilistic Finite Element Model Calibration Tool Based on Uncertainty Quantification and Machine Learning

Qualification and certification of safety critical parts is a hurdle to the adoption of metallic additively manufactured components for aerospace vehicle applications. Challenges include variability in part properties due to inconsistent defect distribution and microstructure. Understanding of the process through finite element modeling (FEM), and process control through in-situ monitoring, may result in significant improvements; however, solutions useful to manufacturers will require large volumes of data and automated data utilization. Toward this end, a generalizable automated FEM calibration paradigm is developed. This paradigm leverages existing and novel tools from machine learning and uncertainty quantification to enable the automatic calibration of FEMs without requiring prior knowledge of the model performance across input parameter space, including meshing and solver settings, which can require time consuming manual model probing or cause noisy and inconsistent predictions. The result is a probabilistic distribution of calibrated and validated FEM input parameters targeting measured data.

Additive manufacturing model calibration finite el↗

Differential Yields and Uncertainty Assessments for Electric Propulsion Plume Impingement Sputter Redeposition Contamination

Redeposition of sputtered erosion products from electric propulsion plume impingement is a contamination concern for spacecraft. Calculation of expected deposition quantities requires accurate characterization of the angular distribution of differential yields. An evaluation of available expressions is performed as well as a derivation of an alternate form that can better match experimental measurements through more general inclusion of anisotropic effects. The derivation is extended to the dependence of the total yield on incident angle. Considerations of the inherent uncertainty in both total and differential yields and accounting of subsequent margins for end applications are also discussed.

sputtering↗

Comparison of Entry Descent and Landing Aerodynamic Databases with Uncertainty Quantification Developed Using Machine Learning Techniques

When developing the aerodynamic databases for use in trajectory simulations, it is important to develop a system of metrics to qualify which aerodynamic models are best to use. Since aerodynamics are just one input into trajectory simulations, the results of these simulations do not reflect on the quality of the aerodynamic database used. This means that aerodynamic database comparisons must be done offline. While traditional metrics that focus on mean/nominal predictions are a good first step, more robust estimates of the prediction interval become important as more focused uncertainty models are developed. We explore the limitations of evaluating aerodynamic models based purely on nominal-centered response surfaces. Before elaborating and evaluating metrics based on distributed models, the value of evaluating prediction interval and confidence interval are discussed to conclude that prediction intervals are more relevant to the use of trajectory analysis. Several metrics to evaluate the prediction interval are introduced with a focus on the standard calibration metric. Finally, we compare candidate models using both mean and distributed metrics. A finalized candidate model developed using state of the art machine learning methods is compared to a baseline model developed using traditional aerodynamic database modeling techniques.

Aerodynamic Database↗

AeroFusion: Data Fusion and Uncertainty Quantification for Entry Vehicles

AeroFusion is a NASA Langley initiative to incorporate advances in data science into the aerodynamic modeling process to improve efficiency. The effort can largely be categorized in three components: reduced-order modeling techniques, surrogate modeling techniques, and uncertainty quantification. By combining various methods from these categories, AeroFusion aims to reduce the development cost of aerodynamic models, both in terms of time and money.

Steven Snyder↗

AeroFusion: Data Fusion and Uncertainty Quantification for Entry Vehicles

AeroFusion is a NASA Langley initiative to incorporate advances in data science into the aerodynamic modeling process to improve efficiency. The effort can largely be categorized in three components: reduced-order modeling techniques, surrogate modeling techniques, and uncertainty quantification. By combining various methods from these categories, AeroFusion aims to reduce the development cost of aerodynamic models, both in terms of time and money.

Steven Snyder↗

Strategies for Automation of Model Tuning in Multifidelity Trajectory Uncertainty Propagation

Multi-model Monte Carlo methods are efficient strategies to perform forward uncertainty quantification studies in entry, descent, and landing (EDL) applications. These multi-model methods are based on the classical Monte Carlo estimator, but fuse predictions from several low-fidelity models to obtain estimators with greater precision given a prescribed computational budget. The effectiveness of these approaches relies on the magnitudes of correlations between the low-fidelity models and the high-fidelity model, as well as the relative computational costs of all models. Identifying and exploiting the best trade-off between correlation and cost, which ultimately depends on the selection of hyperparameters in the low-fidelity models, is a task often performed by hand or simply inspired by the deterministic understanding available for a specific application. This work extends a preliminary effort,

Marten Thompson↗

Quantification of Numerical Uncertainty via Nonlinear Dynamical Approach

Motivations (Ensure a Higher Level of Confidence in the Predictability & Reliability of Numerical Simulation for Multiscale Complex Nonlinear Fluid Problems) - The last two decades have been an era when computation is ahead of analysis & when very large scale practical computations are increasingly used in poorly understood multiscale complex nonlinear physical problems & non-traditional fields (Especially when computations offer the ONLY way of generating this type of data limited simulations). - At present some of the numerical uncertainties can be explained and minimized by traditional numerical analysis and standard CFD practices. However, such practices, usually based on linearized analysis, MIGHT NOT be sufficient for strongly nonlinear and/or stiff problems. - We need a good understanding of the nonlinear behavior of numerical schemes being used as an integral part of code verification, validation and certification.

HEC↗

Accounting for Dose Uncertainty in Dose-Response Curve Estimation Using Hierarchical Bayes Models

As part of their development of the technology for low-boom supersonic flight, the National Aeronautics and Space Administration (NASA) is planning to conduct a set of supersonic aircraft annoyance surveys in select communities in the United States, to measure public perception of the reduced sonic boom. The relationship between a noise exposure level of a supersonic flight event and the probability of an individual being highly annoyed by the event is quantified by a dose-response curve, which is usually based on logistic regression modeling. Unavoidable amounts of estimation error are expected in the upcoming noise measurements, which can bias the results of the logistic regression if ignored. Hence, the development of an estimation approach that accounts for such error when estimating the dose-response curve is imperative. In this paper, an evaluation study is conducted to assess the impact of measurement error on dose-response curve estimation. For this, hierarchical Bayes models using different specifications are fit to data collected by NASA in 2018, as part of a risk-reduction study of supersonic flights affecting Galveston, Texas. It is observed that the estimated dose-response curve appears sensitive to uncertainty in dose measurements, being subject to attenuation bias.

community response↗

Uncertainty in Land-Use Adaptation Persists Despite Crop Model Projections Showing Lower Impacts Under High Warming

Climate change is expected to impact crop yields and alter resource availability. However, the understanding of the potential of agricultural land-use adaptation and its costs under climate warming is limited. Here, we use a global land system model to assess land-use-based adaptation and its cost under a set of crop model projections, including CO2 fertilization, based on climate model outputs. In our simulations of a low-emissions scenario, the land system responds through slight changes in cropland area in 2100, with costs close to zero. For a high emissions scenario and impacts uncertainty, the response tends toward cropland area changes and investments in technology, with average adaptation costs between −1.5 and +19 US$05 per ton of dry matter per year. Land-use adaptation can reduce adverse climate effects and use favorable changes, like local gains in crop yields. However, variance among high-emissions impact projections creates challenges for effective adaptation planning.

Agriculture↗

Uncertainty in Aerosol–Cloud Radiative Forcing Is Driven By Clean Conditions

Atmospheric aerosols and their impact on cloud properties remain the largest uncertainty in the human forcing of the climate system. By increasing the concentration of cloud droplets (Nd), aerosols reduce droplet size and increase the reflectivity of clouds (a negative radiative forcing). Central to this climate impact is the susceptibility of cloud droplet number to aerosol (β), the diversity of which explains much of the variation in the radiative forcing from aerosol–cloud interactions (RFaci) in global climate models. This has made measuring β a key target for developing observational constraints of the aerosol forcing.

Edward Gryspeerdt↗

Characterization of Errors in Satellite-Based HCHO/NO 2 Tropospheric Column Ratios With Respect to Chemistry, Column-to-PBL Translation, Spatial Representation, and Retrieval Uncertainties

The availability of formaldehyde (HCHO) (a proxy for volatile organic compound reactivity) and nitrogen dioxide (NO 2 ) (a proxy for nitrogen oxides) tropospheric columns from ultraviolet–visible (UV–Vis) satellites has motivated many to use their ratios to gain some insights into the near-surface ozone sensitivity. Strong emphasis has been placed on the challenges that come with transforming what is being observed in the tropospheric column to what is actually in the planetary boundary layer (PBL) and near the surface; however, little attention has been paid to other sources of error such as chemistry, spatial representation, and retrieval uncertainties. Here we leverage a wide spectrum of tools and data to quantify those errors carefully. Concerning the chemistry error, a well-characterized box model constrained by more than 500 h of aircraft data from NASA's air quality campaigns is used to simulate the ratio of the chemical loss of HO 2 + RO 2 (LRO x ) to the chemical loss of NO x (LNO x ). Subsequently, we challenge the predictive power of HCHO/NO 2 ratios (FNRs), which are commonly applied in current research, in detecting the underlying ozone regimes by comparing them to LRO x /LNO x . FNRs show a strongly linear (R 2 =0.94) relationship with LRO x /LNO x , but only on the logarithmic scale. Following the baseline (i.e., ln(LRO x /LNO x ) = −1.0 ± 0.2) with the model and mechanism (CB06, r2) used for segregating NO x -sensitive from VOC-sensitive regimes, we observe a broad range of FNR thresholds ranging from 1 to 4. The transitioning ratios strictly follow a Gaussian distribution with a mean and standard deviation of 1.8 and 0.4, respectively. This implies that the FNR has an inherent 20 % standard error (1σ) resulting from not accurately describing the RO x –HO x cycle. We calculate high ozone production rates (PO 3 ) dominated by large HCHO × NO 2 concentration levels, a new proxy for the abundance of ozone precursors. The relationship between PO 3 and HCHO × NO 2 becomes more pronounced when moving towards NO x -sensitive regions due to nonlinear chemistry; our results indicate that there is fruitful information in the HCHO × NO 2 metric that has not been utilized in ozone studies. The vast amount of vertical information on HCHO and NO 2 concentrations from the air quality campaigns enables us to parameterize the vertical shapes of FNRs using a second-order rational function permitting an analytical solution for an altitude adjustment factor to partition the tropospheric columns into the PBL region. We propose a mathematical solution to the spatial representation error based on modeling isotropic semivariograms. Based on summertime-averaged data, the Ozone Monitoring Instrument (OMI) loses 12 % of its spatial information at its native resolution with respect to a high-resolution sensor like the TROPOspheric Monitoring Instrument (TROPOMI) (> 5.5 × 3.5 km 2 ). A pixel with a grid size of 216 km 2 fails at capturing ∼ 65 % of the spatial information in FNRs at a 50 km length scale comparable to the size of a large urban center (e.g., Los Angeles). We ultimately leverage a large suite of in situ and ground-based remote sensing measurements to draw the error distributions of daily TROPOMI and OMI tropospheric NO 2 and HCHO columns. At a 68 % confidence interval (1σ), errors pertaining to daily TROPOMI observations, either HCHO or tropospheric NO 2 columns, should be above 1.2–1.5 × 10 16 molec. cm −2 to attain a 20 %–30 % standard error in the ratio. This level of error is almost non-achievable with the OMI given its large error in HCHO. The satellite column retrieval error is the largest contributor to the total error (40 %–90 %) in the FNRs. Due to a stronger signal in cities, the total relative error (< 50 %) tends to be mild, whereas areas with low vegetation and anthropogenic sources (e.g., the Rocky Mountains) are markedly uncertain (> 100 %). Our study suggests that continuing development in the retrieval algorithm and sensor design and calibration is essential to be able to advance the application of FNRs beyond a qualitative metric.

Amir H. Souri↗