Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Quantifying structural errors in cloud condensation nuclei activity from reduced representation of aerosol size distributions

Aerosol effects on clouds and radiation are the dominant contribution to uncertainty in radiative forcing relative to the pre-industrial atmosphere. While previous studies have assessed the impact of parametric uncertainty on modeled forcing, structural errors from the numerical representation of particle distributions have not been well quantified. Here we present a framework for quantifying error in aerosol size distributions and cloud condensation nuclei activity, which we apply to the widely used 4-mode version of the Modal Aerosol Module (MAM4). Box model predictions from the MAM4 are evaluated against the Particle Monte Carlo Model for Simulating Aerosol Interactions and Chemistry (PartMC-MOSAIC), a benchmark model that tracks the evolution of individual particles. We show that size distributions simulated by MAM4 diverge from those simulated by PartMC-MOSAIC after only a few hours of aging by condensation and coagulation in polluted conditions, which leads to large errors in modeled cloud condensation nuclei concentrations. We find that differences between MAM4 and PartMC-MOSAIC are largest under polluted conditions, where the size distribution evolves rapidly though aging by condensation of semi-volatile substances and coagulation among particles. These findings suggest that structural error in modeled aerosol properties contributes to the large inter-model variability in aerosol radiative forcing.

Fierce, Laura M.↗

Using Median Point in Keeling Plot to Reduce the Uncertainty of the Isotopic Composition of Evapotranspiration

Abstract The isotopic composition of evapotranspirationδ ET is a crucial parameter in isotope-based evapotranspiration (ET) partitioning and moisture recycling studies. The Keeling plot method is the most prevalent method to calculateδ ET , though it contains large extrapolated uncertainties from the least squares regression. Traditional Keeling regression uses the mean point of individual measurements. Here, a modified Keeling plot framework was proposed using the median point of individual measurements. We tested theδ ET uncertainty using the mean point [σ ET (mean)] and median point [σ ET (median)]. Multiple resolutions of input and output data from six independent sites were used to test the performance of the two methods. Theσ ET (mean) would be greater thanσ ET (median) when the mean value of inverse vapor concentration () is greater than the median value of inverse vapor concentration []. When applying the filter ofr 2 > 0.8, around 70% ofσ ET (mean) was greater thanσ ET (median). This phenomenon might be due to the normality of the vapor concentrationC υ producing the asymmetric distribution of 1/C υ . The median method could perform significantly better than the mean method when inputting high-resolution measurements (e.g., 1 Hz) and when the water vapor concentrationC υ is relatively low. Compared to the mean method, applying the median method could on average reduce 6.88% of ET partitioning uncertainties and could on average reduce 9.00% of moisture recycling uncertainties. This study provided a new insight of the Keeling plot method and emphasized handling model output uncertainty from multiple perspectives instead of only from input parameters.

Meteorology & Atmospheric Sciences↗

Validation Analysis of Medium-Scale Methanol Pool Fire Simulated in SIERRA/Fuego [Slides]

Analysis of methanol pool fire conducted as part of validation study for SIERRA/Fuego. Results showed trends & errors consistent with related studies. Area validation metric provides way to quantify model form uncertainty. AVM shows that more work could be done to understand how model form uncertainty varies with mesh resolution. There is a possible atypical use of MAVM on time-series data. AVM shows mismatch between predicted flame height and experimental value less sensitive to variations in mixture fraction than temperature. Mismatch about experimental value also more symmetric for mixture fraction. Our analysis showed that mixture fraction is preferable for this application.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Insights into the vulnerability of Antarctic glaciers from the ISMIP6 ice sheet model ensemble and associated uncertainty

Abstract. The Antarctic Ice Sheet represents the largest source of uncertainty in future sea level rise projections, with a contribution to sea level by 2100 ranging from −5 to 43 cm of sea level equivalent under high carbon emission scenarios estimated by the recent Ice Sheet Model Intercomparison for CMIP6 (ISMIP6). ISMIP6 highlighted the different behaviors of the East and West Antarctic ice sheets, as well as the possible role of increased surface mass balance in offsetting the dynamic ice loss in response to changing oceanic conditions in ice shelf cavities. However, the detailed contribution of individual glaciers, as well as the partitioning of uncertainty associated with this ensemble, have not yet been investigated. Here, we analyze the ISMIP6 results for high carbon emission scenarios, focusing on key glaciers around the Antarctic Ice Sheet, and we quantify their projected dynamic mass loss, defined here as mass loss through increased ice discharge into the ocean in response to changing oceanic conditions. We highlight glaciers contributing the most to sea level rise, as well as their vulnerability to changes in oceanic conditions. We then investigate the different sources of uncertainty and their relative role in projections, for the entire continent and for key individual glaciers. We show that, in addition to Thwaites and Pine Island glaciers in West Antarctica, Totten and Moscow University glaciers in East Antarctica present comparable future dynamic mass loss and high sensitivity to ice shelf basal melt. The overall uncertainty in additional dynamic mass loss in response to changing oceanic conditions, compared to a scenario with constant oceanic conditions, is dominated by the choice of ice sheet model, accounting for 52 % of the total uncertainty of the Antarctic dynamic mass loss in 2100. Its relative role for the most dynamic glaciers varies between 14 % for MacAyeal and Whillans ice streams and 56 % for Pine Island Glacier at the end of the century. The uncertainty associated with the choice of climate model increases over time and reaches 13 % of the uncertainty by 2100 for the Antarctic Ice Sheet but varies between 4 % for Thwaites Glacier and 53 % for Whillans Ice Stream. The uncertainty associated with the ice–climate interaction, which captures different treatments of oceanic forcings such as the choice of melt parameterization, its calibration, and simulated ice shelf geometries, accounts for 22 % of the uncertainty at the ice sheet scale but reaches 36 % and 39 % for Institute Ice Stream and Thwaites Glacier, respectively, by 2100. Overall, this study helps inform future research by highlighting the sectors of the ice sheet most vulnerable to oceanic warming over the 21st century and by quantifying the main sources of uncertainty.

54 ENVIRONMENTAL SCIENCES↗

Insights on the Vulnerability of Antarctic Glaciers From the ISMIP6 Ice Sheet Model Ensemble and Associated Uncertainty

The Antarctic Ice Sheet represents the largest source of uncertainty in future sea level rise projections, with a contribution to sea level by 2100 ranging from −5 to 43 cm of sea level equivalent under high carbon emission scenarios estimated by the recent Ice Sheet Model Intercomparison for CMIP6 (ISMIP6). ISMIP6 highlighted the different behaviors of the East and West Antarctic ice sheets, as well as the possible role of increased surface mass balance in offsetting the dynamic ice loss in response to changing oceanic conditions in ice shelf cavities. However, the detailed contribution of individual glaciers, as well as the partitioning of uncertainty associated with this ensemble, have not yet been investigated. Here, we analyze the ISMIP6 results for high carbon emission scenarios, focusing on key glaciers around the Antarctic Ice Sheet, and we quantify their projected dynamic mass loss, defined here as mass loss through increased ice discharge into the ocean in response to changing oceanic conditions. We highlight glaciers contributing the most to sea level rise, as well as their vulnerability to changes in oceanic conditions. We then investigate the different sources of uncertainty and their relative role in projections, for the entire continent and for key individual glaciers. We show that, in addition to Thwaites and Pine Island glaciers in West Antarctica, Totten and Moscow University glaciers in East Antarctica present comparable future dynamic mass loss and high sensitivity to ice shelf basal melt. The overall uncertainty in additional dynamic mass loss in response to changing oceanic conditions, compared to a scenario with constant oceanic conditions, is dominated by the choice of ice sheet model, accounting for 52 % of the total uncertainty of the Antarctic dynamic mass loss in 2100. Its relative role for the most dynamic glaciers varies between 14 % for MacAyeal and Whillans ice streams and 56 % for Pine Island Glacier at the end of the century. The uncertainty associated with the choice of climate model increases over time and reaches 13 % of the uncertainty by 2100 for the Antarctic Ice Sheet but varies between 4 % for Thwaites Glacier and 53 % for Whillans Ice Stream. The uncertainty associated with the ice–climate interaction, which captures different treatments of oceanic forcings such as the choice of melt parameterization, its calibration, and simulated ice shelf geometries, accounts for 22 % of the uncertainty at the ice sheet scale but reaches 36 % and 39 % for Institute Ice Stream and Thwaites Glacier, respectively, by 2100. Overall, this study helps inform future research by highlighting the sectors of the ice sheet most vulnerable to oceanic warming over the 21st century and by quantifying the main sources of uncertainty.

Hélène Seroussi↗

Reliability Analysis in the Presence of Aleatory Uncertainty

This paper proposes a method for modeling a system’s response using data. In contrast to approaches that identify a limit state function, we focus on the case in which not all uncertain parameters affecting the response are observable and the measured response is corrupted by noise. To this end, the system response is not characterized by a limit state function but instead by a Random Predictor Model (RPM) having a nonparametric structure. Consequently, the resulting failure probability is not a scalar but a random variable. This variable accounts for the aleatory contributions of the model-form uncertainty and the measurement noise into the response. Furthermore, we propose a framework that enables trading off the predicted range of failure probabilities resulting from such an analysis with a measure of risk. In this context, risk is the percentage of all predicted outcomes the analyst is willing to ignore. The reliability analysis of an aeroelastic structure subject to flutter is used to illustrate the ideas proposed.

Crespo, L. G.↗

Gravitational waves from global cosmic strings and cosmic archaeology

Global cosmic strings are predicted in many motivated extensions to the Standard Model of particle physics, with close connections to axion dark matter physics. Recent studies suggest that, although subdominant relative to Goldstone emission, gravitational wave (GW) signals from global strings can be detectable with current and planned GW detectors such as LIGO, LISA, DECIGO/BBO, ET/CE and AEDGE/AION, as well as pulsar timing arrays such as PPTA, NANOGrav and SKA. This work is an extensive, updated study on GWs from a global cosmic string network, taking into account of the most recent developments related to the subject. The main analysis is based on the analytical Velocity-dependent One-Scale (VOS) model calibrated with recent simulation results, which provides a generic protocol for such calculations with details given. We also demonstrate how the GW signal can be influenced with variations to the baseline model: this includes considering the uncertainties of model parameters and the potential deviation from the conventional VOS model prediction (i.e. the scaling behavior) as suggested by some of the recent simulation results. Furthermore, we investigated in detail the effect of a non-standard cosmology (e.g. early matter domination or kination) or new particle species on the GW signals from global strings. We demonstrate that the frequency spectrum of GW background from global cosmic strings can be used to probe the cosmic history prior to the Big Bang nucleosynthesis (BBN) (i.e. the primordial dark age) up to a temperature of T ~ 10 8 GeV.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Towards robust surrogate models: Benchmarking machine learning approaches to expediting phase field simulations of brittle fracture

Data-driven approaches have the potential to make modeling complex, nonlinear physical phenomena significantly more computationally tractable. For example, computational modeling of fracture is a core challenge where machine learning techniques have the potential to provide a much needed speedup that would enable progress in areas such as multi-scale modeling and uncertainty quantification. Currently, phase field modeling (PFM) of fracture is one such approach that offers a convenient variational formulation to model crack nucleation, branching and propagation. To date, machine learning techniques have shown promise in approximating PFM simulations. While standard fracture benchmarks represent realistic scenarios frequently observed in practice, they typically do not provide sufficiently challenging tests for data-driven methods. Here, to address this gap, we introduce a challenging dataset based on PFM simulations designed to benchmark and advance ML methods for fracture modeling. This dataset includes three energy decomposition methods, two boundary conditions, and 1000 random initial crack configurations for a total of 6000 simulations. Each sample contains 100 time steps capturing the temporal evolution of the crack field. Alongside this dataset, we also implement and evaluate Physics Informed Neural Networks (PINN), Fourier Neural Operators (FNO), and UNet models as baselines, and explore the impact of ensembling strategies on prediction accuracy. With this combination of our dataset and baseline models drawn from the literature we aim to provide a standardized and challenging benchmark for evaluating machine learning approaches to solid mechanics. Our results highlight both the promise and limitations of popular current models, and demonstrate the utility of this dataset as a testbed for advancing machine learning in fracture mechanics research.

Benchmark dataset↗

Significant impact of forcing uncertainty in a large ensemble of climate model simulations

Forcing due to solar and volcanic variability, on the natural side, and greenhouse gas and aerosol emissions, on the anthropogenic side, are the main inputs to climate models. Reliable climate model simulations of past and future climate change depend crucially upon them. Here we analyze large ensembles of simulations using a comprehensive Earth System Model to quantify uncertainties in global climate change attributable to differences in prescribed forcings. The different forcings considered here are those used in the two most recent phases of the Coupled Model Intercomparison Project (CMIP), namely CMIP5 and CMIP6. We show significant differences in simulated global surface air temperature due to volcanic aerosol forcing in the second half of the 19th century and in the early 21st century. The latter arise from small-to-moderate eruptions incorporated in CMIP6 simulations but not in CMIP5 simulations. We also find significant differences in global surface air temperature and Arctic sea ice area due to anthropogenic aerosol forcing in the second half of the 20th century and early 21st century. These differences are as large as those obtained in different versions of an Earth System Model employing identical forcings. In simulations from 2015 to 2100, we find significant differences in the rates of projected global warming arising from CMIP5 and CMIP6 concentration pathways that differ slightly but are equivalent in terms of their nominal radiative forcing levels in 2100. Our results highlight the influence of assumptions about natural and anthropogenic aerosol loadings on carbon budgets, the likelihood of meeting Paris targets, and the equivalence of future forcing scenarios.

54 ENVIRONMENTAL SCIENCES↗

Calibrating a finite-strain phase-field model of fracture for bonded granular materials with uncertainty quantification

To study the mechanical behavior of mock high explosives, an experimental and simulation program was developed to calibrate, with quantified uncertainty, a material model of the bonded granular material Idoxuridine and nitroplasticized Estane-5703. This paper reports on the efficacy of such a framework as a generalizable methodology for calibrating material models against experimental data with uncertainty quantification. Additionally, this paper studies the effect of two manufacturing temperatures and three initial granular configurations on the unconfined compressive behavior of the resulting bonded granular materials. In each of these cases, the same calibration framework was used; in that, hundreds of high-fidelity direct numerical simulations using a new, graphics processing unit-enabled, high-performance finite element method software, Ratel, were run to calibrate a finite-strain phase-field fracture model against experimental data. It was found that manufacturing temperature influenced the elastic response of the mock high explosives, with higher temperatures yielding a stiffer response. By contrast, it was found that the initial configuration of the grains had a negligible impact on the overall behavior of the mock high explosives though it remains possible that local damage accumulation within the specimens could be altered by the initial configurations. Overall, the calibration framework was successful at creating well-calibrated models, showing its usefulness as an engineering and scientific tool.

36 MATERIALS SCIENCE↗

Uncertainty analysis of Resource Demand Model for Covid-19

As part of the Department of Energy response to the novel coronavirus pandemic of 2020, a modeling effort was sponsored by the DOE Office of Science. One task of this modeling effort at Sandia was to develop a model to predict medical resource needs given various patient arrival scenarios. Resources needed include personnel resources (nurses, ICU nurses, physicians, respiratory therapists), fixed resources (regular or ICU beds and ventilators), and consumable resources (masks, gowns, gloves, face shields, sedatives). This report documents the uncertainty analysis that was performed on the resource model. The uncertainty analysis involved sampling 26 input parameters to the model. The sampling was performed conditional on the patient arrival streams that also were inputs to the model. These patient arrival streams were derived from various epidemiology models and had a significant effect on the projected resource needs. In this report, we document the sampling approach, the parameter ranges used, and the computational workflow necessary to perform large-scale uncertainty studies for every county and state in the United States.

59 BASIC BIOLOGICAL SCIENCES↗

Characteristics of locational uncertainty marginal price for correlated uncertainties of variable renewable generation and demands

With the rapid increase of variable renewable energy sources in power systems, how to manage and price the uncertainty of renewable resources’ power outputs is becoming an urgent issue. Current market designs considering the uncertainties are mainly based on the probabilistic scenario set of demand and renewable energy resources power outputs. This consideration makes market designs vulnerable to three significant challenges when put into practice. First, the accurate probability distribution of renewable generation is hard to obtain in real-time. Second, it is challenging to clear the market timely with many scenarios to guarantee accuracy. Third, generation cost recovery cannot be guaranteed for some scenarios. To overcome these challenges, this paper proposes a locational uncertainty marginal price model to price the uncertainty explicitly based on a scenario-free stochastic market-clearing model. Instead of using the probabilistic scenario set, the uncertainty of renewable energy sources and loads is modeled with distributionally-robust chance constraints. The correlation of uncertainties can be endogenously modeled in both the market-clearing and the locational uncertainty marginal price formation. Furthermore, this paper proves that generation cost recovery, revenue adequacy, and partial market equilibrium can be achieved using the locational uncertainty marginal price model. Numerical results from both the small and large systems simulations validate that the generation cost recovery is maintained no matter the generation participates in uncertainty mitigation or not. The transmission congestion surplus is also allocated appropriately among loads, renewable energy sources, and financial transmission right owners.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Probabilistic predictions and uncertainty estimation for radiological and nuclear effects modeling

Better characterization of meteorological uncertainty is needed to predict the effects of radiological and nuclear releases in the atmosphere. Multi-physics ensembles of atmospheric simulations can estimate uncertainty of physical processes, but they are often limited for computational reasons. Because weather uncertainty is important for emergency response applications, but the conventional way of running multi-physics ensembles is infeasible, we have developed new machine learning-based methods that quickly estimate and identify key sources of meteorological uncertainty. Machine learning accelerates the analysis of weather uncertainty by iteratively learning about model physics options that affect plume predictions. We have demonstrated the power of machine learning by creating a large multi-physics weather and dispersion ensemble dataset containing 1,200 simulations for two hypothetical radiological release scenarios. By training on less than 10% of the ensemble, we can quickly and accurately predict different outcomes, including the mass of radiological material deposited and spatial distribution and extent of contaminated areas.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty Quantification of a Rotorcraft Conceptual Sizing Toolsuite

A computational framework to support the quantification of system uncertainties and sensitivities for rotorcraft applications is presented using the NASA Design and Analysis of Rotorcraft (NDARC) conceptual sizing tool. A 90 passenger conceptual tiltrotor configuration was used for case demonstration in the modeling of uncertainties in NDARCs emission module. A non-intrusive forward propagation uncertainty quantification approach was applied to ensemble simulations using a Monte Carlo methodology with stratified Latin hypercube sampling. An off-the-shelf software, DAKOTA, which supports trade studies and design space exploration, including optimization, surrogate modeling and uncertainty analysis was used to address the research goals. A toolsuite was further developed incorporating DAKOTA with automated design processes and methods using function wrappers to execute program routines including support for data post-processing. Uncertainties in rotorcraft emissions modeling using the Average Temperature Response metric for a set mission profile were studied. It was shown that for the current study, using the base-line best estimate modeling parameters for the Average Temperature Response metric, NDARC under-estimates the effects of emissions when compared with results from Monte Carlo simulations. A global sensitivity analysis was further undertaken to quantify the contribution of the various emission species on output sensitivity, hence uncertainty. The work demonstrates that the developed toolsuite is robust and will support the quantification of system uncertainties and sensitivities in future rotorcraft design efforts.

Rotorcraft↗

Low-Earth Orbit Trajectory Optimization in the Presence of Atmospheric Uncertainty

The previous 20 to 25 years have seen a tremendous increase in space exploration, and with that an increase in the level of logistics planning needed to ensure mission success. For spacecraft that are designed to be periodically re-supplied, a key logistics consumable is propellant, as it constitutes the greatest up-mass on re-supply vehicles. A trajectory design strategy is therefore desired that minimizes propellant usage in order to ease the demand for propellant re-supply missions. This thesis develops such a strategy in three stages, and uses the International Space Station (ISS) as its testbed, as no other LEO spacecraft is more challenging from a space logistics standpoint. First, the ISS trajectory planning problem is formulated as a constrained burn optimization problem assuming a deterministic atmosphere. The cost function is total ∆v, with constraints imposed on longitude of ascending viii node (LAN) and semi-major axis (SMA) altitude. Analytic derivatives are constructed for both the cost and constraints, which are necessary given the 6-week to 2-year time frames being considered. A gradient-based optimizer is then utilized to find locally-optimal solutions to real-world ISS trajectory planning problems. Second, atmospheric uncertainty is addressed by constructing a probabilistic model of space weather data using Gaussian Processes (GPs). Bayesian inference is performed using the GP model to generate mean and covariance estimates for space weather predictions, whose pedigree is assessed against test data. The predictions are then mapped into atmospheric density via the analytic Jacchia-Roberts density model, and the effect of space weather uncertainty on orbital lifetime is examined. Third, an ISS burn execution uncertainty model is developed. This model, along with the space weather uncertainty model, are deployed in a linear covariance analysis to ascertain their combined effect on LAN and SMA altitude dispersions. The deterministic constraints from the original problem are re-formulated as stochastic constraints, where now the constraint uncertainty interval is required to fall within specified bounds. An updated optimization framework is constructed using the original ∆v cost function along with the stochastic constraints to solve the trajectory optimization problem under atmospheric uncertainty. Finally, the complete architecture is summarized for deployment in an operational setting.

Trajectory Optimization↗

Hydrogen Line Shape Uncertainties in White Dwarf Model Atmospheres

For isolated white dwarf (WD) stars, fits to their observed spectra provide the most precise estimates of their effective temperatures and surface gravities. Even so, recent studies have shown that systematic offsets exist between such spectroscopic parameter determinations and those based on broadband photometry. These large discrepancies (10% in T eff , 0.1 M ⊙ in mass) provide scientific motivation for reconsidering the atomic physics employed in the model atmospheres of these stars. Recent simulation work of ours suggests that the most important remaining uncertainties in simulation-based calculations of line shapes are the treatment of 1) the electric field distribution and 2) the occupation probability (OP) prescription. We review the work that has been done in these areas and outline possible avenues for progress.

79 ASTRONOMY AND ASTROPHYSICS↗

Uncertainty estimates in geomagnetic field modeling

This paper presents an extension of the conventional uncertainty analysis which characterizes the sources of uncertainty in the coefficients of the geomagnetic field models. The new formalism accounts for the systematic errors introduced by the omission of such sources as the presence of crustal fields, the external fields, and the field from the truncated terms. The usefulness of this formalism depends on two critical conditions. The first of these is the knowledge of the statistical properties of the fields whose parameters are not solved in the analysis, i.e., the crustal field and the external field. The second critical point in the practical use of the method is the approximation used for the weight matrix.

Langel, R. A.↗