SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Characterizing and quantifying uncertainty in projections of climate change impacts on air quality

Climate change can aggravate air pollution, with important public health and environmental consequences. While major sources of uncertainty in climate change projections - greenhouse gas (GHG) emissions scenario, model response, and internal variability - have been investigated extensively, their propagation to estimates of air quality impacts has not been systematically assessed. Here, we compare these uncertainties using a coupled modeling framework that includes a human activity model, an Earth system model of intermediate complexity, and a global atmospheric chemistry model. Uncertainties in projections of U.S. air quality under 21st century climate change are quantified based on a climate-chemistry ensemble that includes multiple initializations, representations of climate sensitivity, and climate policy scenarios, under constant air pollution emissions. We find that climate-related uncertainties are comparable at mid-century, making it difficult to distinguish the impact of variations in GHG emissions on ozone and particulate matter pollution. While GHG emissions scenario eventually becomes the dominant uncertainty based on the scenarios considered, all sources of uncertainty are significant through the end of the century. The results provide insights into intrinsically different uncertainties in projections of air pollution impacts and the potential for large ensembles to better capture them.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Propagating Parameter Uncertainty in Power System Nonlinear Dynamic Simulations Using a Koopman Operator-Based Surrogate Model

In this work, we propose a Koopman operator-based surrogate model for propagating parameter uncertainties in power system nonlinear dynamic simulations. First, we augment a priori known state-space model by reformulating parameters deemed uncertain as pseudo-state variables. Then, we apply the Koopman operator theory to the resulting state-space model and obtain a linear dynamical system model. This transformation allows us to analyze the evolution of the system dynamics through its Koopman eigenfunctions, eigenvalues, and modes. Of particular importance for this letter, the obtained linear dynamical system is a surrogate that enables the evaluation of parameter uncertainties by simply perturbing the initial conditions of the Koopman eigenfunctions associated with the pseudo-state variables. Simulations carried out on the New England test system reveal the excellent performance of the proposed method in terms of accuracy and computational efficiency.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2013

Modeling Errors in Daily Precipitation Measurements: Additive or Multiplicative?

The definition and quantification of uncertainty depend on the error model used. For uncertainties in precipitation measurements, two types of error models have been widely adopted: the additive error model and the multiplicative error model. This leads to incompatible specifications of uncertainties and impedes intercomparison and application.In this letter, we assess the suitability of both models for satellite-based daily precipitation measurements in an effort to clarify the uncertainty representation. Three criteria were employed to evaluate the applicability of either model: (1) better separation of the systematic and random errors; (2) applicability to the large range of variability in daily precipitation; and (3) better predictive skills. It is found that the multiplicative error model is a much better choice under all three criteria. It extracted the systematic errors more cleanly, was more consistent with the large variability of precipitation measurements, and produced superior predictions of the error characteristics. The additive error model had several weaknesses, such as non constant variance resulting from systematic errors leaking into random errors, and the lack of prediction capability. Therefore, the multiplicative error model is a better choice.

Modeling↗

DOE OSTI2022

Yield Estimation of the August 2020 Beirut Explosion by Using Physics‐Based Propagation Simulations of Regional Infrasound

Abstract The August 2020 Beirut explosion is the largest single‐fired ammonium nitrate explosion documented in history. The massive explosion excited loud infrasound in the atmosphere, and clear waveforms were recorded by a regional infrasound array at an epicentral distance of 100 km, allowing for accurate measurements of explosion energy. We estimate the explosion size based on the infrasound waveform inversion. Unlike conventional inversions using empirical models, we perform full 3‐D finite‐difference simulations to obtain a physics‐based propagation model for the inversion. Accurate numerical modeling of infrasound is challenging as the propagation is substantially affected by the turbulent atmosphere. Instead of a single deterministic prediction, we provide a range of waveform predictions by running multiple simulations with stochastic weather forecast models, which allows for comprehensive uncertainty analysis of numerical modeling and estimated yields. Finally, we expand the yield estimation technique for seismoacoustic analysis and demonstrate the substantial advantage of the joint approach.

58 GEOSCIENCES↗

DOE OSTI2022

Multi-fidelity information fusion with concatenated neural networks

Recently, computational modeling has shifted towards the use of statistical inference, deep learning, and other data-driven modeling frameworks. Although this shift in modeling holds promise in many applications like design optimization and real-time control by lowering the computational burden, training deep learning models needs a huge amount of data. This big data is not always available for scientific problems and leads to poorly generalizable data-driven models. This gap can be furnished by leveraging information from physics-based models. Exploiting prior knowledge about the problem at hand, this study puts forth a physics-guided machine learning (PGML) approach to build more tailored, effective, and efficient surrogate models. For our analysis, without losing its generalizability and modularity, we focus on the development of predictive models for laminar and turbulent boundary layer flows. In particular, we combine the self-similarity solution and power-law velocity profile (low-fidelity models) with the noisy data obtained either from experiments or computational fluid dynamics simulations (high-fidelity models) through a concatenated neural network. We illustrate how the knowledge from these simplified models results in reducing uncertainties associated with deep learning models applied to boundary layer flow prediction problems. The proposed multi-fidelity information fusion framework produces physically consistent models that attempt to achieve better generalization than data-driven models obtained purely based on data. While we demonstrate our framework for a problem relevant to fluid mechanics, its workflow and principles can be adopted for many scientific problems where empirical, analytical, or simplified models are prevalent. In line with grand demands in novel PGML principles, this work builds a bridge between extensive physics-based theories and data-driven modeling paradigms and paves the way for using hybrid physics and machine learning modeling approaches for next-generation digital twin technologies.

42 ENGINEERING↗

DOE OSTI2021

Keras CT Segmentation v.1

SAND2020-14119 O A Tensorflow and Keras-backed framework for learned segmentation methods of 3D CT scan volumes. Supported functionality includes training models, running inference and quantifying uncertainty. The main underlying model architecture is V-Net. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Ganter, Tyler↗

DOE OSTI2024

Experimental Validation of Thermal Hydraulic Behavior in Sodium Fast Reactors (SFR) with the Thermal Hydraulic Experimental Test Article (THETA)

Thermal stratification and transition to natural circulation pose two of the largest sources of uncertainty in systems-level modeling of liquid metal-cooled fast reactors. As these phenomena typically develop during transient event sequences, licensing-basis events analyzed using systemslevel models may have considerable uncertainties associated with thermal-hydraulic parameters of the system to account for these phenomena. As a result, the validation basis for these phenomena for systems-level codes is insufficient to fully support the wide range of liquid metal fast reactors being developed in the US. Currently, the most viable path for licensing a design is to take significant conservatisms and maintain sufficiently large safety margins to account for this uncertainty.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS2007

Stress Rupture Life Reliability Measures for Composite Overwrapped Pressure Vessels

Composite Overwrapped Pressure Vessels (COPVs) are often used for storing pressurant gases onboard spacecraft. Kevlar (DuPont), glass, carbon and other more recent fibers have all been used as overwraps. Due to the fact that overwraps are subjected to sustained loads for an extended period during a mission, stress rupture failure is a major concern. It is therefore important to ascertain the reliability of these vessels by analysis, since the testing of each flight design cannot be completed on a practical time scale. The present paper examines specifically a Weibull statistics based stress rupture model and considers the various uncertainties associated with the model parameters. The paper also examines several reliability estimate measures that would be of use for the purpose of recertification and for qualifying flight worthiness of these vessels. Specifically, deterministic values for a point estimate, mean estimate and 90/95 percent confidence estimates of the reliability are all examined for a typical flight quality vessel under constant stress. The mean and the 90/95 percent confidence estimates are computed using Monte-Carlo simulation techniques by assuming distribution statistics of model parameters based also on simulation and on the available data, especially the sample sizes represented in the data. The data for the stress rupture model are obtained from the Lawrence Livermore National Laboratories (LLNL) stress rupture testing program, carried out for the past 35 years. Deterministic as well as probabilistic sensitivities are examined.

Murthy, Pappu L. N.↗

NASA NTRS2020

Twenty‐First Century Drought Projections in the CMIP6 Forcing Scenarios

There is strong evidence climate change will increase drought risk and severity, but these conclusions depend on the regions, seasons, and drought metrics being considered. We analyze changes in drought across the hydrologic cycle (precipitation, soil moisture, and runoff) in projections from Phase Six of the Coupled Model Intercomparison Project (CMIP6). The multi‐model ensemble shows robust drying in the mean state across many regions and metrics by the end of the 21st century, even following the more aggressive mitigation pathways (SSP1‐2.6 and SSP2‐4.5). Regional hotspots with strong drying include western North America, Central America, Europe and the Mediterranean, the Amazon, southern Africa, China, Southeast Asia, and Australia. Compared to SSP3‐7.0 and SSP5‐8.5, however, the severity of drying in the lower warming scenarios is substantially reduced and further precipitation declines in many regions are avoided. Along with drying in the mean state, the risk of the historically most extreme drought events also increases with warming, by 200–300% in some regions. Soil moisture and runoff drying in CMIP6 is more robust, spatially extensive, and severe than precipitation, indicating an important role for other temperature‐sensitive drought processes, including evapotranspiration and snow. Given the similarity in drought responses between CMIP5 and CMIP6, we speculate both generations of models are subject to similar uncertainties, including vegetation processes, model representations of precipitation, and the degree to which model responses to warming are consistent with observations. These topics should be further explored to evaluate whether CMIP6 models offer reasons to have increased confidence in drought projections.

drought↗

NASA NTRSDate not supplied

Multihierarchy Gaussian Process Models for Probabilistic Aerodynamic Databases using Uncertain Nominal and Off-Nominal Configuration Data

Probabilistic aerodynamic databases are a crucial component of the development lifecycle for aerospace vehicles. A key challenge when building aerodynamic databases is that most data used to construct them represent various simplifications of the real flight vehicle. For example, wind tunnel models often simplify the vehicle geometry and surface roughness characteristics, while CFD computations often make simplifications to the physics being modeled, such as fully laminar or turbulent calculations. Multifidelity data fusion models rely on a user being able to define a hierarchy of fidelity levels anchored to some "truth" data. This approach is unsatisfactory when no data can be considered to accurately reflect real flight conditions. In this work, we provide an alternative approach by presenting a consistent mathematical framework for building probabilistic aerodynamic databases in the form of a conditional probability distribution described by an ensemble of multifidelity Gaussian Processes. Instead of relying on a single hierarchy of data fidelity levels, the presented framework identifies a "nominal" configuration and potential corrections to the nominal which represent specific physical phenomena not represented in the nominal data. The nominal and correction functions themselves are constructed as multifidelity Gaussian Processes and linearly combined to form an ensemble model which fuses the uncertainties associated nominal and correction models. Results obtained using the proposed framework on a simplified Orion Crew Module wind tunnel dataset demonstrate the predictive capability of the multihierarchy framework. We further demonstrate the benefits of such a probabilistic aerodynamic database approach through function sampling and computing the conditional distributions of derived quantities, such as the trim angle of attack and aerodynamic coefficients at trim.

Gaussian Processes↗

DOE OSTI2026

Nuclear Data Libraries Sensitivity Studies for ORSA Using SCALE

Subcritical assemblies offer valuable training capabilities in nuclear criticality safety (NCS) for individuals handling fissile material. At Oak Ridge National Laboratory(ORNL), the Oak Ridge Subcritical Assembly (ORSA), a new experimental facility, is being established to provide hands-on training for the Nuclear Criticality Safety Program (NCSP).It is essential to accurately determine the neutron multiplication factor (keff) to ensure that ORSA remains subcritical and safe during operations. This study investigated the sensitivity of keff to variations across Evaluated Nuclear Data File (ENDF/B) libraries, consisting of ENDF/B-VII.1, ENDF/B-VIII.0, and ENDF/B-VIII.1. The analysis was conducted using the CSAS6 sequence in the SCALE-6.3 code system. Individual isotopes in the ORSA model were replaced one at a time with ENDF/B-VII.1 as the base library and changing to ENDF/B-VIII.0or ENDF/B-VIII.1. The results demonstrated that the changes in keffof the nuclides associated with the ORSA model were mostly within the uncertainty of the base model (~24 pcm), except for primary nuclides like Uranium-235and H-poly with few other nuclides. The relative delta keff values of Uranium-235 and H-poly, expressed in pcm, were +280 and -212 in ENDF/B-VIII.0 and +332 and -275 in ENDF/B-VIII.1, respectively, which were notable changes in reactivity. These results demonstrated that ORSA was largely insensitive to variations across these nuclear data libraries.

Hong, Evan [North Carolina State University]↗

DOE OSTI2020

Bayesian differential programming for robust systems identification under uncertainty

This paper presents a machine learning framework for Bayesian systems identification from noisy, sparse and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of recent developments in differentiable programming to propagate gradient information through ordinary differential equation solvers and perform Bayesian inference with respect to unknown model parameters using Hamiltonian Monte Carlo sampling. This allows an efficient inference of the posterior distributions over plausible models with quantified uncertainty, while the use of sparsity-promoting priors enables the discovery of interpretable and parsimonious representations for the underlying latent dynamics. A series of numerical studies is presented to demonstrate the effectiveness of the proposed methods, including nonlinear oscillators, predator–prey systems and examples from systems biology. Taken together, our findings put forth a flexible and robust workflow for data-driven model discovery under uncertainty. All codes and data accompanying this article are available at https://bit.ly/34FOJMj .

Science & Technology - Other Topics↗

NASA NTRS2021

Dealing with Ion LET Uncertainties: An Application of Generalized Linear Models

Although most SEE rate estimation methods presume a fit to SEE cross section vs. LET, fitting SEE data is challenging because the data are not compatible with the assumptions of many common fitting techniques (e.g. linear regression. The difficulty of fitting such data is compounded when the LET of the ion responsible for an SEE is uncertain. We modify a Generalized Linear Model SEE data fitting methodology to accommodate uncertain LET and apply the method to the problem of backside heavy-ion SEE testing to demonstrate the utility of the method, explore the dependence of systematic errors that arise from improper treatment of LET uncertainty and develop guidelines for minimizing such systematic errors when proper treatment is not possible. Additional applications are suggested and assessed for suitability of treatment by the model.

Single-event effects↗

DOE OSTI2021

Statistical emulation of a perturbed basal melt ensemble of an ice sheet model to better quantify Antarctic sea level rise uncertainties

Abstract. Antarctic ice shelves are vulnerable to warming ocean temperatures, and some have already begun thinning in response to increased basal melt rates. Sea level is therefore expected to rise due to Antarctic contributions, but uncertainties in its amount and timing remain largely unquantified. In particular, there is substantial uncertainty in future basal melt rates arising from multi-model differences in thermal forcing and how melt rates depend on that thermal forcing. To facilitate uncertainty quantification in sea level rise projections, we build, validate, and demonstrate projections from a computationally efficient statistical emulator of a high-resolution (4 km) Antarctic ice sheet model, the Community Ice Sheet Model version 2.1. The emulator is trained to a large (500-member) ensemble of 200-year-long 4 km resolution transient ice sheet simulations, whereby regional basal melt rates are perturbed by idealized (yet physically informed) trajectories. The main advantage of our emulation approach is that by sampling a wide range of possible basal melt trajectories, the emulator can be used to (1) produce probabilistic sea level rise projections over much larger Monte Carlo ensembles than are possible by direct numerical simulation alone, thereby providing better statistical characterization of uncertainties, and (2) predict the simulated ice sheet response under differing assumptions about basal melt characteristics as new oceanographic studies are published, without having to run additional numerical ice sheet simulations. As a proof of concept, we propagate uncertainties about future basal melt rate trajectories, derived from regional ocean models, to generate probabilistic sea level rise estimates for 100 and 200 years into the future.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2019

Health Management and Prognostics for Electric Aircraft Powertrain

W and c Any air borne vehicle needs incorporating safety as key parameter of measure, and inclusion of autonomy raises the critical need for safety under autonomous operations. Management of faults and component degradation is key as complexity in autonomous operations grow over the period of time. Therefore, in addition to basic operational requirements, an autonomous electric vehicle should be able to make accurate estimates of its current system health and take the correct decisions to complete its mission successfully. Real-time safety and state-awareness tools are therefore essential for the vehicle to be able to reach its destination in a safe and successful manner. The need for safety assurance and health management capabilities is particularly relevant for aircraft electric propulsion systems, which are relatively new and with limited historical to learn. They are critical systems requiring high power density along with reliability, resilience, efficient management of weight, and operational costs. A model- based fault diagnosis and prognostics approach of complex critical systems can successfully accomplish the safety and state awareness goal for such electric propulsion systems, enabling autonomous decision making capability for safe and efficient operation. To identify critical components in the system a Qualitative Bayesian approach using FMECA is implemented. This requires the assessment of some quantities representing the state of the electric unmanned aerial systems (e-UAS), as well as look-ahead forecasts of such states during the entire flight, presented in form of safety metrics (SM). In-service data and performance data gathered from degraded components sup- ports diagnostic and prognostic methods for these systems, but this data can be difficult to obtain as weight and packaging restrictions reduce redundancy and instrumentation on-board the vehicle. Therefore, an model-based framework should be capable or operating with limited data. In addition to data scarcity, the variability of such complex critical systems re- quires the model-based framework to reason in the presence of uncertainty, such as sensor noise, and modeling imperfections. Quantification of errors and uncertainties in the measured states and quantities is therefore a fundamental step for a precise estimation of such SMs; un-modeled uncertainty may result in erroneous state assessment and un- reliable predictions of future states of e-UAVs. Typical, centralized model-based schemes suffer from inherent disadvantages such as computational complexity, single point of failure, and scalability issues, and therefore may fail in such a complex scenario. This paper presents a methodology for developing a system level diagnostics and prognostics approach using a Qualitative Bayesian FMECA approach along with a formal uncertainty management framework for an e-UAS. In this work we demonstrate the efficacy of the framework to predict effects of sub-system level degradation on vehicle operation incorporating uncertainty management to predict future behavior under different operating conditions.

Kulkarni, Chetan↗

DOE OSTI2025

Exploring Afro-Asian water fluxes in CMIP5 and CMIP6 models: Present-day evaluation and future projections

Accurate representation and projection of water fluxes are vital, particularly in monsoon regions where seasonal variability and changes significantly impact water resources, agriculture, hydroelectric power generation, and the economy. This study uses both CMIP5 and CMIP6 models to investigate the present-day representation of key water flux components (including precipitation, evaporation, water vapor, and moisture advection) over the Afro-Asian region during the summer monsoon (JJAS). We also examine future changes under two emission scenarios and assess the underlying physical mechanisms driving these changes while identifying sources of projection uncertainty. Our results show that both models reasonably capture the present-day characteristics of water flux components, although with noticeable biases. Across most regions, we find that CMIP6 models demonstrate slight improvements over CMIP5 in the representation of these components. In a warmer future, a robust intensification of JJAS precipitation (exceeding 0.25 mm/day) is projected across the Afro-Asian region. This increase is largely driven by the vertical thermodynamic term associated with increasing temperature. We find that model uncertainty is the primary source of uncertainty in water flux projections, accounting for over 50 % of the total variance.

Climate change↗

NASA NTRSDate not supplied

Comparison between Hayabusa 2 Spectral Measurements and Simulations

Recent Hayabusa 2 spectral measurements are compared with state-of-the-art shock-layer radiation simulations resulting from the LAURA/HARA code suite. These simulations include coupled ablation, which accounts for the injection of ablation products into the flowfield, and coupled radiation, which accounts for radiative energy loss in the flowfield. To enable the cou- pled ablation simulations, a best-estimate model is developed for Hayabusa’s carbon-phenolic ablator based on available published information. The comparison between the simulations and measurements focuses on three atomic nitrogen lines, two atomic oxygen lines, one atomic hydrogen line, and the CN Violet band system. Parametric uncertainties are evaluated for these features using a recently developed capability in LAURA/HARA. These uncertainties capture the impact of flowfield and radiation modeling uncertainties on the observed radiation simulations, and include the impact of coupled radiation and ablation product emission. The resulting parametric uncertainties range from 50 to over 100% for the atomic lines, and 80% for CN Violet. Uncertainties in flowfield kinetics and non-Boltzmann modeling provide the dominant contribution to these uncertainties. For the atomic nitrogen and oxygen lines, com- parisons between the nominal simulations and measurements show agreement well within these simulation uncertainty bounds, with the measurements within 20% of the nominal simulation over most of the trajectory, and within 10% at peak emission. This excellent agreement is un- precedented for observed radiation measurements of atomic lines, where previous Stardust and Hayabusa 1 comparisons were significantly worse. The improved agreement for these Hayabusa 2 comparisons is both the result of improved measurement quality and enhanced flowfield and radiation modeling. For the ablation product emission from the 656 nm atomic hydrogen line, the agreement between measurements and simulations is within ±20% for all trajectory points except one outlier. This good comparison is surprising considering this species depends on the ablation rate and is shown to have strong wake contribution, which both contribute to the large ≈±70% parametric uncertainty. For the ablation product emission from CN Violet, the simulations over-predict the measurements by over a factor of two early in the trajectory, with the comparison improving later in the trajectory. This disagreement for CN Violet is consistent with the ≈±80% parametric uncertainty bounds evaluated for the simulations. To utilize the excellent agreement between the atomic line simulations and measurements in the assessment of the radiative heating margin for a future flight vehicle, the flowfield property binning (FPB) approach is applied. Using the Mars Sample Return (MSR) Earth Entry System (EES) as an example, the combination of the excellent Hayabusa comparisons and the FPB analysis justify nearly a 10% reduction in the radiative heating margin from an assumed baseline margin of 30%. This direct quantitative link between observed radiation measurements and the radia- tive heating margin of future flight vehicles demonstrates the value of these observed radiation measurements.

Shock-Layer Radiative Heating↗

NASA NTRS2017

Uncertainty Quantification of CFD Data Generated for a Model Scramjet Isolator Flowfield

Computational fluid dynamics is now considered to be an indispensable tool for the design and development of scramjet engine components. Unfortunately, the quantification of uncertainties is rarely addressed with anything other than sensitivity studies, so the degree of confidence associated with the numerical results remains exclusively with the subject matter expert that generated them. This practice must be replaced with a formal uncertainty quantification process for computational fluid dynamics to play an expanded role in the system design, development, and flight certification process. Given the limitations of current hypersonic ground test facilities, this expanded role is believed to be a requirement by some in the hypersonics community if scramjet engines are to be given serious consideration as a viable propulsion system. The present effort describes a simple, relatively low cost, nonintrusive approach to uncertainty quantification that includes the basic ingredients required to handle both aleatoric (random) and epistemic (lack of knowledge) sources of uncertainty. The nonintrusive nature of the approach allows the computational fluid dynamicist to perform the uncertainty quantification with the flow solver treated as a "black box". Moreover, a large fraction of the process can be automated, allowing the uncertainty assessment to be readily adapted into the engineering design and development workflow. In the present work, the approach is applied to a model scramjet isolator problem where the desire is to validate turbulence closure models in the presence of uncertainty. In this context, the relevant uncertainty sources are determined and accounted for to allow the analyst to delineate turbulence model-form errors from other sources of uncertainty associated with the simulation of the facility flow.

Baurle, R. A.↗