Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty quantification and propagation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Large Ensemble Particle Filter for Spatial Climate Reconstructions Using a Linear Inverse Model

Proxy records that document the last 2000 years of climate provide evidence for the wide range of the natural climate variability from inter-annual to secular timescales not captured by the short window of recent direct observations. Assessing climate models ability to reproduce such natural variations is crucial to understand climate sensitivity and impacts of future climate change. Paleoclimate data assimilation (PDA) offers a powerful way to extend the short instrumental period by optimally combining the physics described by General Circulation Climate Models (GCMs) with information from available proxy records while taking into account their uncertainties. Here we present a new PDA approach based on a sequential importance resampling (SIR) Particle filter (PF) that uses Linear Inverse Modeling (LIM) as an emulator of several CMIP-class GCMs. We examine in a perfect-model framework the skill of the various LIMs to forecast the dynamics of the surface temperatures and provide spatial field reconstructions over the last millennium in a SIR PF. Our results show that the LIMs allow for skillful ensemble forecasts at 1-year lead-time based on GCMs dynamical knowledge with best prediction in the tropics and the North Atlantic. The PDA further provides a set of physically consistent spatial fields allowing robust uncertainty quantification related to climate models biases and proxy spatial sampling. Our results indicate that the LIM yields dynamical memory improving climate variability reconstructions and support the use of the LIM as a GCM-emulator in real reconstruction to propagate large ensembles of particles at low cost in SIR PF.

54 ENVIRONMENTAL SCIENCES↗

TRUST Sensors in Environments: Fiber Optic Displacement (SEFOD) Report

The sensors in environments for fiber optic displacement gages (SEFOD) testbed is a collaboration between W-13, and E-14. Testbeds in this project are focused on characterization and propagation of the uncertainty in experimental techniques used by E-14 in WR-like environments. Discussions with SMEs identified instrumentation as the best candidates for single feature testbeds addressing experimental uncertainty sources. Previous work and student projects have addressed instrumentation uncertainty quantification of thermocouples, load cells, and accelerometers.

47 OTHER INSTRUMENTATION↗

Remaining Useful Life Estimation in Prognosis: An Uncertainty Propagation Problem

The estimation of remaining useful life is significant in the context of prognostics and health monitoring, and the prediction of remaining useful life is essential for online operations and decision-making. However, it is challenging to accurately predict the remaining useful life in practical aerospace applications due to the presence of various uncertainties that affect prognostic calculations, and in turn, render the remaining useful life prediction uncertain. It is challenging to identify and characterize the various sources of uncertainty in prognosis, understand how each of these sources of uncertainty affect the uncertainty in the remaining useful life prediction, and thereby compute the overall uncertainty in the remaining useful life prediction. In order to achieve these goals, this paper proposes that the task of estimating the remaining useful life must be approached as an uncertainty propagation problem. In this context, uncertainty propagation methods which are available in the literature are reviewed, and their applicability to prognostics and health monitoring are discussed.

Uncertainty Quantification↗

Uncertainty Quantification of CFD Model Assumptions Against Sonic Boom Noise Prediction of a Commercial Supersonic Transport

This paper presents the results of uncertainty modeling of sonic boom noise generation from commercial supersonic transport considering the Spalart-Allmaras (SA) turbulence modeling parameters as well as Mach number, angle of attack and altitude. Sample generation and analysis for this uncertainty model was performed by UQPCE, which is a software package developed at the NASA Langley Research Center. To build the uncertainty model, 42 cases of sonic boom noise calculation were performed. Computation of the ground noise can be briefly summarized in two steps. First, the near field pressure waveforms are sampled from CFD calculation using the NASA Langley’s FUN3D solver. Second, this information is passed to an atmospheric propagation code, sBOOM, which solves an augmented Burger’s equation and simulates how the near field waveforms will change while passing through the atmosphere. The ground signature is further processed to obtain the perceived loudness, PLdB. Having a high spatial resolution near the shockwave in the CFD calculation is critical in sonic boom noise prediction. Because the variation in the input parameters for the current uncertainty quantification (UQ) study is likely to lead to change in shock location, angle and strength, the grid adaptation for shock capturing is independently applied for each condition. The final mesh used in the CFD calculation consists of approximately 420 million cells. The pressure signatures are sampled at three, four and five body lengths away from the aircraft to make sure the three dimensional effects around the aircraft are resolved. The results of the UQ analysis shows that within the three aleatory variables, the angle of attack had the most impact against ground noise, followed by the altitude and the Mach number. Between the two SA model parameters, the Kármán constant (𝜅) was significantly more important than the turbulent Prandtl number (𝜎), but these two parameters were only marginally significant in the overall prediction variance in ground noise. The UQ procedure explained in this paper can be widely applied to other model parameters.

Uncertainty Quantification↗

Uncertainty Quantification of CFD Model Assumptions Against Sonic Boom Noise Prediction of a Commercial Supersonic Transport

This paper presents the results of uncertainty modeling of sonic boom noise generation from commercial supersonic transport considering the Spalart-Allmaras (SA) turbulence modeling parameters as well as Mach number, angle of attack and altitude. Sample generation and analysis for this uncertainty model was performed by UQPCE, which is a software package developed at the NASA Langley Research Center. To build the uncertainty model, 42 cases of sonic boom noise calculation were performed. Computation of the ground noise can be briefly summarized in two steps. First, the near field pressure waveforms are sampled from CFD calculation using the NASA Langley’s FUN3D solver. Second, this information is passed to an atmospheric propagation code, sBOOM, which solves an augmented Burger’s equation and simulates how the near field waveforms will change while passing through the atmosphere. The ground signature is further processed to obtain the perceived loudness, PLdB. Having a high spatial resolution near the shock wave in the CFD calculation is critical in sonic boom noise prediction. Because the variation in the input parameters for the current uncertainty quantification (UQ) study is likely to lead to change in shock location, angle and strength, the grid adaptation for shock capturing is independently applied for each condition. The final mesh used in the CFD calculation consists of approximately 420 million cells. The pressure signatures are sampled at three, four and five body lengths away from the aircraft to make sure the three dimensional effects around the aircraft are resolved. The results of the UQ analysis shows that within the three aleatory variables, the angle of attack had the most impact against ground noise, followed by the altitude and the Mach number. Between the two SA model parameters, the Kármán constant (𝜅) was significantly more important than the turbulent Prandtl number (𝜎), but these two parameters were only marginally significant in the overall prediction variance in ground noise. The UQ procedure explained in this paper can be widely applied to other model parameters.

Uncertainty Quantifications↗

Equipping Neural Network Surrogates with Uncertainty for Propagation in Physical Systems

Coarse-grained or filtered models typically rely on closure models to account for unresolved scales. For instance, large eddy simulation for modeling turbulent fluid flows explicitly resolves the largest scales, but requires modeling closure terms to account for the sub-filter scales. With the vast amount of data available from high-fidelity simulations, there are unique opportunities to leverage data-driven modeling techniques to formulate expressive and flexible closure models. Despite their flexibility, data-driven models struggle in domain shift settings, i.e. when deployed in configurations not captured in the training dataset. In particular, the efficacy of neural network surrogates is difficult to assess a priori due to the deterministic, point-estimate nature of predictions. In high-consequence applications, such models require reliable uncertainty estimates in the data-informed and out-of-distribution regimes. To quantify uncertainties in both regimes, we employ Bayesian neural networks which are able to capture both epistemic and aleatoric uncertainties. We will discuss challenges associated with the training and evaluation of these networks. Furthermore, we will discuss uncertainty embedding strategies to enable efficient sampling and propagation of uncertainty through high-fidelity simulations.

Bayesian neural networks↗

Uncertainty Quantification of Inducer Natural Frequency using Conditional Assessment of Modeling and Modal Testing of Simpler Systems

The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.

Uncertainty Quantification↗

Uncertainty Quantification of Inducer Eigenvalues using Conditional Assessment of Models and Modal Test of Simpler Systems

The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.

Uncertainty Quantification↗

Quantification of spatial and seasonal trends in the atmosphere and construction of statistical models for infrasonic propagation

SUMMARY Infrasonic waves are influenced by variations in the density, pressure and temperature as well as the ambient winds. Modelling infrasonic propagation can be challenging due to the dynamic nature of the atmosphere as well as the sparseness of measurements which result in variability and notable uncertainty. A framework is presented to quantify spatial and seasonal trends in atmospheric structure via analysis of the effective sound speed profile and identification of temporal trends in the middle atmospheric waveguide produced by the circumpolar vortex winds. Seasonal definitions identifying typical atmospheric structures during the summer, winter and spring/fall transition periods are identified using atmospheric data from 2010 through 2020. Seasonal trend analysis is conducted for a number of locations across the contiguous United States to quantify spatial variations in atmospheric structure that impact infrasonic propagation. For each season and location, empirical orthogonal function analysis is used to reduce the historical archive of atmospheric data into a smaller representative set that can be analysed using numerical tools more efficiently. Infrasonic ray tracing and finite-frequency modal propagation analyses are applied to construct propagation path geometry and transmission loss statistics which are useful in localization and yield estimation for infrasonic sources, respectively. An example application is detailed in which transmission loss statistics are combined with an explosive source model and noise statistics to quantify the capability of a network to detect nearby sources.

58 GEOSCIENCES↗

Taming nuclear mass models with Gaussian processes

We propose a new set of nuclear mass predictions based on multiple theoretical mass models. By employing Gaussian process regression with the Matérn kernel, we achieved root-mean-square (rms) deviations below 100 keV for the training dataset. The best-performing mass models achieved rms deviations below 150 keV for the new precise mass data from AME2020, whereas the ensemble average showed robust performance across the nuclear chart. Our approach uniquely combines: (1) systematic refinement of eight mass models through their residuals, (2) physics-informed features, including magic numbers, nucleon parity numbers, neutron excess, and nuclear collectivity, and (3) theory-to-theory validation demonstrating robust extrapolation capability. We find that the Matérn kernel provides superior uncertainty quantification compared to the RBF kernel, with a length-scale analysis revealing enhanced inter-nuclei correlations. We provide complete mass predictions for all unknown nuclides in AME2020, offering valuable constraints for nuclear structure studies and astrophysical modeling when used with proper uncertainty propagation.

Gaussian processes↗

Uncertainty Quantification and Sensitivity Analysis of Low-Dimensional Manifold via Co-Kurtosis PCA in Combustion Modeling

For multi-scale multi-physics applications e.g., the turbulent combustion code Pele, robust and accurate dimensionality reduction is crucial to solving problems at exascale and beyond. A recently developed technique, Co-Kurtosis based Principal Component Analysis (CoK-PCA) which leverages principal vectors of co-kurtosis, is a promising alternative to traditional PCA for complex chemical systems. To improve the effectiveness of this approach, we employ Artificial Neural Networks for reconstructing thermo-chemical scalars, species production rates, and overall heat release rates corresponding to the full state space. Our focus is on bolstering confidence in this deep learning based non-linear reconstruction through Uncertainty Quantification (UQ) and Sensitivity Analysis (SA). UQ involves quantifying uncertainties in inputs and outputs, while SA identifies influential inputs. One of the noteworthy challenges is the computational expense inherent in both endeavors. To address this, we employ the Monte Carlo methods to effectively quantify and propagate uncertainties in our reduced spaces while managing computational demands. Our research carries profound implications not only for the realm of combustion modeling but also for a broader audience in UQ. By showcasing the reliability and robustness of CoK-PCA in dimensionality reduction and deep learning predictions, we empower researchers and decision-makers to navigate complex combustion systems with greater confidence.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Recent advances in the quantification of uncertainties in reaction theory

Uncertainty quantification has become increasingly more prominent in nuclear physics over the past several years. In few-body reaction theory, there are four main sources that contribute to the uncertainties in the calculated observables: the effective potentials, approximations made to the few-body problem, structure functions, and degrees of freedom left out of the model space. In this work, we illustrate some of the features that can be obtained when modern statistical tools are applied in the context of nuclear reactions. This work consists of a summary of the progress that has been made in quantifying theoretical uncertainties in this domain, focusing primarily on those uncertainties coming from the effective optical potential as well as their propagation within various reaction theories. We use, as the central example, reactions on the doubly-magic stable nucleus 40 Ca, namely neutron and proton elastic scattering and single-nucleon transfer 40 Ca(d,p) 41 Ca. First, we show different optimization schemes used to constrain the optical potential from differential cross sections and other experimental constraints; we then discuss how these uncertainties propagate to the transfer cross section, comparing two reaction theories. Finally, we finish by laying out our future plans.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Scalable Bayesian Physics-Informed Kolmogorov-Arnold Networks

Uncertainty quantification (UQ) plays a pivotal role in scientific machine learning, especially when surrogate models are used to approximate complex systems. Although multilayer perceptions (MLPs) are commonly employed as surrogates, they often suffer from overfitting due to their large number of parameters. Kolmogorov-Arnold networks (KANs) offer an alternative solution with fewer parameters. However, gradient-based inference methods, such as Hamiltonian Monte Carlo (HMC), may result in computational inefficiency when applied to KANs, especially for large-scale datasets, due to the high cost of back-propagation. To address these challenges, we propose a novel approach, combining the dropout Tikhonov ensemble Kalman inversion (DTEKI) with Chebyshev KANs. This gradient-free method effectively mitigates overfitting and enhances numerical stability. In addition, we incorporate the active subspace method to reduce the parameter-space dimensionality, allowing us to improve the accuracy of predictions and obtain more reliable uncertainty estimates. Extensive experiments demonstrate the efficacy of our approach in various test cases, including scenarios with large datasets and high noise levels. Our results show that the new method achieves comparable or better accuracy, much higher efficiency as well as stability compared to HMC, in addition to scalability. Moreover, by leveraging the low-dimensional parameter subspace, our method preserves prediction accuracy while substantially reducing further the computational cost.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Estimates for Sonic-Boom Pressure Signatures and Loudness Carpets

A non-intrusive uncertainty quantification method is applied to computational analysis of supersonic, low-boom aircraft. The mean and standard deviation statistics of the pressure waveforms and loudness metrics are evaluated through use of numerical quadrature. The probability density function (p.d.f.) of these outputs is evaluated via kernel density estimation. The simulations use an inviscid, embedded-boundary Cartesian-mesh flow solver in the nearfield combined with an augmented Burgers’ equation solver for propagation in the farfield. The results show that the p.d.f. of the waveform is bimodal at shocks, which makes the mean and standard deviation statistics inappropriate. Despite this limitation, we show that the moment statistics can provide effective assessment of discrepancies when comparing with experimental data. This is demonstrated by presenting uncertainty analysis of a wind-tunnel test and showing that we significantly improve the predictions when we include the test uncertainties in the simulation. Normal distributions are obtained for the ground signature and loudness metrics, which is primarily due to the careful shaping of the low-boom waveform. Separation of variables and error control are used to reduce computational cost. We demonstrate that this is an efficient approach in the sense of balancing numerical errors in the statistics quadrature with discretization errors in the solvers.

ARMD↗

Space-Time Data fusion for Remote Sensing Applications

NASA has been collecting massive amounts of remote sensing data about Earth's systems for more than a decade. Missions are selected to be complementary in quantities measured, retrieval techniques, and sampling characteristics, so these datasets are highly synergistic. To fully exploit this, a rigorous methodology for combining data with heterogeneous sampling characteristics is required. For scientific purposes, the methodology must also provide quantitative measures of uncertainty that propagate input-data uncertainty appropriately. We view this as a statistical inference problem. The true but notdirectly- observed quantities form a vector-valued field continuous in space and time. Our goal is to infer those true values or some function of them, and provide to uncertainty quantification for those inferences. We use a spatiotemporal statistical model that relates the unobserved quantities of interest at point-level to the spatially aggregated, observed data. We describe and illustrate our method using CO2 data from two NASA data sets.

carbon dioxide↗

An uncertainty quantification method relevant to material test reactors

Within material test reactor calculations, energy dependent flux and reaction rate uncertainties are typically not quantified when performing as-run analyses to determine the neutron field experienced by the experiment. When high fidelity Monte-Carlo codes are used in such analyses, straight forward methods to calculate output uncertainties are not available, instead expert opinion is used to postulate computational uncertainties. New methods to propagate uncertainties through these high fidelity simulations are available when sufficient computational power is available. A tool is developed here for sampling any part of an MCNP input from random distributions to determine output uncertainties based on those inputs. Another tool is developed to sample nuclear data cross-section in ACE format using multi-group nuclear data covariances. The Total Monte-Carlo Method and Gesellschaft für Anlagen-und Reaktorsicherheit method (GRS) are implemented and compared to one another as well as MCNP sensitivity and uncertainty calculations. The methods were applied to the Godiva critical sphere k-eigenvalue, the UAM pin-cell benchmark energy dependent flux and reaction rates, and the Advanced Test Reactor energy dependent flux within an experimental location. Furthermore, the two methods agree well, with GRS allowing for an order of magnitude speedup for reaction rate uncertainty calculations and several orders of magnitude for eigenvalue uncertainty calculations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Mechanistic Multiscale Uncertainty Propagation in Support of Accelerated Fuel Qualification

Taking a nuclear fuel concept through the research, development, and qualification stages has historically taken on the order of 20 to 25 years because of extensive irradiation tests required for a variety of conditions. The concept of accelerated fuel qualification (AFQ) has been proposed to increase the innovation pace for nuclear fuels. The goal of AFQ is not to replace the traditional qualification approach but rather to reduce the total number of experiments required to ensure approval from the regulatory authority. Of the many AFQ approaches being explored, advanced modeling—and, in particular, mechanistic modeling—is in a uniquely cross-cutting position to reduce the number of required integral tests through the inclusion of separate-effects testing, while helping to extrapolate reactor performance during rare events. We make the case that propagation of uncertainty through various computational length scales helps contextualize mechanistic modeling. We will utilize UO 2 fission gas diffusion predictions from the atomistically informed cluster dynamics code Centipede to inform fuel performance rodlet simulations using the BISON finite element code as the metric for showing how multiscale mechanistic uncertainty quantification can help reduce uncertainty in fuel performance. In conclusion, by quantifying uncertainty and its reduction through multiscale modeling, the qualification process may be accelerated through the reduction of costly irradiation experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗