Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Analysis of Neural Networks as Random Dynamical Systems

In this report we present our findings and outcomes of the NNRDS (analysis of Neural Networks as Random Dynamical Systems) project. The work is largely motivated by the analogy of a large class of neural networks (NNs) with a discretized ordinary differential equation (ODE) schemes. Namely, residual NNs, or ResNets, can be viewed as a discretization of neural ODEs (NODEs) where the NN depth plays the role of the time evolution. We employ several legacy tools from ODE theory, such as stiffness, nonlocality, autonomicity, to enable regularization of ResNets thus improving their generalization capabilities. Furthermore, armed with NN analysis tools borrowed from the ODE theory, we are able to efficiently augment NN predictions with uncertainty overcoming wellknown dimensionality challenges and adding a degree of trust towards NN predictions. Finally, we have developed a Python library QUiNN (Quantification of Uncertainties in Neural Networks) that incorporates improved-architecture ResNets, besides classical feed-forward NNs, and contains wrappers to PyTorch NN models enabling several major classes of uncertainty quantification methods for NNs. Besides synthetic problems, we demonstrate the methods on datasets from climate modeling and materials science.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Quantification and visualization of uncertainties in reconstructed penumbral images of implosions at Omega

Penumbral imaging is a technique used in plasma diagnostics in which a radiation source shines through one or more large apertures onto a detector. To interpret a penumbral image, one must reconstruct it to recover the original source. The inferred source always has some error due to noise in the image and uncertainty in the instrument geometry. Interpreting the inferred source thus requires quantification of that inference’s uncertainty. Markov chain Monte Carlo algorithms have been used to quantify uncertainty for similar problems but have never been used for the inference of the shape of an image. Because of this, there are no commonly accepted ways of visualizing uncertainty in two-dimensional data. This paper demonstrates the application of the Hamiltonian Monte Carlo algorithm to the reconstruction of penumbral images of fusion implosions and presents ways to visualize the uncertainty in the reconstructed source. This methodology enables more rigorous analysis of penumbral images than has been done in the past.

Instruments & Instrumentation↗
DOE OSTI2020

On the quantification and efficient propagation of imprecise probabilities with copula dependence

This paper addresses the problem of quantification and propagation of uncertainties associated with dependence modeling when data for characterizing probability models are limited. Practically, the system inputs are often assumed to be mutually independent or correlated by a multivariate Gaussian distribution. However, this subjective assumption may introduce bias in the response estimate if the real dependence structure deviates from this assumption. In this work, we overcome this limitation by introducing a flexible copula dependence model to capture complex dependencies. Here, a hierarchical Bayesian multimodel approach is proposed to quantify uncertainty in dependence model-form and model parameters that result from small data sets. This approach begins by identifying, through Bayesian multimodel inference, a set of candidate marginal models and their corresponding model probabilities, and then estimating the uncertainty in the copula-based dependence structure, which is conditional on the marginals and their parameters. The overall uncertainties integrating marginals and copulas are probabilistically represented by an ensemble of multivariate candidate densities. A novel importance sampling reweighting approach is proposed to efficiently propagate the overall uncertainties through a computational model. Through an example studying the influence of constituent properties on the out-of-plane properties of transversely isotropic E-glass fiber composites, we show that the composite property with copula-based dependence model converges to the true estimate as data set size increases, while an independence or arbitrary Gaussian correlation assumption leads to a biased estimate.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Investigation of Ethane Dehydrogenation and Hydrogenolysis on Pt(111), Pt(211), and Pt(100): Bayesian Quantification and Correction of DFT-Based Enthalpic and Entropic Uncertainties

Computational investigations of heterogeneously catalyzed reactions using density functional theory (DFT) are often inaccurate, largely due to uncertainties in the choice of DFT functional (enthalpic uncertainty) and approximations for modeling adsorbate movement along the catalyst surface (entropic uncertainty). This work illustrates that both uncertainties are significant in the investigation of ethane dehydrogenation (EDH) and hydrogenolysis on Pt catalysts by considering the complete deconstruction of ethane on Pt(111), Pt(211), and Pt(100) using microkinetic modeling (MKM). Hence, this work uses both noncalibrated and Bayesian-calibrated MKMs to quantify and correct inaccuracies in macroscopic properties due to both uncertainties. A Bayesian approach to the correction of entropic errors was introduced using a “Modified Fermi Function (MFF)” to calibrate between the two bounds of entropy represented by the harmonic oscillator (HO) and free translator (FT) approximations. Regardless of enthalpic and entropic uncertainties, all three surfaces are capable of ethane activation; however, Pt(211) was found to be the most active and is largely responsible for methane production. Next, Pt(111) is largely responsible for acetylene production, and Pt(100) has the highest ethylene selectivity but is most susceptible to coking. By comparison of different calibrated models, the FT entropy approximation was found to better describe EDH under typical experimental conditions. Statistical evidence was found to support Pt(111) as the active site for EDH, assuming that one single site is responsible for the chemistry. On the three surfaces, competing second dehydrogenations to CH 2 CH 2 and CH 3 CH were observed as well as isomerization of CH 3 CH back to CH 2 CH 2 and deeper dehydrogenation of CH 3 CH. In conclusion, C–C cleavage was found to largely proceed via the CH 3 C intermediate on Pt(100) and Pt(111), while on Pt(211), it was via both CHC and CH 3 C.

Bayesian model selection↗
DOE OSTI2021

Quantifying the Multi-Objective Cost of Uncertainty

Various real-world applications involve modeling complex systems with immense uncertainty and optimizing multiple objectives based on the uncertain model. Quantifying the impact of the model uncertainty on the given operational objectives is critical for designing optimal experiments that can most effectively reduce the uncertainty that affect the objectives pertinent to the application at hand. In this paper, we propose the concept of mean multi-objective cost of uncertainty (multi-objective MOCU) that can be used for objective-based quantification of uncertainty for complex uncertain systems considering multiple operational objectives. We provide several illustrative examples that demonstrate the concept and strengths of the proposed multi-objective MOCU. Furthermore, we present a real-world example based on the mammalian cell cycle network to demonstrate how the multi-objective MOCU can be used for quantifying the operational impact of model uncertainty when there are multiple, possibly competing, objectives.

42 ENGINEERING↗
DOE OSTI2022

Quantification of the effect of uncertainty on impurity migration in PISCES-A simulated with GITR

A Bayesian inference strategy has been used to estimate uncertain inputs to global impurity transport code (GITR) modeling predictions of tungsten erosion and migration in the linear plasma device, PISCES-A. This allows quantification of GITR output uncertainty based on the uncertainties in measured PISCES-A plasma electron density and temperature profiles (n e , T e ) used as inputs to GITR. The technique has been applied for comparison to dedicated experiments performed for high (4 × 10 22 m –2 s –1 ) and low (5 × 10 21 m –2 s –1 ) flux 250 eV He–plasma exposed tungsten (W) targets designed to assess the net and gross erosion of tungsten, and corresponding W impurity transport. The W target design and orientation, impurity collector, and diagnostics, have been designed to eliminate complexities associated with tokamak divertor plasma exposures (inclined target, mixed plasma species, re-erosion, etc) to benchmark results against the trace impurity transport model simulated by GITR. The simulated results of the erosion, migration, and re-deposition of W during the experiment from the GITR code coupled to materials response models are presented. Specifically, the modeled and experimental W I emission spectroscopy data for a 429.4 nm line and net erosion through the target and collector mass difference measurements are compared. Furthermore, the methodology provides predictions of observable quantities of interest with quantified uncertainty, allowing estimation of moments, together with the sensitivities to plasma temperature and density.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

High-Fidelity Computational Studies of Intermediate Pressure Capacitively Coupled Plasmas

This report discussed progress made in the development of a computational model for intermediate pressure capacitively coupled plasma discharge. A new full fidelity argon chemistry model has been developed that includes electron, argon ion, three lumped states for electronically excited species, and the background ground state argon. As such the mechanism has been validated over a wide range of intermediate pressure conditions from 100 mTorr to a few Torr. Uncertainties in the electron impact cross sections and the rate coefficients for the reactions are propagated through the model to establish uncertainties that emerge in the model due the reaction mechanism and its impact on the discharge properties. The model is therefore validated in face of uncertainties.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Minimization of Measurement Uncertainty in Optical Frequency Domain Reflectometry

Optical frequency domain reflectometry (OFDR) is a technique for interrogating optical fiber sensors to generate relative, quasi-distributed measurements. Although Optical frequency domain reflectometry (OFDR) is increasingly being adopted for aerospace, energy production, and structural monitoring applications, the quantification of uncertainty for OFDR measurements has not been developed beyond sparse empirical relationships. To address this knowledge gap, an uncertainty metric for OFDR measurements was developed. This uncertainty metric was applied to weight the edges between OFDR measurements on directed correlation graphs and analyzed to minimize the cumulative uncertainty. In conclusion, this work is the first to propose an uncertainty metric for OFDR and provides a generalized mathematical framework for optimizing OFDR hardware selection, optical fiber sensor selection, and postprocessing strategy.

42 ENGINEERING↗
DOE OSTI2022

Quantification of neural networks uncertainties with applications to SAFARI-1 axial neutron flux profiles

Deep Neural Networks (DNNs) have been widely used as a data-driven modelling tool in nuclear engineering. However, as a Machine Learning model, Artificial Neural Network (ANN) predictions are subjected to uncertainties originating from the noise in training data, incomplete coverage of the domain, and imperfect neural network architectures. In this work, we target at quantifying the prediction/approximation uncertainties of ANNs using Monte Carlo Dropout (MCD), as well as Bayesian Neural Networks (BNNs) which are solved by variational inference. With a demonstration problem in which neural networks are used to predict the assembly axial neutron flux profiles, the results have shown that the three different neural network models (regular DNNs, DNNs solved with MCD and BNNs) can produce results that agree very well among each other and with the measurement data, on cycles that are not used in the training process. Besides the excellent generalization capability, the uncertainty bands produced by MCD and BNN agree very well, and in general, they can fully envelop the noisy measurement data points. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Destructive Analysis of TRISO Particles: Crush/Burn/Leach Followed by Davies-Gray Titration and IDMS

The accurate accounting of nuclear materials is a cornerstone of international nuclear safeguards. One emerging challenge in this domain is the fabrication of TRIstructural ISOtropic (TRISO) particle fuels. Although these innovative fuel forms are critical for advanced reactor applications, their robust refractory ceramics and coating compositions present significant obstacles to destructive analysis (DA) methods. Ensuring full and quantitative recovery from these particles is essential for accurate mass accountancy. The current study was initiated to address these challenges, first by validating a previously established destructive method developed by Oak Ridge National Laboratory (ORNL) for the quantitative recovery of uranium from TRISO particles and then following that process with uranium content determination through isotope dilution mass spectrometry (IDMS) and Davies-Gray titration. This study expands on the scope of a digestive method that was developed under the Advanced Gas Reactor Fuel Development and Qualification program and is currently implemented in both the Coated Particle Fuel Development Laboratory and Irradiated Fuels Examination Laboratory at ORNL. The success of the previous Advanced Gas Reactor work relied on developing a DA method to evaluate the fabrication process and reactor experiments. The methodology described in this report was designed to rigorously investigate the efficacy of the crush/burn/leach sample preparation of TRISO particles; it aims to quantify uranium recovery while also assessing the effects of TRISO constituents (e.g., silicon and zirconium) on analytical precision and accuracy. By comparing the results from the titration method and IDMS, we sought to determine whether existing analytical procedures accepted by the International Atomic Energy Agency (IAEA) could be effectively translated to TRISO fuel forms. The team employed an approach that involved processing replicate TRISO samples, optimizing the milling (i.e., crushing) step and performing serial leaches. The elemental composition of the analytical samples was examined to prepare for interference studies in the second year of this project. The integration of gamma spectrometry to verify residual uranium activity further strengthened the validation. Statistical methods were applied to the collected data to evaluate the uncertainties arising from sampling, sample preparation and uranium quantification. These uncertainties were then compared to the IAEA’s international target values (ITVs). Additional data collected in upcoming project work will strengthen the uncertainty estimates. Ultimately, it is hoped that this project will contribute materially to the body of work related to characterization of TRISO based fuels for the purpose of material accountancy and its applications to international safeguards.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Opinion: The importance of historical and paleoclimate aerosol radiative effects

Abstract. Estimating past aerosol radiative effects and their uncertainties is an important topic in climate science. Aerosol radiative effects propagate into large uncertainties in estimates of how present and future climate evolves with changing greenhouse gas emissions. A deeper understanding of how aerosols affected the atmospheric energy budget under past climates is hindered in part by a lack of relevant paleo-observations and in part because less attention has been paid to the problem. Because of the lack of information we do not seek here to determine the change in the radiative forcing due to aerosol changes but rather to estimate the uncertainties in those changes. Here we argue that current uncertainties from emission uncertainties (90 % confidence interval range spanning 2.8 W m−2) are just as large as model spread uncertainties (2.8 W m−2) in calculating preindustrial to present-day aerosol radiative effects. There are no estimates of radiative forcing for important aerosols such as wildfire and dust aerosols in most paleoclimate time periods. However, qualitative analysis of paleoclimate proxies suggests that changes in aerosols between different past climates are similar in magnitude to changes in aerosols between the preindustrial and present day; plus, there is the added uncertainty from the variability in aerosols and fires in the preindustrial. From the limited literature we crudely estimate a paleoclimate aerosol uncertainty for the Last Glacial Maximum relative to preindustrial of 4.8 W m−2, and we estimate the uncertainty in the aerosol feedback in the natural Earth system over the paleoclimate (Last Glacial Maximum to preindustrial) to be about 3.2 W m−2 K−1. In order to more accurately assess the uncertainty in historical aerosol radiative effects, we propose a new model intercomparison project, which would include multiple plausible emission scenarios tested across a range of state-of-the-art climate models over the historical period. These emission scenarios would then be compared to the available independent aerosol observations to constrain which are most probable. In addition, future efforts should work to characterize and constrain paleo-aerosol forcings and uncertainties. Careful propagation of aerosol uncertainties in the literature is required to ensure an accurate quantification of uncertainties in projections of future climate changes.

Environmental Sciences & Ecology↗
DOE OSTI2022

Examining Sources of Uncertainty in Coincidence Neutron Measurements of Spent Research Reactor Fuel [Slides]

The nature of spent fuel introduces many sources of uncertainty into measurement results. Quantification of those uncertainties is essential for understanding the relationship between NDA measurements and fissile mass. Modeling is a useful tool for identifying those characteristics that contribute significantly to measurement uncertainties and understanding how to account for those uncertainties when performing coincident neutron measurements.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Robust Deep Gaussian Process-Based Probabilistic Electrical Load Forecasting Against Anomalous Events

The abnormal events, such as the unprecedented COVID-19 pandemic, can significantly change the load behaviors, leading to huge challenges for traditional short-term forecasting methods. This article proposes a robust deep Gaussian processes (DGP)-based probabilistic load forecasting method using a limited number of data. Since the proposed method only requires a limited number of training samples for load forecasting, it allows us to deal with extreme scenarios that cause short-term load behavior changes. In particular, the load forecasting at the beginning of abnormal event is cast as a regression problem with limited training samples and solved by double stochastic variational inference DGP. The mobility data are also utilized to deal with the uncertainties and pattern changes and enhance the flexibility of the forecasting model. The proposed method can quantify the uncertainties of load forecasting outcomes, which would be essential under uncertain inputs. Extensive comparison results with other state-of-the-art point and probabilistic forecasting methods show that our proposed approach can achieve high forecasting accuracies with only a limited number of data while maintaining the excellent performance of capturing the forecasting uncertainties.

anomalous events↗
DOE OSTI2023

Refining Principal Stress Measurements in Reservoir Underburden in Regions of Induced Seismicity through Seismological Tools, Laboratory Experiments - Final Technical Report

This project developed methodologies to measure the in-situ principal stress in the deep subsurface through use of multiple independent, but complementary, seismic methods, laboratory verification, and development of theoretical frameworks. By leveraging existing regional and local datasets we developed, tested, and refined a set of diagnostic tools for determining the in-situ stress state with reduced uncertainty at and below reservoir depths (1.5-6 km). A set of novel tools was produced that are scale independent, such that their utility is equivalent on regional, field scale, and near borehole monitoring of principal stresses in reservoir underburden for carbon storage projects. During a 4-year Department of Energy (DOE) and Southern Company funded project, carried out by the Electric Power Research Institute (EPRI), Lawrence Livermore National Laboratory (LLNL), the University of Oklahoma (OU), and the U.S. Geological Survey (USGS), the project team developed methodologies to measure the far-field in-situ principal stress in the deep subsurface, leveraging induced seismicity data from waste-water disposal projects. These methodologies consisted in the use of well-established and technically advanced seismic processing methods, such as virtual seismometer method-moment tensor (VSM-MT) and shear wave splitting (SWS), that are adept at recovering the stress orientation and certain components of the stress tensor. These methods were applied to robust seismicity catalogs created with matched filter techniques near sites of active fluid disposal—a proxy for carbon storage sites where such datasets are more limited. Estimates of the stress orientation made with seismic processing tools were considered along with laboratory acoustic emission experiments conducted on rock samples from the region of interest. Stress orientations in the studied region do not vary significantly across distances of ~100 km, nor are they found to rotate through time as a consequence of local wastewater disposal, as previously speculated. Finally, the project team investigated the trade-offs among the different seismic methods and evaluated the range of uncertainty that is generated with these methodologies, which led to a practical use and refinement of the VSM-MT technique when it is applied to field datasets. Understanding the trade-offs between these different methods highlighted the potential benefits of improved quantification of uncertainties on stress field estimations.

58 GEOSCIENCES↗
DOE OSTI2020

Multiclass classification experiments

We seek a multiclass classifier that can satisfy the following requirements. 1. Predict among at least three classes. 2. Handle a moderately large number of correlated predictors. 3. Handle mixed categorical and continuous predictors. 4. Handle missing values (in some way). 5. Be trained with about n = 1,000 responses, and 6. Quantify prediction uncertainty. Based on 5. above, it is assumed that accuracy of prediction is paramount (relative to, say, runtime). All methods considered in this document take on the order of minutes (most take seconds) on a 2.8 GHz Quad-Core Intel Core i7 processor with 16GB RAM. Secondly, quantification of uncertainty is assumed to be a secondary task, since, with this small data size, resampling methods (i.e. bootstrapping) are possible. Further studies should quantify the feasibility and accuracy of resampling methods, and/or other methods, for quantifying uncertainty. R was used for all software.

97 MATHEMATICS AND COMPUTING↗