Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A neural-network-enhanced parameter-varying framework for multi-objective model predictive control applied to buildings

Management of the electrical grid is becoming more complex due to the increased penetration of alternative energy generation technologies and a broadening diversity of electric loads. This complexity creates challenges in balancing demand and generation that can increase the potential for grid instabilities. One effective way to address this issue is to leverage previously unexploited demand flexibility through advanced control strategies. In this work, we propose an advanced control method, called adaptive neural parameter-varying model predictive control (ANPV-MPC), to control the temperature and energy consumption of a building via its Heating, Ventilation, and Air Conditioning system. ANPV-MPC combines key ideas in parameter-varying control, adaptive control, and online learning strategies to bridge the gap between computationally efficient linear model predictive control and more accurate nonlinear model predictive control. The novelty in ANPV-MPC is the use of a physics-inspired Bayesian neural network to estimate the coefficients of the parameter-varying linear control model. The Bayesian neural network additionally provides uncertainty estimates, triggering online training to capture evolving building system conditions. We show that ANPV-MPC can approximate the building system dynamics with a 28.39% higher accuracy than traditional linear model predictive control, resulting in 36.23% better control performance without increasing complexity of the optimal control problem. ANPV-MPC also adapts in real time to previously unseen conditions using online learning, further improving its performance.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Isopropanol dehydration reaction rate kinetics measurement using H 2 O time histories

H 2 O formation during thermal decomposition of isopropanol was measured behind reflected shock waves at temperatures ranging from 1127 to 1621 K at an average pressure of 1.42 atm using a laser absorption technique. Of the five modern chemical kinetics models used to compare the H 2 O time histories, the model from Li et al (Combust. Flame 2019;207:171-185) showed the best overall agreement. Sensitivity and rate of production analyses using the Li et al model (as well as those from AramcoMech 3.0, CRECK, and Togbe et al (Energy Fuel. 2011;25:676-683)) showed unimolecular dehydration of isopropanol, iC 3 H 7 OH ⇌ H 2 O + C 3 H 6 (R1), is nearly the sole reaction controlling H2O production at early times, allowing for an a priori measurement of the forward rate constant k 1 . The Arrhenius expression k1 (s –1 ) = 2.60 × 10 13 exp(-31 120 K/T) was determined to represent best the data from this study. According to the models and previous experimental investigations, the pressure investigated is well within the high-pressure limit (HPL) for this reaction. Additional, higher-pressure experiments also confirmed the HPL assumption. An uncertainty analysis was performed by varying secondary reactions within their uncertainties and examining their effect on the overall prediction, establishing an uncertainty within ±20% for all but the highest temperature cases, which have a maximum uncertainty of ±40%. Experiments conducted with a radical trapper, toluene, showed little influence from radical chemistry, suggesting this estimated uncertainty is fairly conservative. Experimental data from Heyne et al (Z Phys Chem. 2015;229:881-907) were found to be in good agreement with the rate measurements from this study and, therefore, a second Arrhenius expression, k 1 (s –1 ) = 2.11 × 10 13 exp(-30 820 K/T), was found to represent both datasets well. This second expression has a larger temperature range of 976-1621 K. Here the present study provides the first high-temperature data collected for this reaction, adding to the limited data available for isopropanol in the literature.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Quantitative assessment of Distributed Acoustic Sensing at the Source Physics Experiment, Phase II

In this report, we assess the data recorded by a Distributed Acoustic Sensing (DAS) cable deployed during the Source Physics Experiment, Phase II (DAG) in comparison with the data recorded by nearby 4.5-Hz geophones. DAS is a novel recording method with unprecedented spatial resolution, but there are significant concerns around the data fidelity as the technology is ramped up to more common usage. Here we run a series of tests to quantify the similarity between DAS data and more conventional data and investigate cases where the higher spatial resolution of the DAS can provide new insights into the wavefield. These tests include 1D modeling with seismic refraction and bootstrap uncertainties, assessing the amplitude spectra with distance from the source, measuring the frequency dependent inter-station coherency, estimating time-dependent phase velocity with beamforming and semblance, and measuring the cross-correlation between the geophone and the particle velocity inferred from the DAS. In most cases, we find high similarity between the two datasets, but the higher spatial resolution of the DAS provides increased details and methods of estimating uncertainty.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Quantitative assessment of Distributed Acoustic Sensing at the Source Physics Experiment (Phase II)

In this report, we assess the data recorded by a Distributed Acoustic Sensing (DAS) cable deployed during the Source Physics Experiment, Phase II (DAG) in comparison with the data recorded by nearby 4.5-Hz geophones. DAS is a novel recording method with unprecedented spatial resolution, but there are significant concerns around the data fidelity as the technology is ramped up to more common usage. Here we run a series of tests to quantify the similarity between DAS data and more conventional data and investigate cases where the higher spatial resolution of the DAS can provide new insights into the wavefield. These tests include 1D modeling with seismic refraction and bootstrap uncertainties, assessing the amplitude spectra with distance from the source, measuring the frequency dependent inter-station coherency, estimating time-dependent phase velocity with beamforming and semblance, and measuring the cross-correlation between the geophone and the particle velocity inferred from the DAS. In most cases, we find high similarity between the two datasets, but the higher spatial resolution of the DAS provides increased details and methods of estimating uncertainty.

58 GEOSCIENCES↗
DOE OSTI2021

Spherical fitting for oscilloscope film trace reading

This report describes a spherical fitting algorithm that can be used for estimating the oscilloscope film trace coordinates. This algorithm was adopted from a least square algebraic spherical fitting algorithm developed by the author earlier for photovoltaic velocimetry applications. Preliminary assessment suggests that the algorithm may be used for optimizing the coordinates manually digitized by the user, or may be used as an uncertainty estimator for the user’s film reading uncertainties.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Quantifying uncertainty in Pareto estimates of global lake area

Abstract Size is a critical factor determining the rate and occurrence of specific lake processes such as carbon sequestration and greenhouse gas emissions and emerging evidence suggests that small lakes in particular have particularly large CO 2 flux rates. Because we do not have a complete census of all lakes, upscaling estimates of such processes to small lakes at broad spatial scales requires the use of lake size‐abundance distributions rather than empirical measurements of area. Existing lake census efforts are incomplete such that as lakes become smaller, they are more likely to be omitted either because they are too small to be resolved from remote sensing products or because of limited ground surveying effort (i.e., “censoring” of small lakes relative to large lakes). The present study explores one potential shortcoming of prior approaches estimating global lake area using lake size‐abundance distributions. Namely, that these prior approaches rely on frequentist curve fitting techniques combined with an ad‐hoc cutoff determination strategy (visual inspection to determine a likely censoring point). This yields an over‐exact lake area estimate that is typically reported with no uncertainty bounds. I show how these shortcomings can be addressed with a Bayesian model that produces larger estimates of lake area uncertainty relative to the typical approach. When used as part of a sensitivity analysis, such an approach has the potential to enable more robust intercomparisons among studies of aquatic processes upscaling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Radar-based Snow Property Profile Retrievals for NSA

The product contains estimated snow microphysical properties retrieved primarily from vertically-profiling radar observations using a priori constraints that are dependent on atmospheric state. The product provides data at 1-minute time resolution, including snowfall rate at the surface and vertical profiles at 300-meter resolution of snow particle size distribution parameters and snow water contents. Estimated uncertainties for the snowfall rates and snow water contents are also provided. The product is obtained using an optimal estimation retrieval in which radar forward model and a priori state characteristics are based on expected snow particle microphysical and radar scattering properties evaluated from field experiment data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Equations of state, phase relations, and oxygen fugacity of the Ru-RuO 2 buffer at high pressures and temperatures

Experimental studies and measurements of inclusions in diamonds show that ferric iron components are increasingly stabilized with depth in the mantle. To determine the thermodynamic stability of such components, their concentration needs to be measured at known oxygen fugacities. The metal-oxide pair Ru and RuO 2 are ideal as an internal oxygen fugacity buffer in high-pressure experiments. Both phases remain solid to high temperatures and react minimally with silicates, only exchanging oxygen. To calculate oxygen fugacities at high pressure and temperature, however, requires information on the phase relations and equation of state properties of the solid phases. We have made in situ synchrotron X-ray diffraction measurements in a multi-anvil press on mixtures of Ru and RuO 2 to 19.4 GPa and 1473 K with which we have determined phase relations of the RuO 2 phases and derived thermal equations of state (EoS) parameters for both Ru and RuO 2 . Rutile-structured RuO 2 was found to undergo two phase transformations, first at ~7 GPa to an orthorhombic structure and then above 12 GPa to a cubic structure. The phase boundary of the cubic phase was constrained for the first time at high pressure and temperature. We have derived a continuous Gibbs free energy expression for the tetragonal and orthorhombic phases of RuO 2 by fitting the second-order phase transition boundary and P-V-T data for both phases, using a model based on Landau theory. The transition between the orthorhombic and cubic phases was then used along with EoS terms derived for both phases to determine a Gibbs free energy expression for the cubic phase. We have used these data to calculate the oxygen fugacity of the Ru + O 2 = RuO 2 equilibrium, which we have parameterized as a single polynomial across the stability fields of all three phases of RuO 2 . The expression is log 10 f O 2 (Ru – RuO 2 ) = (7.782 – 0.00996P + 0.001932P 2 – 3.76 × 10 –5 P 3 ) + (–13 763 + 592P – 3.955P 2 )/T + (–1.05 × 10 6 – 4622P)/T 2 , which should be valid from room pressure up to 25 GPa and 773–2500 K, with an estimated uncertainty of 0.2 log units. Our calculated fO 2 is shown to be up to 1 log unit lower than estimates that use previous expressions or ignore EoS terms.

Armstrong, Katherine↗
DOE OSTI2025

Accelerating Hamiltonian Monte Carlo for Bayesian inference in neural networks and neural operators

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high dimensionality of the network’s parameter space and the non-convexity of their posterior distributions. Therefore, various approximation techniques, such as variational inference (VI) or stochastic gradient MCMC, are often employed to infer the posterior distribution of the network parameters. Such approximations introduce inaccuracies in the inferred distributions, resulting in unreliable uncertainty estimates. In this work, we propose a hybrid approach that combines inexpensive VI and accurate HMC methods to efficiently and accurately quantify uncertainties in neural networks and neural operators. The proposed approach leverages an initial VI training on the full network. We examine the influence of individual parameters on the prediction uncertainty, which shows that a large proportion of the parameters do not contribute substantially to uncertainty in the network predictions. This information is then used to significantly reduce the dimension of the parameter space, and HMC is performed only for the subset of network parameters that strongly influence prediction uncertainties. This yields a framework for accelerating the full batch HMC for posterior inference in neural networks. We demonstrate the efficiency and accuracy of the proposed framework on deep neural networks and operator networks, showing that inference can be performed for large networks with tens to hundreds of thousands of parameters. Finally, we show that this method can effectively learn surrogates for complex physical systems by modeling the operator that maps from upstream conditions to wall-pressure data on a cone in hypersonic flow.

Bayesian inference↗
DOE OSTI2022

Uncertainty-aware mixed-variable machine learning for materials design

Abstract Data-driven design shows the promise of accelerating materials discovery but is challenging due to the prohibitive cost of searching the vast design space of chemistry, structure, and synthesis methods. Bayesian optimization (BO) employs uncertainty-aware machine learning models to select promising designs to evaluate, hence reducing the cost. However, BO with mixed numerical and categorical variables, which is of particular interest in materials design, has not been well studied. In this work, we survey frequentist and Bayesian approaches to uncertainty quantification of machine learning with mixed variables. We then conduct a systematic comparative study of their performances in BO using a popular representative model from each group, the random forest-based Lolo model (frequentist) and the latent variable Gaussian process model (Bayesian). We examine the efficacy of the two models in the optimization of mathematical functions, as well as properties of structural and functional materials, where we observe performance differences as related to problem dimensionality and complexity. By investigating the machine learning models’ predictive and uncertainty estimation capabilities, we provide interpretations of the observed performance differences. Our results provide practical guidance on choosing between frequentist and Bayesian uncertainty-aware machine learning models for mixed-variable BO in materials design.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Probabilistic Prediction of Geomagnetic Storms and the K p index

Geomagnetic activity is often described using summary indices to summarize the likelihood of space weather impacts, as well as when parameterizing space weather models. The geomagnetic index K p in particular, is widely used for these purposes. Current state-of-the-art forecast models provide deterministic K p predictions using a variety of methods – including empirically-derived functions, physics-based models, and neural networks – but do not provide uncertainty estimates associated with the forecast. This paper provides a sample methodology to generate a 3-hour-ahead K p prediction with uncertainty bounds and from this provide a probabilistic geomagnetic storm forecast. Specifically, we have used a two-layered architecture to separately predict storm (K p ≥ 5 – ) and non-storm cases. As solar wind-driven models are limited in their ability to predict the onset of transient-driven activity we also introduce a model variant using solar X-ray flux to assess whether simple models including proxies for solar activity can improve the predictions of geomagnetic storm activity with lead times longer than the L1-to-Earth propagation time. By comparing the performance of these models we show that including operationally-available information about solar irradiance enhances the ability of predictive models to capture the onset of geomagnetic storms and that this can be achieved while also enabling probabilistic forecasts.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Ab Initio Limits of Atomic Nuclei

We predict the limits of existence of atomic nuclei, the proton and neutron drip lines, from the light through medium-mass regions. Starting from a chiral two- and three-nucleon interaction with good saturation properties, we use the valence-space in-medium similarity renormalization group to calculate ground-state and separation energies from helium to iron, nearly 700 isotopes in total. Here, we use the available experimental data to quantify the theoretical uncertainties for our ab initio calculations towards the drip lines. Where the drip lines are known experimentally, our predictions are consistent within the estimated uncertainty. For the neutron-rich sodium to chromium isotopes, we provide predictions to be tested at rare-isotope beam facilities.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2023

Uncertain of uncertainties? A comparison of uncertainty quantification metrics for chemical data sets

Abstract With the increasingly more important role of machine learning (ML) models in chemical research, the need for putting a level of confidence to the model predictions naturally arises. Several methods for obtaining uncertainty estimates have been proposed in recent years but consensus on the evaluation of these have yet to be established and different studies on uncertainties generally uses different metrics to evaluate them. We compare three of the most popular validation metrics (Spearman’s rank correlation coefficient, the negative log likelihood (NLL) and the miscalibration area) to the error-based calibration introduced by Levi et al. ( Sensors 2022 , 22 , 5540). Importantly, metrics such as the negative log likelihood (NLL) and Spearman’s rank correlation coefficient bear little information in themselves. We therefore introduce reference values obtained through errors simulated directly from the uncertainty distribution. The different metrics target different properties and we show how to interpret them, but we generally find the best overall validation to be done based on the error-based calibration plot introduced by Levi et al. Finally, we illustrate the sensitivity of ranking-based methods (e.g. Spearman’s rank correlation coefficient) towards test set design by using the same toy model ferent test sets and obtaining vastly different metrics (0.05 vs. 0.65).

Rasmussen, Maria H.↗
DOE OSTI2021

Geant4Reweight: a framework for evaluating and propagating hadronic interaction uncertainties in Geant4

Geant4Reweight is an open-source C++ framework that allows users to weight tracks produced by the Geant4 particle transport Monte Carlo simulation according to hadron interaction cross section variations and estimate uncertainties in Geant4 interaction models by comparing the simulation’s hadron interaction cross section predictions to data. The ability to weight hadron transport as simulated by Geant4 is crucial to the propagation of systematic uncertainties related to secondary hadronic interactions in current and upcoming neutrino oscillation experiments, including MicroBooNE, NOvA, and DUNE, aswell as hadron test beam experiments such as ProtoDUNE. Here, we provide motivation for weighting hadron tracks in Geant4 in the context of systematic uncertainty propagation, a description of Geant4’s transport simulation technique, and a description of our weighting technique and fitting framework in the momentum range 0–10 GeV/c, which is typical for the hadrons produced by neutrino interactions in these experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Robust calibration of non-perturbative models with history matching

We apply, for the first time, Bayes Linear Emulation and History Matching to the calibration of non-perturbative models in Monte Carlo event generators. In contrast to the usual approach of "Monte Carlo tuning", History Matching does not result in best-fit plus ellipsoidal parameter uncertainty estimates but instead identifies all parameter space regions that are consistent with data. This approach leads to a systematic and robust quantification of parametric uncertainties in the models, especially in those challenging cases where different, possibly disjoint, regions of parameter space deliver similar results, which are usually not properly treated with current methodology. We highlight the power of this method with the hadronisation models available through Sherpa : the built-in cluster fragmentation Ahadic and string fragmentation through an interface to Pythia .

Iskauskas, Andrew [Durham U. (main)] (ORCID:000000↗
DOE OSTI2023

Multi-Fidelity Gaussian Process for Distribution System Voltage Probabilistic Estimation with PVs

The increasing penetration of behind-the-meter PVs causes challenges to maintain voltage security due to the lack of distribution system visibility. This paper proposes a nonlinear autoregressive Gaussian process (NARGP) approach to fuse limited number of SCADA/AMI data together with historical pseudo measurements for distribution node voltage probabilistic estimation. The high-fidelity SCADA data are fused with the low-fidelity AMI and pseudo measurements by the autoregressive algorithm embedded in the Gaussian process. This allows us to use multi-fidelity data to achieve entire distribution system voltage visibility. Numerical results carried out on the IEEE 123node system demonstrate that the NARGP method is able to obtain high accuracy in estimating bus voltage and quantifying estimation uncertainties as compared to other approaches.

distribution system estimation↗
DOE OSTI2020

Discovering the nature of neutrinos: How nuclear theory will advance this grand endeavor. Final report

Why is there more matter than antimatter in the visible universe? Are neutrinos their own antiparticles? These are some of the most profound questions in science. The detection of a (0vββ) neutrinoless doublebeta decay and the measurement of its half-life is one of the most important experimental endeavors in science because it will answer these questions. Paramount to these measurements are accurate predictions with quantified uncertainties of the 0vββ-decay nuclear transitions, especially for the germanium-76 and xeon-136 nuclei, two candidate materials for building the next generation of DOE funded 0vββ-decay experiments. These predictions will guide the Office of Science’s down selection of experiments as well as aid in determining how much material is needed by these experiments. We studied a specific difficult to assess source of uncertainty that will impact coming microscopic predictions, uncertainty which arises from an incomplete yet systematically improvable model of interactions between nucleons and of nucleons with the other particles involved in decay process, referred to as the theory uncertainty. We employed a surrogate model of the germanium-76 nucleus, and its decay products, just detailed enough to adequately mimic the decaying nucleons need for a reasonable measure of this uncertainty and nothing more, avoiding the immense computational expense required in quantifying uncertainties of the full calculation. We found that microscopic calculations of this process can be expected to achieve relative theory uncertainties around 30%, including an unconstrained contribution that had the potential to spoil microscopic calculations. This results in a nearly order of magnitude on previously estimated uncertainties for this rare decay process.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗