Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Multifidelity uncertainty quantification with models based on dissimilar parameters

Multifidelity uncertainty quantification (MF UQ) sampling approaches have been shown to significantly reduce the variance of statistical estimators while preserving the bias of the highest-fidelity model, provided that the low-fidelity models are well correlated. However, maintaining a high level of correlation can be challenging, especially when models depend on different input uncertain parameters, which drastically reduces the correlation. Existing MF UQ approaches do not adequately address this issue. In this work, we propose a new sampling strategy that exploits a shared space to improve the correlation among models with dissimilar parameterization. We achieve this by transforming the original coordinates onto an auxiliary manifold using the adaptive basis (AB) method (Tipireddy and Ghanem, 2014). The AB method has two main benefits: (1) it provides an effective tool to identify the low-dimensional manifold on which each model can be represented, and (2) it enables easy transformation of polynomial chaos representations from high- to low-dimensional spaces. This latter feature is used to identify a shared manifold among models without requiring additional evaluations. Here we present two algorithmic flavors of the new estimator to cover different analysis scenarios, including those with legacy and non-legacy high-fidelity (HF) data. We provide numerical results for analytical examples, a direct field acoustic test, and a finite element model of a nuclear fuel assembly. For all examples, we compare the proposed strategy against both single-fidelity and MF estimators based on the original model parameterization.

42 ENGINEERING↗
DOE OSTI2025

Analysis and optimization of seismic monitoring networks with Bayesian optimal experimental design

SUMMARY Monitoring networks increasingly aim to assimilate data from a large number of diverse sensors covering many sensing modalities. Bayesian optimal experimental design (OED) seeks to identify data, sensor configurations or experiments which can optimally reduce uncertainty and hence increase the performance of a monitoring network. Information theory guides OED by formulating the choice of experiment or sensor placement as an optimization problem that maximizes the expected information gain (EIG) about quantities of interest given prior knowledge and models of expected observation data. Therefore, within the context of seismo-acoustic monitoring, we can use Bayesian OED to configure sensor networks by choosing sensor locations, types and fidelity in order to improve our ability to identify and locate seismic sources. In this work, we develop the framework necessary to use Bayesian OED to optimize a sensor network’s ability to locate seismic events from arrival time data of detected seismic phases at the regional-scale. This framework requires five elements: (i) A likelihood function that describes the distribution of detection and traveltime data from the sensor network, (ii) A prior distribution that describes a priori belief about seismic events, (iii) A Bayesian solver that uses a prior and likelihood to identify the posterior distribution of seismic events given the data, (iv) An algorithm to compute EIG about seismic events over a data set of hypothetical prior events, (v) An optimizer that finds a sensor network which maximizes EIG. Once we have developed this framework, we explore many relevant questions to monitoring such as: how to trade off sensor fidelity and earth model uncertainty; how sensor types, number and locations influence uncertainty; and how prior models and constraints influence sensor placement.

58 GEOSCIENCES↗
DOE OSTI2022

Moisture‐Budget Drivers of Global Projections of Meteorological Drought From Multiple GCM Large Ensembles

Future projections of global meteorological drought are evaluated in the Multi‐Model Large Ensemble Archive, including an evaluation of the atmospheric moisture budget, conditioned on drought years. Drought is defined as 5‐year running‐mean annual precipitation below some threshold, for example, 10th percentile. Drought increases in frequency over the subtropics, in addition to certain tropical regions, consistent with previous studies. Here, the moisture‐budget decomposition allows drought to be defined as mean‐flow, eddy, or feedback droughts, depending on which term in the equation contributes the largest negative interannual anomaly. In the historical climate, mean‐flow droughts constitute most droughts at low latitudes; eddy droughts are equally common at higher latitudes; feedback droughts (i.e., droughts exacerbated by land–atmosphere feedbacks) constitute almost all droughts in water‐limited subtropical/Mediterranean regions. The future drought increases are predominantly due to increases in feedback droughts in regions where these droughts are common historically but also over the Amazon. However, over most Mediterranean‐type regions mean‐flow droughts are also large contributors, resulting from dynamics. Eddy droughts also contribute to future increases along the equatorward flanks of historical eddy‐driven jets, likely reflecting poleward shifts therein. Model uncertainty is particularly large over the Amazon and Australia, a reflection of model diversity in processes associated with land‐atmosphere interaction. Based on these results, an availability of 3‐D atmospheric data from a wider swath of global climate model large ensembles could help constrain global drought projections based on the representation of drought mechanisms in the historical climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Modeling the smoky troposphere of the southeast Atlantic: a comparison to ORACLES airborne observations from September of 2016

The southeast Atlantic is home to well-defined smoke outflow from Africa coinciding vertically with extensive marine boundary-layer cloud decks, both reaching their climatological maxima in spatial extent around September. A framework is put forth for evaluating the performance of a range of global and regional aerosol models against observations made during the NASA ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) airborne mission in September 2016. The sparse airborne observations are first aggregated into 2o grid boxes and into three vertical layers: the cloud-topped marine boundary layer (MBL), the layer from cloud top to 3 km, and the 3-6 km layer. Aerosol extensive properties simulated for the entire study region for all September suggest that the 2016 ORACLES observations are reasonably representative of the regional monthly average, with systematic deviations of 30% or less. All six models typically place the bottom of the smoke layer at lower altitudes than do the airborne lidar observations by 300-1400 m, whereas model aerosol top heights are within 0-500 m of the observations. All but one of the models that report carbonaceous aerosol masses underestimate the ratio of particulate extinction to the masses, a proxy for mass extinction efficiency, in 3-6 km. Notable findings on individual models include that WRF-CAM5 predicts the mass of black carbon and organic aerosols with minor (~10% or less) biases. GEOS-5 overestimates the carbonaceous particle masses in the MBL by a factor of 3-6. Extinction coefficients in the free troposphere (FT) and above-cloud aerosol optical depth (ACAOD) are 10-30% lower in WRF-CAM5, 30-50% lower in GEOS-5, 10-40% higher in GEOS-Chem, 10-20% higher in EAM-E3SM except for the practically unbiased 3-6 km extinction, and 20-70% lower in the Unified Model, than the airborne in situ, lidar and sunphotometer measurements. ALADIN-Climate also underestimates the ACAOD, by 30%. GEOS-5 and GEOS-Chem predict carbon monoxide in the MBL with small (10% or less) negative biases, despite their overestimates of carbonaceous aerosol masses. Overall, this study highlights a new approach to utilizing airborne aerosol measurements for model diagnosis.

Shinozuka, Yohei↗
DOE OSTI2021

Uncertainty Quantification of Geophysical Inversion Using Stochastic Partial Differential Equations (LDRD #218329)

This report summarizes work completed under the Laboratory Directed Research and Development (LDRD) project "Uncertainty Quantification of Geophysical Inversion Using Stochastic Differential Equations." Geophysical inversions often require computationally expensive algorithms to find even one solution, let alone propagating uncertainties through to the solution domain. The primary purpose of this project was to find more computationally efficient means to approximate solution uncertainty in geophysical inversions. We found multiple computationally efficient methods of propagating Earth model uncertainty into uncertainties in solutions of full waveform seismic moment tensor inversions. However, the optimum method of approximating the uncertainty in these seismic source solutions was to use the Karhunen-Love theorem with data misfit residuals. This method was orders of magnitude more computationally efficient than traditional Monte Carlo methods and yielded estimates of uncertainty that closely approximated those of Monte Carlo. We will summarize the various methods we evaluated for estimating uncertainty in seismic source inversions as well as work toward this goal in the realm of 3-D seismic tomographic inversion uncertainty.

58 GEOSCIENCES↗
DOE OSTI2022

Multimodel ensemble predictions of precipitation using bayesian neural networks

Multimodel ensembling improves predictions and considers model uncertainties. In this study, we present a Bayesian Neural Network (BNN) ensemble approach for large-scale precipitation predictions based on a set of climate models. BNN infers spatiotemporally varying model weights and biases through the calibration against observations. This ensemble scheme of BNN sufficiently leverages individual model skill for accurate predictions as well as provides interpretability about which models contribute more to the ensemble prediction at which locations and times to inform model development. Additionally, BNN accurately quantifies epistemic uncertainty to avoid overconfident projections. We demonstrate BNN’s superior prediction performance to three state-of-the-art ensemble approaches and discuss its interpretability and uncertainty quantification.

Fan, Patrick↗
DOE OSTI2022

Multimodel Ensemble Predictions of Precipitation using Bayesian Neural Networks

Multimodel ensembling improves predictions and considers model uncertainties. In this study, we present a Bayesian Neural Network (BNN) ensemble approach for large-scale precipitation predictions based on a set of climate models. BNN infers spatiotemporally varying model weights and biases through the calibration against observations. This ensemble scheme of BNN sufficiently leverages individual model skill for accurate predictions as well as provides interpretability about which models contribute more to the ensemble prediction at which locations and times to inform model development. Additionally, BNN accurately quantifies epistemic uncertainty to avoid overconfident projections. We demonstrate BNN’s superior prediction performance to three state-of-the-art ensemble approaches and discuss its interpretability and uncertainty quantification.

Fan, Patrick↗
DOE OSTI2026

Assessing Photovoltaic Capacity Factor Variability Using Long-Term Satellite Derived Solar Resource Data Under Brazilian Climate

Accurate estimation of photovoltaic (PV) energy yield and its variability is essential for reducing financial risk and supporting reliable system planning for rapidly expanding PV markets. In Brazil, high solar adoption and increasing levels of distributed energy resources are beginning to introduce operational challenges such as curtailment and evolving grid requirements. Understanding how natural variability in solar resource propagates into PV system performance is therefore increasingly important for both project design and grid integration. Modern PV yield assessments commonly rely on multi-year meteorological datasets and probabilistic exceedance metrics (e.g., P50/P90) to quantify energy yield uncertainty for project financing. However, the implications of long-term solar resource variability for PV system design choices and high-adoption grid conditions remain less well characterized for rapidly expanding markets such as Brazil. In particular, understanding how weather-driven variability propagates into PV production distributions and capacity factor expectations is important for evaluating curtailment exposure, deployment strategies, and storage requirements in regions experiencing rapid growth of distributed and utility-scale PV. Seasonal and interannual variability in atmospheric conditions can produce substantial fluctuations in monthly PV energy production, which propagate into uncertainty in annual energy yield and capacity factor expectations. Characterizing this variability using long-term meteorological datasets allows probabilistic estimation of PV system performance and provides improved insight into the range of expected PV energy outcomes. This study explores the use of long-term satellite-derived meteorological data from the National Solar Radiation Database (NSRDB) to evaluate the variability of photovoltaic system performance across multiple locations in Brazil. Using a 27-year dataset (1998-2024), PV system simulations are performed to characterize the distribution of annual and seasonal capacity factors and energy yield outcomes, while propagating key sources of meteorological variability and model uncertainty through the PV modeling chain. The analysis also investigates the sensitivity of PV performance outcomes to key system design assumptions within the PV modeling chain, including tracking configuration and system sizing parameters. The resulting probabilistic performance characterization provides insight into how weather-driven variability influences PV production expectations and capacity factor distributions. These results provide a foundation for evaluating how weather-driven variability interacts with high PV adoption and potential storage or curtailment mitigation strategies.

14 SOLAR ENERGY↗
DOE OSTI2024

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models: Preprint

Uncertainty visualization is a key component in translating important insights from ensemble data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models for computationally expensive simulations, users can interact with more aspects of data spaces than ever before. However, the integration of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble visualization↗
DOE OSTI2021

Constraining $\mathcal{f(R)}$ gravity with a $\mathcal{k}$-cut cosmic shear analysis of the Hyper Suprime-Cam first-year data

Here, using Subaru Hyper Suprime-Cam (HSC) year 1 data, we perform the first k-cut cosmic shear analysis constraining both Λ CDM and f(R) Hu-Sawicki modified gravity. To generate the f(R) cosmic shear theory vector, we use the matter power spectrum emulator trained on COLA (COmoving Lagrangian Acceleration) simulations [Phys. Rev. D 103, 123525 (2021)]. The k-cut method is used to significantly down-weight sensitivity to small scale (k > 1h Mpc -1 ) modes in the matter power spectrum where the emulator is less accurate, while simultaneously ensuring our results are robust to baryonic feedback model uncertainty. We have also developed a test to ensure that the effects of poorly modeled small scales are nulled as intended. For Λ CDM we find S 8 =σ 8 (Ω m /0.3) 0.5 =0.789$^{+0.039}_{-0.022}$, while the constraints on the f(R) modified gravity parameters are prior dominated. In the future, the k-cut method could be used to constrain a large number of theories of gravity where computational limitations make it infeasible to model the matter power spectrum down to extremely small scales.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Non-uniform active learning for Gaussian process models with applications to trajectory informed aerodynamic databases

The ability to non-uniformly weight the input space is desirable for many applications, and has been explored for space-filling approaches. Increased interests in linking models, such as in a digital twinning framework, increases the need for sampling emulators where they are most likely to be evaluated. In particular, here we apply non-uniform sampling methods for the construction of aerodynamic databases. This paper combines non-uniform weighting with active learning for Gaussian Processes (GPs) to develop a closed-form solution to a non-uniform active learning criterion. We accomplish this by utilizing a kernel density estimator as the weight function. We demonstrate the need and efficacy of this approach with an atmospheric entry example that accounts for both model uncertainty as well as the practical state space of the vehicle, as determined by forward modeling within the active learning loop.

42 ENGINEERING↗
DOE OSTI2020

Modeling Nanoconfinement Effects Using Active Learning

Predicting the spatial configuration of gas in nanopores of is relevant in applications such as fluid flow forecasting and hydrocarbon reserves estimation. For example, shale reservoirs have suffered from computationally intractable multiscale problems, since fluid properties such as viscosity, density, and adsorption must be calculated by using expensive molecular dynamics (MD) simulations within each nanopore, whereas flow through these connected nanopores must be simulated at the micrometer scale. We utilize machine learning techniques to quickly and accurately model nanoscale confinement effects as an important step toward bridging the nano and micro scales. Our workflow is based on building and training physics-based deep-neural-networks models by learning from a database of MD calculations. The model accounts for the adsorption phenomenon by predicting the statistical distribution of gas inside nanopores. Because large databases of MD calculations are expensive to create, we investigate active learning (AL) as a data set construction strategy. In this workflow, new data are selected based on the model uncertainty via the query-by-committee approach. We show that our workflow obtains accurate models that generalize to real scanning electron microscopy geometries with 1/10th of the number of MD calculations required vs random data set generation. Our method enables the possibility of modeling nanoconfinement effects at the mesoscale, where complex connected sets of nanopores affect flow.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Bayesian inference of multi-messenger astrophysical data: Joint and coherent inference of gravitational waves and kilonovae

Multi-messenger observations of binary neutron star mergers can provide information on the neutron star’s equation of state (EOS) above the nuclear saturation density by directly constraining the mass-radius diagram. We present a Bayesian framework for joint and coherent analyses of multi-messenger binary neutron star signals. As a first application, we analyze the gravitational-wave GW170817 and the kilonova (kN) AT2017gfo data. These results are then combined with the most recent X-ray pulsar analyses of PSR J0030+0451 and PSR J0740+6620 to obtain new EOS constraints.We extend the bajes infrastructure with a joint likelihood for multiple datasets, support for various semi-analytical kN models, and numerical-relativity (NR)-informed relations for the mass ejecta, as well as a technique to include and marginalize over modeling uncertainties. The analysis of GW170817 used the TEOBResumS effective-one-body waveform template to model the gravitational-wave signal. The analysis of AT2017gfo used a baseline multicomponent spherically symmetric model for the kN light curves. Various constraints on the mass-radius diagram and neutron star properties were then obtained by resampling over a set of ten million parameterized EOSs, which was built under minimal assumptions (general relativity and causality).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Model certainty in cellular network-driven processes with missing data

Mathematical models are often used to explore network-driven cellular processes from a systems perspective. However, a dearth of quantitative data suitable for model calibration leads to models with parameter unidentifiability and questionable predictive power. Here we introduce a combined Bayesian and Machine Learning Measurement Model approach to explore how quantitative and non-quantitative data constrain models of apoptosis execution within a missing data context. We find model prediction accuracy and certainty strongly depend on rigorous data-driven formulations of the measurement, and the size and make-up of the datasets. For instance, two orders of magnitude more ordinal (e.g., immunoblot) data are necessary to achieve accuracy comparable to quantitative (e.g., fluorescence) data for calibration of an apoptosis execution model. Notably, ordinal and nominal (e.g., cell fate observations) non-quantitative data synergize to reduce model uncertainty and improve accuracy. Finally, we demonstrate the potential of a data-driven Measurement Model approach to identify model features that could lead to informative experimental measurements and improve model predictive power.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Leveraging machine learning to enhance aerosol classification using Single-Particle Mass Spectrometry

Advancing automated classification of atmospheric aerosols from Single-Particle Mass Spectrometry (SPMS) data remains challenging due to overlapping ion signatures, compositional diversity, and limited labeled data. This study evaluates supervised and semi-supervised learning frameworks to enhance aerosol identification by jointly leveraging labeled and unlabeled spectra. Four models were compared: a supervised Support Vector Machine (SVM), a self-training SVM, a stacked autoencoder classifier, and a stacked autoencoder trained using a temporal-ensembling Mean Teacher approach. All models achieved high and stable accuracies (90.0 %–91.1 %), surpassing previous results on the same dataset (87 %) and matching the performance of state-of-the-art deep learning methods. Despite small global metric differences (≤ 1 %), semi-supervised variants yielded up to 5 %–10 % improvements for compositionally rare particle types – such as soot (0.77 % of spectra, F1-score: 0.93–0.97) and hazelnut pollen (0.98 % of spectra, F1-score: 0.97–1.00) – equating to roughly ∼ 187 additional correctly classified spectra. These gains are scientifically significant, as such rare particles exert disproportionate influence on radiative absorption and ice nucleation processes; their improved detection reduces modeled uncertainties in aerosol absorption optical depth and mixed-phase cloud ice nucleation rates. The models' residual misclassifications (≈ 9 %) largely arise from true spectral overlap among chemically adjacent species (e.g., Na- vs. K-feldspar, coated vs. uncoated feldspars), reflecting physical compositional continuity rather than algorithmic error. Collectively, these findings demonstrate that leveraging unlabeled data to learn robust spectral representations and refine classification enhances both fidelity and interpretability, bridging data-driven analysis with aerosol–climate process understanding.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Model and Standard Operating Procedures Supporting Signal Variation Flow Graph Analysis

This document will describe the principles of the Signal Variation Flow Technique, and the uncertainty models generated using it. We focus on the capture of the variation between the ideal signal and the measured signal. The ideal signal is defined to represent the signal output of a system whose full state behavior is known, with no variation in environment or during operation, and whose photons trajectories are not modified by the object. A CT uncertainty analysis is the result of two main steps. First, the radiography regime extends from the source to the collected image, which is 2D in the case of standard CT. This maps all upstream uncertainties into the variation observed on the radiograph and captures all variation in the physical domain. Second, the reconstruction regime extends from the captured images to the reconstructed 3D image. This regime is purely in the mathematical domain and corrects reconstruction algorithm artifacts/anomalies. The present work focuses on building the model through the radiography regime. The reconstruction regime is expected to be largely a study of algorithmic sensitivity, requiring the definition of a range of standardized tests through which the algorithms would be run. Radiographic variation would then be mapped through reconstruction sensitivities to predict the signal variation in the final image. An incomplete list for the reconstructed image variation output basis includes voxel density, edge blur and length variation, in analogous fashion to the basis functions presented in this work. The signal variation occurs in several forms at the radiograph. These forms are gathered into a complete basis set of functions describing all variation on the radiograph. The scale of each basis function is calculated independently via a specific SVFG. This includes 0D pixel noise (0DI), 0D energy noise (0DE), 1D blur (1DB), 1D length (1DL) or 2D position (2DP). These models are orthogonal in that they each explore a space in the signal variation domain that cannot be reached by the other basis functions. The variation basis functions, and associated SVFG models are split by output dimensionality, a term loosely used for categorization, and explained further below.

42 ENGINEERING↗
DOE OSTI2025

Large-scale deep learning for metastasis detection in pathology reports

Objectives No existing algorithm can reliably identify metastasis from pathology reports across multiple cancer types and the entire US population. In this study, we develop a deep learning model that automatically detects patients with metastatic cancer by using pathology reports from many laboratories and of multiple cancer types. Materials and Methods We use 60 471 unstructured pathology reports from 4 Surveillance, Epidemiology, and End Results (SEER) registries. The reports were coded into 1 of 3 labels: metastasis negative, metastases positive, or metastasis undetermined. We utilize a task-specific deep neural network trained from scratch and compare its performance with a widely used large language model (LLM). Results Our deep learning architecture trained on task-specific data outperforms a general-purpose LLM, with a recall of 0.894 compared to 0.824. We quantified model uncertainty and used it to defer reports for human review. We found that retaining 72.9% of reports increased recall from 0.894 to 0.969. Discussion A smaller deep learning architecture trained on task-specific data outperforms a general LLM. Equally critical to model performance is the incorporation of uncertainty quantification, achieved here through an abstention mechanism. Conclusions This study’s finding demonstrate the feasibility of developing algorithms to automatically identify metastatic cancer cases from unstructured pathology reports.

machine learning↗
DOE OSTI2022

Towards precise and accurate calculations of neutrinoless double-beta decay

We present the results of a National Science Foundation Project Scoping Workshop, the purpose of which was to assess the current status of calculations for the nuclear matrix elements governing neutrinoless double-beta decay and determine if more work on them is required. After reviewing important recent progress in the application of effective field theory, lattice quantum chromodynamics, and ab initio nuclear-structure theory to double-beta decay, we discuss the state of the art in nuclear-physics uncertainty quantification and then construct a roadmap for work in all these areas to fully complement the increasingly sensitive experiments in operation and under development. The roadmap includes specific projects in theoretical and computational physics as well as the use of Bayesian methods to quantify both intra- and inter-model uncertainties. Here, the goal of this ambitious program is a set of accurate and precise matrix elements, in all nuclei of interest to experimentalists, delivered together with carefully assessed uncertainties. Such calculations will allow crisp conclusions from the observation or non-observation of neutrinoless double-beta decay, no matter what new physics is at play.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗