Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Data-Efficient Dimensionality Reduction and Surrogate Modeling of High-Dimensional Stress Fields

Tensor datatypes representing field variables like stress, displacement, velocity, etc., have increasingly become a common occurrence in data-driven modeling and analysis of simulations. Numerous methods [such as convolutional neural networks (CNNs)] exist to address the meta-modeling of field data from simulations. As the complexity of the simulation increases, so does the cost of acquisition, leading to limited data scenarios. Modeling of tensor datatypes under limited data scenarios remains a hindrance for engineering applications. Here, in this article, we introduce a direct image-to-image modeling framework of convolutional autoencoders enhanced by information bottleneck loss function to tackle the tensor data types with limited data. The information bottleneck method penalizes the nuisance information in the latent space while maximizing relevant information making it robust for limited data scenarios. The entire neural network framework is further combined with robust hyperparameter optimization. We perform numerical studies to compare the predictive performance of the proposed method with a dimensionality reduction-based surrogate modeling framework on a representative linear elastic ellipsoidal void problem with uniaxial loading. The data structure focuses on the low-data regime (fewer than 100 data points) and includes the parameterized geometry of the ellipsoidal void as the input and the predicted stress field as the output. The results of the numerical studies show that the information bottleneck approach yields improved overall accuracy and more precise prediction of the extremes of the stress field. Additionally, an in-depth analysis is carried out to elucidate the information compression behavior of the proposed framework.

artificial intelligence↗

Enabling Hyper-Differential Sensitivity Analysis for Ill-Posed Inverse Problems

Inverse problems constrained by partial differential equations (PDEs) play a critical role in model development and calibration. In many applications, there are multiple uncertain parameters in a model that must be estimated. However, high dimensionality of the parameters and computational complexity of the PDE solves make such problems challenging. A common approach is to reduce the dimension by fixing some parameters (which we will call auxiliary parameters) to a best estimate and use techniques from PDE-constrained optimization to estimate the other parameters. In this article, hyper-differential sensitivity analysis (HDSA) is used to assess the sensitivity of the solution of the PDE-constrained optimization problem to changes in the auxiliary parameters. Foundational assumptions for HDSA require satisfaction of the optimality conditions which are not always practically feasible as a result of ill-posedness in the inverse problem. Here we introduce novel theoretical and computational approaches to justify and enable HDSA for ill-posed inverse problems by projecting the sensitivities on likelihood informed subspaces and defining a posteriori updates. Our proposed framework is demonstrated on a nonlinear multiphysics inverse problem motivated by estimation of spatially heterogeneous material properties in the presence of spatially distributed parametric modeling uncertainties.

97 MATHEMATICS AND COMPUTING↗

Quasi-Newton Variational Bayes v.3.0

SAND2024-09052O Quasi-Newton Variational Bayes (QNVB) is a training algorithm that performs high-dimensional variational inference on machine learning models. It provides mechanisms to calibrate and control model uncertainty during training. The PyTorch implementation of projective integral updates for Gaussian mean-fields supports the manuscript, "Projective Integral Updates for High-Dimensional Variational Inference." Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Duersch, Jed↗

A perspective on Bayesian methods applied to materials discovery and design

For more than two decades, there has been increasing interest in developing frameworks for the accelerated discovery and design of novel materials that could enable promising and transformative technologies. The Integrated Computational Materials Engineering (ICME) program called for integrating computational tools to establish linkages along process-structure-property-performance (PSPP) chains. The Materials Genome Initiative called for integrating experiments and computations within data science frameworks as a strategy to accelerate the materials development cycle. While these frameworks and paradigms have been quite influential, traditional ICME or data science-based approaches tend to have some limitations, mainly when querying the materials space is costly and very little information is available. Bayesian methods are more suitable in this context due to their efficiency gains. To this end, the materials discovery problem is framed as a Bayesian Optimization (BO). Different examples in which BO has been applied to solve materials discovery problems are presented. The methods/examples discussed include BO under model uncertainty, multi-information source BO, multi-objective and multi-constraint BO, and batch BO. Bayesian Materials Discovery is a promising area of research that is likely to become more influential as more attention is put on autonomous materials discovery platforms. Therefore, a discussion is provided on the potential development of such methods to increase the ability of existing platforms in materials discovery. Here, the ultimate goal is to pave the way to autonomous materials discovery.

36 MATERIALS SCIENCE↗

Towards a data-driven model of hadronization using normalizing flows

We introduce a model of hadronization based on invertible neural networks that faithfully reproduces a simplified version of the Lund string model for meson hadronization. Additionally, we introduce a new training method for normalizing flows, termed MAGIC, that improves the agreement between simulated and experimental distributions of high-level (macroscopic) observables by adjusting single-emission (microscopic) dynamics. Our results constitute an important step toward realizing a machine-learning based model of hadronization that utilizes experimental data during training. Finally, we demonstrate how a Bayesian extension to this normalizing-flow architecture can be used to provide analysis of statistical and modeling uncertainties on the generated observable distributions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Non-Destructive Imaging of a Liquid Moving Through Porous Media Using a Computer Tomography Scanner

The most common approach used by modelers to describe movement of liquids through a porous solid, such as cement, sediment, or glass, is to assume a uniform flow rate, such as a Darcy Flux or a diffusion constant. However, this convenient simplification is problematic because in many cases it ignors the presence of fractures and macropores, which commonly dominate water flow and contaminant transport. For this reason, it is common that such modeling results do not reflect the multi-modal flow detected in laboratory and field studies. The objective of this seedling study was to develop a new capability for SRNL to track liquid moving through micro- (matrix-) and macro-flow using an X-ray Computed Topography (CT) Scanner. 4-dimensional anamated renditions were created that permited quantifying traditional matrix flow and macropore flow. These animations were modelled using a public domain software, HYDRUS 1-D, describing one dimension, dual-porosity and dual-permeability processes. This new capability provides a proof of concept for reducing model uncertainty applicable to waste disposal risk calculations, environmental remediation, and waste form development when describing the movement of liquids as they pass through glass, cement, fractured rock, or soil.

47 OTHER INSTRUMENTATION↗

Dispersion Validation for Flow Involving a Large Structure Revisited: 45 Degree Rotation

The atmospheric dispersion of contaminants in the wake of a large urban structure is a challenging fluid mechanics problem of interest to the scientific and engineering communities. Magnetic Resonance Velocimetry (MRV) and Magnetic Resonance Concentration (MRC) are relatively new techniques that leverage diagnostic equipment used primarily by the medical field to make 3D engineering measurements of flow and contaminant dispersal. SIERRA/Fuego, a computational fluid dynamics (CFD) code at Sandia National Labs is employed to make detailed comparisons to the dataset to evaluate the quantitative and qualitative accuracy of the model. This work is the second in a series of scenarios. In the prior work, a single large building in an array of similar buildings was considered with the wind perpendicular to a building face. In this work, the geometry is rotated by 45 degrees and improved studies are performed for simulation credibility. The comparison exercise shows conditionally good comparisons between the model and experiment. Model uncertainties are assessed through parametric variations. Various methods of quantifying the accuracy between experiments and data are examined Three-dimensional analysis of accuracy is performed. The effort helped identify deficiencies in the techniques used to make these comparisons, and further methods development therefore becomes one of the main recommendations for follow-on work.

42 ENGINEERING↗

Integrated Resource Supply-Demand-Routing Model for the COVID-19 Crisis

As part of the Department of Energy response to the novel coronavirus disease (COVID-19) pandemic of 2020, a modeling effort was sponsored by the DOE Office of Science. Through this effort, an integrated planning framework was developed whose capabilities were demonstrated with the combination of a treatment resource demand model and an optimization model for routing supplies. This report documents this framework and models, and an application involving ventilator demands and supplies in the continental United States. The goal of this application is to test the feasibility of implementing nationwide ventilator sharing in response to the COVID-19 crisis. Multiple scenarios were run using different combinations of forecasted and observed patient streams, and it is demonstrated that using a "worst-case forecast for planning may be preferable to best mitigate supply-demand risks in an uncertain future. There is also a brief discussion of model uncertainty and its implications for the results.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A Hybrid Climate Modeling System Using AI-assisted Process Emulators

This white paper addresses Focus Area II. We advocate developing a hybrid modeling system to improve the understanding of decadal- and longer-scale predictability of high impact water cycle components. This hybrid model combines a partial differential equation (PDE)-based dynamic core with AI/ML based emulators to represent many of the computationally expensive processes in Earth’s climate models. The hybrid modeling system has the potential to exploit emerging graphics processing unit (GPU)-accelerated architectures and allows for the generation of large ensemble (~1000’s) simulations to better characterize the model uncertainty and understand predictability.

58 GEOSCIENCES↗

Event-scale predictions of water and nitrogen exports in coastal watersheds

Focal Area(s): The purpose of this white paper is to call for the improvement of the predictability and explainability of the magnitude and timing of water and nutrient exports in coastal watersheds. In this regard, hybrid machine learning approaches and process-based numerical models provide new opportunities to maximize predictability, emulate process-based model components, and explicitly address model uncertainty associated with event-scale predictions in coastal watersheds.

54 ENVIRONMENTAL SCIENCES↗

Final Report

Maps of the distribution of galaxies, or the cosmic {\em large-scale structure}, provide information about the past several billion years of cosmic history. These maps have the power to inform several of the largest scientific puzzles driving the Department of Energy's High Energy Physics program: the neutrino mass scale, properties of dark matter, the existence of new particles, and the mechanism responsible for cosmic acceleration. This research will develop the theory of structure formation in the presence of cosmic neutrinos and other novel types of matter. Without this research, the full power of cosmic-structure data will not be harnessed. The primary goal is to ensure that modeling uncertainties are not an obstacle to detecting the neutrino mass scale and other cosmological parameters with next-generation experiments. A secondary goal is to anticipate the possibility of new physics by developing the astrophysical phenomenology of novel dark-matter and cosmic-acceleration scenarios. This research will produce new tools to study neutrinos, hidden components of dark matter, dynamical dark energy, and structure formation in the Universe.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Cloud and Precipitation Experiment at Kennaook (Cape-K) Science Plan

The Cloud and Precipitation Experiment at Kennaook (CAPE-K) will augment ongoing measurements at the Kennaook/Cape Grim Baseline Air Pollution Station (KCG) with components of the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s second Mobile Facility (AMF2) in a deployment that is scheduled to extend from April 2024 through September 2025. Located at Kennaook/Cape Grim on the northwestern tip of Tasmania (40.68° S, 144.69° E), KCG has produced the longest and most consequential record of Southern Hemisphere aerosol and gas-phase chemistry; however, extensive cloud and precipitation measurements have not been collected at this site. CAPE-K is motivated by the fact that model uncertainty in the surface radiation budget due to clouds and precipitation remain significant in this region, where strong latitudinal gradients in cloud feedbacks are found and there are strong and well-documented seasonal variations in marine aerosol properties. Satellite data suggest that cloud properties co-vary with the seasonal cycle in aerosol in the Southern Ocean (SO), yet detailed vertically resolved measurements of cloud and precipitation in the marine boundary layer are sparse. CAPE-K will provide the first such seasonal cycle of measurements in this important latitude band. CAPE-K will provide detailed cloud and precipitation observations over two winter seasons and align with complementary high-value-add activities planned by Australian colleagues, including a voyage of the Research Vessel Investigator (RVI) in May 2025 that will conduct measurements just offshore of KCG.

54 ENVIRONMENTAL SCIENCES↗

Building Intelligence with Layered Defense Using Security-Constrained Optimization and Security Risk Detection (BUILD-SOS): A Probabilistic Approach

In this project, we employ a layered protection strategy incorporating advanced optimization and detection techniques using a probabilistic approach. The probabilistic approach is not only applied when detecting cyber attacks, but also incorporated in control strategies, which greatly increases the attacking difficulties. Hackers need to understand both probabilistic detection algorithms and uncertainty modeling methods in control in order to execute any effective attacks. The end-to-end solutions enable us to provide Building Intelligence with Layered Defense using Security-Constrained Optimization and Security Risk Detection (BUILD-SOS).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Event Location using Arrival Times from Seismic and Acoustic Phenomena

Accurately locating seismoacoustic sources with geophysical observations helps to monitor natural and anthropogenic phenomena. Sparsely deployed infrasound arrays can readily locate large sources thousands of kms away, but small events typically produce signals observable at only local to regional distances. At such distances, accurate location efforts rely on observations across smaller regional or temporary deployments which often consist of single-channel infrasound sensors that cannot record direction of arrival. Event locations can also be aided by inclusion of ground coupled airwaves (GCA). This study demonstrates how we can robustly locate a catalog of seismoacoustic events using infrasound, GCA, and seismic arrival times at local to near-regional distances. We employ a probabilistic location framework using simplified forward models. Our results indicate that both single-channel infrasound and GCA arrival times can provide accurate estimates of event location in the absence of array-based observations even when using simple models. However, one must carefully choose model uncertainty bounds to avoid underestimation of confidence intervals.

58 GEOSCIENCES↗

Designing Operationally Flexible Diafiltration Membrane Systems for Critical Mineral Separations

This talk presents the design of operationally flexible diafiltration membrane systems for Li/Co recovery, and applies robust optimization methodologies using these flexible systems to generate optimal designs immune to membrane manufacturing variability and uncertain process inlet conditions. The results highlight the use of robust optimization to find design strategies and insights that may reduce technical risks arising from model uncertainties.

Yao, Jason↗

Treatment and Mineral Recovery from Combustion Residual Leachate and Produced Water

This talk presents the design of operationally flexible diafiltration membrane systems for Li/Co recovery, and applies robust optimization methodologies using these flexible systems to generate optimal designs immune to membrane manufacturing variability and uncertain process inlet conditions. The results highlight the use of robust optimization to find design strategies and insights that may reduce technical risks arising from model uncertainties.

Able, Chad↗

Coupling RELAP5-3D to BISON

This report details two approaches for coupling the BISON nuclear fuel performance code with RELAP5-3D. Both approaches are shown to work well. The first is a Python-based approach, and the second combines the two applications into one executable with data passed in memory from one library to the other. This second coupling approach forms the basis for analysis of complex loss of coolant scenarios and enables future calculations of modeling uncertainties.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Simulation of Deuterium Oxidation in a Room with a Fire

A series of experiments where deuterium was released in trace amounts into a room with a fire were performed at Sandia National Laboratories. This report describes the corresponding effort to model the test series using SIERRA/FUEGO. The objective of this modeling effort was to produce a simulation test matrix that can be utilized to help interpret the corresponding experiments and be used to assess the credibility of using the SIERRA/FUEGO simulations as a surrogate for real tritium reaction data for mock fire and release studies. The simulations assessed multiple configurations of fire size and location and overall found that there was low conversion of deuterium to oxidized deuterium. There are some notable differences between the simulation predictions and the experimental results, such as the simulations generally predicting higher amounts of deuterium conversion compared to the experiment. A strategy to address modeling uncertainties and unknowns is also given in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗