Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Improving and Assessing the Quality of Uncertainty Quantification in Deep Learning

Deep learning (DL) models have enjoyed increased attention in recent years because of their powerful predictive capabilities. While many successes have been achieved, standard deep learning methods suffer from a lack of uncertainty quantification (UQ). While the development of methods for producing UQ from DL models is an active area of current research, little attention has been given to the quality of the UQ produced by such methods. In order to deploy DL models to high-consequence applications, high-quality UQ is necessary. This report details the research and development conducted as part of a Laboratory Directed Research and Development (LDRD) project at Sandia National Laboratories. The focus of this project is to develop a framework of methods and metrics for the principled assessment of UQ quality in DL models. This report presents an overview of UQ quality assessment in traditional statistical modeling and describes why this approach is difficult to apply in DL contexts. An assessment on relatively simple simulated data is presented to demonstrate that UQ quality can differ greatly between DL models trained on the same data. A method for simulating image data that can then be used for UQ quality assessment is described. A general method for simulating realistic data for the purpose of assessing a model’s UQ quality is also presented. A Bayesian uncertainty framework for understanding uncertainty and existing metrics is described. Research that came out of collaborations with two university partners are discussed along with a software toolkit that is currently being developed to implement the UQ quality assessment framework as well as serve as a general guide to incorporating UQ into DL applications.

97 MATHEMATICS AND COMPUTING↗

Framework for Optimization, Quantification of Uncertainty, and Surrogates, and CCSI2 Toolset Capabilities

This poster will present key features and capabilities of the CCSI2 software platform to relevant technical and research audience members at the 2024 FECM / NETL Carbon Management Research Project Review Meeting. Attendees will learn about available process models in the CCSI2 Toolset, as well as design of experiments and machine learning features in the Framework for Optimization, Quantification of Uncertainty, and Surrogates (FOQUS) software to support pilot plant work.

Paul, Brandon↗

Model-based quantification of margins and uncertainties in metal additive manufacturing for process design and qualification

Laser powder bed fusion (LPBF) Additive Manufacturing (AM) has the potential to enable the production of components with novel designs and material properties unachievable otherwise. However, process repeatability is a challenge, making qualification ill-defined and greatly reducing the utility of what could be an important manufacturing technology. In this work, a combination of modeling, uncertainty quantification (UQ), and experimentation are used in an effort to predict and bound the range of possible outcomes of the LPBF process. Quantities of interest predicted are melt pool dimensions, microstructure features, and mechanical distortions. A combination of high fidelity thermal-fluid models, microstructure growth models, and reduced fidelity, rapid thermal and mechanical models are used. Uncertainty propagation techniques are used to predict probability distributions of quantities of interest from estimates of process uncertainties. Repeated experiments are done to quantify observed probability distributions and compared to predicted distributions to determine if predictions are precise and accurate. Novel modeling methods are microstrucutre characterization techniques are also discussed. It is found that high fidelity models do a generally good job bounding experimentally observed melt pool morphologies for both bead-on-plate and powder bed cases. Microstructure models are able to bound a number of experimentally observed microstructure statistics, but with low precision due to challenges with calibrating the microstructure growth model parameters. A developed modified inherent strain distortion model does not accurately predict observed distortions. A lumped laser distortion model shows promise in being both accurately and precisely bounding observed outcomes from the deflection comb build, but requires further evaluation on more builds and geometries.

36 MATERIALS SCIENCE↗

Uncertainty Quantification and Sensitivity Analysis of Low-Dimensional Manifold via Co-Kurtosis PCA in Combustion Modeling

For multi-scale multi-physics applications e.g., the turbulent combustion code Pele, robust and accurate dimensionality reduction is crucial to solving problems at exascale and beyond. A recently developed technique, Co-Kurtosis based Principal Component Analysis (CoK-PCA) which leverages principal vectors of co-kurtosis, is a promising alternative to traditional PCA for complex chemical systems. To improve the effectiveness of this approach, we employ Artificial Neural Networks for reconstructing thermo-chemical scalars, species production rates, and overall heat release rates corresponding to the full state space. Our focus is on bolstering confidence in this deep learning based non-linear reconstruction through Uncertainty Quantification (UQ) and Sensitivity Analysis (SA). UQ involves quantifying uncertainties in inputs and outputs, while SA identifies influential inputs. One of the noteworthy challenges is the computational expense inherent in both endeavors. To address this, we employ the Monte Carlo methods to effectively quantify and propagate uncertainties in our reduced spaces while managing computational demands. Our research carries profound implications not only for the realm of combustion modeling but also for a broader audience in UQ. By showcasing the reliability and robustness of CoK-PCA in dimensionality reduction and deep learning predictions, we empower researchers and decision-makers to navigate complex combustion systems with greater confidence.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Summary of light-element evaluation work: nuclear data uncertainty quantification

Hale & Paris (T-2) have evaluated the 15 N system to provide nuclear cross section and covariance information for nuclear data uncertainty quantification. This memo gives a brief discussion of the R-matrix method used to generate this nuclear scattering and reaction data in the ENDF-6 format.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Baselining the Indirect Effect by Improving Quantification of Sea Spray and Marine Sources at Ascension Island (Final Report)

Oceans cover two-thirds of the Earth and understanding the interactions of aerosols with clouds in these large marine regions requires quantifying the man-made contributions to the budget of cloud-drop forming particles (known as cloud condensation nuclei, or CCN) relative to the non-manmade “baseline” conditions and understanding the meteorology of boundary layer clouds. Modeling studies have shown substantial uncertainties and sensitivities to natural marine CCN sources, meaning that to reduce uncertainties in indirect effects we must be able to better quantify the CCN budget in ocean regions. While models provide important constraints on these uncertainties, actually reducing uncertainties requires substantial observations in open-ocean and coastal regions in order to establish the baseline on which manmade emissions are added. The tropical South Atlantic Ocean is one of the least-sampled regions of the planet, making the comprehensive measurements of the Department of Energy Atmospheric Radiation Measurement Layered Atlantic Smoke Interactions with Clouds (LASIC) campaign provides the longest record of aerosol size distribution measurements from a differential mobility analyzer in a cloud-influenced marine location in the ARM database, with 17 months of ground-based aerosol size distribution measurements. This project addressed the research topic of Aerosol-Cloud Interactions (ACI) by supporting three publications from the LASIC measurements: 1. The ARM measurements were combined with a new value-added technique that was pioneered by the Russell group for quantifying sea salt. This quantification of sea salt uses supermicron scattering measurements for retrieving reasonable sea spray mass concentrations, providing the best-available, observationally-constrained estimate of the sea spray mode properties when supermicron size distribution measurements are not available. 2. The fitted modes of the distribution were used to investigate the signatures of cloud processing for very clean to very smoky aerosol conditions, revealing not only differences in the particles that activate in clouds but also in the mechanisms that control that droplet formation process. In clean air, the size required to form a cloud droplet is influenced by the number of particles, as well as how quickly particles take up water during growth in cloud. 3. Building on this aerosol characterization, cloud and meteorological conditions were used to evaluate aerosol-related changes in cloud albedo and optical depth. We introduced a new method of decomposing the impact of aerosols on clouds known as the Twomey effect by incorporating retrieved supersaturation from two independent sets of observations to constrain the feedback of aerosol particles on cloud properties. The method quantifies the reduction of the Twomey effect at high aerosol concentrations, which has never been explained quantitatively by observations. In addition, the results provide the first direct validation for the conditions observed in the tropical South Atlantic of a parcel-based approach that is embedded in many climate models. Together these findings illustrate how ARM extended field campaigns in stratocumulus-covered regions can be used to constrain ACI processes with direct observations, providing specific radiative effects without models. By making such process-specific constraints available to improve ACI in global climate models, ARM observations play a key role in supporting model development.

58 GEOSCIENCES↗

Fracture Network Quantification for Enhanced Reservoir Characterization in CO2 Storage Sites

Presentation slides on “Fracture Network Quantification for Enhanced Reservoir Characterization in CO2 Storage Sites” for the CCUS 2025 conference held in Houston, Texas March 3-5, 2025. Accurate reservoir characterization is fundamental for the safe and efficient operation of carbon capture, utilization, and storage (CCUS) projects. This process is not only critical during initial site selection but also plays a key role in continuously updating reservoir geomodels throughout injection operations to effectively manage subsurface storage sites. Our primary objective is to develop a comprehensive understanding of fracture networks within CO2 injection reservoirs, which are critical for predicting the behavior of injected fluids, ensuring storage integrity post-injection, and mitigating risks such as leakage or induced seismicity.

artifical intelligence / machine learning (AI/ML)↗

Fracture Network Quantification during CO2 Injection

This is the presentation prepared for the ARMA 2025 (59th US Rock Mechanics/Geomechanics Symposium) Conference held in Santa Fe, New Mexico, June 8-11, 2025. Accurate mapping and quantification of these networks are essential to ensure the integrity of CO2 storage reservoirs, understand and reduce potential leakage, and maintain long-term environmental safety. This study presents a novel machine learning-driven approach, integrated with geomechanical analysis, to quantify fracture networks and assess their spatial distribution during CO2 injection. This paper combines microseismic monitoring data with principles of hydraulic diffusivity and geomechanical analysis to characterize reservoir scale fracture network. The novelty of our approach lies in its capacity to assimilate time-dependent pressure data and microseismicity into a cohesive framework, which not only identifies microseismic triggering fronts but also tracks fracture distribution during active injection. Besides, leveraging image log data and analysis our approach also provides another angle of the insights to solidate the fracture networks understanding and geomechanical impacts. Key results from our study include the detection of over 100 distinct fracture clusters across the injection site, with fracture orientations strongly correlated with the prevailing in-situ stress field.

CO2 storage and sequestration↗

ESMs Latent Space Exploration for Uncertainty Quantification and Spatiotemporal Downscaling

This final report for DOE Award DE-SC0023044 presents advances in two key areas of climate modeling: (1) representative climate model selection and (2) Earth System Model (ESM) downscaling using hybrid AI methods. The first section introduces a reordered, three-stage workflow to select representative GCM runs that more effectively balance historical skill with ensemble spread, validated across Texas, Bihar, and New York. The second section introduces two novel super-resolution frameworks, ViSIR and ViFOR, that integrate Vision Transformers with sinusoidal and Fourier-based implicit neural representations. These models achieve state-of-the-art reconstruction accuracy for ESM variables including surface temperature and heat fluxes. The report includes detailed methodology, benchmarks, and results, demonstrating significant gains in uncertainty quantification, spatial fidelity, and scalability for climate-impact studies.

54 ENVIRONMENTAL SCIENCES↗

Quantum-Inspired Bayesian Sampling for Uncertainty Quantification and Machine Learning (Final Technical Report)

With increasing simulation and measurement data, machine learning and artificial intelligence have been widely used in computational decision-making of complex engineering systems. The resulting tools, such as uncertainty quantification solvers, reinforcement learning, and physics-informed machine learning, have achieved great success in critical DOE tasks such as material discovery and design, energy system modeling and control, and numerical weather and climate prediction. A core topic in scientific machine learning and artificial intelligence is Bayesian inference: given an observed data set, people want to estimate the posterior distribution of a (possibly large) number of hidden parameters. Due to the flexibility and weak assumptions, Bayesian sampling has been the mainstream Bayesian inference solvers despite the rapid progress of approximate Bayesian inference. Classical Bayesian sampling methods such as Markov-chain Monte Carlo suffer from a low-acceptance rate due to the random walk nature, therefore state-of-the-art techniques use Hamiltonian Monte Carlo and its variants to efficiently draw posterior samples in a high dimension. The key idea of Hamiltonian Monte Carlo and its variants is to simulate the Hamiltonian dynamics of a classical particle with a fixed mass, and their performance significantly degrades when the posterior distribution is highly spiky or has multiple modes. Leveraging the idea of quantum physics, this project has investigated new theory, algorithms and applications of Bayesian inference (especially Bayesian sampling). The main results include: (1) novel quantum-inspired Bayesian sampling methods that can lead to better accuracy for challenging multi-modal or spiky distributions, (2) more scalable machine learning framework leveraging tensor-compressed Bayesian inference, and (3) Bayesian and sampling approaches for verifying the robustness of continuous and binary neural networks.

97 MATHEMATICS AND COMPUTING↗

Uncertainty quantification for inverse problems with application to ptychographic reconstruction

Inverse problems in imaging are commonly solved by optimization or learned surrogates that return a single reconstruction, while uncertainty information is often unavailable. In many experimental settings, however, uncertainty is required to assess reliability, guide downstream analysis, and prioritize additional measurements. In this note, we present a compact uncertainty-quantification framework based on local objective curvature, and then specialize it to ptychographic reconstruction. We further show how repeated reconstructions can be aggregated in a statistically principled way, including a practical implementation path for PtychoNN.

97 MATHEMATICS AND COMPUTING↗

Quantum surrogate models for uncertainty quantification

Surrogate models are a critical ingredient to computation-based design and validation of many DOE mission-relevant physical systems. When first-principles computation of properties of a physical systems becomes pro hibitive, surrogate models are the only path towards achieving tasks such as uncertainty quantification (UQ), exploration of design space, and validation of design choices. In this project we have developed and demonstrated a new surro gate modeling paradigm for complex models that is data-driven, non-intrusive, and has the potential to be versatile and equipped with performance guaran tees. This combination of features is absent in existing surrogate modeling tools. The framework we have developed in this project exploits a quantum-classical correspondence to establish a quantum system that mimics the dynamics of the classical Hamiltonian system from which data in the form of temporal snapshots is provided. Since quantum dynamics propagates distributions over observables, the framework is naturally suited to propagation of epistemic uncertainties in the form of distributions over initial state and parametric uncertainties. In this project, we take the first step in establishing this novel framework by deriving a quantization and de-quantization procedure, demonstrating the accuracy of the quantum surrogate models these define using two model systems, and defining the next steps in maturing the framework towards a tool applicable to Sandia mission-relevant problems.

97 MATHEMATICS AND COMPUTING↗

Multi-scale quantification of anthropogenic, fire, and drought-associated forest disturbances across the continental U.S., 2000–2014

Our understanding of broad-scale forest disturbances under climatic extremes remains incomplete. Drought, as a typical extreme event, is a key driver of forest mortality but there have been no reports on continental-scale quantification of its impact on forest mortality or how it compares to other natural or anthropogenic drivers. Thus, our ability to understand and predict broad-scale carbon cycling in response to changing climate and extreme events is limited. In this study, we applied an attribution approach based on different sources of data to quantify the area and potential carbon loss/transfer in continental U.S. (CONUS) from four types of disturbance: (1) anthropogenic (especially timber harvest); (2) fire; (3) drought-associated; and (4) other from 2000 to 2014. Our results showed that anthropogenic disturbances, fire, drought-associated disturbances, and other disturbances accounted for 54.3, 10.7, 12.7, and 22.3% of total canopy area loss, respectively. Anthropogenic disturbance was the most important driver contributing to 58.1% potential carbon loss/transfer in CONUS for 2000–2014. The potential carbon loss/transfer from natural disturbances (fire, drought, and other) for the same study period accounted for approximately 41.9% of the total loss/transfer from all agents, suggesting that natural disturbances also played a very important role in forest carbon turnover. Potential carbon loss/transfer associated with drought accounted for approximately 11.6% of the total loss/transfer in CONUS, which was of similar magnitude to potential carbon loss/transfer from fire (~11.0%). The other natural disturbance accounted for 19.3% of potential carbon loss/transfer. Our results demonstrated the importance of the impacts of various disturbances on forest carbon stocks at the continental scale, and the drought-associated carbon loss/transfer data developed here could be used for evaluating the performance of predictive models of tree mortality under droughts.

54 ENVIRONMENTAL SCIENCES↗

Using PyBioNetFit to leverage qualitative and quantitative data in biological model parameterization and uncertainty quantification

Data generated in studies of cellular regulatory systems are often qualitative. For example, measurements of signaling readouts in the presence and absence of mutations may reveal a rank ordering of responses across conditions but not the precise extents of mutation-induced differences. Qualitative data are often ignored by mathematical modelers or are considered in an ad hoc manner, as in the study of Kocieniewski and Lipniacki (2013) [Phys Biol 10: 035006], which was focused on the roles of MEK isoforms in ERK activation. In this earlier study, model parameter values were tuned manually to obtain consistency with a combination of qualitative and quantitative data. This approach is not reproducible, nor does it provide insights into parametric or prediction uncertainties. Here, starting from the same data and the same ordinary differential equation (ODE) model structure, we generate formalized statements of qualitative observations, making these observations more reusable, and we improve the model parameterization procedure by applying a systematic and automated approach enabled by the software package PyBioNetFit. We also demonstrate uncertainty quantification (UQ), which was absent in the original study. Our results show that PyBioNetFit enables qualitative data to be leveraged, together with quantitative data, in parameterization of systems biology models and facilitates UQ. These capabilities are important for reliable estimation of model parameters and model analyses in studies of cellular regulatory systems and reproducibility.

59 BASIC BIOLOGICAL SCIENCES↗

Bayes goes fast: Uncertainty quantification for a covariant energy density functional emulated by the reduced basis method

A covariant energy density functional is calibrated using a principled Bayesian statistical framework informed by experimental binding energies and charge radii of several magic and semi-magic nuclei. The Bayesian sampling required for the calibration is enabled by the emulation of the high-fidelity model through the implementation of a reduced basis method (RBM)—a set of dimensionality reduction techniques that can speed up demanding calculations involving partial differential equations by several orders of magnitude. The RBM emulator we build—using only 100 evaluations of the high-fidelity model—is able to accurately reproduce the model calculations in tens of milliseconds on a personal computer, an increase in speed of nearly a factor of 3,300 when compared to the original solver. Besides the analysis of the posterior distribution of parameters, we present model calculations for masses and radii with properly estimated uncertainties. We also analyze the model correlation between the slope of the symmetry energy L and the neutron skin of 48 Ca and 208 Pb. The straightforward implementation and outstanding performance of the RBM makes it an ideal tool for assisting the nuclear theory community in providing reliable estimates with properly quantified uncertainties of physical observables. Such uncertainty quantification tools will become essential given the expected abundance of data from the recently inaugurated and future experimental and observational facilities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Three-Dimensional Imaging and Quantification of Gas Storativity in Nanoporous Media via X-rays Computed Tomography

This study provides the engineering science underpinnings for improved characterization and quantification of the interplay of gases with kerogen and minerals in shale. Natural nanoporous media such as shale (i.e., mudstone) often present with low permeability and dual porosity, making them difficult to characterize given the complex structural and chemical features across multiple scales. These structures give nanoporous solids a large surface area for gas to sorb. In oil and gas applications, full understanding of these media and their sorption characteristics are critical for evaluating gas reserves, flow, and storage for enhanced recovery and CO 2 sequestration potential. Other applications include CO 2 capture from industrial plants, hydrogen storage on sorbent surfaces, and heterogeneous catalysis in ammonia synthesis. Therefore, high-resolution experimental procedures are demanded to better understand the gas–solid behavior. In this study, CT imaging was applied on the sub-millimeter scale to shale samples (Eagle Ford and Wolfcamp) to improve quantitative agreement between CT-derived and pulse decay (mass balance) derived results. Improved CT imaging formulations are presented that better match mass balance results, highlighting the significance of gas sorption in complex nanoporous media. The proposed CT routine implemented on the Eagle Ford sample demonstrated a 17% error reduction (22% to 5%) when compared to the conventional CT procedure. These observations are consistent in the Wolfcamp sample, emphasizing the reliability of this technique for broader implementation of digital adsorption studies in nanoporous geomaterials.

42 ENGINEERING↗

Automated Quantification of Wind Turbine Blade Leading Edge Erosion from Field Images

Wind turbine blade leading edge erosion is a major source of power production loss and early detection benefits optimization of repair strategies. Two machine learning (ML) models are developed and evaluated for automated quantification of the areal extent, morphology and nature (deep, shallow) of damage from field images. The supervised ML model employs convolutional neural networks (CNN) and learns features (specific types of damage) present in an annotated set of training images. The unsupervised approach aggregates pixel intensity thresholding with calculation of pixel-by-pixel shadow ratio (PTS) to independently identify features within images. The models are developed and tested using a dataset of 140 field images. The images sample across a range of blade orientation, aspect ratio, lighting and resolution. Each model (CNN v PTS) is applied to quantify the percent area of the visible blade that is damaged and classifies the damage into deep or shallow using only the images as input. Both models successfully identify approximately 65% of total damage area in the independent images, and both perform better at quantifying deep damage. The CNN is more successful at identifying shallow damage and exhibits better performance when applied to the images after they are preprocessed to a common blade orientation.

Aird, Jeanie A.↗