Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Developing an Automated Uncertainty Quantification Tool to Improve Watershed-Scale Predictions of Water and Nutrient Cycling

Managing the flow of water, nutrients, and contaminants in watersheds is vital to addressing pressing issues related to water scarcity, access to clean drinking water, energy production, resilience to natural and anthropogenic perturbations, and ecological restoration. Decisions about the management of watersheds critically depend on the accuracy with which the flow of water and chemicals through the watershed can be predicted by computer models. Prediction uncertainty can be reduced by matching the model to data, which are collected in the field at great expense. The contribution of watershed characterization data to reducing uncertainty of relevant model predictions can be evaluated in a so-called data-worth analysis, which provides transparent, quantitative metrics about a data set’s value for the support of relevant watershed management objectives. To achieve this goal, we developed a software package that implements the data-worth analysis approach for use with state-of-the-art watershed models. The purpose of the proposed data-worth analysis is to help decision-makers allocate resources for watershed characterization such that the uncertainty in model predictions can be significantly reduced, which leads to better, more effective management decisions. At the same time, watershed characterization costs can be reduced. The specific technical objectives of this SBIR/STTR Phase II project were to develop a framework and associated software toolsets that implement the uncertainty quantification and data-worth analysis approach for use with state-of-the-art watershed models. This goal was achieved by (A) developing a user-friendly, robust software package that is accessible to a wide audience, including watershed managers, policy-makers, and public stakeholders; (B) by demonstrating application of the prototype on several use cases that are representative of complex watershed management challenges spanning a range of scales and that consider different open-source, DOE-based codes and other modeling platforms; and (C) by gathering information about the needs and requirements from potential users to help guide future developments, ensuring that the final product will be commercially viable. The developed software consists of a graphical user interface that guides the user through a sequence of analysis steps, supported by toolsets that leverage state-of-the-art computational simulation-optimization capabilities. A prototype of the software runs on multiple platforms (PC, Mac, multi-processor Linux environment), is linked to diverse watershed simulators (e.g., ECOSYS, TOUGH2, TOUGHREACT, Amanzi-ATS), performs multiple analysis tasks (predictive simulations, sensitivity analysis, uncertainty analysis, automatic parameter estimation, and data-worth analysis, multicomponent geothermometry), and is readily extensible to include external simulators and analysis tools. The software is being commercialized and will be continually updated to address user needs.

58 GEOSCIENCES↗

Uncertainty Quantification in High-Low Dynamic System Coupling Using RAVEN and TRANSFORM

This report demonstrates new functionality and applications stemming from the development of high fidelity to low fidelity (high-low) coupling for system simulations and to further explore the capabilities of RAVEN in the performance of uncertainty quantification in this kind of high-low coupled system models. The work builds from previous work on high-low coupling that utilized CTF, the high fidelity subchannel analysis code, with a low fidelity model built in TRANSFORM, the system analysis code, utilizing the Functional Mock-Up Interface (FMI)

97 MATHEMATICS AND COMPUTING↗

Dakota, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis (V.6.16 User's Manual)

The Dakota toolkit provides a flexible and extensible interface between simulation codes and iterative analysis methods. Dakota contains algorithms for optimization with gradient and nongradient-based methods; uncertainty quantification with sampling, reliability, and stochastic expansion methods; parameter estimation with nonlinear least squares methods; and sensitivity/variance analysis with design of experiments and parameter study methods. These capabilities may be used on their own or as components within advanced strategies such as surrogate-based optimization, mixed integer nonlinear programming, or optimization under uncertainty. By employing object-oriented design to implement abstractions of the key components required for iterative systems analyses, the Dakota toolkit provides a flexible and extensible problem-solving environment for design and performance analysis of computational models on high performance computers. This report serves as a user's manual for the Dakota software and provides capability overviews and procedures for software execution, as well as a variety of example studies.

97 MATHEMATICS AND COMPUTING↗

Development of the uncertainty quantification toolkit's python interface and surrogate construction tutorial

The uncertainty quantification toolkit (UQTk) is a collection of c++ libraries that assess the confidence of numerical models. Surrogate approximations, often polynomial chaos expansions (PCEs), lessen the computational cost of these assessments. I developed a Python interface in UQTk for regression and Bayesian compressive sensing to add to the existing Galerkin projection method. These methods receive an object containing the polynomial basis information and NumPy arrays of sample points, call c++ methods, and return the PCE coefficients in a NumPy array. To demonstrate these methods, I wrote a tutorial in which I use them to construct surrogates for Genz functions and calculate the resulting error.

97 MATHEMATICS AND COMPUTING↗

Deployment of Multifidelity Uncertainty Quantification for Thermal Battery Assessment Part I: Algorithms and Single Cell Results

This report documents the results of an FY22 ASC V&V level 2 milestone demonstrating new algorithms for multifidelity uncertainty quantification. Part I of the report describes the algorithms, studies their performance on a simple model problem, and then deploys the methods to a thermal battery example from the open literature. Part II (restricted distribution) applies the multifidelity UQ methods to specific thermal batteries of interest to the NNSA/ASC program.

25 ENERGY STORAGE↗

NRAP Recommended Practices for Containment Assurance and Leakage Risk Quantification

This report presents recommendations for quantitatively assessing and managing leakage risk and effective containment assurance at geologic carbon storage (GCS) sites, amidst uncertainty in site characteristics and performance. These recommended practices are a product of the U.S. Department of Energy’s (DOE) Office of Fossil Energy and Carbon Management’s National Risk Assessment Partnership (NRAP)—a multi-year collaborative research effort of Lawrence Berkeley National Laboratory, Lawrence Livermore National Laboratory, Los Alamos National Laboratory, National Energy Technology Laboratory, and Pacific Northwest National Laboratory. These recommended practices are organized as a set of conceptual workflows that correspond with the stages of the GCS project lifecycle. They consider aspects of site characterization, quantification of potential leakage, assessing the spatial extent of potential environmental impacts, optimizing monitoring design for detection of potential leakage, evaluation of concordance between monitored and forecasted reservoir response, assessing conformance with expected/accepted performance, and determination of the timeline over which risk of impactful leakage can be expected to abate. These conceptual workflows are intended to aid stakeholders in making risk management decisions at GCS sites and to support development of sound, risk-based justifications for characterizing the subsurface, defining area of potential leakage impact, designing site monitoring plans, selecting leakage risk management/mitigation alternatives, and estimating site closure timelines.

54 ENVIRONMENTAL SCIENCES↗

Automated, Unmanned Detection and Quantification of Fugitive Methane Emissions

Compressor stations used to move natural gas are one of the largest sources of fugitive methane emissions in the midstream sector, accounting for approximately 50% of all fugitive emissions (Zimmerle et al., 2015). This problem is most widespread at reciprocating compressors (Subramanian et al., 2015) where faulty seals are a key contributor to methane emissions (Johnson et al., 2015). As such, there is a significant need for a robust technology that could provide an early indication of an unexpected emission. Equally important, the technology needs to be able to account for biogenic versus anthropogenic sources of methane. One means of indirectly making this determination, is to leverage optical technologies that can autonomously pinpoint the source of such leaks. This presentation discusses recent work funded by the U.S. Department of Energy (DOE) National Energy Technology Laboratory (NETL), focused on the development of an innovative remote sensing technology that can reliably and autonomously detect fugitive methane emissions in near real-time, using computer vision and deep learning. The technology called the Smart Methane Leak Detection (SLED/M) system was initially developed to monitor facilities such as compressor stations in a stationary, pan-tilt-zoom configuration. The system has recently been adapted to monitor facilities from an unmanned aerial system (UAS). The speed and maneuverability of UAS platforms are attractive to leak detection and repair program operators, but introduce several challenges. Many existing methane detection algorithms rely on mostly static backgrounds becoming unusable with motion. In addition, top-down views of fugitive methane emissions present differently in Optical Gas Imagers (OGI) compared to looking across the plume. Our work has focused on overcoming these challenges, enhancing the operators ability to detect methane emissions, and pinpoint their sources. Another recent adaptation to SLED/M is the ability to quantify methane emissions using passive sensors (OGI, thermal camera), environmental conditions, plume modeling, and deep learning. SLED/M advances the state-of-the-art for methane emission detection and quantification by focusing on three key critical criteria for effective methane emission mitigation: (1) autonomy (no need for a human to be in the loop), (2) high reliability (low false alarm rates), and (3) real-time performance. Results from this work will be presented.

03 NATURAL GAS↗

5-10 Years Cross-cutting Priorities on the Topic of Nuclear Data Covariances and Uncertainty Quantification for Users

The goal of this meeting was to draft a whitepaper on prioritized nuclear data covariance and uncertainty quantification needs impacting users for the next 5 to 10 years. These needs are described herein in an actionable context (i.e., a high-level plan is given to address them), and are feasible for the community to tackle the need (i.e., high-level idea of funding is provided). It should be noted that each of these proposed projects are ideal for training new nuclear data evaluators who are also integrated into application needs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

UQ4QM: Uncertainty Quantification for Quantum Materials (Chemical Dynamics Initiative Final Report)

The Uncertainty Quantification for Quantum Materials (UQ4QM) LDRD project focused on developing solutions for strategic two project areas the Chemical Dynamics Initiative (CDi) Use Case 3. This included data-driven approaches toward understanding heterogeneous data, such as multi-fidelity data or data with unknown spatial or temporal perturbations. The applications were varied but the project aims pursued solutions which were amenable to common UQ approaches in order to maximize impact.

36 MATERIALS SCIENCE↗

Uncertainty Quantification of Monolithic Tungsten Target Block Fatigue

The current STS spallation target design consists of 21 water cooled, tantalum clad, monolithic tungsten blocks. The target wheel assembly rotates such that each target block receives a direct proton pulse every 1.4 seconds (21 blocks / 15 Hz pulses). The quasi-steady heating induced by the repetitive beam pulses creates a significant mean stress distribution in the target. On top of this, the rapid energy deposition from a proton pulse induces dynamic stress waves that are of the same order of magnitude as the mean stresses. Over the design goal of 5,000 operational hours per year for a decade, each target must withstand over 130 million repetitions of these dynamic stress events. The fatigue life prediction of the target blocks is a complex sequence of simulations that depend upon a set of input parameters. For the tungsten block, the end goal is the fatigue factor-of-safety (FOS). This study documents a new structural analysis routine using software available to U.S. national laboratories (e.g. CUBIT, Sierra Multiphysics, Dakota) that enables more rapid target fatigue analysis. The increased throughput is amenable to parameter sensitivity and uncertainty quantification (UQ) studies. A set of input parameters (ultimate strength, fatigue strength, density, elastic modulus, Poisson’s ratio, thermal conductivity, coefficient of thermal expansion, specific heat, flow rate) with expected ranges are documented based on literature data, recent experimental testing, and engineering judgement. UQ bounds the resulting fatigue FOS at [0.5, 3.4] using epistemic interval analysis. These bounds are expected to be wider due to model effects (discretization) and beam effects (focus, offset) that were not included. Parameter sensitivity underscores the importance of ultimate strength and fatigue strength of irradiated tungsten on the fatigue calculations.

43 PARTICLE ACCELERATORS↗

Quantification of Residual Water in Spent Fuel Dry Storage Canisters Using Mass Spectrometry

The purpose of this report is to document updates on the apparatus to simulate commercial vacuum drying procedures at the Nuclear Energy Work Complex at Sandia National Laboratories. Validation of the extent of water removal in a dry spent nuclear fuel storage system based on drying procedures used at nuclear power plants is needed to close existing technical gaps. Operational conditions leading to incomplete drying may have potential impacts on the fuel, cladding, and other components in the system during subsequent storage and disposal, such as fuel degradation; cladding corrosion, embrittlement, or breaching; and the creation of a flammable environment via radiolysis of water. A general lack of data suitable for model validation of commercial nuclear canister drying processes necessitates well-designed investigations of drying process efficacy and water retention. Scaled tests that incorporate relevant physics and well-controlled boundary conditions are essential to provide insight and guidance to the simulation of prototypic systems undergoing drying processes. This report documents details on the quantification of residual water in the Advanced Drying Cycle Simulator (ADCS), an apparatus built to simulate commercial drying procedures and quantify the amount of residual water remaining in a pressurized water reactor (PWR) fuel assembly after drying. The ADCS was constructed with a prototypic 17×17 PWR fuel skeleton and waterproof heater rods to simulate decay heat. The ADCS is outfitted with thermocouples to measure the thermal response of the ADCS to simulated decay heats and internal helium fill pressures relevant to commercial drying procedures. The ADCS is also instrumented with pressure transducers to measure the pressures and vacuum levels observed during simulated commercial drying. The most unique instrumentation used for quantifying residual water in the ADCS is a Hiden Analytical HPR-30 mass spectrometer (MS), which measures gas compositions of the ADCS internal free volume, based on partial pressures calculated from relative proportions of gas molecules detected by the MS. This report details the methodology used to implement MS measurements in quantifying residual water in the ADCS. This methodology includes the calibration of the HPR-30 MS to a Buck Research Instruments CR-4 chilled mirror hygrometer, which itself is calibrated to a NIST-traceable standard. Data collected by both the MS and the chilled mirror hygrometer from water/helium mixtures ranging from 150 to 500,000 ppmv water in helium were used to generate calibration curves, establishing a source of verification of MS measured water contents. Details regarding water content measurement uncertainties are included in this report, defining the accuracy and verifiability of the HPR-30 MS in measuring residual water content in simulated dry storage canister environments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Non-conformity Scores for High-Quality Uncertainty Quantification from Conformal Prediction

High-quality uncertainty quantification (UQ) is a critical component of enabling trust in deep learning (DL) models and is especially important if DL models are to be deployed in high-consequence applications. Conformal prediction (CP) methods represent an emerging nonparametric approach for producing UQ that is easily interpretable and, under weak assumptions, provides a guarantee regarding UQ quality. This report describes the research outputs of an Exploratory Express Laboratory Directed Research and Development (LDRD) project at Sandia National Laboratories. This project focused on how best to implement CP methods for DL models. This report introduces new methodology for obtaining high-quality UQ from DL models using CP methods, describes a novel system of assessing UQ quality, and provides experimental results that demonstrate the quality of the new methodology and utility of the UQ quality assessment system. Avenues for future research and discussion of potential impacts at Sandia and in the wider research community are also given.

97 MATHEMATICS AND COMPUTING↗

Improving and Assessing the Quality of Uncertainty Quantification in Deep Learning

Deep learning (DL) models have enjoyed increased attention in recent years because of their powerful predictive capabilities. While many successes have been achieved, standard deep learning methods suffer from a lack of uncertainty quantification (UQ). While the development of methods for producing UQ from DL models is an active area of current research, little attention has been given to the quality of the UQ produced by such methods. In order to deploy DL models to high-consequence applications, high-quality UQ is necessary. This report details the research and development conducted as part of a Laboratory Directed Research and Development (LDRD) project at Sandia National Laboratories. The focus of this project is to develop a framework of methods and metrics for the principled assessment of UQ quality in DL models. This report presents an overview of UQ quality assessment in traditional statistical modeling and describes why this approach is difficult to apply in DL contexts. An assessment on relatively simple simulated data is presented to demonstrate that UQ quality can differ greatly between DL models trained on the same data. A method for simulating image data that can then be used for UQ quality assessment is described. A general method for simulating realistic data for the purpose of assessing a model’s UQ quality is also presented. A Bayesian uncertainty framework for understanding uncertainty and existing metrics is described. Research that came out of collaborations with two university partners are discussed along with a software toolkit that is currently being developed to implement the UQ quality assessment framework as well as serve as a general guide to incorporating UQ into DL applications.

97 MATHEMATICS AND COMPUTING↗

Framework for Optimization, Quantification of Uncertainty, and Surrogates, and CCSI2 Toolset Capabilities

This poster will present key features and capabilities of the CCSI2 software platform to relevant technical and research audience members at the 2024 FECM / NETL Carbon Management Research Project Review Meeting. Attendees will learn about available process models in the CCSI2 Toolset, as well as design of experiments and machine learning features in the Framework for Optimization, Quantification of Uncertainty, and Surrogates (FOQUS) software to support pilot plant work.

Paul, Brandon↗

Model-based quantification of margins and uncertainties in metal additive manufacturing for process design and qualification

Laser powder bed fusion (LPBF) Additive Manufacturing (AM) has the potential to enable the production of components with novel designs and material properties unachievable otherwise. However, process repeatability is a challenge, making qualification ill-defined and greatly reducing the utility of what could be an important manufacturing technology. In this work, a combination of modeling, uncertainty quantification (UQ), and experimentation are used in an effort to predict and bound the range of possible outcomes of the LPBF process. Quantities of interest predicted are melt pool dimensions, microstructure features, and mechanical distortions. A combination of high fidelity thermal-fluid models, microstructure growth models, and reduced fidelity, rapid thermal and mechanical models are used. Uncertainty propagation techniques are used to predict probability distributions of quantities of interest from estimates of process uncertainties. Repeated experiments are done to quantify observed probability distributions and compared to predicted distributions to determine if predictions are precise and accurate. Novel modeling methods are microstrucutre characterization techniques are also discussed. It is found that high fidelity models do a generally good job bounding experimentally observed melt pool morphologies for both bead-on-plate and powder bed cases. Microstructure models are able to bound a number of experimentally observed microstructure statistics, but with low precision due to challenges with calibrating the microstructure growth model parameters. A developed modified inherent strain distortion model does not accurately predict observed distortions. A lumped laser distortion model shows promise in being both accurately and precisely bounding observed outcomes from the deflection comb build, but requires further evaluation on more builds and geometries.

36 MATERIALS SCIENCE↗

Uncertainty Quantification and Sensitivity Analysis of Low-Dimensional Manifold via Co-Kurtosis PCA in Combustion Modeling

For multi-scale multi-physics applications e.g., the turbulent combustion code Pele, robust and accurate dimensionality reduction is crucial to solving problems at exascale and beyond. A recently developed technique, Co-Kurtosis based Principal Component Analysis (CoK-PCA) which leverages principal vectors of co-kurtosis, is a promising alternative to traditional PCA for complex chemical systems. To improve the effectiveness of this approach, we employ Artificial Neural Networks for reconstructing thermo-chemical scalars, species production rates, and overall heat release rates corresponding to the full state space. Our focus is on bolstering confidence in this deep learning based non-linear reconstruction through Uncertainty Quantification (UQ) and Sensitivity Analysis (SA). UQ involves quantifying uncertainties in inputs and outputs, while SA identifies influential inputs. One of the noteworthy challenges is the computational expense inherent in both endeavors. To address this, we employ the Monte Carlo methods to effectively quantify and propagate uncertainties in our reduced spaces while managing computational demands. Our research carries profound implications not only for the realm of combustion modeling but also for a broader audience in UQ. By showcasing the reliability and robustness of CoK-PCA in dimensionality reduction and deep learning predictions, we empower researchers and decision-makers to navigate complex combustion systems with greater confidence.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Summary of light-element evaluation work: nuclear data uncertainty quantification

Hale & Paris (T-2) have evaluated the 15 N system to provide nuclear cross section and covariance information for nuclear data uncertainty quantification. This memo gives a brief discussion of the R-matrix method used to generate this nuclear scattering and reaction data in the ENDF-6 format.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Baselining the Indirect Effect by Improving Quantification of Sea Spray and Marine Sources at Ascension Island (Final Report)

Oceans cover two-thirds of the Earth and understanding the interactions of aerosols with clouds in these large marine regions requires quantifying the man-made contributions to the budget of cloud-drop forming particles (known as cloud condensation nuclei, or CCN) relative to the non-manmade “baseline” conditions and understanding the meteorology of boundary layer clouds. Modeling studies have shown substantial uncertainties and sensitivities to natural marine CCN sources, meaning that to reduce uncertainties in indirect effects we must be able to better quantify the CCN budget in ocean regions. While models provide important constraints on these uncertainties, actually reducing uncertainties requires substantial observations in open-ocean and coastal regions in order to establish the baseline on which manmade emissions are added. The tropical South Atlantic Ocean is one of the least-sampled regions of the planet, making the comprehensive measurements of the Department of Energy Atmospheric Radiation Measurement Layered Atlantic Smoke Interactions with Clouds (LASIC) campaign provides the longest record of aerosol size distribution measurements from a differential mobility analyzer in a cloud-influenced marine location in the ARM database, with 17 months of ground-based aerosol size distribution measurements. This project addressed the research topic of Aerosol-Cloud Interactions (ACI) by supporting three publications from the LASIC measurements: 1. The ARM measurements were combined with a new value-added technique that was pioneered by the Russell group for quantifying sea salt. This quantification of sea salt uses supermicron scattering measurements for retrieving reasonable sea spray mass concentrations, providing the best-available, observationally-constrained estimate of the sea spray mode properties when supermicron size distribution measurements are not available. 2. The fitted modes of the distribution were used to investigate the signatures of cloud processing for very clean to very smoky aerosol conditions, revealing not only differences in the particles that activate in clouds but also in the mechanisms that control that droplet formation process. In clean air, the size required to form a cloud droplet is influenced by the number of particles, as well as how quickly particles take up water during growth in cloud. 3. Building on this aerosol characterization, cloud and meteorological conditions were used to evaluate aerosol-related changes in cloud albedo and optical depth. We introduced a new method of decomposing the impact of aerosols on clouds known as the Twomey effect by incorporating retrieved supersaturation from two independent sets of observations to constrain the feedback of aerosol particles on cloud properties. The method quantifies the reduction of the Twomey effect at high aerosol concentrations, which has never been explained quantitatively by observations. In addition, the results provide the first direct validation for the conditions observed in the tropical South Atlantic of a parcel-based approach that is embedded in many climate models. Together these findings illustrate how ARM extended field campaigns in stratocumulus-covered regions can be used to constrain ACI processes with direct observations, providing specific radiative effects without models. By making such process-specific constraints available to improve ACI in global climate models, ARM observations play a key role in supporting model development.

58 GEOSCIENCES↗