Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “accurate quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗

Advanced NASA Earth Science Mission Concept for Vegetation 3D Structure, Biomass and Disturbance

Carbon in forest canopies represents about 85% of the total carbon in the Earth's aboveground biomass (Olson et al., 1983). A major source of uncertainty in global carbon budgets derives from large errors in the current estimates of these carbon stocks (IPCC, 2001). The magnitudes and distributions of terrestrial carbon storage along with changes in sources and sinks for atmospheric C02 due to land use change remain the most significant uncertainties in Earth's carbon budget. These uncertainties severely limit accurate terrestrial carbon accounting; our ability to evaluate terrestrial carbon management schemes; and the veracity of atmospheric C02 projections in response to further fossil fuel combustion and other human activities. Measurements of vegetation three-dimensional (3D) structural characteristics over the Earth's land surface are needed to estimate biomass and carbon stocks and to quantify biomass recovery following disturbance. These measurements include vegetation height, the vertical profile of canopy elements (i.e., leaves, stems, branches), andlor the volume scattering of canopy elements. They are critical for reducing uncertainties in the global carbon budget. Disturbance by natural phenomena, such as fire or wind, as well as by human activities, such as forest harvest, and subsequent recovery, complicate the quantification of carbon storage and release. The resulting spatial and temporal heterogeneity of terrestrial biomass and carbon in vegetation make it very difficult to estimate terrestrial carbon stocks and quantify their dynamics. Vegetation height profiles and disturbance recovery patterns are also required to assess ecosystem health and characterize habitat. The three-dimensional structure of vegetation provides habitats for many species and is a control on biodiversity. Canopy height and structure influence habitat use and specialization, two fundamental processes that modify species richness and abundance across ecosystems. Accurate and consistent 3D measurements of forest structure at the landscape scale are needed for assessing impacts to animal habitats and biodiversity following disturbance.

Ranson, K. Jon↗

Three‐Dimensional Permeability Inversion Using Convolutional Neural Networks and Positron Emission Tomography

Abstract Quantification of heterogeneous multiscale permeability in geologic porous media is key for understanding and predicting flow and transport processes in the subsurface. Recent utilization of in situ imaging, specifically positron emission tomography (PET), enables the measurement of three‐dimensional (3‐D) time‐lapse radiotracer solute transport in geologic media. However, accurate and computationally efficient characterization of the permeability distribution that controls the solute transport process remains challenging. Leveraging the relationship between local permeability variation and solute advection behavior, an encoder‐decoder based convolutional neural network (CNN) is implemented as a permeability inversion scheme using a single PET scan of a radiotracer pulse injection experiment as input. The CNN can accurately capture the 3‐D spatial correlation between the permeability and the radiotracer solute arrival time difference maps in geologic cores. We first test the inversion accuracy using synthetic test datasets and then test the accuracy on a suite of experimental PET imaging datasets acquired on four different geologic cores. The network‐predicted permeability maps from the geologic cores are used to parameterize forward numerical models that are directly compared with the experimental PET imaging data. The results indicate that a single trained network can generate robust 3‐D permeability inversion maps in seconds. Numerical models parameterized with these permeability maps closely capture the experimentally observed solute arrival time behavior. This work provides an unprecedented approach for efficiently characterizing multiscale permeability heterogeneity in complex geologic samples.

54 ENVIRONMENTAL SCIENCES↗

Exploration of multifidelity UQ sampling strategies for computer network applications.

Network modeling is a powerful tool to enable rapid analysis of complex systems that can be challenging to study directly using physical testing. Here, two approaches are considered: emulation and simulation. The former runs real software on virtualized hardware, while the latter mimics the behavior of network components and their interactions in software. Although emulation provides an accurate representation of physical networks, this approach alone cannot guarantee the characterization of the system under realistic operative conditions. Operative conditions for physical networks are often characterized by intrinsic variability (payload size, packet latency, etc.) or a lack of precise knowledge regarding the network configuration (bandwidth, delays, etc.); therefore uncertainty quantification (UQ) strategies should be also employed. UQ strategies require multiple evaluations of the system with a number of evaluation instances that roughly increases with the problem dimensionality, i.e., the number of uncertain parameters. It follows that a typical UQ workflow for network modeling based on emulation can easily become unattainable due to its prohibitive computational cost. In this paper, a multifidelity sampling approach is discussed and applied to network modeling problems. The main idea is to optimally fuse information coming from simulations, which are a low-fidelity version of the emulation problem of interest, in order to decrease the estimator variance. By reducing the estimator variance in a sampling approach it is usually possible to obtain more reliable statistics and therefore a more reliable system characterization. Several network problems of increasing difficulty are presented. For each of them, the performance of the multifidelity estimator is compared with respect to the single fidelity counterpart, namely, Monte Carlo sampling. For all the test problems studied in this work, the multifidelity estimator demonstrated an increased efficiency with respect to MC.

97 MATHEMATICS AND COMPUTING↗

How Austenitic Is a Martensitic Steel Produced by Laser Powder Bed Fusion? A Cautionary Tale

Accurate phase fraction analysis is an essential element of the microstructural characterization of alloys and often serves as a basis to quantify effects such as heat treatment or mechanical deformation. Additive manufacturing (AM) of metals, due to the intrinsic nonequilibrium solidification and spatial variability, creates additional challenges for the proper quantification of phase fraction. Such challenges are exacerbated when the alloy itself is prone to deformation-induced phase transformation. Using commonly available in-house X-ray diffraction (XRD) and electron backscatter diffraction (EBSD) and less commonly used synchrotron-based high-energy X-ray diffraction, we characterized nitrogen-atomized 17-4 precipitation-hardening martensitic stainless steel, a class of AM alloy that has received broad attention within the AM research community. On the same build, our measurements recovered the entire range of reported values on the austenite phase fractions of as-built AM 17-4 in literature, from ≈100% martensite to ≈100% austenite. Aided by Calphad simulation, our experimental findings established that our as-built AM 17-4 is almost fully austenitic and that in-house XRD and EBSD measurements are subject to significant uncertainties created by the specimen’s surface finish. Hence, measurements made using these techniques must be understood in their correct context. Our results carry significant implications, not only to AM 17-4 but also to AM alloys that are susceptible to deformation-induced structure transformation and suggest that characterizations with less accessible but bulk sensitive techniques such as synchrotron-based high energy X-ray diffraction or neutron diffraction may be required for proper understanding of these materials.

17-4 steel↗

Uncertainty-quantification-enabled inversion of nuclear responses

Nuclear quantum many-body methods rely on integral transform techniques to infer properties of electroweak response functions from ground-state expectation values. Retrieving the energy dependence of these responses is highly nontrivial, especially for quantum Monte Carlo methods, as it requires inverting the Laplace transform, a notoriously ill-posed problem. Here, in this work, we propose an artificial neural network architecture suitable for accurate response function reconstruction with precise estimation of the uncertainty of the inversion. We demonstrate the capabilities of this new architecture benchmarking it against maximum entropy and previously developed neural network methods designed for a similar task, paying particular attention to its robustness noise in the Euclidean

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quantification of HCl from high-resolution, ground-based, infrared solar spectra in the 3000 per cm region

Recent ground-based infrared solar spectra at 0.02 per cm resolution in the 3000 per cm region have been analyzed for the atmospheric content of HCl. Nonlinear spectral least-squares fitting applied to spectra obtained at several zenith angles shows little sensitivity of the results to tropospheric HCl but provides an accurate measurement of the total column amount.

Goldman, A.↗

Data-driven modeling of dislocation mobility from atomistics using physics-informed machine learning

Dislocation mobility, which dictates the response of dislocations to an applied stress, is a fundamental property of crystalline materials that governs the evolution of plastic deformation. Traditional approaches for deriving mobility laws rely on phenomenological models of the underlying physics, whose free parameters are in turn fitted to a small number of intuition-driven atomic scale simulations under varying conditions of temperature and stress. This tedious and time-consuming approach becomes particularly cumbersome for materials with complex dependencies on stress, temperature, and local environment, such as body-centered cubic crystals (BCC) metals and alloys. In this paper, we present a novel, uncertainty quantification-driven active learning paradigm for learning dislocation mobility laws from automated high-throughput large-scale molecular dynamics simulations, using Graph Neural Networks (GNN) with a physics-informed architecture. We demonstrate that this Physics-informed Graph Neural Network (PI-GNN) framework captures the underlying physics more accurately compared to existing phenomenological mobility laws in BCC metals.

36 MATERIALS SCIENCE↗

Machine learning enhanced predictions of ICRF heating: Overcoming numerical limitations via data curation

In this work, we present the development of robust surrogate models for Ion Cyclotron Range of Frequencies (ICRF) and High-Harmonic Fast Wave (HHFW) heating predictions in fusion plasmas. Building upon our previous efforts to achieve real-time capable models, we identify the cause of the outliers found using TORIC in certain HHFW heating scenarios. The outliers are observed to be spurious ion Bernstein wave (IBW)-like modes caused by a wavelength control algorithm designed to address challenging scenarios with high perpendicular wavenumbers. The effect arises from the modulation in the perpendicular susceptibility, which can induce sign reversal and IBW-like propagation for scenarios featuring normalized ion Larmor radius λ i ≫ 1. We use TORIC with this algorithm disabled to generate a novel HHFW-NSTX database that is free of outliers. Surrogate models trained on this database, including Random Forest Regressor (RFR), Multi-Layer Perceptrons, and Gaussian Process Regressors (GPR), demonstrate the ability to accurately predict HHFW heating profiles, with regression scores of R 2 ∈[0.93−0.99]. Additionally we demonstrate that it is possible to generalize predictions beyond training data by the use of both RFR and GPR models, enabling the prediction of scenarios previously limited to the original model. GPR models also provide uncertainty quantification, offering insights into model confidence. This work introduces a comprehensive Verification, Validation, and Uncertainty Quantification methodology for surrogate modeling, applicable not only to ICRF heating but also to other RF heating challenges and fusion physics problems. Beyond accelerated inference, these models show effective extrapolation capabilities, providing an alternative for addressing numerical challenges.

Artificial neural networks↗

The MUSIC Critical Benchmark and Nuclear Data

The Measurement of Uranium Subcritical and Critical (MUSIC) experiment was a series of measurements of critical and subcritical configurations of bare highly enriched uranium. The goal was to compare measurement methods, analysis techniques, and simulation methods across regimes of criticality and to provide high-quality validation of 235 U nuclear data. A benchmark evaluation of the two critical configurations of the MUSIC experiments will soon be published in the release of the International Criticality Safety Benchmark Evaluation Project Handbook. The recent execution of the experiment aids in proper quantification of model simplifications and all uncertainties associated with the experiment. Historical benchmark evaluations are heavily relied on for uranium nuclear data validation despite the fact that the same level of documentation and comparable uncertainty analysis may not be present. The MUSIC evaluation is less likely to include “unknown unknowns” that could impede accurately modeling the system. Presented are both highly detailed and very simplified models, which represent the experimental configurations accurately, aiding the users of the benchmark for nuclear data or transport code validation. The sensitivities of k eff to nuclear data and nuclear data–related uncertainties are very similar between this experiment and previous bare uranium sphere experiments. In addition, the nuclear data uncertainties to any nuclides other than 235 U are small. For all these reasons, the recently evaluated MUSIC benchmark critical configurations could prove very useful for 235 U nuclear data validation. Currently, major libraries have good agreement with the experimental results, within 200 pcm for all nuclear data libraries, and within one standard deviation of the experimental result for most. Suggested nuclear data adjustments based on MUSIC and Lady Godiva are also presented, with posterior improvements to both the agreement in k eff and the uncertainty associated with the nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Unified Metric for Fast Frequency Response in Low-Inertia Power Systems: Preprint

Future power system with more inverter-based resources (IBRs) is vulnerable to the frequency-decline contingency. Fast frequency response (FFR) provided by IBRs is a good candidate to arrest the frequency excursion. Diverse types of FFRs have been integrated into the power system. Without a unified quantification of FFRs, it is hard for the grid operators to fully leverage the FFR capabilities of IBRs. This work introduces potential unified metrics of prevailing FFRs. We utilized the metric-to-frequency (M2F) mapping to validate the accuracy of the metrics. The results show the proposed metric to be simple yet accurate.

effective inertia↗

Uncertainty quantification for deep learning in particle accelerator applications

With the advent of increased computational resources and improved algorithms, machine learning-based models are being increasingly applied to complex problems in particle accelerators. However, such data-driven models may provide overly confident predictions with unknown errors and uncertainties. For reliable deployment of machine learning models in high-regret and safety-critical systems such as particle accelerators, estimates of prediction uncertainty are needed along with accurate point predictions. In this investigation, we evaluate Bayesian neural networks (BNN) as an approach that can provide accurate predictions along with reliably quantified uncertainties for particle accelerator problems, and compare their performance with bootstrapped ensembles of neural networks. We select three accelerator setups for this evaluation: a storage ring, a photoinjector, and a linac. The problems span different data volumes and dimensionalities (e.g., scalar predictions as well as image outputs). It is found that BNN provide accurate predictions of the mean along with reliable estimates of predictive uncertainty across the test cases. In this vein, BNN may offer an attractive alternative to deterministic deep learning tools to generate accurate predictions with quantified uncertainties in particle accelerator applications.

43 PARTICLE ACCELERATORS↗

Uncertainty Quantification using Deep Ensembles for Decision Making in Cyber-Physical-Human Systems

In this paper and its companion, Differential Equation Approximation Using Gradient-Boosted Quantile Regression, Robison et al., we examine an approach to quantifying model uncertainty with the aim of increasing the trustworthiness of computational models in human-machine interactions. In Differential Equation Approximation Using Gradient-Boosted Quantile Regression, we focus on gradient-boosted decision trees, while in this one, we give more details about deep ensembles. Uncertainty quantification is crucial for building trustworthy autonomous decision-making agents in human-machine teams. There are two types of uncertainties: aleatoric and epistemic. The former is related to the inherent stochasticity (noise) of the process, whereas the latter is associated with the lack of knowledge or representation capability of models, such as neural networks. By lack of knowledge, we mean the model’s inability to accurately predict outputs for all possible inputs. The aleatory uncertainty can be estimated fairly easily with, for example, filters, whereas epistemic uncertainty is challenging to compute. This paper uses deep ensembles to quantify both aleatory and epistemic uncertainty. It can act as an uncertainty-aware surrogate transition model for decision-making frameworks. "Uncertainty-aware" means that the surrogate transition model should make predictions along with confidence in those predictions. In the context of decision-making, the transition models are ordinary differential equations (ODEs). Since ODEs can be simulated to make one-step or multi-step predictions, a good surrogate model for them should perform reasonably well in both modes. In a multi-step approach, the trajectory sampling method TS∞ was used to propagate uncertainty over multiple steps. The cartpole dynamical system was selected to demonstrate the ability of deep ensembles as good surrogate transition models for decision-making frameworks. The deep ensembles modeled the dynamics of cartpole ODEs and made uncertainty-aware predictions in single-step and multi-step transition modes.

CPH systems↗

Interlaced Characterization and Calibration (ICC) for Improved Computational Simulation Credibility

Accurate material characterization and model calibration are pivotal for simulations used for high-consequence engineering decisions. Current characterization and calibration methods (1) use simplified test specimen geometries and global data, (2) cannot guarantee that sufficient characterization data is collected for a specific model of interest, (3) provide only mean parameter values with no uncertainty quantification, and (4) are sequential, inflexible, and time-consuming. This work developed a new paradigm—coined Interlaced Characterization and Calibration (ICC)—which drives forward the state-of-the-art in model calibration by bringing together recent advancements into one improved workflow. The ICC paradigm (1) employs tools to efficiently use full-field data to calibrate high-fidelity material models, (2) aligns the data needed with the data collected by adopting an optimal experimental design protocol, (3) provides uncertainty metrics on the calibrated model parameters, and (4) incorporates these advances into a quasi real-time feedback loop. The ICC framework was validated synthetically with both low-fidelity and high-fidelity simulations paired with several different elastoplastic material models, and was also demonstrated experimentally with an aluminum 6061 cruciform exemplar specimen. Results showed that the ICC framework—in which Bayesian optimal experimental design actively guided the experiment— resulted in calibrations with similar or better accuracy than predetermined experiments based on subject matter expertise. Moreover, the ICC framework produced a complete model calibration— with quantified uncertainties on model parameters—in 1 week, a 5 - 10× increase in efficiency over traditional approaches. Thus, the ICC paradigm improves both the calibration process and quality, by (1) improving efficiency, which increases agility of solid mechanics modeling and enables utilization of computational simulation (CompSim) at earlier stages of the design cycle and (2) providing quantified, and in some cases reduced, parameter uncertainties, which increases confidence in model predictions and supports credible decision making.

97 MATHEMATICS AND COMPUTING↗

Multifidelity Monte Carlo estimation for efficient uncertainty quantification in climate-related modeling

Abstract. Uncertainties in an output of interest that depends on the solution of a complex system (e.g., of partial differential equations with random inputs) are often, if not nearly ubiquitously, determined in practice using Monte Carlo (MC) estimation. While simple to implement, MC estimation fails to provide reliable information about statistical quantities (such as the expected value of the output of interest) in application settings such as climate modeling, for which obtaining a single realization of the output of interest is a costly endeavor. Specifically, the dilemma encountered is that many samples of the output of interest have to be collected in order to obtain an MC estimator that has sufficient accuracy – so many, in fact, that the available computational budget is not large enough to effect the number of samples needed. To circumvent this dilemma, we consider using multifidelity Monte Carlo (MFMC) estimation which leverages the use of less costly and less accurate surrogate models (such as coarser grids, reduced-order models, simplified physics, and/or interpolants) to achieve, for the same computational budget, higher accuracy compared to that obtained by an MC estimator – or, looking at it another way, an MFMC estimator obtains the same accuracy as the MC estimator at lower computational cost. The key to the efficacy of MFMC estimation is the fact that most of the required computational budget is loaded onto the less costly surrogate models so that very few samples are taken of the more expensive model of interest. We first provide a more detailed discussion about the need to consider an alternative to MC estimation for uncertainty quantification. Subsequently, we present a review, in an abstract setting, of the MFMC approach along with its application to three climate-related benchmark problems as a proof-of-concept exercise.

54 ENVIRONMENTAL SCIENCES↗

Scalable Risk Assessment of Rare Events in Power Systems With Uncertain Wind Generation and Loads

Risk assessment of rare events has become increasingly important in power system planning and operation with the increasing integration of renewable energy and the presence of system uncertainties. However, quantifying the risk posed by rare events via the traditional method, i.e., Monte Carlo sampling (MCS), incurs substantial computational expense stemming from the vast ensemble of power flow simulations. To accelerate the assessment, this paper proposes a Deep Neural Network (DNN)-kernelized vector-valued Gaussian Process (VVGP) approach with excellent computational efficiency while maintaining high accuracy. Consequently, serving as a surrogate model for the power flow solver, the DNN-kernelized VVGP enables significantly faster but accurate risk assessment compared to the power flow solver. The developed surrogate model evaluates low-order N - k events that contain more than 90% instances by adeptly capturing the topological features while the high-order N - k events are assessed via a power flow solver, thereby striking a balance between computational efficiency and uncertainty quantification accuracy. Moreover, the model incorporates a Support Vector Machine (SVM) classifier to resample concerning low-probability tail events to counteract the biases potentially introduced during the DNN-kernelized VVGP evaluations. Simulations conducted on the modified IEEE 24-bus, 118-bus, and European 1354-bus systems demonstrate that the proposed method maintains the accuracy benchmark set by MCS while significantly reducing computational demands in large-scale power systems as compared to other state-of-the-art methods.

17 WIND ENERGY↗

To have value, comparisons of high-throughput phenotyping methods need statistical tests of bias and variance

The gap between genomics and phenomics is narrowing. The rate at which it is narrowing, however, is being slowed by improper statistical comparison of methods. Quantification using Pearson’s correlation coefficient ( r ) is commonly used to assess method quality, but it is an often misleading statistic for this purpose as it is unable to provide information about the relative quality of two methods. Using r can both erroneously discount methods that are inherently more precise and validate methods that are less accurate. These errors occur because of logical flaws inherent in the use of r when comparing methods, not as a problem of limited sample size or the unavoidable possibility of a type I error. A popular alternative to using r is to measure the limits of agreement (LOA). However both r and LOA fail to identify which instrument is more or less variable than the other and can lead to incorrect conclusions about method quality. An alternative approach, comparing variances of methods, requires repeated measurements of the same subject, but avoids incorrect conclusions. Variance comparison is arguably the most important component of method validation and, thus, when repeated measurements are possible, variance comparison provides considerable value to these studies. Statistical tests to compare variances presented here are well established, easy to interpret and ubiquitously available. The widespread use of r has potentially led to numerous incorrect conclusions about method quality, hampering development, and the approach described here would be useful to advance high throughput phenotyping methods but can also extend into any branch of science. The adoption of the statistical techniques outlined in this paper will help speed the adoption of new high throughput phenotyping techniques by indicating when one should reject a new method, outright replace an old method or conditionally use a new method.

59 BASIC BIOLOGICAL SCIENCES↗

Battery data integrity and usability: Navigating datasets and equipment limitations for efficient and accurate research into battery aging

A tremendous commitment of resources is needed to acquire, understand and apply battery data in terms of performance and aging behavior. There are many state of performance (SOP) and state of health (SOH) metrics that are useful to guide alignment of batteries to end-use, yet how these metrics are measured or extracted can make the difference between usable, valuable datasets versus data that lacks the necessary integrity to meet baseline confidence levels for SOP/SOH quantification. This work will speak to 1) types of data that support SOP and SOH evaluations on mechanistic terms, 2) measurement conditions needed to assure high data integrity, 3) equipment limitations that can compromise data high fidelity, and 4) the impact of cell polarization on data quality. A common goal in battery research and field use is to work from a data platform that supports economical paths of data capture while minimizing down-time for battery diagnostics. An ideal situation would be to utilize data obtained during normal daily use (“pulses or cycles of convenience”) without stopping the daily duty cycles to perform dedicated SOP/SOH diagnostic routines. However, difficulties arise in trying to make use of daily duty cycle data (denoted as cycle-by-cycle, CBC) that underscores the need for standardization of conditions: temperature and duty cycles can vary over the course of a day and throughout a week, month and year; polarization can develop within an immediate cycle and throughout successive cycles as a hysteresis. If CBC data is envisioned as a data source to determine performance and aging trends, it should be recognized that polarization is a frequent consequence of CBC and thus makes it difficult to separate reversible and irreversible components to metrics such as capacity loss and resistance increase over aging. Since CBC conditions can have a major impact on data usability, we will devote part of this paper to CBC data conditioning and management. Differential analyses will also be discussed as a means to detect changing trends in data quality. Our target cell chemistries will be lithium-ion types NMC/graphite and LMO/LTO.

25 ENERGY STORAGE↗