Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

Decline of Tumor Vascular Function as Assessed by Dynamic Contrast-Enhanced Magnetic Resonance Imaging Is Associated With Poor Responses to Radiation Therapy and Chemotherapy

Purpose: To investigate whether changes in the volume transfer coefficient (K{sup trans}) in a growing tumor could be used as a surrogate marker for predicting tumor responses to radiation therapy (RT) and chemotherapy (CT). Methods and Materials: Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) was consecutively performed on tumor-bearing mice, and temporal and spatial changes of K{sup trans} values were measured along with tumor growth. Tumor responses to RT and CT were studied before and after observed changes in K{sup trans} values with time. Results: Dynamic changes with an initial increase and subsequent decline in K{sup trans} values were found to be associated with tumor growth. When each tumor was divided into core and peripheral regions, the K{sup trans} decline was greater in core, although neither vascular structure or necrosis could be linked to this spatial difference. Tumor responses to RT were worse if applied after the decline of K{sup trans}, and there was less drug distribution and cell death in the tumor core after CT. Conclusion: The K{sup trans} value in growing tumors, reflecting the changes of tumor microenvironment and vascular function, is strongly associated with tumor responses to RT and CT and could be a potential surrogate marker for predicting the tumor response to these treatments.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

An adaptive importance sampling algorithm for Bayesian inversion with multimodal distributions

Parametric uncertainties are encountered in the simulations of many physical systems, and may be reduced by an inverse modeling procedure that calibrates the simulation results to observations on the real system being simulated. Following Bayes' rule, a general approach for inverse modeling problems is to sample from the posterior distribution of the uncertain model parameters given the observations. However, the large number of repetitive forward simulations required in the sampling process could pose a prohibitive computational burden. This difficulty is particularly challenging when the posterior is multimodal. We present in this paper an adaptive importance sampling algorithm to tackle these challenges. Two essential ingredients of the algorithm are: 1) a Gaussian mixture (GM) model adaptively constructed as the proposal distribution to approximate the possibly multimodal target posterior, and 2) a mixture of polynomial chaos (PC) expansions, built according to the GM proposal, as a surrogate model to alleviate the computational burden caused by computational-demanding forward model evaluations. In three illustrative examples, the proposed adaptive importance sampling algorithm demonstrates its capabilities of automatically finding a GM proposal with an appropriate number of modes for the specific problem under study, and obtaining a sample accurately and efficiently representing the posterior with limited number of forward simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Sparse-grid, reduced-basis Bayesian inversion: Nonaffine-parametric nonlinear equations

We extend the reduced basis (RB) accelerated Bayesian inversion methods for affine-parametric, linear operator equations which are considered in [16,17] to non-affine, nonlinear parametric operator equations. We generalize the analysis of sparsity of parametric forward solution maps in [20] and of Bayesian inversion in [48,49] to the fully discrete setting, including Petrov–Galerkin high-fidelity (“HiFi”) discretization of the forward maps. We develop adaptive, stochastic collocation based reduction methods for the efficient computation of reduced bases on the parametric solution manifold. The nonaffinity and nonlinearity with respect to (w.r.t.) the distributed, uncertain parameters and the unknown solution is collocated; specifically, by the so-called Empirical Interpolation Method (EIM). For the corresponding Bayesian inversion problems, computational efficiency is enhanced in two ways: first, expectations w.r.t. the posterior are computed by adaptive quadratures with dimension-independent convergence rates proposed in [49]; the present work generalizes [49] to account for the impact of the PG discretization in the forward maps on the convergence rates of the Quantities of Interest (QoI for short). Second, we propose to perform the Bayesian estimation only w.r.t. a parsimonious, RB approximation of the posterior density. Based on the approximation results in [49], the infinite-dimensional parametric, deterministic forward map and operator admit N-term RB and EIM approximations which converge at rates which depend only on the sparsity of the parametric forward map. In several numerical experiments, the proposed algorithms exhibit dimension-independent convergence rates which equal, at least, the currently known rate estimates for N-term approximation. We propose to accelerate Bayesian estimation by first offline construction of reduced basis surrogates of the Bayesian posterior density. The parsimonious surrogates can then be employed for online data assimilation and for Bayesian estimation. They also open a perspective for optimal experimental design.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Gradient-based optimization for regression in the functional tensor-train format

Predictive analysis of complex computational models, such as uncertainty quantification (UQ), must often rely on using an existing database of simulation runs. In this paper we consider the task of performing low-multilinear-rank regression on such a database. Specifically we develop and analyze an efficient gradient computation that enables gradient-based optimization procedures, including stochastic gradient descent and quasi-Newton methods, for learning the parameters of a functional tensor-train (FT). We compare our algorithms with 22 other nonparametric and parametric regression methods on 10 real-world data sets and show that for many physical systems, exploiting low-rank structure facilitates efficient construction of surrogate models. Here, we use a number of synthetic functions to build insight into behavior of our algorithms, including the rank adaptation and group-sparsity regularization procedures that we developed to reduce overfitting. Finally we conclude the paper by building a surrogate of a physical model of a propulsion plant on a naval vessel.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A physics-informed and hierarchically regularized data-driven model for predicting fluid flow through porous media

This paper presents a new deep learning data-driven model for predicting structure dependent pore-fluid velocity fields in rock. The model is based on a Convolutional Auto-Encoder (CAE) artificial neural network capable of learning from image data generated by direct numerical simulations of fluid flow through pore-structures, such as by Lattice Boltzmann or molecular dynamics methods. The main novelty of the model in comparison to previous CAE-based data-driven approaches consists of three parts. The first is a methodology for decomposing the full-domain of the porous media into sub-regions, or “sub-domains”, in order to reduce the overall size of the CAE, batch process the sub-domains in parallel, and enable the CAE to learn local and generalizable nonlinear mappings of pore-fluid velocities. The second consists of embedding the finite difference solutions of the incompressible Navier-Stokes and continuity equations into convolutional layers prior to the CAE in order to provide the CAE with knowledge of fluid dynamics physics (PhyFlow). The third main novelty is that the training of the CAE is regularized with a hierarchical loss function that encourages the learning of fluid flow patterns (in a way similar to ranked modes in principal component analysis), ranking from most to least important. This is shown to increase the stability in learning, reduce over-fitting, and promote interpretability of the CAE neural network layers (HierCAE). The comprehensive new data-driven model, which we call the PhyFlow-HierCAE model, is shown to exhibit improved accuracy and generalizability of flow field predictions over conventional CAE models, attributable to the embedded physical knowledge and the hierarchical regularization, as well as realize orders of magnitude speed-ups in computation times as a surrogate for the direct numerical simulations. Examples of training and forward predictions on unseen pore-structures are provided and evaluated for data from Lattice Boltzmann and molecular dynamics simulations of pore-fluid flow. The model is shown to be a fast and accurate emulator (or “surrogate”) for predicting effective permeability of unseen pore-structures based on learning from relatively small direct numerical simulation datasets.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

GrainGNN: A dynamic graph neural network for predicting 3D grain microstructure

We propose GrainGNN, a surrogate model for the evolution of polycrystalline grain structure under rapid solidification conditions in metal additive manufacturing. High fidelity simulations of solidification microstructures are typically performed using multicomponent partial differential equations (PDEs) with moving interfaces. The inherent randomness of the PDE initial conditions (grain seeds) necessitates ensemble simulations to predict microstructure statistics, e.g., grain size, aspect ratio, and crystallographic orientation. Here, currently such ensemble simulations are prohibitively expensive and surrogates are necessary.In GrainGNN, we use a dynamic graph to represent interface motion and topological changes due to grain coarsening. We use a reduced representation of the microstructure using hand-crafted features; we combine pattern finding and altering graph algorithms with two neural networks, a classifier (for topological changes) and a regressor (for interface motion). Both networks have an encoder-decoder architecture; the encoder has a multi-layer transformer long-short-term-memory architecture; the decoder is a single layer perceptron.We evaluate GrainGNN by comparing it to high-fidelity phase field simulations for in-distribution and out-of-distribution grain configurations for solidification under laser power bed fusion conditions. GrainGNN results in 80%–90% pointwise accuracy; and nearly identical distributions of scalar quantities of interest (QoI) between phase field and GrainGNN simulations compared using Kolmogorov-Smirnov test. GrainGNN's inference speedup (PyTorch on single x86 CPU) over a high-fidelity phase field simulation (CUDA on a single NVIDIA A100 GPU) is 150×–2000× for 100-initial grain problem. Further, using GrainGNN, we model the formation of 11,600 grains in 220 seconds on a single CPU core.

36 MATERIALS SCIENCE↗

A weighted shifted boundary method for immersed moving boundary simulations of Stokes' flow

The Shifted Boundary Method (SBM) belongs to the class of unfitted (or immersed, or embedded) finite element methods, and relies on reformulating the original boundary value problem over a surrogate (approximate) computational domain. The surrogate domain is constructed so as to avoid cut cells and the associated problematic implementation and numerical integration issues. Accuracy is maintained by modifying the original boundary conditions using Taylor expansions: hence the name of the method, that shifts the location and values of the boundary conditions. Here, in this article, we extend the SBM to the simulation of incompressible Stokes flow, by appropriately weighting its variational form with the elemental volume fraction of active fluid. This approach allows to drastically reduce spurious pressure oscillations in time, which are produced if the total volume of active fluid were to change abruptly over a time step. The proposed Weighted SBM (W-SBM) exactly preserves states of hydrostatic equilibrium, and induces small mass and momentum conservation errors, which converge as the grid is refined. This is in analogy to cutFEMs and related unfitted approaches, which rely on an affine representation of cut boundaries. We demonstrate the robustness and accuracy of the proposed method with an extensive suite of two-dimensional tests.

97 MATHEMATICS AND COMPUTING↗

Neural chaos: A spectral stochastic neural operator

Building surrogate models for operators with uncertainty quantification capabilities is essential for many engineering applications where randomness–such as variability in material properties, boundary conditions, and initial conditions–is unavoidable. Polynomial Chaos Expansion (PCE) is widely recognized as a go-to method for constructing stochastic surrogates in both intrusive and non-intrusive ways, and it has recently been used in the context of operator learning. However, its application becomes challenging for complex or high-dimensional processes, as achieving accuracy requires higher-order polynomials, which can increase computational demand and/or the risk of overfitting. Furthermore, PCE requires specialized treatments to manage random variables that are not independent, and these treatments may be problem-dependent or may fail with increasing complexity. Here, in this work, we adopt the same formalism as the spectral expansion used in PCE; however, we replace the classical polynomial basis functions with neural network (NN) basis functions to leverage their expressivity. To achieve this, we propose an algorithm that identifies NN-parameterized basis functions in a purely data-driven manner, without any prior assumptions about the joint distribution of the random variables involved, whether independent or dependent, or about their marginal distributions. The proposed algorithm identifies each NN-parameterized basis function sequentially, ensuring they are orthogonal with respect to the data distribution. The basis functions are constructed directly on the joint stochastic variables without requiring a tensor product structure or assuming independence of the random variables. This approach may offer greater flexibility for complex stochastic models, while simplifying implementation compared to the tensor product structures typically used in PCE to handle random vectors. This is particularly advantageous given the current state of open-source packages, where building and training neural networks can be done with just a few lines of code and extensive community support. We demonstrate the effectiveness of the proposed scheme through several numerical examples of varying complexity and provide comparisons with classical PCE.

Polynomial chaos expansion↗

On the transferability of residence time distributions in two 10-km long river sections with similar hydromorphic units

Quantifying hydrologic exchange fluxes (HEFs) at the stream-groundwater interface and their residence time distributions (RTDs) in the subsurface are important for managing the water quality and ecosystem health in dynamic river corridors. However, direct simulating high-spatial resolution HEFs and RTDs can be time-consuming, especially for watershed-scale modeling. Efficient surrogate models linking RTDs to hydromorphic units (HUs) can be alternatives for simulating RTDs in large-scale models. A common concern of these surrogate models, though, is the transferability of the relationship between the RTDs and HUs from one river corridor to another. To address this issue, this work evaluates the HEFs and resulting RTD-HU relationships for two 10-km long river corridors along the Columbia River leveraging a one-way coupled three-dimensional transient surface-subsurface water transport modeling framework we previously developed. Applying such a framework at the two river corridors with similar HUs allows for quantitative comparisons of HEFs and RTDs using both statistical tests and machine learning classification models. Finally, our comparison shows that the similarity and transferability of the RTD-HU relationship is very low for the two investigated river sections, which suggests that devising a general algorithm to estimate RTDs based solely on surface water hydrodynamics and short-distance river channel topography data, as well as HU classification, might be nearly impossible.

54 ENVIRONMENTAL SCIENCES↗

Kinetics of the high temperature oxygen exchange reaction on 238 PuO 2 powder

In this study, oxygen exchange reactions performed on PuO 2 suggest the reaction is influenced by at least three mechanisms: an internal chemical reaction, surface mobility of active species/defects, and surface exchange of gaseous oxygen with lattice oxygen. Activation energies for the surface mobility and internal chemical reaction are presented. Determining which mechanism is dominant appears to be a complex function including at least specific surface area and temperature. Thermal exposure may also impact the oxygen exchange reaction by causing reductions in the specific surface area of PuO 2 . Previous CeO 2 surrogate studies exhibit similar behavior, confirming that CeO 2 is a good qualitative surrogate for PuO 2 , in regards to the oxygen exchange reaction. Comparison of results presented here with previous work on the PuO 2 oxygen exchange reaction allows complexities in the previous work to be explained. These explanations allowed new conclusions to be drawn, many of which confirm the conclusions presented here.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Glass binder development for a glass-bonded sodalite ceramic waste form

This paper discusses work to develop Na2O-B2O3-SiO2 glass binders for immobilizing LiCl-KCl eutectic salt waste in a glass-bonded sodalite waste form following electrochemical reprocessing of used metallic nuclear fuel. Here, five new glasses with high Na2O contents were designed to generate waste forms having higher sodalite contents and fewer stress fractures. The structural, mechanical, and thermal properties of the new glasses were measured using variety of analytical techniques. The glasses were then used to produce ceramic waste forms with surrogate salt waste. The materials made using the glasses developed during this study were formulated to generate more sodalite than materials made with previous baseline glasses used. The coefficients of thermal expansion for the glass phase in the glass-bonded sodalite waste forms made with the new binder glasses were closer to the sodalite phase in the critical temperature region near and below the glass transition temperature. These improvements should result in lower probability of cracking in the full-scale monolithic ceramic waste form, leading to better long-term chemical durability. Additionally, a model generated during this study for predicting softening temperature of silicate binder glasses is presented.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

3D analysis of TRISO fuel compacts via X-ray computed tomography

In this study, low-enriched uranium oxycarbide (LEUCO) and surrogate tristructural isotropic (TRISO)- coated-particle compacts with particle volumetric packing fractions of 25%, 40%, and 48% were imaged utilizing X-ray-computed tomography. Subsequent 3D image analysis identified and further quantified kernel size, sphericity, and observed porosity. In addition, the spatial distribution, coordination number, and kernel-nearest neighbors were analyzed and compared for the different packing fractions. Metrics such as observed porosity and sphericity enabled quantification and screening for abnormal kernels within TRISO compacts. Assessment of TRISO particle location confirmed and further quantified a non-uniform distribution of TRISO particles with the spatial distribution in the radial direction being roughly described as a dampened sinusoidal function. The amplitude and frequency of this non-uniform distribution increased with increasing packing fraction. Measured kernel-nearest neighbor distances indicated two regions along the radial surfaces of compacts where TRISO particles are more likely to be in intimate contact with one another. These regions were found: (1) at upper and lower faces of compacts (i.e., corners); (2) offset ~10% of a compact's length from the axial center near the exterior surface. Within these regions, small quantities of defective TRISO surrogate particles (48% packing fraction) and defective LEUCO TRISO particles (40% packing fraction) were found. No defective particles were found within 25% packing fraction LEUCO TRISO compacts.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

First principles optimization of plutonium electrorefining

Herein this work presents a means of controlling plutonium electrorefining at a maximum rate regardless of equipment setup through the derivation of power supply current and potential governing equations for normal and off-normal operations. The governing equations are demonstrated by electrorefining surrogate materials. A simple linear current sweeping method was used to determine the maximum electrorefining current for the surrogate system. This method can be used to develop autonomous process optimization, real-time online processing monitoring, and real-time process endpoint detection. Ultimately, this research provides the foundation to optimize the liquid metal electrorefining rate to decrease the time needed to the physical limit for the process.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Micromechanical response of SiC-OPyC layers in TRISO fuel particles

Tristructural isotropic (TRISO)–coated particle fuel is a proposed fuel for multiple advanced reactor concepts. The performance of the particle depends on whether the silicon carbide (SiC) layer remains intact to prevent the release of metallic and gaseous fission products. Mechanical fracture of the SiC layer is a potential failure mode under various fuel configurations and operating environments, including the potential transmission of matrix-originating cracks through TRISO particles. Furthermore, this study uses instrumented indentation techniques on cross-sectioned surrogate particles to examine the mechanical stability of the critical interface between SiC and the outer pyrolytic carbon (OPyC) layer. The observed behavior at the interface is rationalized by examining the radially dependent fracture behavior of the SiC layer and performing a numerical analysis to quantify the residual stresses that develop during the processing and cross-sectioning of the as-fabricated particle. Characterizing the SiC-OPyC interface of surrogate TRISO particles using nanoindentation provides unique insight into the interface's room-temperature residual stress and mechanical stability. The modeling efforts were used to investigate the experimental procedure further, and the results are presented herein to validate this fuel form's potential mechanical failure modes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantitative measurement of pebble fuel anisotropy using generalized ellipsometry

The renewed development of high-temperature gas-cooled reactors has created a need to modernize pebble fuel quality control methods. One important specification in these methods is the coefficient of thermal expansion (CTE) anisotropy, which reflects graphite grain alignment and affects fuel performance. This study investigates the feasibility of using two-modulator generalized ellipsometry microscopy (2-MGEM) as a potential surrogate metric for CTE anisotropy. Graphite matrix compacts with controlled levels of anisotropy were fabricated by varying pre-pressures during forming and were subsequently characterized using both optical dilatometry and 2-MGEM. Measured responses were compared to an isotropic reference pebble produced using an industrial manufacturing process to provide a practical baseline. The resulting measurements revealed a strong quantitative correlation between the CTE anisotropy ratio and the corresponding diattenuation ratio. However, propagated measurement uncertainties in the optical method were found to limit definitive pass/fail discrimination, highlighting the need for improved precision before qualification as a quality control tool. Still, the results establish a quantitative relationship between optical and CTE anisotropy and support further development of 2-MGEM as a potential surrogate method for evaluating graphite matrix anisotropy in pebble fuel manufacturing.

Raftery, Alicia [ORNL] (ORCID:0000000259076427)↗

UQpy: A general purpose Python package and development environment for uncertainty quantification

In this paper, we present the UQpy software toolbox, an open-source Python package for general uncertainty quantification (UQ) in mathematical and physical systems. The software serves as both a user-ready toolbox that includes many of the latest methods for UQ in computational modeling and a convenient development environment for Python programmers advancing the field of UQ. The paper presents an introduction to the software's architecture and existing capabilities, divided in the code in a set of modules centered around different UQ tasks such as sampling methods, generation of random processes and random fields, probabilistic inverse modeling, reliability analysis, surrogate modeling, and active learning. The paper also highlights the importance of the RunModel module, which is used to drive simulations in the uncertainty analyses performed in UQpy. This module conveniently allows the user to define computational models directly in Python, or to run simulations from a third-party software in serial or in parallel. To illustrate the various capabilities, two examples are tracked throughout the paper and analyzed repeatedly for various UQ tasks. The first is a Python model solving a nonlinear structural dynamics problem, used to illustrate UQpy's capabilities in sampling and forward propagation of high dimensional random vectors (stochastic processes), and probabilistic inference. The second model is a third-party Abaqus finite element model solving the thermomechanical response of a beam structure. This example is used to illustrate UQpy's capabilities in variance reduction sampling techniques, reliability analysis, surrogate modeling and active learning techniques.

97 MATHEMATICS AND COMPUTING↗

A hybrid numerical and machine learning framework for evaluating the performance of a 780 cm 2 aqueous organic redox flow battery

Aqueous organic redox flow battery (AORFB) is a promising cost-competitive technology for large-scale energy storage. Among existing work, the dihydroxyphenazine (DHP)-based AORFB has demonstrated high energy density and low capacity degradation in 10 cm2 cells during lab tests. However, its commercial-scale performance in more complex environments remains unknown, posing a barrier for commercialization. To address this gap, this work presents a comprehensive performance evaluation of a 780 cm 2 DHP-based AORFB by combining physics-based numerical model, machine learning (ML)-based surrogate models, and ML-derived sensitivity quantification. Specifically, we first select 12 key battery parameters that include 10 physicochemical quantities and 2 operation quantities, then select 6 performance metrics that include energy efficiency (EE), discharging capacity, charging energy, and power losses due to concentration, activation, and ohmic over-potentials. With such selection, 12800 combinations of the 12 parameters are subsequently generated using the Latin Hypercube Sampling method. These combinations, together with 38 pre-defined State of Charge, are then integrated to a validated AORFB model developed in COMSOL to compute the performance metrics. With both input parameters and performance metrics, 60 deep neural network (DNN) surrogate models are then trained to approximate the relationship between the 10 physicochemical quantities and 6 performance metrics at each flow rate and current density. Sensitivity scores are then calculated based on the DNN models. Two additional sensitivity analysis tools, i.e., MARS, and SHAP, are also used to cross-validate the sensitivity scores from the DNN. The results demonstrate that 1) the standard potential ranks the first in controlling EE and charging energy, 2) the membrane conductivity is most critical for power loss and EE, and 3) specific area and reaction rate control activation power loss.

25 ENERGY STORAGE↗

Direct sensitivity analysis on the parameterization of crystal plasticity models

Various methods for calibrating crystal plasticity finite element (CPFE) models lead to non-unique input parameter values, which subsequently introduce uncertainty in the predicted mechanical response. Sensitivity analysis (SA) conducted on crystal plasticity models is used to identify how variability in these parameters contribute to output uncertainty. Traditional SA on CPFE parameters uses simplified surrogate models to save computational time. However, the accuracy of the surrogate models depends on the quantity of training data used, and any modeling error can propagate into the SA results, potentially affecting their reliability. In this work, the elementary effects test (EET) method, a global SA technique using direct CPFE simulations was employed, and the results obtained were compared with the First Order Second Moment (FOSM) method. ExaConstit, an open-source GPU-enabled CPFE code, was used to perform the simulations and direct SA. The EET method was accurately able to capture the non-linear effects of all the input parameters on the output and is a valuable approach for reliably attributing parameter sensitivities in CPFE models. Based on the results, efficient strategies to perform future parameter calibration and SA are discussed. Additionally, the SA trends observed in different single crystal orientations closely mirrored the activity of the slip systems.

Elementary Effects Test↗