Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “inverse modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Inverse prediction of PuO2 processing conditions using Bayesian seemingly unrelated regression with functional data

Over the past decade, a variety of innovative methodologies have been developed to better characterize the relationships between processing conditions and the physical, morphological, and chemical features of special nuclear material (SNM). Different processing conditions generate SNM products with different features, which are known as “signatures” because they are indicative of the processing conditions used to produce the material. These signatures can potentially allow a forensic analyst to determine which processes were used to produce the SNM and make inferences about where the material originated. This article investigates a statistical technique for relating processing conditions to the morphological features of PuO 2 particles. We develop a Bayesian implementation of seemingly unrelated regression (SUR) to inverse-predict unknown PuO 2 processing conditions from known PuO 2 features. Model results from simulated data demonstrate the usefulness of the technique. Applied to empirical data from a bench-scale experiment specifically designed with inverse prediction in mind, our model successfully predicts nitric acid concentration, while results for Pu concentration and precipitation temperature were equivalent to a simple mean model. Our technique compliments other recent methodologies developed for forensic analysis of nuclear material and can be generalized across the field of chemometrics for application to other materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks

One of the open problems in scientific computing is the long-time integration of nonlinear stochastic partial differential equations (SPDEs), especially with arbitrary initial data. We address this problem by taking advantage of recent advances in scientific machine learning and the spectral dynamically orthogonal (DO) and borthogonal (BO) methods for representing stochastic processes. The recently introduced DO/BO methods reduce the SPDE to solving a system of deterministic PDEs and a system of stochastic ordinary differential equations. Specifically, we propose two new physics-informed neural networks (PINNs) for solving time-dependent SPDEs, namely the neural network (NN)-DO/BO methods. The proposed methods incorporate the DO/BO constraints into the loss function (along with the modal decomposition of the SPDE) with an implicit form instead of generating explicit expressions for the temporal derivatives of the DO/BO modes. Hence, the NN-DO/BO methods can overcome some of the drawbacks of the original DO/BO methods. For example, we do not need the assumption that the covariance matrix of the random coefficients is invertible as in the original DO method, and we can remove the assumption of no eigenvalue crossing as in the original BO method. Moreover, the NN-DO/BO methods can be used to solve time-dependent stochastic inverse problems with the same formulation and same computational complexity as for forward problems. Furthermore, we demonstrate the capability of the proposed methods via several numerical examples, namely: (1) A linear stochastic advection equation with deterministic initial condition: we obtain good results with the proposed methods, while the original DO/BO methods cannot be applied directly in this case. (2) Long-time integration of the stochastic Burgers' equation: we show the good performance of NN-DO/BO methods, especially the effectiveness of the NN-BO approach for such problems with many eigenvalue crossings during the whole time evolution, while the original BO method fails. (3) Nonlinear reaction diffusion equation: we consider both the forward problem and the inverse problems, including very noisy initial point values, to investigate the flexibility of the NN-DO/BO methods in handling inverse and mixed type problems. Taken together, these simulation results demonstrate that the NN-DO/BO methods can be employed to effectively quantify uncertainty propagation in a wide range of physical problems, but future work should address the efficiency issue of PINNs for forward problems.

97 MATHEMATICS AND COMPUTING↗

Anthropogenic Impacts on Atmospheric Carbonyl Sulfide Since the 19th Century Inferred From Polar Firn Air and Ice Core Measurements

Carbonyl sulfide (COS) was measured in firn air collected during seven different field campaigns carried out at four different sites in Greenland and Antarctica between 2001 and 2015. A Bayesian probabilistic statistical model is used to conduct multisite inversions and to reconstruct separate atmospheric histories for Greenland and Antarctica. The firn air inversions cover most of the 20th century over Greenland and extend back to the 19th century over Antarctica. The derived atmospheric histories are consistent with independent surface air time series data from the corresponding sites and the Antarctic ice core COS records during periods of overlap. Atmospheric COS levels began to increase over preindustrial levels starting in the 19th century, and the increase continued for much of the 20th century. Atmospheric COS peaked at higher than present-day levels around 1975 CE over Greenland and around 1987 CE over Antarctica. An atmosphere/surface ocean box model is used to investigate the possible causes of observed variability. The results suggest that changes in the magnitude and location of anthropogenic sources have had a strong influence on the observed atmospheric COS variability.

54 ENVIRONMENTAL SCIENCES↗

Joint Inversion of Regional Waveform, First-Motion Polarity, and Synthetic Aperture Radar Surface Displacement for the Fourth and Sixth North Korean Declared Nuclear Explosions

Here, this study analyzed the Democratic People’s Republic of Korea’s (DPRK) fourth (DPRK4, 6 January 2016 M w 4.49) and sixth (DPRK6, 7 September 2017 M w 5.2) declared nuclear tests, employing a joint seismic and Interferometric Synthetic Aperture Radar (InSAR) inversion to improve understanding of these events and enhance moment tensor (MT) inversion capabilities. The recent efforts have focused on employing seismic waveform and InSAR geodetic deformation data separately to analyze these and the previous nuclear tests (e.g., Chiang et al., 2018; Myers et al., 2018; Wang et al., 2018). Building upon our previous work (Chi-Durán et al., 2021), we performed a joint regional waveform, first-motion (FM) polarity, and surface displacement inversion, which demonstrated improved source-type discrimination, a revised MT solution with reduced scalar moment uncertainty, and an independently constrained location. In this article, we build on the previous results for DPRK6 by including an analysis using a four-layered velocity model with free-surface topography to compute the near-source static deformation Green’s functions. The model consists of a 50 m basalt layer (⁠V P = 2.07 km/s, V S = 1.2 km/s⁠), a 250 m stratified volcanic deposit layer (⁠V P = 1.73 km/s, V S = 1.0 km/s⁠), a 700 m weathered granodiorite layer (⁠V P = 2.5 km/s, V S = 1.3 km/s⁠⁠), and a granodiorite half-space (⁠V P = 5.35 km/s, V S = 3.09 km/s⁠⁠). The half-space shares the velocity of the regional MDJ2 velocity model (Ford et al., 2010), which has proven effective for waveform inversion in the region. This model considers the range of reported values for various lithologies and weathering effects. Our findings show that using the layered velocity model enhances the recovery of source location and depth for both the explosions by improving fits and reducing uncertainties. The joint inversion also improves source-type discrimination and better constrains the scalar seismic moment necessary for downstream yield estimation.

58 GEOSCIENCES↗

Bayesian uncertainty quantification of tristructural isotropic particle fuel silver release: Decomposing model inadequacy plus experimental noise and parametric uncertainties

Tristructural isotropic (TRISO) particle fuel is one of the most promising fuel concepts enabling high temperature and high burnup reactor operation. One dominant source of radioactivity released from the TRISO particles is silver (Ag), which is subject to a high release fraction and long decay life compared to other fission products. Previous modeling efforts using the fuel performance code BISON indicated nonnegligible uncertainties in modeling the diffusion process of fission products in TRISO compared to the Advanced Gas Reactor experiments. The overall uncertainties observed when modeling the fission product diffusion can result from uncertainties in model parameters, noisy experimental measurements, and deficiencies in the developed models. The three types of underlying uncertainties have not yet been properly quantified in open literature. Here, this paper presents the Bayesian uncertainty quantification (UQ) using massively parallelizable Markov chain Monte Carlo samplers. The uncertainties due to model parameters, model inadequacy, and experimental measurement noise are quantified, with the σ term used to represent the sum of the model inadequacy and measurement noise uncertainties. It is worth noting that this is the first time the σ term is inferred for nuclear fuel experiments, as compared to using prescribed values for uncertainty quantification in previous work. The parallelizable Markov chain Monte Carlo samplers efficiently infer the model parameters and the σ term, giving insight into physical parameters like diffusion coefficients and the combined model discrepancy and measurement noise. A subsequent forward uncertainty quantification (UQ) is also performed based on the calibration results to generate more accurate predictions of the Ag release. The model inadequacy plus experimental noise is the most dominant source of uncertainty compared to the parametric uncertainty. All the UQ analyses presented in this work are based on the second series of the irradiation experiments in the Advanced Gas Reactor program.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

3D Multiresolution Velocity Model Fusion with Probability Graphical Models

ABSTRACT The variability in spatial resolution of seismic velocity models obtained via tomographic methodologies is attributed to many factors, including inversion strategies, ray-path coverage, and data integrity. Integration of such models, with distinct resolutions, is crucial during the refinement of community models, thereby enhancing the precision of ground-motion simulations. Toward this goal, we introduce the probability graphical model (PGM), combining velocity models with heterogeneous resolutions and nonuniform data point distributions. The PGM integrates data relations across varying resolution subdomains, enhancing detail within low-resolution (LR) domains by utilizing information and prior knowledge from high-resolution (HR) subdomains through a maximum posterior problem. Assessment of efficacy, utilizing both 2D and 3D velocity models—consisting of synthetic checkerboard models and a fault-zone model from Ridgecrest, California—demonstrates noteworthy improvements in accuracy, compared to state-of-the-art fusion techniques. Specifically, we find reductions of 30% and 44% in computed travel-time residuals for 2D and 3D models, respectively, as compared to conventional smoothing techniques. Unlike conventional methods, the PGM’s adaptive weight selection facilitates preserving and learning details from complex, nonuniform HR models and applies the enhancements to the LR background domain.

Geochemistry & Geophysics↗

Joint Inversion of Surface Electrical Resistivity Tomography and Seismic Refraction Data between the 200 Areas

Geologic stratigraphy on the Hanford Site influences groundwater and contaminant migration through the aquifer system and the vadose zone. The current geologic framework model (GFM) relies heavily on a sparse distribution of borehole data in some locations to map geologic contacts and hydrologic properties in the subsurface. Non-invasive geophysical methods such as electrical resistivity tomography (ERT), transient electromagnetic surveying, and seismic imaging are being used at Hanford to map subsurface structure in areas with limited well observations. This is to develop and mature the capability of geophysical methods to aid in GFM refinement, to identify regions of subsurface complexity, and for optimal well siting. A joint inversion of co-located seismic refraction and ERT data was carried out for data collected on a ~2.3-km profile between the 200 Areas on the Hanford Site. While ERT and seismic refraction images have sensitivity to overlapping physical properties (porosity, moisture content, lithology), the resolution and physics used to acquire each of these datasets are different and therefore information can be different or mutually complementary. Performing a joint inversion provides a reasonable option for a coherent, coupled interpretation for mutually complementary datasets. Between the 200 Areas, there are few boreholes to interpret the geologic framework model, and these data sets were obtained to provide a first line of evidence toward identifying stratigraphic structure. The seismic refraction and ERT data were independently inverted during fiscal year 2022 and broadly showed a two-layer structure with a trough-like feature that is ~1 km wide and upwards of 150 m deep. The depth of the trough feature was greater in the ERT image compared to the seismic image, which indicated a maximum depth of approximately 110 m. The objective of the joint inversion described in this report was to invert the seismic refraction and ERT data together while constraining the ERT image to be structurally similar to the seismic refraction image. The approach was applied using the geophysical inverse modeling program E4D, which has the capability to invert first-arrival times from seismic refraction data and ERT resistances using a “cross-gradient” constraint. The application of cross-gradient constraints with different weights produces ERT models that show a high degree of similarity within the upper 100 m (above ~120 m elevation). None of the ERT models show an improved structural similarity to the seismic result; therefore, it is recommended that further attempts to jointly interpret these models focus on petrophysics and image resolution. Petrophysical measurements of core samples would improve knowledge of what drives the ERT response in this region and, along with downhole geophysical measurements, could be used to “ground truth” the surface-based geophysical results. Image resolution studies would provide insight into which regions of the inverted images are reliable and which regions are poorly constrained.

58 GEOSCIENCES↗

Optimal Experimental Design for Inverse Problems in the Presence of Observation Correlations

Optimal experimental design (OED) is the general formalism of sensor placement and decisions on the data collection strategy for engineered or natural experiments. This problem is prevalent in many critical fields such as battery design, numerical weather prediction, geosciences, environmental and urban studies. State-of-the-art computational methods for experimental design do not accommodate correlation structure in observational errors produced by many expensive-to-operate devices such as X-ray machines, radars, and satellites. Discarding evident data correlations leads to biased results, higher expenses, and waste of valuable resources. We present a general formulation of the OED formalism for model-constrained large-scale Bayesian linear inverse problems, where measurement errors are generally correlated. The proposed approach utilizes the Hadamard product of matrices to formulate the weighted-likelihood, and is valid for both finite as well as infinite-dimensional Bayesian inverse problems. Extensive numerical experiments are carried out for empirical verification of the proposed approach using an advection-diffusion model, where the objective is to optimally place a small set of sensors, under a limited budget, to predict the concentration of a contaminant in a closed and bounded domain.

Correlated observations↗

Acceleration mechanisms of energetic ion debris in laser-driven tin plasma EUV sources

Laser-driven tin plasmas are driving new-generation nanolithography as sources of extreme ultraviolet (EUV) radiation centered at 13.5 nm. A major challenge facing industrial EUV source development is predicting energetic ion debris produced during the plasma expansion that may damage the sensitive EUV channeling multilayer optics. Gaining a detailed understanding of the plasma dynamics and ion acceleration mechanisms in these sources could provide critical insights for designing debris mitigation strategies in future high-power EUV sources. Here, we develop a fully kinetic model of tin-EUV sources using one-dimensional particle-in-cell simulations to study ion debris acceleration, which will be valuable for cross-validation of radiation-hydrodynamic simulations. An inverse-bremsstrahlung heating operator is used to model the interaction of a tin target with an Nd:YAG laser, and thermal conduction is included through a Monte Carlo Coulomb collision operator. While the large-scale evolution is in reasonable agreement with analogous hydrodynamic simulations, the significant timescale for collisional equilibration between electrons and ions allows for the development of prominent two-temperature features. A collimated flow of energetic ions is produced with a spectrum that is significantly enhanced at high energies compared to fluid simulations. The dominant acceleration mechanism is found to be a large-scale electric field supported mainly by the electron pressure gradient, which is enhanced in the kinetic simulations due to the increased electron temperature. We discuss the implications of these results for future modeling of tin-EUV sources and the development of debris mitigation schemes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Artificial intelligence-driven approaches for materials design and discovery

Materials design is an important component of modern science and technology, yet traditional approaches rely heavily on trial and error and can be inefficient. Computational techniques, enhanced by modern artificial intelligence, have reshaped the landscape of designing new materials. Among these approaches, inverse design has shown great promise in designing materials that meet specific property requirements. Here, in this Review, we present key computational advances in materials design over the past few decades. We follow the evolution of relevant materials design techniques, from high-throughput forward machine learning methods and evolutionary algorithms, to advanced artificial intelligence strategies such as reinforcement learning and deep generative models. We highlight the paradigm shift from conventional screening approaches to inverse generation driven by deep generative models. Finally, we discuss current challenges and future perspectives of materials inverse design. This Review may serve as a brief guide to the approaches, progress and outlook of designing future functional materials with technological relevance.

computational methods↗

Inversion of Time-Lapse Seismic Reservoir Monitoring Data Using CycleGAN: A Deep Learning-Based Approach for Estimating Dynamic Reservoir Property Changes

Carbon capture and storage is being pursued globally as a geoengineering measure for reducing the emission of anthropogenic CO 2 the atmosphere. Comprehensive monitoring, verification, and accounting programs must be established for demonstrating the safe storage of injected CO 2 . One of the most commonly deployed monitoring techniques is time-lapse seismic reservoir monitoring (also known as 4-D seismic), which involves comparing 3-D seismic survey data taken at the same study site but over different times. Analyses of 4-D seismic data volumes can help improve the quality of storage reservoir characterization, track the movement of injected CO 2 plume, and identify potential CO 2 spillover/leakage from the storage reservoirblue. However, the derivation of high-resolution CO 2 saturation maps from 4-D seismic data is a highly nonlinear and ill-posed inverse problem, often requiring significant computational effort. In this research, we apply a physics-based deep learning method to facilitate the solution of both the forward and inverse problems in seismic inversion while honoring physical constraints. A cycle generative adversarial neural network (CycleGAN) model is trained to learn the bidirectional functional mappings between the reservoir dynamic property changes and seismic attribute changes, such that both forward and inverse solutions can be obtained efficiently from the trained model. We show that our CycleGAN-based approach not only improves the reliability of 4-D seismic inversion but also expedites the quantitative interpretation. Our deep learning-based workflow is generic and can be readily used for reservoir characterization and reservoir model updates involving the use of 4-D seismic data.

58 GEOSCIENCES↗

A New Capability of E4D For 3D Parallel Joint Inversion of DC Resistivity And Traveltime Data on Unstructured Mesh

A major challenge in interpreting geophysical data is how to derive consistent three-dimensional (3D) earth models of different physical properties from spatially and temporally limited measurements. Joint inversion with cross-gradient constraints is an approach to find such models by imposing structural similarities between different physical parameters. We have developed a parallel distributed-memory joint inversion code for direct-current (DC) resistivity and traveltime data using the cross-gradient constraint on unstructured mesh. The code utilizes existing E4D framework for parallel forward simulation, distributed storage and computation of the Jacobian matrix of forward operator, and parallel execution of matrix-vector multiplication during inversion. Besides, the joint inversion is solved by nonlinear conjugate gradient algorithm parallelized for DC resistivity and traveltime data. The joint inversion capability of E4D was tested using synthetic data from cross-borehole DC resistivity and traveltime data. The results indicate that the shape and size of the anomalies from the joint inversion are more reliable than those from separate inversions.

58 GEOSCIENCES↗

Radiation Source Localization Using Surrogate Models Constructed from 3-D Monte Carlo Transport Physics Simulations

Recent research has focused on the development of surrogate models for radiation source localization in a simulated urban domain. We employ the Monte Carlo N-Particle (MCNP) code to provide high- delity simulations of radiation transport within an urban domain. The model is constructed to employ a source location (x, y, z) as input and return the estimated count rate for a set of speci ed detector locations. Because MCNP simulations are computationally expensive, we develop e cient and accurate surrogate models of the detector responses. We construct surrogate models using Gaussian processes (GP) and neural networks (NN) that we train and verify using the MCNP simulations. The trained surrogate models provide an e cient framework for Bayesian inference and experimental design. We employ Delayed Rejection Adaptive Metropolis (DRAM), a Markov Chain Monte Carlo (MCMC) algorithm, to infer the location and intensity of an unknown source. The DRAM results yield a posterior probability distribution for the source's location conditioned on the observed detector count rates. The posterior distribution exhibits regions of high and low probability within the simulated environment identifying potential source locations. In this manner, we can quantify the source location to within at least one of these regions of high probability in the considered cases. Employing these methods, we are able to reduce the space of potential source locations by at least 60%.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A novel approach for tetrahedral-element-based finite element simulations of anisotropic hyperelastic intervertebral disc behavior

Intervertebral discs are microstructurally complex spinal tissues that add greatly to the flexibility and mechanical strength of the human spine. Attempting to provide an adjustable basis for capturing a wide range of mechanical characteristics and to better address known challenges of numerical modeling of the disc, we present a robust finite-element-based model formulation for spinal segments in a hyperelastic framework using tetrahedral elements. We evaluate the model stability and accuracy using numerical simulations, with particular attention to the degenerated intervertebral discs and their likely skewed and narrowed geometry. To this end, 1) annulus fibrosus is modeled as a fiber-reinforced Mooney-Rivlin type solid for numerical analysis. 2) An adaptive state-variable dependent explicit time step is proposed and utilized here as a computationally efficient alternative to theoretical estimates. 3) Tetrahedral-element-based FE models for spinal segments under various loading conditions are evaluated for their use in robust numerical simulations. For flexion, extension, lateral bending, and axial rotation load cases, numerical simulations reveal that a suitable framework based on tetrahedral elements can provide greater stability and flexibility concerning geometrical meshing over commonly employed hexahedral-element-based ones for representation and study of spinal segments in various stages of degeneration.

59 BASIC BIOLOGICAL SCIENCES↗

Uncertainty reduction in residual stress measurements by an optimised inverse solution using nonconsecutive polynomials

Many destructive methods for measuring residual stresses such as the slitting method require an inverse analysis to solve the problem. The accuracy of the result as well as an uncertainty component (the model uncertainty) depends on the basis functions used in the inverse solution. The use of a series expansion as the basis functions for the inverse solution was analysed in a previous work for the particular case where functions orders grew consecutively. The present work presents a new estimation of the model uncertainty and a new improved methodology to select the final basis functions for the case where the basis is composed of polynomials. Including nonconsecutive polynomial orders in the basis generates a larger space of possible solutions to be evaluated and allows the possibility to include higher-order polynomials. The paper includes a comparison with two other inverse analyses methodologies applied to synthetically generated data. With the new methodology, the final error is reduced and the uncertainty estimation improved.

36 MATERIALS SCIENCE↗

Multi-Fidelity Active Subspaces for Wind Farm Uncertainty Quantification

Wind plants operate in stochastic environments characterized by complex turbulent flow dynamics and high-dimensional random variables. A key step in uncertainty quantification studies is sensitivity analysis and dimension reduction that can facilitate the development of surrogate models to be used for forward and inverse propagation or optimization under uncertainty. Prior work has shown active subspaces are an effective tool for identifying important directions in the space of stochastic inputs; however, they have only been applied to single-fidelity wind plant models. In this study, we investigate the efficacy of a multi-fidelity active subspace method for analyzing the uncertainty in wind plant power output. The multi-fidelity active subspace estimator offers the promise of increased accuracy in identifying active subspaces as compared to a single-fidelity estimator for the same computational cost, or a reduction in cost for the same accuracy. This makes the study of uncertainty in larger wind plants and with higher fidelity physics tractable. The multi-fidelity active subspace method is applied to gridded and existing wind plant layouts with single and multiple inflow conditions and its performance for surrogate modeling and uncertainty propagation is compared against a single-fidelity active subspace method. This multi-fidelity approach yields substantial computational speedups of 2x - 3.4x across the test cases along with acceptable accuracy in surrogate modeling and computing statistical moments.

active subspace↗

Efficient Neural Network Approaches for Conditional Optimal Transport with Applications in Bayesian Inference

In this work, we present two neural network approaches that approximate the solutions of static and dynamic conditional optimal transport (COT) problems. Both approaches enable conditional sampling and conditional density estimation, which are core tasks in Bayesian inference—particularly in the simulation-based (“likelihood-free”) setting. Our methods represent the target conditional distribution as a transformation of a tractable reference distribution. Obtaining such a transformation, chosen here to be an approximation of the COT map, is computationally challenging even in moderate dimensions. To improve scalability, our numerical algorithms use neural networks to parameterize candidate maps and further exploit the structure of the COT problem. Our static approach approximates the map as the gradient of a partially input convex neural network. It uses a novel numerical implementation to increase computational efficiency compared to state-of-the-art alternatives. Our dynamic approach approximates the conditional optimal transport via the flow map of a regularized neural ODE; compared to the static approach, it is slower to train but offers more modeling choices and can lead to faster sampling. We demonstrate both algorithms numerically, comparing them with competing state-of-the-art approaches, using benchmark datasets and simulation-based Bayesian inverse problems.

97 MATHEMATICS AND COMPUTING↗

Parameter estimation for X-ray scattering analysis with Hamiltonian Markov Chain Monte Carlo

Bayesian-inference-based approaches, in particular the random-walk Markov Chain Monte Carlo (MCMC) method, have received much attention recently for X-ray scattering analysis. Hamiltonian MCMC, a state-of-the-art development in the field of MCMC, has become popular in recent years. It utilizes Hamiltonian dynamics for indirect but much more efficient drawings of the model parameters. We described the principle of the Hamiltonian MCMC for inversion problems in X-ray scattering analysis by estimating high-dimensional models for several motivating scenarios in small-angle X-ray scattering, reflectivity, and X-ray fluorescence holography. Hamiltonian MCMC with appropriate preconditioning can deliver superior performance over the random-walk MCMC, and thus can be used as an efficient tool for the statistical analysis of the parameter distributions, as well as model predictions and confidence analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗