Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “inversion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Bi-fidelity Gradient-Based Approach for Nonlinear Well Logging Inverse Problems

Solving a non-linear inverse problem is challenging in computational science and engineering. Sampling based methods require a large number of model valuations; gradientbased methods require fewer model evaluations but only find the local minima. Multifidelity optimization combines the low fidelity model and the high-fidelity model to achieve both high accuracy and high efficiency. In this paper, we present a bi-fidelity approach to solve non-linear inverse problems. In the bi-fidelity inversion method, the low-fidelity model is used to acquire a good initial guess, and the high-fidelity model is used to locate the global minimum. Combined with a multi-start optimization scheme, the proposed approach significantly increases the possibility of finding the global minimum for nonlinear inverse problems with many local minima. The method is tested with two toy problems and then applied to an electromagnetic well logging inverse problem, which is difficult to solve using traditional gradient-based methods. The bi-fidelity method provides promising inversion results and can be easily applied to traditional gradient-based methods.

42 ENGINEERING↗

Robust A-Optimal Experimental Design for Sensor Placement in Bayesian Linear Inverse Problems

Optimal design of experiments for Bayesian inverse problems has recently gained wide popularity and attracted much attention, especially in the computational science and Bayesian inversion communities. An optimal design maximizes a predefined utility function that is formulated in terms of the elements of an inverse problem, an example being optimal sensor placement for parameter identification. The state-of-the-art algorithmic approaches following this simple formulation generally overlook misspecification of the elements of the inverse problem, such as the prior or the measurement uncertainties. This work presents an efficient algorithmic approach for designing optimal experimental design schemes for Bayesian linear inverse problems such that the optimal design is robust to misspecification of elements of the inverse problem. Specifically, we consider a worst-case scenario approach for the uncertain or misspecified parameters, formulate robust objectives, and propose an algorithmic approach for optimizing such objectives. Furthermore, both relaxation and stochastic solution approaches are discussed with detailed analysis and insight into the interpretation of the problem and the proposed algorithmic approach. Extensive numerical experiments to validate and analyze the proposed approach are carried out for sensor placement in a parameter identification problem.

Bayesian inverse problems↗

Multi-variance replica exchange SGMCMC for inverse and forward problems via Bayesian PINN

Physics-informed neural network (PINN) has been successfully applied in solving a variety of nonlinear non-convex forward and inverse problems. However, the training is challenging because of the non-convex loss functions and the multiple optima in the Bayesian inverse problem. In this work, we propose a multi-variance replica exchange stochastic gradient Langevin dynamics method to tackle the challenge of the multiple local optima in the optimization and the challenge of the multiple modal posterior distribution in the inverse problem. Replica exchange methods are capable of escaping from the local traps and accelerating the convergence; two chains with different temperatures are designed where the low temperature chain aims for the local convergence, and the target of the high temperature chain is to travel globally and explore the whole loss function entropy landscape. However, it may not be efficient to solve mathematical inversion problems by using the vanilla replica method directly since the method doubles the computational cost in evaluating the forward solvers (likelihood functions) in the two chains. To address this issue, we propose to make different assumptions on the energy function estimation and this facilities one to use solvers of different fidelities in the likelihood function evaluation. More precisely, one can use a solver with low fidelity in the high temperature chain while using a solver with high fidelity in the low temperature chain. Our proposed method significantly lowers the computational cost in the high temperature chain, meanwhile preserving the accuracy and converging very fast. Here we give an unbiased estimate of the swapping rate and give an estimation of the discretization error of the scheme. To verify our idea, we design and solve four inverse problems which have multiple modes. The proposed method is also employed to train the Bayesian PINN to solve the forward and inverse problems; faster and more accurate convergence has been observed when compared to the stochastic gradient Langevin dynamics (SGLD) method and vanilla replica exchange methods.

97 MATHEMATICS AND COMPUTING↗

Deep inverse photonic design: A tutorial

Deep learning (DL) has been used to design deep neural networks (DNNs) which have recently been applied to solving inverse problems in artificial electromagnetic materials (AEMs). Although inverse problems are often ill-posed, and therefore are difficult to solve, deep inverse models (DIMs) have achieved impressive results often surpassing capabilities possible with other approaches. We overview the process of deep inverse learning applied to AEM problems, including the building of data sets, design of a forward model, and comparison of inverse approaches including limitations. We conclude by detailing some important outstanding issues of deep inverse design of AEMs, and present an outlook of this exciting field.

42 ENGINEERING↗

Coupled Time-Lapse Full-Waveform Inversion for Subsurface Flow Problems Using Intrusive Automatic Differentiation

We describe a novel framework for estimating subsurface properties, such as rock permeability and porosity, from time-lapse observed seismic data by coupling full-waveform inversion (FWI), subsurface flow processes, and rock physics models. For the inverse modeling, we handle the back propagation of gradients by an intrusive automatic differentiation strategy that offers three levels of user control: (1) At the wave physics level, we adopted the discrete adjoint method in order to use our existing high-performance FWI code; (2) at the rock physics level, we used built-in automatic differentiation operators from the TensorFlow backend; (3) at the flow physics level, we implemented customized partial differential equation (PDE) operators for the multiphase flow equations. The three-level coupled inversion strategy strikes a good balance between computational efficiency and programming efforts, and when the gradients are chained together, it constitutes a coupled inverse system. Our numerical experiments demonstrate that the three-level coupled inverse problem is superior in terms of accuracy to a traditional decoupled inversion strategy. Additionally, our method is able to simultaneously invert for parameters in empirical relationships such as the rock physics models. Our proposed inverted model can be used for reservoir performance prediction and reservoir management/optimization purposes.

54 ENVIRONMENTAL SCIENCES↗

Real-time deep-learning inversion of seismic full waveform data for CO 2 saturation and uncertainty in geological carbon storage monitoring

Deep-learning inversion has recently drawn attention in geological carbon storage research due to its potential of imaging and monitoring carbon storage in real time, significantly improving efficiency and safety of carbon storage operations. We present a deep-learning full waveform inversion method that after the neural network has been trained can image CO 2 saturation and its uncertainty in real time. Our deep-learning inversion method is based on the U-Net architecture with the neural network trained on pairs of synthetic seismic data and CO 2 saturation models. Accordingly, our training establishes a mapping relationship between seismic data and CO 2 saturation models and once fully trained directly estimates CO 2 saturation as a function of subsurface location. We further quantify uncertainties of CO 2 saturation estimates using the Monte Carlo dropout method and a bootstrap aggregating method. For this proof-of-concept study, the CO 2 training models and data are derived from the Kimberlina 1.2 model, a hypothetical 3D geological carbon storage model that is constructed based on various geological and hydrological data from the Southern San Joaquin Basin, California. We perform deep-learning inversion experiments using noise-free and noisy training and test data sets and compare the results. Our modelling experiments show that (1) the deep-learning inversion can estimate 2D distributions of CO 2 fairly well even in the presence of Gaussian random noise and (2) both CO 2 saturation imaging and uncertainty quantification can be done in real time. Our results suggest that the deep-learning inversion method can serve as a robust real-time monitoring tool for geological carbon storage and/or other time-varying reservoir/aquifer properties that result from injection, extraction, and/or other subsurface transport phenomena.

58 GEOSCIENCES↗

Inverse Analysis with Variational Autoencoders: A Comparison of Shallow and Deep Networks

Inverse problems are applied to determine unknown properties by matching observational data with a physical model that often takes many parameters as input. To overcome the underconstrained nature of inverse problems and achieve good performance, an approach is presented involving regularization with a technique known as a variational autoencoder (VAE), which is trained to map a high-dimensional parameter space with a complex structure to a low-dimensional latent space with a simple structure. We apply this approach to unconditioned realizations of the parameters (heterogeneous hydraulic fields) for a hydrogeological inverse problem. Two types of hydraulic conductivity fields are used to evaluate the characterization for the different levels of heterogeneity complexity of the physical inputs. This approach keeps the computational cost of generating the training data low. The reason is unconditioned realizations neither rely on the observational data used to perform the inverse analysis nor require any groundwater flow model forward runs. In addition, this approach applies regularization on a low-dimensional latent space from the VAE and increases optimization efficiency through automatic differentiation. Furthermore, two different neural network (NN) structures are tested for their utility in using the VAE for inverse analysis. The performance of a deep, convolutional neural network strongly depends on the dimensionality of the latent space, which requires tuning. In contrast, a shallow, dense neural network provides consistently accurate characterization without tuning. Furthermore, our approach evaluates the advantages of the shallow, dense neural network over the deep, convolutional one and enables future application to a wide range of inverse problems.

97 MATHEMATICS AND COMPUTING↗

Anisotropic seismic-waveform inversion: Application to a seismic velocity model from Eleven-Mile Canyon in Nevada

Accurate imaging and characterization of fracture zones is crucial for geothermal energy exploration. Aligned fractures within fracture zones behave as anisotropic media for seismic-wave propagation. The anisotropic properties in fracture zones introduce extra difficulties for seismic imaging and waveform inversion. We have recently developed a new anisotropic elastic-waveform inversion method using a modified total-variation regularization scheme and a wave-energy-base preconditioning technique. Our new inversion method uses the parameterization of elasticity constants to describe anisotropic media, and hence it can properly handle arbitrary anisotropy. We apply our new inversion method to a seismic velocity model along a 2D-line seismic data acquired at Eleven-Mile Canyon located at the Southern Dixie Valley in Nevada for geothermal energy exploration. Our inversion results show that anisotropic elastic-waveform inversion has potential to reconstruct subsurface anisotropic elastic parameters for imaging and characterization of fracture zones.

15 GEOTHERMAL ENERGY↗

Influence of the inverse sheath on divertor plasma performance in tokamak edge plasma simulations

Recently, it was shown that strong electron thermionic emission from material walls could result in the formation of an “inverse sheath”, which prevents the flow of cold ions to the wall. Such regimes look very favorably from the point of view of plasma-material interactions at the edge of magnetic fusion devices, where the problem of the erosion of plasma facing components under ion irradiation is one of the key issues for developing of future magnetic fusion reactors. However, it is not clear whether such regimes are compatible with edge plasma parameters and heat removal requirements in fusion reactors.To address the issue of practicality of the “inverse sheath” regime for edge tokamak plasma conditions, we perform a set of numerical simulations with 2D edge plasma transport code UEDGE for a DIII-D-like geometry and magnetic configuration.To describe both “standard” and “inverse sheath” conditions within the framework of the UEDGE code (which does not consider the sheath region per se), at the material surfaces, we apply effective boundary conditions which emulate both “standard” and“inverse sheath” regimes. We demonstrate that for the same input parameters, spatial distributions of edge plasma parameters corresponding to detached divertor and“inverse sheath” regimes are similar, with only a few minor differences. We discuss the compatibility of “inverse sheath” regimes with core plasma parameters.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Comparison of Inversion (“flipping”) Rates Among Different Port Designs: A Single-Center Experience

PurposeTo compare incidence of port inversion among different types of implantable venous access devices.Materials and Methods Records of patients who underwent imaging-guided subcutaneous port placement without port fixation between July 2001 and April 2015 were reviewed with use of a quality assurance database. 1930 patients with complete follow-up (death or explant) were included in the study. Collected data included date and indication for port placement, port type, venous access site, immediate and long-term complications, indication for removal, and total number of catheter days. BMI of patients with inverted ports was also calculated.Results Port inversion within the pocket was observed in 18 patients (0.9%) including 7/82 (9%) of Dignity ports, 4/126 (3%) of Vaxcel plastic arm ports, 3/142 (2%) of Smartports, 2/100 (2%) of Powerports, 1/14 (7%) of Vaccess ports, and 1/1421 (0.07%) of Vortex LP ports. Among these designs, the inversion rate was significantly lower in Vortex LP ports (0.1%) (P < 0.05). There was a trend toward higher inversion rate of Dignity ports, which have a rectangular design with a relatively narrow base. Mean dwell in inverted ports was 114 days (7–580).Conclusion The incidence of port inversion without suture fixation of the port base to the pocket is extremely low. The present study shows differences in inversion incidence based on port design.Level of Evidence: Case Series, Level IV.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Stochastic joint inversion of hydrogeophysical data for salt tracer test monitoring and hydraulic conductivity imaging

The assessment of hydraulic conductivity of heterogeneous aquifers is a difficult task using traditional hydrogeological methods (e.g., steady state or transient pumping tests) due to their low spatial resolution. Geophysical measurements performed at the ground surface and in boreholes provide additional information for increasing the resolution and accuracy of the inverted hydraulic conductivity field. We used a stochastic joint inversion of Direct Current (DC) resistivity and Self-Potential (SP) data plus in situ measurement of the salinity in a downstream well during a synthetic salt tracer experiment to reconstruct the hydraulic conductivity field between two wells. The pilot point parameterization was used to avoid over-parameterization of the inverse problem. Bounds on the model parameters were used to promote a consistent Markov chain Monte Carlo sampling of the model parameters. To evaluate the effectiveness of the joint inversion process, we compared 8 cases in which the geophysical data are coupled or not to the in situ sampling of the salinity to map the hydraulic conductivity. We first tested the effectiveness of the inversion of each type of data alone (concentration sampling, self-potential, and DC resistivity), and then we combined the data two by two. We finally combined all the data together to show the value of each type of geophysical data in the joint inversion process because of their different sensitivity map. We also investigated a case in which the data were contaminated with noise and the variogram unknown and inverted stochastically. The results of the inversion revealed that incorporating the self-potential data improves the estimate of hydraulic conductivity field especially when the self-potential data were combined to the salt concentration measurement in the second well or to the time-lapse cross-well electrical resistivity data. Various tests were also performed to quantify the uncertainty in the inverted hydraulic conductivity field.

54 ENVIRONMENTAL SCIENCES↗

Influence of Inversion on Mg Mobility and Electrochemistry in Spinels

Magnesium oxide and sulfide spinels have recently attracted interest as cathode and electrolyte materials for energy-dense Mg batteries, but their observed electrochemical performance depends strongly on synthesis conditions. In this study, using first-principles calculations and percolation theory, we explore the extent to which spinel inversion influences Mg 2+ ionic mobility in MgMn 2 O 4 as a prototypical cathode, and MgIn 2 S 4 as a potential solid electrolyte. We find that spinel inversion and the resulting changes of the local cation ordering give rise to both increased and decreased Mg 2+ migration barriers, along specific migration pathways, in the oxide as well as the sulfide. To quantify the impact of spinel inversion on macroscopic Mg 2+ transport, we determine the percolation thresholds in both MgMn 2 O 4 and MgIn 2 S 4 . Furthermore, we analyze the impact of inversion on the electrochemical properties of the MgMn 2 O 4 cathode via changes in the phase behavior, average Mg insertion voltages and extractable capacities, at varying degrees of inversion. In conclusion, our results confirm that inversion is a major performance limiting factor of Mg spinels and that synthesis techniques or compositions that stabilize the well-ordered spinel structure are crucial for the success of Mg spinels in multivalent batteries.

36 MATERIALS SCIENCE↗

Identifying Band Inversions in Topological Materials Using Diffusion Monte Carlo

Topological insulators are characterized by insulating bulk states and robust metallic surface states. Band inversion is a hallmark of topological insulators. At time-reversal invariant points in the Brillouin zone, spin–orbit coupling (SOC) induces a swapping of orbital character at the bulk band edges. Reliably detecting band inversion in solid-state systems with many-body methods would aid in identifying possible candidates for spintronics and quantum computing applications and improve our understanding of the physics behind topologically nontrivial systems. Density functional theory (DFT) methods are a well-established means of investigating these interesting materials due to their favorable balance of computational cost and accuracy but often struggle to accurately model the electron–electron correlations present in the many materials containing heavier elements. In this work, we develop a novel method to detect band inversion within continuum quantum Monte Carlo (QMC) methods that can accurately treat the electron correlation and spin–orbit coupling that are crucial to the physics of topological insulators. Our approach applies a momentum-space-resolved atomic population analysis throughout the first Brillouin zone utilizing the Löwdin method and the one-body reduced density matrix produced with diffusion Monte Carlo (DMC). We integrate this method into QMCPACK, an open source ab initio QMC package, so that these ground-state methods can be used to complement experimental studies and validate prior DFT work on predicting the band structures of correlated topological insulators. Here, we demonstrate this new technique on the topological insulator bismuth telluride, which displays band inversion between its Bi-p and Te-p states at the Γ-point. We show an increase in charge on the bismuth-p orbital and a decrease in charge on the tellurium-p orbital when comparing band structures with and without SOC. Additionally, we use our method to compare the degree of band inversion present in monolayer Bi 2 Te 3 , which has no interlayer van der Waals interactions, to that seen in the bilayer and bulk. The method presented here will enable future many-body studies of band inversion that can shed light on the delicate interplay between correlation and topology in correlated topological materials.

Band structure↗

Physics-embedded inverse analysis with algorithmic differentiation for the earth’s subsurface

Abstract Inverse analysis has been utilized to understand unknown underground geological properties by matching the observational data with simulators. To overcome the underconstrained nature of inverse problems and achieve good performance, an approach is presented with embedded physics and a technique known as algorithmic differentiation. We use a physics-embedded generative model, which takes statistically simple parameters as input and outputs subsurface properties (e.g., permeability or P-wave velocity), that embeds physical knowledge of the subsurface properties into inverse analysis and improves its performance. We tested the application of this approach on four geologic problems: two heterogeneous hydraulic conductivity fields, a hydraulic fracture network, and a seismic inversion for P-wave velocity. This physics-embedded inverse analysis approach consistently characterizes these geological problems accurately. Furthermore, the excellent performance in matching the observational data demonstrates the reliability of the proposed method. Moreover, the application of algorithmic differentiation makes this an easy and fast approach to inverse analysis when dealing with complicated geological structures.

54 ENVIRONMENTAL SCIENCES↗

Probabilistic inversion of circular phase spectra: application to two-station phase-velocity dispersion estimation in western Canada

SUMMARY Periodic directional and temporal measurements are common in seismology, and necessitate specific statistical analyses that are appropriate for circular quantities. In this work, we explore the use of a von Mises distribution as a representation of errors on circular seismological observations. Specifically, we automate the estimation of surface-wave phase-velocity dispersion for the teleseismic two-station method, which generally suffers from a 2π phase ambiguity. The use of Bayesian inverse techniques, which aim to rigorously quantify model parameter uncertainty, have become widespread throughout seismology over the last decade. Here, we apply Bayesian inversion to measurements of surface-wave phase spectra in order to estimate 1-D, path-averaged Earth structure between station pairs. The dispersion curve and associated uncertainties are additional results of the inversion, which can then be used as input for subsequent analyses (e.g. tomography). We demonstrate this technique through application to surface-wave recordings from long-running seismic stations throughout western Canada. Our results for over 10 000 station pairs reveal first-order tectonic features consistent with previous studies, which provides confidence in our approach as well as an initial step towards resolving a full 3-D seismic velocity model for the region. This work also presents a foundation for the inversion of surface-wave phase spectra to estimate 3-D Earth structure directly. Finally, the ideas presented in this work are not limited to the inversion of surface-wave phase spectra, but can also be considered for Bayesian geophysical inversion of any circular quantities.

Gosselin, Jeremy M. (ORCID:0000000203754102)↗

Ensemble Kalman inversion of induced polarization data

SUMMARY This paper explores the applicability of ensemble Kalman inversion (EKI) with level-set parametrization for solving geophysical inverse problems. In particular, we focus on its extension to induced polarization (IP) data with uncertainty quantification. IP data may provide rich information on characteristics of geological materials due to its sensitivity to characteristics of the pore–grain interface. In many IP studies, different geological units are juxtaposed and the goal is to delineate these units and obtain estimates of unit properties with uncertainty bounds. Conventional inversion of IP data does not resolve well sharp interfaces and tends to reduce and smooth resistivity variations, while not readily providing uncertainty estimates. Recently, it has been shown for DC resistivity that EKI is an efficient solver for inverse problems which provides uncertainty quantification, and its combination with level set parametrization can delineate arbitrary interfaces well. In this contribution, we demonstrate the extension of EKI to IP data using a sequential approach, where the mean field obtained from DC resistivity inversion is used as input for a separate phase angle inversion. We illustrate our workflow using a series of synthetic and field examples. Variations with uncertainty bounds in both DC resistivity and phase angles are recovered by EKI, which provides useful information for hydrogeological site characterization. Although phase angles are less well-resolved than DC resistivity, partly due to their smaller range and higher percentage data errors, it complements DC resistivity for site characterization. Overall, EKI with level set parametrization provides a practical approach forward for efficient hydrogeophysical imaging under uncertainty.

Geochemistry & Geophysics↗

Uncertainty analysis for infrasound waveform inversion: Application to explosion yield estimation

While the acoustic waveform inversion method is increasingly used in geophysical acoustics to constrain source parameters, the inversion results are often provided without any uncertainty analysis. Here, this study presents a probabilistic representation for acoustic waveform inversion and method to evaluate the inversion uncertainty using ground-truth data. A posteriori probability distribution of source estimate is described by a priori waveform misfit covariance and the variance of acoustic source model. The probabilistic framework is applied to local explosion infrasound to estimate the yields of explosions and uncertainty. Estimated yields showed overall good agreement with the true yields (less than 25% errors). The uncertainty of the estimated yield is represented by the sum of the waveform inversion uncertainty and source model uncertainty. It is shown that the yield uncertainty attributed to local infrasound inversion (within 10 km) is as small as the uncertainty caused by 10% prediction errors in the acoustic source model. Finally, these results indicate that the acoustic source model uncertainty should also be considered for accurate yield estimation and that local infrasound can be a valuable tool to understand the magnitude of the source uncertainty.

58 GEOSCIENCES↗

Solving multiphysics-based inverse problems with learned surrogates and constraints

Abstract Solving multiphysics-based inverse problems for geological carbon storage monitoring can be challenging when multimodal time-lapse data are expensive to collect and costly to simulate numerically. We overcome these challenges by combining computationally cheap learned surrogates with learned constraints. Not only does this combination lead to vastly improved inversions for the important fluid-flow property, permeability, it also provides a natural platform for inverting multimodal data including well measurements and active-source time-lapse seismic data. By adding a learned constraint, we arrive at a computationally feasible inversion approach that remains accurate. This is accomplished by including a trained deep neural network, known as a normalizing flow, which forces the model iterates to remain in-distribution, thereby safeguarding the accuracy of trained Fourier neural operators that act as surrogates for the computationally expensive multiphase flow simulations involving partial differential equation solves. By means of carefully selected experiments, centered around the problem of geological carbon storage, we demonstrate the efficacy of the proposed constrained optimization method on two different data modalities, namely time-lapse well and time-lapse seismic data. While permeability inversions from both these two modalities have their pluses and minuses, their joint inversion benefits from either, yielding valuable superior permeability inversions and CO 2 plume predictions near, and far away, from the monitoring wells.

Yin, Ziyi (ORCID:0000000250248771)↗