Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “FWI”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Pre-conditioned BFGS-based uncertainty quantification in elastic full-waveform inversion

SUMMARY Full-waveform inversion has become an essential technique for mapping geophysical subsurface structures. However, proper uncertainty quantification is often lacking in current applications. In theory, uncertainty quantification is related to the inverse Hessian (or the posterior covariance matrix). Even for common geophysical inverse problems its calculation is beyond the computational and storage capacities of the largest high-performance computing systems. In this study, we amend the Broyden–Fletcher–Goldfarb–Shanno (BFGS) algorithm to perform uncertainty quantification for large-scale applications. For seismic inverse problems, the limited-memory BFGS (L-BFGS) method prevails as the most efficient quasi-Newton method. We aim to augment it further to obtain an approximate inverse Hessian for uncertainty quantification in FWI. To facilitate retrieval of the inverse Hessian, we combine BFGS (essentially a full-history L-BFGS) with randomized singular value decomposition to determine a low-rank approximation of the inverse Hessian. Setting the rank number equal to the number of iterations makes this solution efficient and memory-affordable even for large-scale problems. Furthermore, based on the Gauss–Newton method, we formulate different initial, diagonal Hessian matrices as pre-conditioners for the inverse scheme and compare their performances in elastic FWI applications. We highlight our approach with the elastic Marmousi benchmark model, demonstrating the applicability of pre-conditioned BFGS for large-scale FWI and uncertainty quantification.

58 GEOSCIENCES↗

Machine learning for seismic low-frequency extrapolation

The cycle-skipping problem that plagues full waveform inversion (FWI) can be at least partially mitigated if low frequencies (which encode the kinematics of wave propagation in seismic data) are recorded. However, seismic sources and receivers are band-limited, so seismic data does not generally include signals down to 0 Hz. To improve our ability to solve the seismic inverse problem, one can synthesize this missing low-frequency (LF) content from the recorded high-frequency (HF) data using machine learning (ML) models. Deep learning models such as convolutional neural networks (CNNs) demonstrate impressive ability to perform low frequency extrapolation. However, such models require powerful hardware (GPU machines) and careful training. We assess the extrapolation capabilities of three different ML models that do not require GPU machines, namely, random forest, Gaussian process regression and gradient boosting, on both synthetic and real data. Experimental results on two synthetic data sets (generated from a low velocity lens embedded in a homogeneous medium, and the Marmousi model) demonstrate that FWI applied to the extrapolated data consistently improves inversion accuracy relative to FWI applied to the original data sets that do not contain low frequencies. Application of low-frequency extrapolation to real data from the Northwest Shelf of Australia demonstrates that tree-based ML models such as gradient boosting can outperform CNNs in terms of both accuracy and computational cost on non-GPU architectures.

58 GEOSCIENCES↗

InversionNet3D: Efficient and Scalable Learning for 3-D Full-Waveform Inversion

Seismic full-waveform inversion (FWI) techniques aim to find a high-resolution subsurface geophysical model provided with waveform data. Some recent effort in data-driven FWI has shown some encouraging results in obtaining 2-D velocity maps. However, due to high computational complexity and large memory consumption, the reconstruction of 3-D high-resolution velocity maps via deep networks is still a great challenge. Here, in this article, we present InversionNet3D (InvNet3D), an efficient and scalable encoder–decoder network for 3-D FWI. The proposed method employs group convolution in the encoder to establish an effective hierarchy for learning information from multiple sources while cutting down unnecessary parameters and operations at the same time. The introduction of invertible layers further reduces the memory consumption of intermediate features during training and, thus, enables the development of deeper networks with more layers and higher capacity as required by different application scenarios. Experiments on the 3-D Kimberlina dataset demonstrate that InvNet3D achieves state-of-the-art reconstruction performance with lower computational cost and lower memory footprint compared to the baseline.

58 GEOSCIENCES↗

Direct Numerical Simulation of Flame-Wall Interaction for Low-Carbon Gas Turbine Combustion

Green hydrogen (H2) and ammonia (NH3) are emerging as carbon free alternatives to hydrocarbon fuels. In gas turbines, flames interact with the combustor liner (wall), which affects the pollutant emissions, the burning efficiency, and the thermal load on the liner. We lack understanding of this important flame-wall interaction (FWI) for alternative fuels. FWI occurs at the scale of the flame thickness, and such scales are only resolved by direct numerical simulation. Here, we resolve the FWI for NH3 and H2 flames. Preliminary results of two distinct projects are presented: 2D laminar anchored V-flame, and 3D turbulent swirling flame. For the laminar flame, we show flame quenching at the wall and resulting leakage of NH3 and increased N2O, but decreased NO emissions. For the swirling flame, we show CO emissions, and comparison of flame shapes and location to experimental measurements. Ultimately we show that quenching and pollutant emissions strongly affected by fuel/air ratio, and that an inclined wall can stabilize very lean turbulent CH4/H2 flames, but prone to large CO emissions.

adaptive mesh refinement↗

Coupled Time-Lapse Full-Waveform Inversion for Subsurface Flow Problems Using Intrusive Automatic Differentiation

We describe a novel framework for estimating subsurface properties, such as rock permeability and porosity, from time-lapse observed seismic data by coupling full-waveform inversion (FWI), subsurface flow processes, and rock physics models. For the inverse modeling, we handle the back propagation of gradients by an intrusive automatic differentiation strategy that offers three levels of user control: (1) At the wave physics level, we adopted the discrete adjoint method in order to use our existing high-performance FWI code; (2) at the rock physics level, we used built-in automatic differentiation operators from the TensorFlow backend; (3) at the flow physics level, we implemented customized partial differential equation (PDE) operators for the multiphase flow equations. The three-level coupled inversion strategy strikes a good balance between computational efficiency and programming efforts, and when the gradients are chained together, it constitutes a coupled inverse system. Our numerical experiments demonstrate that the three-level coupled inverse problem is superior in terms of accuracy to a traditional decoupled inversion strategy. Additionally, our method is able to simultaneously invert for parameters in empirical relationships such as the rock physics models. Our proposed inverted model can be used for reservoir performance prediction and reservoir management/optimization purposes.

54 ENVIRONMENTAL SCIENCES↗

CFD modeling of near-wall combustion and unburned methane prediction in natural gas spark ignition engines

Natural gas-powered engines play a critical role in gas drilling, compression, and transmission sectors, but methane (CH 4 ) from engine combustion slip can be significant over their lifespan, contributing to atmospheric pollution and signaling reduced engine efficiency. Here, to address this challenge, computational fluid dynamics (CFD) simulations offer valuable insights into the in-cylinder combustion process, enabling the optimization of combustion strategies and engine designs to minimize unburned CH 4 slip. This study aims to evaluate and improve combustion models for simulating the combustion process and predicting unburned CH 4 concentrations in natural gas spark-ignition (SI) engines, including engines that are part of combined reformer-engine systems. Specifically, the performance of two flamelet-based combustion models—the Extended Coherent Flame Model (ECFM) and the G-equation model—was assessed using experimental engine data collected under varying excess-air ratio (λ) conditions and fuel compositions, including natural gas and syngas blends. In addition, to enhance the predictive capabilities of the G-equation model, a flame-wall interaction (FWI) sub-model was integrated into its framework. The effects of its model parameters, such as quenching and influence distance, on combustion behavior and unburned methane predictions were analyzed in detail. The ECFM tended to predict delayed combustion phasing under diluted mixture conditions, resulting in overprediction of unburned CH 4 concentrations. In contrast, the G-equation model provided reasonable predictions of combustion pressure, while representing higher the CH 4 reduction rate across the operating condition compared to experimental data. Incorporating the FWI sub-model—with the quenching distance calculated based on a pressure-dependent relation (P -0.48 ) and a fixed influence distance of 1.5 mm—further improved the G-equation model’s accuracy in predicting CH 4 reduction rates without compromising its ability to simulate the combustion process.

Combustion model↗

Shear reflectivity compensation in full-waveform inversion using least-squares reverse-time migration

SUMMARY The computational cost of elastic-waveform inversion is too high for inverting PP reflections, while using acoustic full-waveform inversion (FWI) is inaccurate because it does not depend on the shear modulus/velocity/impedance that affects elastic PP wavefield amplitudes. To solve this problem, we develop a waveform inversion method that uses acoustic least-squares reverse-time migration (LSRTM) to compensate the shear reflectivity for acoustic FWI. Our method is based on the quasi-elastic-wave equation developed by Chapman et al. (2014). The quasi-elastic-wave equation uses a linearized acoustic-wave equation with shear modulus μ as a virtual source to correct the acoustic PP wavefield amplitudes toward elastic ones. Our waveform inversion method inverts for elastic parameters by minimizing the L2 norm of the difference between recorded and predicted PP reflections modelled using the quasi-elastic-wave equation. Numerical tests on synthetic and field data show that our method can properly handle the amplitudes of elastic PP reflections and provides an accurate estimate of the P- and S-wave velocities/impedances and, in some cases, the density. The method does not need the computationally expensive numerical solution to the elastic-wave equation. It also gives a better estimate of elastic parameters than a pure LSRTM method for elastic PP reflections.

Feng, Zongcai↗

SPiRaL: a multiresolution global tomography model of seismic wave speeds and radial anisotropy variations in the crust and mantle

SUMMARY SPiRaL is a joint global-scale model of wave speeds (P and S) and anisotropy (vertical transverse isotropy, VTI) variations in the crust and mantle. The model is comprised of >2.1 million nodes with five parameters at each node that capture velocity variations for P- and S-waves travelling at arbitrary directions in transversely isotropic media with a vertical symmetry axis (VTI). The crust (including ice, water, sediments and crystalline layers) is directly incorporated into the model. The default node spacing is approximately 2° in the lower mantle and 1° in the crust and upper mantle. The grid is refined with ∼0.25° minimum node spacing in highly sampled regions of the crust and upper mantle throughout North America and Eurasia. The data considered in the construction of SPiRaL includes millions of body wave traveltimes (crustal, regional and teleseismic phases with multiples) and surface wave (Rayleigh and Love) dispersion. A multiresolution inversion approach is employed to capture long-wavelength heterogeneities commonly depicted in global-scale tomography images as well as more localized details that are typically resolved in more focused regional-scale studies. Our previous work has demonstrated that such global-scale models with regional-scale detail can accurately predict both teleseismic and regional body wave traveltimes, which is necessary for more accurate location of small seismic events that may have limited signal at teleseismic distances. SPiRaL was constructed to predict traveltimes for event location and long-period waveform dispersion for seismic source inversion applications in regions without sufficiently tuned models. SPiRaL may also serve as a starting model for full-waveform inversion (FWI) with the goal of fitting waves with periods 10–50 s over multiple broad regions (thousands of kilometres) and potentially the globe. To gain insight to this possibility, we simulated waveforms for a small set of events using SPiRaL and independent waveform-based models for comparison. For the events tested, the performance of the traveltime-based SPiRaL model is shown to be generally on par with regional 3-D waveform-based models in three regions (western United States, Middle East, Korean Peninsula) suggesting SPiRaL may serve as a starting model for FWI over broad regions.

58 GEOSCIENCES↗

Progressive transfer learning for low-frequency data prediction in full waveform inversion

To effectively overcome the cycle-skipping issue in full waveform inversion (FWI), we developed a deep neural network (DNN) approach to predict the absent low-frequency components by exploiting the hidden physical relation connecting the low- and the high-frequency data. To efficiently solve this challenging nonlinear regression problem, two novel strategies were proposed to design the DNN architecture and to optimize the learning process: (1) dual data feed structure; (2) progressive transfer learning. With the dual data feed structure, not only the high-frequency data, but also the corresponding beat tone data are fed into the DNN to relieve the burden of feature extraction. The second strategy, progressive transfer learning, enables us to train the DNN using a single evolving training dataset. Within the framework of the progressive transfer learning, the training dataset continuously evolves in an iterative manner by gradually retrieving the subsurface information through the physics-based inversion module, progressively enhancing the prediction accuracy of the DNN and propelling the inversion process out of the local minima. Here, the synthetic numerical experiments suggest that, without any a priori geological information, the low-frequency data predicted by the progressive transfer learning are sufficiently accurate for an FWI engine to produce reliable subsurface velocity models free of cycle-skipping artifacts.

02 PETROLEUM↗

Joint physics-based and data-driven time-lapse seismic inversion: Mitigating data scarcity

In carbon capture and sequestration (CCS), developing rapid and effective imaging techniques is crucial for real-time monitoring of the spatial and temporal dynamics of CO 2 propagation during/after injection. With continuing improvements in computational power and data storage, data-driven techniques based on machine learning (ML) have been effectively applied to seismic inverse problems. In particular, ML helps alleviate the ill-posedness and high computational cost of full-waveform inversion (FWI). However, such data-driven inversion techniques require massive high-quality training data sets to ensure prediction accuracy, which hinders their application to time-lapse monitoring of CO 2 sequestration. We propose an efficient “hybrid” time-lapse workflow that combines physics-based FWI and data-driven ML inversion. The scarcity of the available training data is addressed by developing a new data-generation technique with physics constraints. The method is vali dated on a synthetic CO 2 -sequestration model based on the Kimberlina storage reservoir in California. The proposed approach is shown to synthesize a large volume of high-quality, physically realistic training data, which is critically important in accurately characterizing the CO 2 movement in the reservoir. In conclusion, the developed hybrid methodology can also simultaneously predict the variations in velocity and saturation and achieve high spatial resolution in the presence of realistic noise in the data.

58 GEOSCIENCES↗

Gas hydrate quantification in Walker Ridge block 313, Gulf of Mexico, from full-waveform inversion of ocean-bottom seismic data

The Gulf of Mexico (GOM) Joint Industry Project Leg 2 logging-while-drilling data in Walker Ridge lease block 313 (WR313) in the GOM detected gas hydrate in coarse- and fine-grained sediments at sites WR313-G and WR313-H. The coarse-grained units are thin ([Formula: see text]) and highly saturated, whereas the fine-grained unit is thick (approximately 200 m) with low saturation and fracture-filling gas hydrate. Unlike its coarse-grained counterpart, the seismic character of the fine-grained unit does not clearly indicate the presence of gas hydrate, which would likely have remained undiscovered in the absence of drilling. In this paper, through frequency-domain acoustic full-waveform inversion (FWI) of ocean-bottom seismometer data along a 2D multichannel seismic transect near sites WR313-G and WR313-H, we detect and quantify gas hydrate in the fine-grained unit. Key results are as follows: First, the base of the gas hydrate stability zone, which is not obvious in the reflection profile, can be discerned in the FWI results. Second, the gas hydrate in the fine-grained unit is mainly confined to the area between two sets of opposite-dipping normal faults implying that the fault architecture may be partially responsible for this gas hydrate accumulation and distribution.

Geochemistry & Geophysics↗

Hessian-based multiparameter fractional viscoacoustic full-waveform inversion

Recent progress on fractional modeling enables incorporating seismic attenuation into wavefield simulation in an accurate and efficient way. But its inverse problem, i.e., the multiparameter viscoacoustic full waveform inversion (FWI), still suffers from various issues, especially the crosstalk between velocity and attenuation. In this study, we integrate the Hessian information via the Newton-CG framework and develop the multiparameter fractional viscoacoustic FWI algorithm. It significantly mitigates the crosstalk problems and sheds light upon simultaneous inversion for both velocity and Q models.

Xing, Guangchi↗

Integration of seismic-pressure-petrophysics inversion of continuous active-seismic monitoring data for monitoring and quantifying CO 2 plume (Final Report)

The overall objective of this project is to develop and validate an integrated package of joint seismic-pressure-petrophysics inversion (jSPPI) of continuous active-source seismic monitoring dataset capable of providing real-time monitoring of CO 2 plume during geologic carbon sequestration (GCS). The three specific developments include: (a) the methodologies for fast seismic full waveform inversion of continuous active source seismic monitoring, (CASSM) datasets for simultaneously estimating velocity and attenuation, and with data assimilation; (b) joint Bayesian petrophysical inversion of seismic models and pressure data for providing and updating CO 2 saturation models; (c) the methods using multiple datasets including (Crainfield and Frio-II borehole) synthetic, laboratory, and field CASSM datasets. The outcomes of jSPPI include (a) a workflow for processing CASSM data, (b) Bayesian inversion algorithms using CASSM data and pressure response data, and (c) integration with data assimilation algorithms for continuously updating site-specific models used for prediction and reservoir management. The validation of joint FWI will be conducted using synthetic models based on the Cranfield and Frio experiments as well as field CASSM datasets collected as part of the Frio-II pilot injection. To quantify and map the mass and distribution of CO 2 (saturation), we will jointly invert velocity and attenuation measurements from the FWI with a Bayesian approach using a rock physics model for attenuation (e.g., White’s attenuation model with two selected patch sizes (White, 1976; Dutta and Seriff, 1979)). The Bayesian inversion will be applied to each time step in the CASSM survey in an updating scheme, which integrates with an ensemble of reservoir simulations at each step. A more complete experimental validation dataset will be collected as part of a mesoscale (2-3 m) gas-CO 2 injection experiment utilizing a higher frequency version of the CASSM system developed for laboratory studies; the integrated inversion will be demonstrated using this dataset which will provide both a dense geometry as well as more precise secondary confirmation measurements (e.g. saturation) typically not available in the field. The resulting real-time map of CO 2 saturation is able to provide a deeper scientific understanding of the complex, time-varying dynamics of subsurface fluid flow migration path as well as the rapid detection of CO 2 leakage hazards.

25 ENERGY STORAGE↗

Deep Image Prior Enabled Full Waveform Inversion (Final Technical Report)

MS Student Naveen Gupta worked on the problem of full waveform inversion (FWI) using neural networks as shown in Figure 1. Our goal was to learn a neural network to represent the subsurface velocity model, which when fed into the FWI module (implemented using a numerical forward model of wave equations) produces amplitude estimates that match with ground-truth observations of amplitude. We used neural networks to solve the inverse problem of estimating velocity distributions for a given seismic amplitude data such that, once trained, our neural network model can generate a distribution of velocity profiles for different random vectors fed as inputs to the neural network model.

97 MATHEMATICS AND COMPUTING↗

ML-Based Rock Properties and Seismic Volume Enhancement

This project aims to improve field-scale Carbon Capture and Storage (CCS) assessments by enhancing petrophysical and geophysical log predictions through machine learning and neural networks. In our work during EY23, we applied Conditional Variational Autoencoders (CVAEs) to predict compressional velocity (Vp) and assess CO2 saturation levels in geological formations at the Illinois Basin Decatur Project (IBDP). In another task, we improved full-waveform inversion (FWI) methods with machine-learning approaches using lithological constraints. Full-waveform inversion (FWI) of seismic data estimates the elastic properties of subsurface rocks with high spatial resolution.

Nathanail, Athanasios↗

Lossy checkpoint compression in full waveform inversion: a case study with ZFPv0.5.5 and the overthrust model

This paper proposes a new method that combines checkpointing methods with error-controlled lossy compression for large-scale high-performance full-waveform inversion (FWI), an inverse problem commonly used in geophysical exploration. This combination can significantly reduce data movement, allowing a reduction in run time as well as peak memory. In the exascale computing era, frequent data transfer (e.g., memory bandwidth, PCIe bandwidth for GPUs, or network) is the performance bottleneck rather than the peak FLOPS of the processing unit. Like many other adjoint-based optimization problems, FWI is costly in terms of the number of floating-point operations, large memory footprint during backpropagation, and data transfer overheads. Past work for adjoint methods has developed checkpointing methods that reduce the peak memory requirements during backpropagation at the cost of additional floating-point computations. Combining this traditional checkpointing with error-controlled lossy compression, we explore the three-way tradeoff between memory, precision, and time to solution. We investigate how approximation errors introduced by lossy compression of the forward solution impact the objective function gradient and final inverted solution. Empirical results from these numerical experiments indicate that high lossy-compression rates (compression factors ranging up to 100) have a relatively minor impact on convergence rates and the quality of the final solution.

58 GEOSCIENCES↗

Seasonal Forecasting of Fire Weather Based on a New Global Fire Weather Database

Seasonal forecasting of fire weather is examined based on a recently produced global database of the Fire Weather Index (FWI) system beginning in 1980. Seasonal average values of the FWI are examined in relation to measures of the El Nino-Southern Oscillation (ENSO) and the Indian Ocean Dipole (IOD). The results are used to examine seasonal forecasts of fire weather conditions throughout the world.

fire weather↗

Future Climate Change Impact on Wildfire Danger Over the Mediterranean: the Case of Greece

Recent studies have shown that temperature and precipitation in the Mediterranean are expected to change, contributing to longer and more intense summer droughts that even extend out of season. In connection to this, the frequency of forest fire occurrence and intensity will likely increase. In the present study, the changes in future fire danger conditions are assessed for the different regions of Greece using the Canadian fire weather index (FWI). Gridded future climate output as estimated from three regional climate models from the Coordinated Regional Downscaling Experiment are utilized. We use three representative concentration pathways (RCPs) consisting of an optimistic emissions scenario where emissions peak and decline beyond 2020 (RCP2.6), a middle-of-the-road scenario (RCP4.5) and a pessimistic scenario, in terms of mitigation where emissions continue to rise throughout the century (RCP8.5). Based on established critical fire FWI threshold values for Greece, the future change in days with critical fire danger were calculated for different areas of Greece domains. The results show that fire danger is expected to progressively increase in the future especially in the high-end climate change scenario with southern and eastern regions of Greece expected to have up to 40 additional days of high fire danger relative to the late 20th century, on average. Crete, the Aegean Islands, the Attica region, as well as parts of Peloponnese are predicted to experience a stronger increase in fire danger.

Forest fires↗