Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “FWI”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustness

In this article, full waveform inversion (FWI) infers the subsurface structure information from seismic waveform data by solving a non-convex optimization problem. Data-driven FWI has been increasingly studied with various neural network architectures to improve accuracy and computational efficiency. Nevertheless, the applicability of pre-trained neural networks is severely restricted by potential discrepancies between the source function used in the field survey and the one utilized during training. Here, we develop a Fourier-enhanced deep operator network (Fourier-DeepONet) for FWI with the generalization of seismic sources, including the frequencies and locations of sources. Specifically, we employ the Fourier neural operator as the decoder of DeepONet, and we utilize source parameters as one input of Fourier-DeepONet, facilitating the resolution of FWI with variable sources. To test Fourier-DeepONet, we develop three new and realistic FWI benchmark datasets (FWI-F, FWI-L, and FWI-FL) with varying source frequencies, locations, or both. Our experiments demonstrate that compared with existing data-driven FWI methods, Fourier-DeepONet obtains more accurate predictions of subsurface structures in a wide range of source parameters. Moreover, the proposed Fourier-DeepONet exhibits superior robustness when handling data with Gaussian noise or missing traces and sources with Gaussian noise, paving the way for more reliable and accurate subsurface imaging across diverse real conditions.

42 ENGINEERING↗

High-Resolution Fire Weather Index Data for the Conterminous US (1980–2099), Version 1

This dataset presents a suite of high-resolution fire weather index datasets calculated from observation (gridMet, Livneh, Daymet V4), reanalysis (AgERA5), downscaled hydro-climate projections over the conterminous United States (CONUS) based on multiple selected Global Climate Models (GCMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). Aside from the daily FWI datasets, we also include a set of FWI extreme indicators at annual, seasonal, and monthly scales, including 1) fwixx: maximum FWI; 2) fwisa: mean FWI. For annual fwisa, it refers to the season with the maximum seasonal average; 3) fwils: Length of fire season over a specified period, where fire season is defined as the days exceeding the median value of the normalized FWI during the reference period (1980-1984); 4) fwixd: Number of extreme fire weather days over a specified period, where extreme day is defined as the day with FWI > the 95th percentile of the FWI during the reference period (1980-1984). All FWI datasets cover 1980-2020 baseline and the model simulated products including the downscaled products additionally include 2021-2099 near-future periods under the high-end (SSP585) emission scenario.

54 ENVIRONMENTAL SCIENCES↗

Deep Learning for Full Waveform Inversion of Elastic Active-Source Seismic Data to Estimate P-Wave Velocity Models

Seismic imaging methods are critical for Global Security and Energy & Homeland Security missions and activities that rely on subsurface characterization, but traditional methods remain computationally expensive and require significant labor hours and expertise to execute. Within the past few years, machine learning (ML), namely deep learning (DL), has been used to develop data-driven end-to-end full waveform inversion (FWI) methods to estimate 2D P-wave velocity (Vp) models in a fraction of the time as conventional FWI. These methods, however, are trained on simplistic acoustic wave seismic data and Vp models that are not realistic nor representative of real-world observations, leaving a large gap between the state-of-the-art and deployable, feasible, and practical DL FWI methods. Here, we generate a synthetic active-source, 3D, elastic wave seismic data set and a variety of Vp models with realistic geologic structure for training DL FWI methods. We evaluate six different methods that have performed well for acoustic DL FWI or medical imaging tasks using our more realistic dataset. We find that these six trained models do not match the performance of published acoustic end-to-end DL FWI methods, indicating more training data may be needed, physics may need to be incorporated to achieve good accuracy at the sacrifice of the end-to-end advantage, and/or novel methods need to be developed to enable end-to-end DL FWI methods to perform well for real-world seismic data.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Integrating deep neural networks with full-waveform inversion: Reparameterization, regularization, and uncertainty quantification

Full-waveform inversion (FWI) is an accurate imaging approach for modeling the velocity structure by minimizing the misfit between recorded and predicted seismic waveforms. However, the strong nonlinearity of FWI resulting from fitting oscillatory waveforms can trap the optimization in local minima. We have adopted a neural-network-based full-waveform inversion (NNFWI) method that integrates deep neural networks with FWI by representing the velocity model with a generative neural network. Neural networks can naturally introduce spatial correlations as regularization to the generated velocity model, which suppresses noise in the gradients and mitigates local minima. Furthermore, the velocity model generated by neural networks is input to the same partial differential equation (PDE) solvers used in conventional FWI. The gradients of the neural networks and PDEs are calculated using automatic differentiation, which back propagates gradients through the acoustic PDEs and neural network layers to update the weights of the generative neural network. Experiments on 1D velocity models, the Marmousi model, and the 2004 BP model determine that NNFWI can mitigate local minima, especially for imaging high-contrast features such as salt bodies, and it significantly improves the inversion in the presence of noise. Adding dropout layers to the neural network model also allows analyzing the uncertainty of the inversion results through Monte Carlo dropout. NNFWI opens a new pathway to combine deep learning and FWI for exploiting the characteristics of deep neural networks and the high accuracy of PDE solvers. Because NNFWI does not require extra training data and optimization loops, it provides an attractive and straightforward alternative to conventional FWI.

58 GEOSCIENCES↗

Subspace Methods in Multi-Parameter Seismic Full Waveform Inversion

In full waveform inversion (FWI) high-resolution subsurface model parameters are sought. FWI is normally treated as a nonlinear least-squares inverse problem, in which the minimum of the corresponding misfit function is found by updating the model parameters. When multiple elastic or acoustic properties are solved for, simple gradient methods tend to confuse parameter classes. This is referred to as parameter cross-talk; it leads to incorrect model solutions, poor convergence and strong dependence on the scaling of the different parameter types. Determining step lengths in a subspace domain, rather than directly in terms of gradients of different parameters, is a potentially valuable approach to address this problem. The particular subspace used can be defined over a span of different sets of data or different parameter classes, provided it involves a small number of vectors compared to those contained in the whole model space. Additionally, in a subspace method, the basis vectors are defined first, and a local minimum is found in the space spanned by these. We examine the application of the subspace method within acoustic FWI in determining simultaneously updates for velocity and density. We first discuss the choice of basis vectors to construct the spanned space, from linear updates by distinguishing only the contributions of different parameter classes towards nonlinear updates by adding the contributions of higher-order perturbations of each parameter class. The numerical character of FWI solutions generated via subspace methods involving different basis vectors is then analyzed and compared with traditional FWI methods. The subspace methods can provide better reconstructions of the model, especially for the velocity, as well as improved convergence rates, while the computational costs are still comparable with the traditional FWI methods.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Fast wave interferometer for ion density measurement on DIII-D

=A fast wave interferometer (FWI), which can measure ion mass density, has been developed on DIII-D for its use on future fusion reactors, as well as for the study of ion behavior in current plasma devices. The frequency of the fast waves used for the FWI is around 60 MHz, and require antennas and coaxial cables or waveguides, which, unlike traditional mirror-based optical interferometers, are less susceptible to neutron/gamma-ray radiation and are relatively immune to impurity deposition and erosion as well as alignment issues. The bulk ion density evaluated using FWI show good agreement with that derived from CO 2 interferometry within about 15%. When the ion mass density measurement by FWI is combined with an electron density measurement from CO 2 interferometry, Z eff measurements are also enabled and are in agreement with those from visible Bremsstrahlung measurements. Additionally, large-bandwidth FWI measurements clearly resolve 10–100 kHz coherent modes and demonstrate its potential as a core fluctuation diagnostic, sensitive to both magnetic and ion density perturbations.

Instruments & Instrumentation↗

Compensating attenuation effects in full-waveform inversion with dissipation-dispersion decoupling

Seismic attenuation poses challenges to velocity model building from acoustic/elastic full-waveform inversion (FWI). In particular, when constructing the FWI gradient for velocity inversion, recent studies have indicated that the high-attenuation structure could distort the gradient by damping the amplitudes and shifting the kinematic phases, resulting in an imbalanced update and thus unreliable velocity model. These Q effects are particularly significant in the reflection acquisition geometry due to the “double-damping” issue. Here, we develop a Q-compensated FWI algorithm for constructing a Q-free FWI gradient. By using a recently developed viscoacoustic wave propagator, this compensation can be done conveniently by keeping the dispersion term and flipping the dissipation term in the wave equation when we simulate the forward and time-reversed adjoint wavefields. The resultant gradient obtained by interacting these two wavefields has correct kinematics and Q-free amplitudes. This Q-compensated FWI can balance the update between Q- and no- Q-areas, which we determine using synthetic examples. In addition, we illustrate how to take advantage of the dissipation-dispersion decoupling to determine the anomalous Q value in the Q model building workflow via Q-compensated reverse time migration.

Geochemistry & Geophysics↗

Attribution of the role of climate change in the forest fires in Sweden 2018

In this study, we analyse the role of climate change in the forestfires that raged through large parts of Sweden in the summer of 2018 from ameteorological perspective. This is done by studying the Canadian FireWeather Index (FWI) based on sub-daily data, both in reanalysis data sets(ERA-Interim, ERA5, the Japanese 55 year Reanalysis, JRA-55, and Modern-Era Retrospective analysis for Research and Applications version 2, MERRA-2) and three large-ensemble climatemodels (EC-Earth, weather@home, W@H, and Community Earth System Model, CESM) simulations. The FWI, based on reanalysis, correlates well with the observed burnt area in summer (r=0.6 to 0.8). We find that the maximum FWI in July 2018 had return times of ~24 years (90 % CI, confidence interval, > 10 years) for southern and northern Sweden. Furthermore, we find a negative trend of the FWI for southern Sweden over the 1979 to 2017 time period in the reanalyses, yielding a non-significant reduced probability of such an event. However, the short observational record, large uncertainty between the reanalysis products and large natural variability of the FWI give a large confidence interval around this number that easily includes no change, so we cannot draw robust conclusions from reanalysis data. The three large-ensembles with climate models point to a roughly 1.1 (0.9 to 1.4) times increased probability (non-significant) for such events in the current climate relative to preindustrial climate. For a future climate (2 °C warming), we find a roughly 2 (1.5 to 3) times increased probability for such events relative to the preindustrial climate. The increased fire weather risk is mainly attributed to the increase intemperature. The other main factor, i.e. precipitation during summer months, isprojected to increase for northern Sweden and decrease for southern Sweden. We, however, do not find a clear change in prolonged dry periods in summer months that could explain the increased fire weather risk in the climate models. In summary, we find a (non-significant) reduced probability of such eventsbased on reanalyses, a small (non-significant) increased probability due to global warming up to now and a more robust (significant) increase in the risk for such events in the future based on the climate models.

54 ENVIRONMENTAL SCIENCES↗

Nondestructive Evaluation of Concrete: Elastic Property Imaging Through Full Waveform Inversion

Concrete is a major construction material worldwide and plays a crucial role in the nuclear industry. The elastic properties of concrete are prone to change and degrade while in service, as it is often subjected to extreme operational and environmental conditions. An accurate evaluation of concrete's elastic properties is thus essential to ensure structural integrity and safety. This is especially true for concrete in nuclear power plants, where irradiation effects significantly impact concrete mechanical properties. There are various methods to assess these properties, with ultrasound-based techniques showing high potential due to their nondestructive nature, cost-effectiveness, and safety. While several nondestructive evaluation methods exist, most rely on idealizations such as assuming homogeneous material and plane wavefronts. In this work, we address these issues by introducing an ultrasound-based nondestructive method aimed at reconstructing spatially varying images of concrete mechanical properties. By accurately modeling wave physics, including scattering and reflection, we overcome several of the aforementioned idealizations and aim to utilize the full waveform for imaging material properties through depth, resulting in more reliable images. Full waveform inversion (FWI) was first introduced by geophysicists to reconstruct subsurface elastic property images. The goal is to minimize the difference between simulated and recorded wavefield signals, often through gradient-based optimization algorithms. While FWI is primarily conducted using the acoustic approximation of the wave equation, few works focus on elastic FWI, where the goal is to reconstruct images of not only the pressure wave speed but also the shear wave speed and density (or their equivalents). This work explores the potential of using elastic FWI to predict concrete mechanical properties as an initial effort for a more accurate monitoring of concrete conditions in service. Reconstructing images of different elastic parameters enables more specificity and accurate condition diagnosis. This paper will detail this approach and provide examples demonstrating the effectiveness of elastic FWI in reconstructing comprehensive maps of concrete mechanical properties.

42 - ENGINEERING↗

Downscaled CMIP5 projections of physical fire risk understate historical trends

Reliable projections of wildfire risk are important for multi-sector impacts analysis. Statistically downscaled and bias-corrected Earth system model ensemble products are routinely used to analyze regional physical wildfire risk, but evaluations of historical observed trends and variability are lacking. Here, we evaluate physical fire risk over the western United States using the Canadian Forest Fire Weather Index (FWI) by comparing model outputs from the Coupled Model Intercomparison Project Phase 5 (CMIP5), statistically downscaled via the Multivariate Adaptive Constructed Analogs (MACA) approach, against the observational target dataset gridMET, a gridded high-resolution surface meteorological product. We analyze multidecadal trends and interannual variability in seasonal average FWI for the historical period and future projections under two emissions scenarios, and we compare MACA-CMIP5 ensemble results with a simple time series model that generates historical and future projections of seasonal FWI based on bootstrapping observed historical trends and variability. Our findings indicate that MACA-CMIP5 accurately captures the magnitude and spatial patterns of seasonally averaged FWI but tends to underestimate historical decadal trends. We show that future increases in fire risk may be underestimated relative to the simple time series model that projects historical variability into the future. We also highlight that model biases in relative humidity contribute significantly to model-data differences. Our results underscore the importance of historical hindcasting exercises for informing broader multi-sector applications.

FWI↗

Multiscale Data-Driven Seismic Full-Waveform Inversion With Field Data Study

Seismic full-waveform inversion (FWI), which uses iterative methods to estimate high-resolution subsurface models from seismograms, is a powerful imaging technique in exploration geophysics. In recent years, the computational cost of FWI has grown exponentially due to the increasing size and resolution of seismic data. Moreover, it is a nonconvex problem and can encounter local minima due to the limited accuracy of the initial velocity models or the absence of low frequencies in the measurements. To overcome these computational issues, we develop a multiscale data-driven FWI method based on fully convolutional networks (FCNs). In preparing the training data, we first develop a real-time style transform method to create a large set of synthetic subsurface velocity models from natural images. We then develop two convolutional neural networks with encoder-decoder structures to reconstruct the low- and high-frequency components of the subsurface velocity models, separately. To validate the performance of our data-driven inversion method and the effectiveness of the synthesized training set, we compare it with conventional physics-based waveform inversion approaches using both synthetic and field data. Finally, these numerical results demonstrate that, once our model is fully trained, it can significantly reduce the computation time and yield more accurate subsurface velocity models in comparison with conventional FWI.

58 GEOSCIENCES↗

Advancing attenuation estimation through integration of the Hessian in multiparameter viscoacoustic full-waveform inversion

Accurate seismic attenuation models of subsurface structures not only enhance subsequent migration processes by improving fidelity, resolution, and facilitating amplitude-compliant angle gather generation but also provide valuable constraints on subsurface physical properties. Leveraging full-wavefield information, multiparameter viscoacoustic full-waveform inversion ( Q-FWI) simultaneously estimates seismic velocity and attenuation ( Q) models. However, a major challenge in Q-FWI is the contamination of crosstalk artifacts, where inaccuracies in the velocity model are mistakenly mapped to the inverted attenuation model. While incorporating the Hessian is expected to mitigate these artifacts, the explicit implementation is prohibitively expensive due to its formidable computational cost. In this study, we formulate and develop a Q-FWI algorithm via the Newton-conjugate gradient (CG) framework, where the search direction at each iteration is determined through an internal CG loop. In particular, the Hessian is integrated into each CG step in a matrix-free fashion using the second-order adjoint-state method. We find through synthetic experiments that our Newton-CG Q-FWI significantly mitigates crosstalk artifacts compared with the limited-memory Broyden-Fletcher-Goldfarb-Shanno method and the CG method, albeit with a notable computational cost. In the discussion of several key implementation details, we also determine the significance of the approximate Gauss-Newton Hessian, the second-order adjoint-state method, and the two-stage inversion strategy.

Geochemistry & Geophysics↗

Multiscale Interactions between Local Short- and Long-Term Spatio-Temporal Mechanisms and Their Impact on California Wildfire Dynamics

California has experienced a surge in wildfires, prompting research into contributing factors, including weather and climate conditions. This study investigates the complex, multiscale interactions between large-scale climate patterns, such as the Boreal Summer Intraseasonal Oscillation (BSISO), El Niño Southern Oscillation (ENSO), and the Pacific Decadal Oscillation (PDO) and their influence on moisture and temperature fluctuations, and wildfire dynamics in California. The combined impacts of PDO and BSISO on intraseasonal fire weather changes; the interplay between fire weather index (FWI), relative humidity, vapor pressure deficit (VPD), and temperature in assessing wildfire risks; and geographical variations in the relationship between the FWI and climatic factors within California are examined. The study employs a multi-pronged approach, analyzing wildfire frequency and burned areas alongside climate patterns and atmospheric conditions. The findings reveal significant variability in wildfire activity across different climate conditions, with heightened risks during specific BSISO phases, La-Niña, and cool PDO. The influence of BSISO varies depending on its interaction with PDO. Temperature, relative humidity, and VPD show strong predictive significance for wildfire risks, with significant relationships between FWI and temperature in elevated regions (correlation, r > 0.7, p ≤ 0.05) and FWI and relative humidity along the Sierra Nevada Mountains (r ≤ -0.7, p ≤ 0.05).

54 ENVIRONMENTAL SCIENCES↗

Toward more-robust, AI-enabled subsurface seismic imaging for geotechnical applications

Non-invasive seismic imaging has the potential to cost-effectively evaluate large volumes of subsurface material to inform geotechnical site investigation. However, seismic imaging using full waveform inversion (FWI) requires significant computational time and is dependent on an initial starting model. As a result, FWI has not yet been widely adopted into geotechnical practice. Previous efforts, on relatively simple two-layered models, indicate that data-driven artificial intelligence (AI) models may be as effective as FWI at predicting 2D images of shear wave velocity (V s ). Furthermore, the AI model predictions can be made almost instantaneously after data acquisition and do not require an initial starting model. We examine the generality of these findings by developing a new AI model for subsurface seismic imaging, whereby we make several notable contributions. First, we architect a multimodal AI model that combines time- and frequency-domain representations of the seismic wavefield to predict a 50 m by 20 m subsurface image of V s . Second, we developed a new diverse dataset of 100,000 images with their corresponding seismic wavefields to train the AI model. Third, we propose four physics-informed data augmentations for data-driven seismic imaging. Fourth, we develop two prediction consistency tests to evaluate the model’s performance when the true subsurface is unknown. Our final model, which has been made publicly available, is capable of predicting a subsurface V s image from a single seismic wavefield with an average, mean absolute percent error (MAPE) of 24 %. The predictive model is applied to a field dataset and shown to be consistent with local geology and shear-wave refraction measurements from the same location.

Artificial intelligence↗

Pre-conditioned BFGS-based uncertainty quantification in elastic full-waveform inversion

SUMMARY Full-waveform inversion has become an essential technique for mapping geophysical subsurface structures. However, proper uncertainty quantification is often lacking in current applications. In theory, uncertainty quantification is related to the inverse Hessian (or the posterior covariance matrix). Even for common geophysical inverse problems its calculation is beyond the computational and storage capacities of the largest high-performance computing systems. In this study, we amend the Broyden–Fletcher–Goldfarb–Shanno (BFGS) algorithm to perform uncertainty quantification for large-scale applications. For seismic inverse problems, the limited-memory BFGS (L-BFGS) method prevails as the most efficient quasi-Newton method. We aim to augment it further to obtain an approximate inverse Hessian for uncertainty quantification in FWI. To facilitate retrieval of the inverse Hessian, we combine BFGS (essentially a full-history L-BFGS) with randomized singular value decomposition to determine a low-rank approximation of the inverse Hessian. Setting the rank number equal to the number of iterations makes this solution efficient and memory-affordable even for large-scale problems. Furthermore, based on the Gauss–Newton method, we formulate different initial, diagonal Hessian matrices as pre-conditioners for the inverse scheme and compare their performances in elastic FWI applications. We highlight our approach with the elastic Marmousi benchmark model, demonstrating the applicability of pre-conditioned BFGS for large-scale FWI and uncertainty quantification.

58 GEOSCIENCES↗

Machine learning for seismic low-frequency extrapolation

The cycle-skipping problem that plagues full waveform inversion (FWI) can be at least partially mitigated if low frequencies (which encode the kinematics of wave propagation in seismic data) are recorded. However, seismic sources and receivers are band-limited, so seismic data does not generally include signals down to 0 Hz. To improve our ability to solve the seismic inverse problem, one can synthesize this missing low-frequency (LF) content from the recorded high-frequency (HF) data using machine learning (ML) models. Deep learning models such as convolutional neural networks (CNNs) demonstrate impressive ability to perform low frequency extrapolation. However, such models require powerful hardware (GPU machines) and careful training. We assess the extrapolation capabilities of three different ML models that do not require GPU machines, namely, random forest, Gaussian process regression and gradient boosting, on both synthetic and real data. Experimental results on two synthetic data sets (generated from a low velocity lens embedded in a homogeneous medium, and the Marmousi model) demonstrate that FWI applied to the extrapolated data consistently improves inversion accuracy relative to FWI applied to the original data sets that do not contain low frequencies. Application of low-frequency extrapolation to real data from the Northwest Shelf of Australia demonstrates that tree-based ML models such as gradient boosting can outperform CNNs in terms of both accuracy and computational cost on non-GPU architectures.

58 GEOSCIENCES↗

InversionNet3D: Efficient and Scalable Learning for 3-D Full-Waveform Inversion

Seismic full-waveform inversion (FWI) techniques aim to find a high-resolution subsurface geophysical model provided with waveform data. Some recent effort in data-driven FWI has shown some encouraging results in obtaining 2-D velocity maps. However, due to high computational complexity and large memory consumption, the reconstruction of 3-D high-resolution velocity maps via deep networks is still a great challenge. Here, in this article, we present InversionNet3D (InvNet3D), an efficient and scalable encoder–decoder network for 3-D FWI. The proposed method employs group convolution in the encoder to establish an effective hierarchy for learning information from multiple sources while cutting down unnecessary parameters and operations at the same time. The introduction of invertible layers further reduces the memory consumption of intermediate features during training and, thus, enables the development of deeper networks with more layers and higher capacity as required by different application scenarios. Experiments on the 3-D Kimberlina dataset demonstrate that InvNet3D achieves state-of-the-art reconstruction performance with lower computational cost and lower memory footprint compared to the baseline.

58 GEOSCIENCES↗

Direct Numerical Simulation of Flame-Wall Interaction for Low-Carbon Gas Turbine Combustion

Green hydrogen (H2) and ammonia (NH3) are emerging as carbon free alternatives to hydrocarbon fuels. In gas turbines, flames interact with the combustor liner (wall), which affects the pollutant emissions, the burning efficiency, and the thermal load on the liner. We lack understanding of this important flame-wall interaction (FWI) for alternative fuels. FWI occurs at the scale of the flame thickness, and such scales are only resolved by direct numerical simulation. Here, we resolve the FWI for NH3 and H2 flames. Preliminary results of two distinct projects are presented: 2D laminar anchored V-flame, and 3D turbulent swirling flame. For the laminar flame, we show flame quenching at the wall and resulting leakage of NH3 and increased N2O, but decreased NO emissions. For the swirling flame, we show CO emissions, and comparison of flame shapes and location to experimental measurements. Ultimately we show that quenching and pollutant emissions strongly affected by fuel/air ratio, and that an inclined wall can stabilize very lean turbulent CH4/H2 flames, but prone to large CO emissions.

adaptive mesh refinement↗