Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “physical reservoir computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Quantum reservoir computing implementation on coherently coupled quantum oscillators

Quantum reservoir computing is a promising approach for quantum neural networks, capable of solving hard learning tasks on both classical and quantum input data. However, current approaches with qubits suffer from limited connectivity. We propose an implementation for quantum reservoir that obtains a large number of densely connected neurons by using parametrically coupled quantum oscillators instead of physically coupled qubits. We analyze a specific hardware implementation based on superconducting circuits: with just two coupled quantum oscillators, we create a quantum reservoir comprising up to 81 neurons. We obtain state-of-the-art accuracy of 99% on benchmark tasks that otherwise require at least 24 classical oscillators to be solved. Our results give the coupling and dissipation requirements in the system and show how they affect the performance of the quantum reservoir. Beyond quantum reservoir computing, the use of parametrically coupled bosonic modes holds promise for realizing large quantum neural network architectures, with billions of neurons implemented with only 10 coupled quantum oscillators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Alfvén eigenmode classification based on ECE diagnostics at DIII-D using deep recurrent neural networks

Modern tokamaks have achieved significant fusion production, but further progress towards steady-state operation has been stymied by a host of kinetic and MHD instabilities. Control and identification of these instabilities is often complicated, warranting the application of data-driven methods to complement and improve physical understanding. In particular, Alfvén eigenmodes are a class of ubiquitous mixed kinetic and MHD instabilities that are important to identify and control because they can lead to loss of confinement and potential damage to the walls of a plasma device. In the present work, we use reservoir computing networks to classify Alfvén eigenmodes in a large labeled database of DIII-D discharges, covering a broad range of operational parameter space. However, despite the large parameter space, we show excellent classification and prediction performance, with an average hit rate of 91% and false alarm ratio of 7%, indicating promise for future implementation with additional diagnostic data and consolidation into a real-time control strategy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Deep Learning for Subsurface Flow: A Comparative Study of U‐Net, Fourier Neural Operators, and Transformers in Underground Hydrogen Storage

Subsurface flow research is essential for the sustainable management of natural resources and the environment. Deep learning (DL) has significantly advanced this field by developing efficient and accurate surrogate models to replace computationally expensive physics‐based simulations. These surrogate models are commonly used to predict the spatiotemporal evolution of state variables, such as gas saturation and reservoir pressure, in heterogeneous geological formations. Despite the various DL models applied to this task, there is a lack of studies systematically comparing their performance. This absence of comparative analysis leads to somewhat arbitrary DL model selection in subsurface flow research, resulting in suboptimal performance and potentially inaccurate predictions. To bridge this gap, we conduct a systematic comparison study of three popular DL architectures—U‐Net, Fourier Neural Operators (FNO), and Segmentation Transformer (SETR)—in surrogate modeling of underground hydrogen storage (UHS). We focus on UHS due to its promise of enhancing clean energy resilience and its cyclic operational conditions that represent common scenarios in various subsurface applications. We evaluate the models based on accuracy, training cost, and inference speed. The comparison shows that U‐Net achieves the highest accuracy, followed by SETR and FNO. Despite its lower accuracy, FNO has the highest inference speed. SETR offers competitive accuracy with the least training memory usage, demonstrating the potential of transformers in learning subsurface flow. Our results provide guidance for selecting DL models for surrogate modeling in a wide range of subsurface flow problems.

42 ENGINEERING↗
DOE OSTI2022

Machine Learning-Assisted High-Temperature Reservoir Thermal Energy Storage Optimization: Numerical Modeling and Machine Learning Input and Output Files

This data set includes the numerical modeling input files and output files used to synthesize data, and the reduced-order machine learning models trained from the synthesized data for reservoir thermal energy storage site identification. In this study, a machine-learning-assisted computational framework is presented to identify High-Temperature Reservoir Thermal Energy Storage (HT-RTES) site with optimal performance metrics by combining physics-based simulation with stochastic hydrogeologic formation and thermal energy storage operation parameters, artificial neural network regression of the simulation data, and genetic algorithm-enabled multi-objective optimization. A doublet well configuration with a layered (aquitard-aquifer-aquitard) generic reservoir is simulated for cases of continuous operation and seasonal-cycle operation scenarios. Neural network-based surrogate models are developed for the two scenarios and applied to generate the Pareto fronts of the HT-RTES performance for four potential HT-RTES sites. The developed Pareto optimal solutions indicate the performance of HT-RTES is operation-scenario (i.e., fluid cycle) and reservoir-site dependent, and the performance metrics have competing effects for a given site and a given fluid cycle. The developed neural network models can be applied to identify suitable sites for HT-RTES, and the proposed framework sheds light on the design of resilient HT-RTES systems. All the simulations and the neural network model were done by Idaho National Laboratory. A detailed description of the work was reported in publication linked below.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Inversion of Time-Lapse Seismic Reservoir Monitoring Data Using CycleGAN: A Deep Learning-Based Approach for Estimating Dynamic Reservoir Property Changes

Carbon capture and storage is being pursued globally as a geoengineering measure for reducing the emission of anthropogenic CO 2 the atmosphere. Comprehensive monitoring, verification, and accounting programs must be established for demonstrating the safe storage of injected CO 2 . One of the most commonly deployed monitoring techniques is time-lapse seismic reservoir monitoring (also known as 4-D seismic), which involves comparing 3-D seismic survey data taken at the same study site but over different times. Analyses of 4-D seismic data volumes can help improve the quality of storage reservoir characterization, track the movement of injected CO 2 plume, and identify potential CO 2 spillover/leakage from the storage reservoirblue. However, the derivation of high-resolution CO 2 saturation maps from 4-D seismic data is a highly nonlinear and ill-posed inverse problem, often requiring significant computational effort. In this research, we apply a physics-based deep learning method to facilitate the solution of both the forward and inverse problems in seismic inversion while honoring physical constraints. A cycle generative adversarial neural network (CycleGAN) model is trained to learn the bidirectional functional mappings between the reservoir dynamic property changes and seismic attribute changes, such that both forward and inverse solutions can be obtained efficiently from the trained model. We show that our CycleGAN-based approach not only improves the reliability of 4-D seismic inversion but also expedites the quantitative interpretation. Our deep learning-based workflow is generic and can be readily used for reservoir characterization and reservoir model updates involving the use of 4-D seismic data.

58 GEOSCIENCES↗
DOE OSTI2022

Reconfigurable training and reservoir computing in an artificial spin-vortex ice via spin-wave fingerprinting

Strongly interacting artificial spin systems are moving beyond mimicking naturally occurring materials to emerge as versatile functional platforms, from reconfigurable magnonics to neuromorphic computing. Typically, artificial spin systems comprise nanomagnets with a single magnetization texture: collinear macrospins or chiral vortices. Here, by tuning nanoarray dimensions we have achieved macrospin–vortex bistability and demonstrated a four-state metamaterial spin system, the ‘artificial spin-vortex ice’ (ASVI). ASVI can host Ising-like macrospins with strong ice-like vertex interactions and weakly coupled vortices with low stray dipolar field. Vortices and macrospins exhibit starkly differing spin-wave spectra with analogue mode amplitude control and mode frequency shifts of Δf = 3.8 GHz. The enhanced bitextural microstate space gives rise to emergent physical memory phenomena, with ratchet-like vortex injection and history-dependent non-linear fading memory when driven through global magnetic field cycles. We employed spin-wave microstate fingerprinting for rapid, scalable readout of vortex and macrospin populations, and leveraged this for spin-wave reservoir computation. ASVI performs non-linear mapping transformations of diverse input and target signals in addition to chaotic time-series forecasting.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Fracture-matrix fluid exchange in oil-bearing unconventional mudstones

The poromechanical properties of unconventional reservoir materials are in large part dictated by their mineralogy. Since these properties govern the response to stress experienced during hydraulic fracturing, fluid production, and fluid injection, they play a central role in the formation of microcracks or bedding delaminations which ultimately dominate mass transport. In this work we study access to the porosity of end member unconventional reservoir materials, where the end members are predominantly dictated by carbonate content. Access to the porosity is quantified using state of the art 3D x-ray computed tomography coupled with physics informed data analytics. Xenon gas, which attenuates x-rays, provides a spatiotemporal map of access to the porosity. The accessible porosity is quantified over a range of net confining stress relevant to the manmade disturbances listed above. These experiments demonstrate that heavily carbonated mudstones are nearly impermeable at the core (~ cm) scale, while carbonate free analogues afford better access to the microstructure. Consistent with previous qualitative 2D radiographs, access to the interior of the clastic mudstones is first observed along planar microcracks, followed by slow penetration into the surrounding matrix. Physics informed data analytics of the 3D tomography measurements presented here show that these microcracks do not permit uniform access to the adjacent rock matrix. In addition, variation of the effective pressure elucidates the mechanisms that govern fracture/matrix fluid exchange. Under conditions consistent with hydrocarbon production fluid accumulates in the immediate vicinity of the nearest microcrack. While there is clear evidence that, as intended, part of this accumulation is from the more distant matrix, fluid is also squeezed out of the microcrack. The fluid build-up at the microcrack indicates that migration out of the rock is hindered by the coupled poroelastic response of the microcrack and adjacent rock matrix. We show that these mechanisms ultimately account for the meager oil recovery factors realized in practice. These insights have implications for making reservoir scale predictions based on core scale observations, and provide a basis for devising new asset development techniques to access more porosity, and enhance fluid extraction. Finally, these findings shed light on key features and mechanisms that govern shale storage capacity, with relevance to other important industrial processes, such as geologic CO 2 storage.

58 GEOSCIENCES↗
DOE OSTI2022

Machine-learning-assisted high-temperature reservoir thermal energy storage optimization

High-temperature reservoir thermal energy storage (HT-RTES) has the potential to become an indispensable component in achieving the goal of the net-zero carbon economy, given its capability to balance the intermittent nature of renewable energy generation. In this study, a machine-learning-assisted computational framework is presented to co-optimize the performance metrics of HT-RTES by combining physics-based simulation with stochastic hydrogeologic formation and thermal energy storage operation parameters, artificial neural network regression of the simulation data, and genetic algorithm-enabled multi-objective optimization. A doublet well configuration with a layered (aquitard-aquifer-aquitard) generic reservoir is simulated for cases of continuous operation and seasonal-cycle operation scenarios. Further, neural network-based surrogate models are developed for the two scenarios and applied to generate the Pareto fronts of the HT-RTES performance for four potential HT-RTES sites. The developed Pareto optimal solutions indicate the performance of HT-RTES is operation-scenario (i.e., fluid cycle) and reservoir-site dependent, and the performance metrics have competing effects for a given site and a given fluid cycle. The developed neural network models can be applied to identify suitable sites for HT-RTES, and the proposed framework sheds light on the design of resilient HT-RTES systems.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

Optoelectronic polymer memristors with dynamic control for power-efficient in-sensor edge computing

Abstract As the demand for edge platforms in artificial intelligence increases, including mobile devices and security applications, the surge in data influx into edge devices often triggers interference and suboptimal decision-making. There is a pressing need for solutions emphasizing low power consumption and cost-effectiveness. In-sensor computing systems employing memristors face challenges in optimizing energy efficiency and streamlining manufacturing due to the necessity for multiple physical processing components. Here, we introduce low-power organic optoelectronic memristors with synergistic optical and mV-level electrical tunable operation for a dynamic “control-on-demand” architecture. Integrating signal sensing, featuring, and processing within the same memristors enables the realization of each in-sensor analogue reservoir computing module, and minimizes circuit integration complexity. The system achieves 97.15% fingerprint recognition accuracy while maintaining a minimal reservoir size and ultra-low energy consumption. Furthermore, we leverage wafer-scale solution techniques and flexible substrates for optimal memristor fabrication. By centralizing core functionalities on the same in-sensor platform, we propose a resilient and adaptable framework for energy-efficient and economical edge computing.

Optics↗
DOE OSTI2024

ML-based Data Assimilation and History Matching: Application to the IBDP CCS Project

It is crucial to monitor the CO2 plume effectively throughout the life cycle of a geologic CO2 sequestration project to ensure safety and storage efficiency. However, the computational cost of existing data assimilation methods can be prohibitively expensive due to the complex physics with multi-component non-isothermal simulation and high dimensionality of large-scale reservoir models. We address this challenge by proposing an accelerated deep learning-based workflow for model calibration and prediction of CO2 plume evolution in the reservoir.The power and efficacy of our workflow is demonstrated by application to the Illinois Basin-Decatur Project (IBDP), a large-scale CO2 storage test in saline aquifer. The data assimilation process is implemented rapidly by the proposed workflow with given field measurements including distributed pressure and temperature sensing (DTS) data at an injection and a monitoring well. CO2 plume evolution is predicted by running the simulations of the calibrated reservoir models.

Nagao, Masahiro↗
DOE OSTI2023

Legacy Well Leakage Risk Analysis at the Farnsworth Unit Site

This paper summarizes the results of the risk analysis and characterization of the CO 2 and brine leakage potential of Farnsworth Unit (FWU) site wells. The study is part of the U.S. DOE’s National Risk Assessment Partnership (NRAP) program, which aims to quantitatively evaluate long-term environmental risks under conditions of significant geologic uncertainty and variability. To achieve this, NRAP utilizes risk assessment and computational tools specifically designed to quantify uncertainties and calculate the risk associated with geologic carbon dioxide (CO 2 ) sequestration. For this study, we have developed a workflow that utilizes physics-based reservoir simulation results as input to perform leakage calculations using NRAP Tools, specifically NRAP-IAM-CS and RROM-Gen. These tools enable us to conduct leakage risk analysis based on ECLIPSE reservoir simulation results and to characterize wellbore leakage at the Farnsworth Unit Site. We analyze the risk of leakage from both individual wells and the entire field under various wellbore integrity distribution scenarios. The results of the risk analysis for the leakage potential of FWU wells indicate that, when compared to the total amount of CO 2 injected, the highest cemented well integrity distribution scenario (FutureGen high flow rate) exhibits approximately 0.01% cumulative CO 2 leakage for a 25-year CO 2 injection duration at the end of a 50-year post-injection monitoring period. In contrast, the highest possible leakage scenario (open well) shows approximately 0.1% cumulative CO 2 leakage over the same time frame.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Multi-fidelity Fourier neural operator for fast modeling of large-scale geological carbon storage

Deep learning-based surrogate models have been widely applied in geological carbon storage (GCS) problems to accelerate the prediction of reservoir pressure and CO2 plume migration. Large amounts of data from physics-based numerical simulators are required to train a model to accurately predict the complex physical behaviors associated with this process. In practice, the available training data are always limited in large-scale 3D problems due to the high computational cost. Therefore, we propose to use a multi-fidelity Fourier neural operator (FNO) to solve large-scale GCS problems with more affordable multi-fidelity training datasets. FNO has a desirable grid-invariant property, which simplifies the transfer learning procedure between datasets with different discretization. Here, we first test the model efficacy on a GCS reservoir model being discretized into 110 k grid cells. The multi-fidelity model can predict with accuracy comparable to a high-fidelity model trained with the same amount of high-fidelity data with 81% less data generation costs. We further test the generalizability of the multi-fidelity model on a same reservoir model with a finer discretization of 1 million grid cells. This case was made more challenging by employing high-fidelity and low-fidelity datasets generated by different geostatistical models and reservoir simulators. We observe that the multi-fidelity FNO model can predict pressure fields with reasonable accuracy even when the high-fidelity data are extremely limited. The findings of this study can help for better understanding of the transferability of multi-fidelity deep learning surrogate models.

58 GEOSCIENCES↗
DOE OSTI2021

Tools for pressure core sub-coring and pore-scale micro-CT (computed tomography) scans

Abstract. The pore habits of gas hydrate in natural sediment matrices provide essential clues for understanding physical (mechanical, thermal, hydraulic, and electrical) properties of hydrate-bearing sediments, yet there are no tools that can directly visualize the pore habits of natural gas hydrate other than indirect interpretation based on core-scale or field-scale observations. A significant challenge is to obtain a mini-core from pressure cores retrieved from natural reservoirs for high-resolution micro-CT (computed tomography) scans while maintaining pressure and temperature conditions required for stability of gas hydrate during all operational steps including manipulation, cutting, transferring, sub-coring and CT scanning. We present a new set of tools for pore-scale micro-CT imaging of natural hydrate-bearing sediments while maintaining pressure and temperature control. The tests with laboratory-prepared cores and pressure cores successfully demonstrate the capability of this set of tools to subsample a mini-core from pressure cores, transfer the mini-core to an X-ray transparent core holder, and conduct micro-CT scans. Successfully obtained CT images prove the functionality of this set of tools.

Seol, Yongkoo↗
DOE OSTI2020

Milestone Report for MS8: Extend Quantitative Brine and CO 2 Leakage Calculations

This report summarizes results of the risk analysis and characterization of CO 2 and brine leakage potential of Farnsworth Unit (FWU) wells. U.S. DOE’s National Risk Assessment Partnership (NRAP) program works on quantitatively assess long-term environmental risks amidst significant geologic uncertainty and variability. NRAP risk assessment and computational tools are developed to quantify uncertainties and calculate risk associated with geologic sequestration of carbon dioxide (CO 2 ). For this study, we have developed a workflow from University of Utah’s physics-based reservoir simulators to performing leakage calculations using NRAP Tools. NRAP tools (NRAP-IAM-CS, RROM-Gen) are used to conduct leakage risk analysis based on Eclipse simulation results, and characterize wellbore leakage at the Farnworth Site. This report summarizes results of the risk analysis and characterization of CO 2 and brine leakage potential of Farnsworth Unit (FWU) wells.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

A geospatial model for the analysis of time-dependent land subsidence induced by reservoir depletion

Land subsidence due to fluid depletion is an outcome of physical processes operating across a wide range of time and length scales. Although geomechanical models are crucial to simulate reservoir compaction and predict its long-term fate, their use across large regions often bears prohibitive computational costs. To overcome this obstacle, this paper proposes a simplified modelling framework consisting of (i) a near-field numerical solver simulating the coupling between fluid flow and rock deformation with reference to a simplified one-dimensional geometry and (ii) a far-field geospatial algorithm mapping ground settlements across a region through the superposition of poroelastic computations at multiple wells. The model computes the delay between depletion history and reservoir compaction in proximity of a producing well by assuming basal depletion of a fluid-saturated deformable disk, while the Geertsma solution of nucleus of strain is used to extrapolate the impact of such time-varying reservoir compaction around the well. This approach has been used to back-analyze the spatio-temporal progression of subsidence at the Groningen gas field. The results are compared against measurements collected over 50 year of production at 25 benchmark locations scattered over an area of 900 km 2 . It is shown that coupled simulations based on average values of rock compressibility and permeability lead to nonlinear trends of subsidence evolution in good agreement with field measurements, while uncoupled analyses overpredict settlements by more than 70%. Lastly, synthetic forecasts based on different rates of depletion were provided. The results suggest that slower depletion rates lead to lower subsidence at a given time, and that residual subsidence may continue to develop for several decades after interruption of production activities.

58 GEOSCIENCES↗
DOE OSTI2023

Efficient Optimization of Energy Recovery From Geothermal Reservoirs With Recurrent Neural Network Predictive Models

Improving the long-term energy production performance of geothermal reservoirs can be accomplished by optimizing field development and management plans. Reliable prediction models, however, are needed to evaluate and optimize the performance of the underlying reservoirs under various operation and development strategies. In traditional frameworks, physics-based simulation models are used to predict the energy production performance of geothermal reservoirs. However, detailed simulation models are not trivial to construct, require a reliable description of the reservoir conditions and properties, and entail high computational complexity. Data-driven predictive models can offer an efficient alternative for use in optimization workflows. This paper presents an optimization framework for net power generation in geothermal reservoirs using a variant of the recurrent neural network (RNN) as a data-driven predictive model. The RNN architecture is developed and trained to replace the simulation model for computationally efficient prediction of the objective function and its gradients with respect to the well control variables. The net power generation performance of the field is optimized by automatically adjusting the mass flow rate of production and injection wells over 12 years, using a gradient-based local search algorithm. Two field-scale examples are presented to investigate the performance of the developed data-driven prediction and optimization framework. Furthermore, the prediction and optimization results from the RNN model are evaluated through comparison with the results obtained by using a numerical simulation model of a real geothermal reservoir.

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

Physics-informed machine learning for fault-leakage reduced-order modeling

Geologic carbon storage (GCS) is a promising technology for mitigating CO 2 emissions. The overall success of GCS depends on safe operations that are informed by risk assessment and have proper mitigation plans in place. Performing quantitative probabilistic risk assessment for a GCS site using traditional reservoir simulators can be challenging due to the high computational costs. To overcome this challenge, the US Department of Energy’s National Risk Assessment Partnership (NRAP) project has developed an integrated assessment modeling approach that utilizes computationally efficient reduced-order models (ROM) for simulating various parts of a GCS storage site to quantify uncertainty. Here, in this study, we develop a reduced-order model for fault leakage risk assessment. We use a deep learning approach to build the reduced-order model. We perform a sensitivity analysis and find that the deep learning model yields high accuracy with a much smaller computational cost than full-physics simulation. We also evaluate the performance of the model in scenarios where simulations are not possible to run, providing analysis not previously performed in fault-leakage ROM analyses. Based on a sensitivity analysis of the model, we suggest a simplified conceptual model for fault leakage and site monitoring.

58 GEOSCIENCES↗