Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “numerical continuation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Modeling the energetic tail of a dusty plasma's electron energy distribution and its effect on dust grain charge and behavior

A model for a weakly ionized dusty plasma is proposed in which UV or x-ray radiation continuously creates free electrons at high energy, which then cool through collisions with a cold neutral gas before recombining. The transition of a free electron from high energy at birth to low energy at demise implies that the electron energy distribution is not the simple Maxwellian of an isolated system in thermal equilibrium, but instead has a high-energy tail that depends on the recombination time. This tail can have a major effect on dust grain charging because the flux of tail electrons can be substantial even if the density of tail electrons is small. Detailed analytic and numerical calculations of dust grain charging show that situations exist in which a small high-energy tail dominates charge behavior. This implies that dust grain charge in terrestrial and space dusty plasmas may be significantly underestimated if a Maxwellian distribution is assumed and the non-thermal dynamics are neglected.

Physics↗
DOE OSTI2022

Joint Planning of Electricity Transmission and Hydrogen Transportation Networks

The abundance and uneven distribution of renewable energy might cause congestion and curtailment in electric power systems. Transmission expansions can potentially alleviate transmission congestion and reduce renewable energy curtailment. On the other hand, with the substantial cost reduction of electrolyzer technology and the continuing rise of hydrogen demand, converting surplus renewable energy to hydrogen provides synergistic benefits to power and hydrogen systems, but consequently requires joint planning of the two systems. To this end, we propose a joint planning approach for power transmission and hydrogen transportation networks to coordinately optimize the investment and operation of power and hydrogen infrastructure. In our proposed model, detailed truck routing, pipeline, and hydrogen storage are formulated to quantify the flexibility of hydrogen transportation system. A robust joint planning approach is also proposed to address various uncertainties from renewable energy, electric load, and hydrogen demand. Furthermore, our numerical simulations show that the proposed joint planning model can save the total system cost, reduce renewable energy curtailment, and increase the utilization level of transmission lines.

08 HYDROGEN↗
DOE OSTI2024

The Wind Turbine Rotors of the Future: A Research Agenda from the Big Adaptive Rotor Project

This white paper outlines a roadmap to inform future research efforts around the wind turbine rotors of the future. The document is authored by researchers that have been working on the Big Adaptive Rotor (BAR) and related initiatives at the National Renewable Energy Laboratory and Sandia National Laboratories. The Wind Energy Technologies Office of the U.S. Department of Energy has been funding BAR since 2018. The learnings from BAR have been documented in dozens of publications. This new paper identifies unresolved critical challenges in wind turbine rotor technology and structures them in four large topic areas: 1. Predictive and validated numerical tools. 2. Design methods and standards. 3. Improvements in manufacturing. 4. Technological innovations. Although wind turbines have not changed in their core architecture, with the market almost entirely dominated by three-bladed upwind rotors, a vast amount of research has allowed to introduce technological innovations resulting in a reduction in levelized cost of energy that made wind competitive with all traditional sources of electricity. Focusing on the rotor, blades will keep following the trend of mass and stiffness reduction, will adopt segmentation, and will keep growing in length, both land-based and offshore. To support this continuous innovation, this white paper argues that research efforts in rotor technology at the national labs are best directed to the first three topic areas and to low technology-readiness-levels (1-3) innovations, leaving the task of implementing higher-TRL (4-9) technological innovations to industry stakeholders. This research roadmap is also well aligned with the upcoming roadmap defined during the International Energy Agency 109th Topical Expert Meeting on the Grand Challenges of Wind Energy.

17 WIND ENERGY↗
DOE OSTI2023

A multiscale phase field fracture approach based on the non-affine microsphere model for rubber-like materials

Rubber-like materials have a broad scope of applications due to their unique properties like high stretchability and increased toughness. Hence, computational models for simulating their fracture behavior are paramount for designing them against failures. In this study, the phase field fracture approach is integrated with a multiscale polymer model for predicting the fracture behavior in elastomers. At the microscale, damaged polymer chains are modeled to be made up of a number of elastic chain segments pinned together. Using the phase field approach, the damage in the chains is represented using a continuous variable. Both the bond stretch internal energy and the entropic free energy of the chain are assumed to drive the damage, and the advantages of this assumption are expounded. A framework for utilizing the non-affine microsphere model for damaged systems is proposed here by considering the minimization of a hypothetical undamaged free energy, ultimately connecting the chain stretch to the macroscale deformation gradient. At the macroscale, a thermodynamically consistent formulation is derived in which the total dissipation is assumed to be mainly due to the rupture of molecular bonds. Using a monolithic scheme, the proposed model is numerically implemented and the resulting three-dimensional simulation predictions are compared with existing experimental data. The capability of the model to qualitatively predict the propagation of complex crack paths and quantitatively estimate the overall fracture behavior is verified. Additionally, the effect of the length scale parameter on the predicted fracture behavior is studied for an inhomogeneous system.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Designs from Local Random Quantum Circuits with SU ( d ) Symmetry

The generation of k -designs (pseudorandom distributions that emulate the Haar measure up to k moments) with local quantum circuit ensembles is a problem of fundamental importance in quantum information and physics. Despite the extensive understanding of this problem for ordinary random circuits, the crucial situations in which symmetries or conservation laws are in play are known to pose fundamental challenges and remain little understood. Here, we construct explicit local unitary ensembles that can achieve high-order unitary k -designs under transversal continuous symmetry, in the particularly important SU ( d ) case. Specifically, we define the convolutional quantum alternating (CQA) group generated by 4-local SU ( d ) -symmetric Hamiltonians as well as associated 4-local SU ( d ) -symmetric random unitary circuit ensembles and prove that they form and converge to SU ( d ) -symmetric k -designs, respectively, for all k < n ( n − 3 ) / 2 , with n being the number of qudits. A key technique that we employ to obtain the results is the Okounkov-Vershik approach to S n representation theory. To study the convergence time of the CQA ensemble, we develop a numerical method using the Young orthogonal form and the S n branching rule. We provide strong evidence for a subconstant spectral gap and certain convergence time scales of various important circuit architectures, which contrast with the symmetry-free case. We also provide comprehensive explanations of the difficulties and limitations in rigorously analyzing the convergence time using methods that have been effective for cases without symmetries, including Knabe’s local gap threshold and Nachtergaele’s martingale methods. This suggests that a novel approach is likely necessary for understanding the convergence time of SU ( d ) -symmetric local random circuits. Published by the American Physical Society 2024

Li, Zimu (ORCID:0000000314736492)↗
DOE OSTI2023

Exascale Multiphysics Nuclear Reactor Simulations for Advanced Designs

ENRICO is a coupled application developed under the U.S. Department of Energy's Exascale Computing Project (ECP) targeting the modeling of advanced nuclear reactors. It couples radiation transport with heat and fluid simulation, including the high-fidelity, highresolution Monte-Carlo code Shift and the Computational fluid dynamics code NekRS. NekRS is a highly-performant open-source code for simulation of incompressible and low-Mach fluid flow, heat transfer, and combustion with a particular focus on turbulent flows in complex domains. It is based on rapidly convergent high-order spectral element discretizations that feature minimal numerical dissipation and dispersion. State-of-the-art multilevel preconditioners, efficient high-order time-splitting methods, and runtime-adaptive communication strategies are built on a fast OCCA-based kernel library, libParanumal, to provide scalability and portability across the spectrum of current and future high-performance computing platforms. On Frontier, Nek5000/RS has recently achieved an unprecedented milestone in breaching over 1 billion spectral elements and 350 billion degrees of freedom. Shift has demonstrated the capability to transport upwards of 1 billion particles per second in full core nuclear reactor simulations featuring complete temperature-dependent, continuous-energy physics on Frontier. Shift achieved a weak-scaling efficiency of 97.8% on 8192 nodes of Frontier and calculated 6 reactions in 214,896 fuel pin regions below 1% statistical error yielding first-of-a-kind resolution for a Monte Carlo transport application.

Hamilton, Steven P.↗
DOE OSTI2024

Ad-Mat: Adaptations of Mature Manufacturing Strategies for Accelerated Redox Flow Battery Deployment

The concept of the Ad-Mat approach is to leverage existing adjacent markets across a broad scope of technologies in order to reduce the manufacturing learning curve and ultimately accelerate redox flow battery (RFB) deployment at scale. Lithium-ion batteries (LIBs) are currently the dominant energy storage technology, and they came to technological maturity under unique market conditions when there was no meaningful competition in the consumer electronic and electric vehicle (EV) space. Today, alternative chemistries that may be technologically better-suited for long-duration storage applications are experiencing a high barrier to entry. This is in large part due to the substantial bias towards the scaled-up production and supply chain that now exists for LIBs. In the case of RFBs in particular, numerous analyses have suggested that RFBs should theoretically have a much lower system cost than LIBs - however, this relies on a mature and competitive manufacturing landscape, which has been extremely challenging to achieve for both flow batteries and other LIB competitors. At the moment, LIB alternatives tend to have isolated small-scale manufacturing pathways, which preclude the economies of scale that would be required to compete with the mature LIB industry. In the present state of the industry, niche manufacturing tools and approaches have evolved to support each alternative technology, such that there is substantial replication and duplication in effort. Continuing to pursue a strategy of isolated manufacturing processes/approaches for each LIB-alternative may never allow for at-scale deployment. In order for RFBs to meaningfully compete with LIBs in the realm of LDES, a new disruptive approach based on cross-industry learning and coordination is needed - and this is exactly what our Ad-Mat concept aims to tackle. In this re-envisioned manufacturing landscape, tools and processes from mature industries can be adapted and deployed across the range of alternative energy storage technologies. Adapting tools, equipment, processes, and industrial learning from mature industries to meet the technological requirements of RFBs would open new markets for existing OEMs in adjacent industries, would prevent unnecessary duplication and re-development, would improve efficiency across the manufacturing chain, and would ultimately support reduced costs and accelerated deployment of RFBs at scale.

adaptive manufacturing↗
DOE OSTI2021

Examination of Semi-Analytical Solution Methods in the Coarse Operator of Parareal Algorithm for Power System Simulation

With continuing advances in high-performance parallel computing platforms, parallel algorithms have become powerful tools for development of faster than real-time power system dynamic simulations. In particular, it has been demonstrated in recent years that parallel-in-time (Parareal) algorithms have the potential to achieve such an ambitious goal. Here, the selection of a fast and reasonably accurate coarse operator of the Parareal algorithm is crucial for its effective utilization and performance. This paper examines semi-analytical solution (SAS) methods as the coarse operators of the Parareal algorithm and explores performance of the SAS methods to the standard numerical time integration methods. Two promising time-power series-based SAS methods were considered; Adomian decomposition method and Homotopy analysis method with a windowing approach for improving the convergence. Numerical performance case studies on 10-generator 39-bus system and 327-generator 2383-bus system were performed for these coarse operators over different disturbances, evaluating the number of Parareal iterations, computational time, and stability of convergence. All the coarse operators tested with different scenarios have converged to the same corresponding true solution (if they are convergent) and the SAS methods provide comparable computational speed, while having more stable convergence to the true solution in many cases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A review of cladding failure thresholds in RIA conditions based on transient reactor test data and the need for continued testing

Transient reactor experiments on light water reactor (LWR) fuel pins had been conducted since the beginning of the nuclear era to help determine core coolability and cladding failure thresholds. During one such test in November of 1993 at the CABRI transient test reactor on a test involving a high burnup fuel rod with a corroded Zircaloy-4 cladding it was first observed that cladding failures could occur prior to a departure from nucleate boiling (pre-DNB) at lower-than-expected peak radial average enthalpies. Thirteen additional tests would be performed in the CABRI reactor over the next decade on fuel rods with higher burnups [1]. Additionally, a larger testing program at the NSRR reactor in Japan with high burnup fuel would uncover a similar trend of pre-DNB ruptures in high burnup test rods at lower-than-expected peak enthalpies [2]. Numerous out of pile testing programs involving a variety of innovative mechanical testing techniques have been employed in an attempt to better quantify the failure thresholds of corroded zirconium alloy cladding in these rapid heating and loading conditions [3][4][5]. While previously interim guidance had been issued, in June of 2020 the NRC officially published updated regulatory guidance to account of these pre-DNB failures in Regulatory Guide 1.236 [6]. This paper will present an independent review of the publicly available transient reactor test database on higher burnup LWR pins conducted at the CABRI and NSRR reactors as well as review of a selection of published out of pile mechanical testing methods. The purpose of the review is to determine how well the new regulatory limits are supported by experimental data. The review will identify if additional transient reactor tests could provide additional support for the NRC guidance or identify the need for revisions. The evaluation will consider how far the existing database can be extrapolated when considering low hydrogen zirconium alloy claddings (with and without protective coatings) containing very high burnup (> 70 MWd/kgU) UO2 fuel pellets. Finally, the authors will suggest how out of pile mechanical tests can be used in conjunction with a limited number of transient reactor tests to develop cladding specific failure thresholds in RIA type transients.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Lefschetz thimble quantum Monte Carlo for spin systems

Monte Carlo simulations are useful tools for modeling quantum systems, but in some cases they suffer from a sign problem, leading to an exponential slow down in their convergence to a value. While solving the sign problem is generically NP hard, many techniques exist for mitigating the sign problem in specific cases; in particular, the technique of deforming the Monte Carlo simulation's plane of integration onto Lefschetz thimbles (complex hypersurfaces of stationary phase) has seen significant success in the context of quantum field theories. We extend this methodology to spin systems by utilizing spin coherent state path integrals to reexpress the spin system's partition function in terms of continuous variables. Using some toy systems, we demonstrate its effectiveness at lessening the sign problem in this setting, despite the fact that the initial mapping to spin coherent states introduces its own sign problem. The standard formulation of the spin coherent path integral is known to make use of uncontrolled approximations; despite this, for large spins they are typically considered to yield accurate results, so it is somewhat surprising that our results show significant systematic errors. Furthermore, possibly of independent interest, our use of Lefschetz thimbles to overcome the intrinsic sign problem in spin coherent state path integral Monte Carlo enables a novel numerical demonstration of a breakdown in the spin coherent path integral.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

From Data to Knowledge: A Graph-Based Reliability Approach to Assess System Health

With the goal of maximizing plant reliability and availability, complex systems such as nuclear power plants continuously monitor and record the performance and the health status of many components, assets, and systems. Such data may take the form of online monitoring data, condition reports, and maintenance reports and it carries the potential to provide system engineers with insights into anomalous behaviors or degradation trends as well as the possible causes behind them and to predict their direct consequences. The analysis of such data poses however few challenges. While some of these challenges are technical in nature (i.e., data are often distributed over several physical servers or databases), others are conceptual in nature (i.e., data elements come in different formats, numeric or textual), and measured values have different scales (e.g., vibration spectra and oil temperature). This paper directly tackles these challenges, and it focuses on the integration of all these data elements in order to assist plant system engineers in analyzing component, assets, and systems performances and optimize maintenance activities. This is performed by 1) extracting knowledge from textual data via technical language processing methods, and 2) quantifying system, asset, and component health from numeric condition-based data. We rely on model-based system engineering (MBSE) models of systems and assets to identify their architecture and functional (i.e., cause and effect) relations. Numeric and textual data elements are then associated with an MBSE graph element, based on their nature. This bonding of MBSE models and data elements constitutes a first-of-its-kind knowledge graph of a nuclear power plants system, with data elements being organized in a structured manner that enables system engineers to identify cause-effect trends in data elements and carry out appropriate actions in response.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Application of transport-based metric for continuous interpolation between cryo-EM density maps

Cryogenic electron microscopy (cryo-EM) has become widely used for the past few years in structural biology, to collect single images of macromolecules "frozen in time". As this technique facilitates the identification of multiple conformational states adopted by the same molecule, a direct product of it is a set of 3D volumes, also called EM maps. To gain more insights on the possible mechanisms that govern transitions between different states, and hence the mode of action of a molecule, we recently introduced a bioinformatic tool that interpolates and generates morphing trajectories joining two given EM maps. This tool is based on recent advances made in optimal transport, that allow efficient evaluation of Wasserstein barycenters of 3D shapes. As the overall performance of the method depends on various key parameters, including the sensitivity of the regularization parameter, we performed various numerical experiments to demonstrate how MorphOT can be applied in different contexts and settings. Finally, we discuss current limitations and further potential connections between other optimal transport theories and the conformational heterogeneity problem inherent with cryo-EM data.

3D shapes↗
DOE OSTI2024

Estimates of Southern Hemispheric Gravity Wave Momentum Fluxes across Observations, Reanalyses, and Kilometer-Scale Numerical Weather Prediction Model

Abstract Gravity waves (GWs) are among the key drivers of the meridional overturning circulation in the mesosphere and upper stratosphere. Their representation in climate models suffers from insufficient resolution and limited observational constraints on their parameterizations. This obscures assessments of middle atmospheric circulation changes in a changing climate. This study presents a comprehensive analysis of stratospheric GW activity above and downstream of the Andes from 1 to 15 August 2019, with special focus on GW representation ranging from an unprecedented kilometer-scale global forecast model (1.4 km ECMWF IFS), ground-based Rayleigh lidar (CORAL) observations, modern reanalysis (ERA5), to a coarse-resolution climate model (EMAC). Resolved vertical flux of zonal GW momentum (GWMF) is found to be stronger by a factor of at least 2–2.5 in IFS compared to ERA5. Compared to resolved GWMF in IFS, parameterizations in ERA5 and EMAC continue to inaccurately generate excessive GWMF poleward of 60°S, yielding prominent differences between resolved and parameterized GWMFs. A like-to-like validation of GW profiles in IFS and ERA5 reveals similar wave structures. Still, even at ∼1 km resolution, the resolved waves in IFS are weaker than those observed by lidar. Further, GWMF estimates across datasets reveal that temperature-based proxies, based on midfrequency approximations for linear GWs, overestimate GWMF due to simplifications and uncertainties in GW wavelength estimation from data. Overall, the analysis provides GWMF benchmarks for parameterization validation and calls for three-dimensional GW parameterizations, better upper-boundary treatment, and vertical resolution increases commensurate with increases in horizontal resolution in models, for a more realistic GW analysis. Significance Statement Gravity wave–induced momentum forcing forms a key component of the middle atmospheric circulation. However, complete knowledge of gravity waves, their atmospheric effects, and their long-term trends are obscured due to limited global observations, and the inability of current climate models to fully resolve them. This study combines a kilometer-scale forecast model, modern reanalysis, and a coarse-resolution climate model to first compare the resolved and parameterized momentum fluxes by gravity waves generated over the Andes, and then evaluate the fluxes using a state-of-the-art ground-based Rayleigh lidar. Our analysis reveals shortcomings in current model parameterizations of gravity waves in the middle atmosphere and highlights the sensitivity of the estimated flux to the formulation used.

Meteorology & Atmospheric Sciences↗
DOE OSTI2022

Real-Time Distribution System State Estimation with Asynchronous Measurements

We report state estimation is a fundamental task in power systems. Although distribution systems are increasingly equipped with sensing devices and smart meters, measurements are typically reported at different rates and asynchronously; these aspects pose severe strains on workhorse state estimation algorithms, which are designed to process batches of data collected in a synchronous manner from all the measurement units. In this paper, we develop a novel state estimation algorithm to continuously update the estimate of the state based on measurements received in an asynchronous manner from measurement units. The synthesis of the algorithm hinges on a proximal-point type method, implemented in an online fashion, and capable of processing measurements received sequentially from sensors. A performance analysis is presented by providing bounds on the estimation error in terms of the mean and variance that hold at each iteration and asymptotically. The scheme is also compared with a more traditional Weighted Least Squares estimator that compensates for the lack of measurement data by using, as pseudo measurements, the measurement retrieved during a certain time window. Numerical simulations on the IEEE 37-bus feeder corroborate the analytical findings.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

The Virasoro minimal string

We introduce a critical string theory in two dimensions and demonstrate that this theory, viewed as two-dimensional quantum gravity on the worldsheet, is equivalent to a double-scaled matrix integral. The worldsheet theory consists of Liouville CFT with central charge c ≥ ≥ 25 coupled to timelike Liouville CFT with central charge 26-c. The double-scaled matrix integral has as its leading density of states the universal Cardy density of primaries in a two-dimensional CFT, thus motivating the name Virasoro minimal string. The duality holds for any value of the continuous parameter c c and reduces to the JT gravity/matrix integral duality in the large central charge limit. It thus provides a precise stringy realization of JT gravity. The main observables of the Virasoro minimal string are quantum analogues of the Weil-Petersson volumes, which are computed as absolutely convergent integrals of worldsheet CFT correlators over the moduli space of Riemann surfaces. By exploiting a relation of the Virasoro minimal string to three-dimensional gravity and intersection theory on the moduli space of Riemann surfaces, we are able to give a direct derivation of the duality. We provide many checks, such as explicit numerical - and in special cases, analytic - integration of string diagrams, the identification of the CFT boundary conditions with asymptotic boundaries of the two-dimensional spacetime, and the matching between the leading non-perturbative corrections of the worldsheet theory and the matrix integral. As a byproduct, we discover natural conformal boundary conditions for timelike Liouville CFT.

Physics↗
DOE OSTI2022

OC6 Phase Ia: CFD Simulations of the Free-Decay Motion of the DeepCwind Semisubmersible

Currently, the design of floating offshore wind systems is primarily based on mid-fidelity models with empirical drag forces. The tuning of the model coefficients requires data from either experiments or high-fidelity simulations. As part of the OC6 (Offshore Code Comparison Collaboration, Continued, with Correlation, and unCertainty (OC6) is a project under the International Energy Agency Wind Task 30 framework) project, the present investigation explores the latter option. A verification and validation study of computational fluid dynamics (CFD) models of the DeepCwind semisubmersible undergoing free-decay motion is performed. Several institutions provided CFD results for validation against the OC6 experimental campaign. The objective is to evaluate whether the CFD setups of the participants can provide valid estimates of the hydrodynamic damping coefficients needed by mid-fidelity models. The linear and quadratic damping coefficients and the equivalent damping ratio are chosen as metrics for validation. Large numerical uncertainties are estimated for the linear and quadratic damping coefficients; however, the equivalent damping ratios are more consistently predicted with lower uncertainty. Some difference is observed between the experimental and CFD surge-decay motion, which is caused by mechanical damping not considered in the simulations that likely originated from the mooring setup, including a Coulomb-friction-type force. Overall, the simulations and the experiment show reasonable agreement, thus demonstrating the feasibility of using CFD simulations to tune mid-fidelity models.

17 WIND ENERGY↗
DOE OSTI2021

Domain decomposition in the GPU-accelerated Shift Monte Carlo code

The GPU solver within the Shift continuous-energy Monte Carlo neutron transport code has been extended to provide domain decomposition in addition to domain replication to enable the solution of problems with memory requirements exceeding the capacity of a single GPU. The strategy follows the Multiple Set, Overlapping Domain (MSOD) approach that is used in Shift’s CPU solver and integrates into the event-based algorithm used for Shift’s GPU solver. Furthermore, the ability to assign processors to spatial domains non-uniformly has been maintained. In this work, two different approaches for communicating particle data between domains are considered, and multiple criteria for load balancing problems have been investigated. Numerical results are presented for both fresh and depleted small modular nuclear reactor (SMR) cores. A parallel efficiency of approximately 80% was achieved with up to 16 spatial domains measured relative to full domain replication. A scaling study on the Summit supercomputer demonstrates a weak scaling parallel efficiency of over 90% on over 24000 GPUs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Reinforcement learning based automated history matching for improved hydrocarbon production forecast

History matching aims to find a numerical reservoir model that can be used to predict the reservoir performance. An engineer and model calibration (data inversion) method are required to adjust various parameters/properties of the numerical model in order to match the reservoir production history. In this study, we develop deep neural networks within the reinforcement learning framework to achieve automated history matching that will reduce engineers’ efforts, human bias, automatically and intelligently explore the parameter space, and remove the need of large set of labeled training data. To that end, a fast-marching-based reservoir simulator is encapsulated as an environment for the proposed reinforcement learning. The deep neural-network-based learning agent interacts with the reservoir simulator within reinforcement learning framework to achieve the automated history matching. Reinforcement learning techniques, such as discrete Deep Q Network and continuous Deep Deterministic Policy Gradients, are used toth, used to train the learning agents. The continuous actions enable the Deep Deterministic Policy Gradients to explore more states at each iteration in a a learning episode; consequently, a better history matching is achieved using this algorithm as compared to Deep Q Network. For simplified dual-target composite reservoir models, the best history-matching performances of the discrete and continuous learning methods in terms of normalized root mean square errors are 0.0447 and 0.0038, respectively. Furthermore, our study shows that continuous action space achieved by the deep deterministic policy gradient drastically outperforms deep Q network.

42 ENGINEERING↗