Engineering Papers⌕ Search

Engineering topics

Liu, Siyan

Publications and source records attributed to Liu, Siyan.

25 records · Page 2

PI3NN: Out-of-distribution-aware Prediction Intervals from Three Neural Networks

We propose a novel prediction interval (PI) method for uncertainty quantification, which addresses three major issues with the state-of-the-art PI methods. First, existing PI methods require retraining of neural networks (NNs) for every given confidence level and suffer from the crossing issue in calculating multiple PIs. Second, they usually rely on customized loss functions with extra sensitive hyperparameters for which fine tuning is required to achieve a well-calibrated PI. Third, they usually underestimate uncertainties of out-of-distribution (OOD) samples leading to over-confident PIs. Our PI3NN method calculates PIs from linear combinations of three NNs, each of which is independently trained using the standard mean squared error loss. The coefficients of the linear combinations are computed using root-finding algorithms to ensure tight PIs for a given confidence level. We theoretically prove that PI3NN can calculate PIs for a series of confidence levels without retraining NNs and it completely avoids the crossing issue. Additionally, PI3NN does not introduce any unusual hyperparameters resulting in a stable performance. Furthermore, we address OOD identification challenge by introducing an initialization scheme which provides reasonably larger PIs of the OOD samples than those of the in-distribution samples. Benchmark and real-world experiments show that our method outperforms several state-of-the-art approaches with respect to predictive uncertainty quality, robustness, and OOD samples identification.

Liu, Siyan↗

A Review of Lattice-Boltzmann Models Coupled with Geochemical Modeling Applied for Simulation of Advanced Waterflooding and Enhanced Oil Recovery Processes

To maintain economic profit and improve the oil production efficiency after the primary and secondary production phase, advanced waterflooding techniques such as low salinity waterflooding in carbonate reservoirs have been investigated in numerical simulations, laboratory experiments, and field pilot tests. Multiple underlying mechanisms have been proposed based on these studies, and they are still under debate. Various numerical modeling approaches are introduced, but there exists a lack of a pore-scale comprehensive modeling scheme to fully understand the processes. Lattice-Boltzmann method (LBM) is a type of numerical fluid flow modeling technique that shows capabilities and flexibilities in modeling pore-scale fluid flow to integrate physical–chemical processes within complex structures. The intrinsic feature of LBM makes it a promising framework for simulating advanced waterflooding due to its flexibility, accuracy, and parallel efficiency. LBM works either by itself for solving reactive transport problems or by coupling with a third-party reaction solver. This review mainly introduces the LBM fluid flow and reactive transport capabilities and the concept and modeling approaches to simulate advanced waterflooding techniques. Meanwhile, an evaluation of the coupled LBM models for enhanced oil recovery (EOR) simulations is discussed with future research challenges and directions concluded.

02 PETROLEUM↗

A prediction interval method for uncertainty quantification of regression models

This paper considers calculation of prediction intervals (PIs) by neural networks (NNs) for quantifying uncertainty in regression tasks, so as to provide fast, accurate and robust emulators to accelerate scientific simulations. We propose a novel method to learn lower and upper bounds of the PI using independent NNs without defining an exclusive loss. Our method requires no distributional assumption, does not introduce extra hyper-parameters, and can effectively identify out-of-distribution samples and quantify their uncertainty. We demonstrate advantages of our method using a benchmark problem and two real-world scientific applications.

Zhang, Pei↗

An out-of-distribution-aware autoencoder model for reduced chemical kinetics

While detailed chemical kinetic models have been successful in representing rates of chemical reactions in continuum scale computational fluid dynamics (CFD) simulations, applying the models in simulations for engineering device conditions is computationally prohibitive. To reduce the cost, data-driven methods, e.g., autoencoders, have been used to construct reduced chemical kinetic models for CFD simulations. Despite their success, data-driven methods rely heavily on training data sets and can be unreliable when used in out-of-distribution (OOD) regions (i.e., when extrapolating outside of the training set). In this paper, we present an enhanced autoencoder model for combustion chemical kinetics with uncertainty quantification to enable the detection of model usage in OOD regions, and thereby creating an OOD-aware autoencoder model that contributes to more robust CFD simulations of reacting flows.Here, we first demonstrate the effectiveness of the method in OOD detection in two well-known datasets, MNIST and Fashion-MNIST, in comparison with the deep ensemble method, and then present the OOD-aware autoencoder for reduced chemistry model in syngas combustion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An Efficient Bayesian Method for Advancing the Application of Deep Learning in Earth Science

Despite their wide and successful applications, deep learning (DL) models are prone to overfitting for small training datasets, produce a poor predictive performance for uncertain data, and provide point estimations without any indication of the accuracy and credibility. These limitations of the deterministic DL models hinder their effective application in Earth system science where the labelled data are sparse, noisy and incomplete with large uncertainty and where the predictive uncertainty quantification is needed for scientific understanding and policy decision making. Integration of Bayesian inference into DL models adds an estimate of uncertainty and regularization in the predictions. However, traditional Bayesian methods are computationally unaffordable and inflexible for high-dimensional problems, which limits their application to DL systems that typically have millions of model parameters. In this effort, we propose an efficient and general-purpose Bayesian inference method to advance DL model optimization and uncertainty quantification, so as to facilitate the adoption of DL in Earth sciences. In a demonstration, we integrate the proposed Bayesian method with a feedforward neural network (NN) to build a fast-to-evaluate surrogate of the complex Energy Exascale Earth System Land Model for efficient modeling. The formulated Bayesian NN, using a small number of training data, produces an accurate prediction with high credibility, whereas with the same small training size, the deterministic NN cannot yield a reasonable estimation and does not provide confidence information. The proposed Bayesian method is computationally efficient and flexible, capable of integration with diverse network variants such as convolutional NNs and recurrent NNs to advance the application of DL in Earth sciences.

Lu, Dan↗

Numerical simulation of Water-alternating-gas Process for Optimizing EOR and Carbon Storage

Carbon dioxide (CO 2 ) generated by fossil fuel combustion can have serious consequences for humans and environments. Carbon capture, utilization and geological storage (CCUS) is a key approach to reduce the emissions of the anthropogenic CO 2 into the atmosphere. Of those, sequestering the CO 2 into depleted hydrocarbon reservoirs with associated enhanced oil recovery is the most achievable approach under current economic constraints since it increases recovery of existing oil reserves, and bridges the gap between nonprofit geological CO 2 sequestration and profit CO 2 -EOR. The Upper Devonian fluvial sandstone reservoir in Jacksonburg-Stringtown oil field in West Virginia, which has produced over 22 million barrels of oil since 1895, is an ideal candidate for CO 2 sequestration coupled with EOR. This research illustrates an example of CCUS, in which CO 2 is sequestered into underground meanwhile enhanced oil recovery from the depleted hydrocarbon reservoir by water alternating gas (WAG) strategy. Three CO 2 storage mechanisms including structural/stratigraphic trapping, dissolution trapping, and residual trapping are considered. A 3D geological model is constructed based on existing geological data from the Jacksonburg-Stringtown oil field. A 3D composition fluid model with 0.4 pore volume (PV) of water injection before WAG process is considered as a benchmark of this study. Several factors including WAG cycle period, injection time ratio, CO 2 injection rate are evaluated. After injection wells are completely shut-in, stored CO 2 is monitored for additional 200 years as a function of various storage mechanisms. The result shows that over 6 years of WAG injection, total 12 - 40 MMlb-mol CO 2 is sequestrated and oil recovery factor can achieve 28%. As a conclusion, this research constructs a basic workflow for CO 2 storage coupled with CO 2 -EOR which can be applied to other super-mature oil fields.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗