Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Investigation into the instantaneous centre of rotation for enhanced design of floating offshore wind turbines

The dynamic behaviour of floating offshore wind turbines (FOWTs) involves complex interactions of multivariate loads from wind, waves, and currents, which result in complex motion characteristics. Although methods for analysing global motion responses are well-established, the time- and location-dependent kinematics remain underexplored. This paper investigates the instantaneous centre of rotation (ICR), a point of zero velocity at a time instance of general plane motion. Understanding and strategically positioning the ICR can reduce the dynamic motion in critical structural locations, enhancing the performance and structural robustness of FOWTs. The paper presents a method for computing the ICR using time-domain simulation results and proposes a statistical analysis approach suitable for design studies. Building on prior research, it examines the sensitivity of the ICR to external loading and design features, providing insights into how these factors influence motion response and how the motion response influences the statistics of the ICR, structural loads, and other performance metrics of interest. The study explores two FOWT configurations, a spar and a semisubmersible, identifying design variables that most effectively control the ICR statistics and identifying the ICR statistics most correlated with the responses of interest. Finally, through two case studies, we demonstrate how to apply these new insights in a practical design scenario. By adjusting the design variables most correlated with the ICR (fairlead vertical position and centre of mass for the spar and mooring line length and offset column diameter for the semisubmersible), we successfully modified the designs of the floating support structures to reduce the loads in the mooring lines, tower base, and blade roots, improving the ultimate strength and fatigue characteristics compared to the original designs.

17 WIND ENERGY↗
DOE OSTI2025

Carbon Dioxide Removal Measurement, Reporting, and Verification Simulation toolkit (CDR MRVSim) v0.1

CDR MRVSim is a statistical software toolkit for techno-economic analysis of measurement, reporting, and verification of multiple carbon dioxide removal technologies. The current version applies Monte Carlo simulation to existing datasets estimate the cost and uncertainty of measuring the soil organic carbon (SOC) content of agricultural land, accounting for multiple sources of uncertainty, using data from field measurements. We are planning to incorporate enhanced rock weathering and other technologies into the software. The current model leverages existing data to characterize underlying variability in soil organic carbon and related parameters, including bulk density, in an agricultural field attempting to increase its SOC. We then simulate baseline and post-intervention "measurement campaigns" in which some number of SOC and bulk density measurements are conducted using a selected technology. This enables estimates of the cost and accuracy of measuring changes in SOC in the simulated field. The primary advantages over similar software are: 1) ability to quantify tradeoffs between cost and uncertainty in MRV across a range of possible MRV approaches 2) focus on guiding development of novel sensors by determining desirable sets of characteristics

Sherwin, Evan [Lawrence Berkeley National Laborato↗
DOE OSTI2022

Numerical error analysis of SOLPS-ITER simulations of EAST

Abstract Plasma edge simulations with codes like SOLPS-ITER are widely employed to interpret fusion experiments. However, numerical errors appearing in such simulations are rarely investigated, despite their potential large impact on simulation results. These errors consist of the statistical error and the bias, both resulting from the finite number of employed EIRENE Monte Carlo particles and incomplete convergence, and the discretization error due to the finite resolution of the computational grids. In this contribution, the resulting numerical errors on simulations of pure deuterium and neon seeded H-mode EAST discharges are examined. The statistical error can be kept small compared to other numerical error contributions by averaging the plasma profiles. This allows investigating the bias and discretization errors using Richardson extrapolation. It is shown that grid refinement and the number of employed Monte Carlo particles have the largest influence on the result, in agreement with similar studies of an ITER deuterium case. For the first time, numerical error bars on the entire simulated target profiles are determined showing that the largest numerical error is 17.9%, mainly due to the plasma grid discretization. On top, also numerical errors on simulated neutral pressures are investigated in detail, for which the statistical error is dominant. The analysis demonstrates which setup is needed to keep numerical errors limited: the SOLPS-ITER averaging procedure should be employed including enough EIRENE particles, and the involved grids should be sufficiently refined to reduce discretization errors.

Boeyaert, Dieter (ORCID:0000000309208660)↗
DOE OSTI2020

Simulation of Particle-Material Interactions

This paper gives an overview of the particle transport theory essentials, the basics of particle-material interaction simulation, physical quantities needed to simulate particle transport and interactions in materials, Monte Carlo simulation flow, response of additive detectors, statistical weights and other techniques to minimize statistical errors. Effects in materials under irradiation, materials response related to component lifetime and performance are considered with a focus on high-energy and high-power accelerator applications. Implementation of simulation of particle-material interactions in the modern Monte Carlo codes along with the code s main features and results of recent benchmarking are described.

43 PARTICLE ACCELERATORS↗
DOE OSTI2026

Precise Modeling of a Complex Solenoidal Magnetic Field Using a Combination of Analytic Functions and a PINN

We demonstrate an iterative approach to modeling a sparsely measured magnetic field in a large-bore solenoid. This approach uses a hybrid of traditional and machine learning techniques. The traditional technique is a linear least-squares fit using a series solution to Laplace's equation, while the machine learning technique involves the training of a physics-informed neural network (PINN) on the least-squares fit residuals. We use a newly defined activation function "DELTAsnake," a modification to the snake activation function proposed by Ziyin et al. that allows for stronger curvature and non-monotonicity. The combined model approximately obeys Maxwell's equations to a level sufficient for producing high quality physics simulations and analysis. Our approach is applied to a highly realistic calculation of the expected magnetic field in the Mu2e experiment's Detector Solenoid which includes a simple model for the expected statistical measurement uncertainties. Using ten toy measurement simulations, we demonstrate the capabilities of our model in comparison to the least-squares method alone; the least-squares method alone results in a reduced chi-squared statistic of ${2.15 \pm 0.01}$, while our approach improves the reduced chi-square to ${1.034 \pm 0.005}$. Furthermore, for an average toy simulation, we show that the range of the RMS of the three field component residuals reduces from ${0.07-0.37}$ Gauss to ${0.05-0.07}$ Gauss. We find that this novel method is robust against a realistic systematic uncertainty deriving from Hall probe calibration bias and can be used to significantly reduce the number of measurements required to achieve an accurate model.

Kampa, Cole [Caltech] (ORCID:0000000192972920)↗
DOE OSTI2025

Exascale granular microstructure reconstruction in 3D volumes of arbitrary geometries with generative learning

Reconstructing 3D granular microstructures within volumes of arbitrary geometries from limited 2D image data is crucial for predicting the material properties, as well as performances of structural components accounting for material microstructural effects. We present a novel generative learning framework that enables exascale reconstruction of granular microstructures within complex 3D geometric volumes. Building upon existing transfer learning techniques using pre-trained convolutional neural networks (CNN), we introduce several key innovations to overcome the difficulties inherent in arbitrary geometries. Our framework incorporates periodic boundary conditions using circular padding techniques, ensuring continuity and representativeness of the reconstructed microstructures. We also introduce a novel seamless transition reconstruction (STR) method that creates statistically equivalent transition zones to integrate multiple pre-existing 3D microstructure volumes. Based on STR, we propose a cost-effective strategy for reconstructing microstructures within complex geometric volumes, minimizing computational waste. Validation through numerical experiments using kinetic Monte Carlo simulations demonstrates accurate reproduction of grain statistics, including grain size distributions and morphology. A case study involving the reconstruction of a 4-blade propeller microstructure illustrates the method’s capability to efficiently handle complex geometries. In conclusion, the proposed framework significantly reduces computational demands while maintaining high reconstruction quality, paving the way for scalable microstructure reconstruction in materials design and analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Techniques for improved statistical convergence in quantification of eddy diffusivity moments

While recent approaches, such as the macroscopic forcing method (MFM) or Green's function-based approaches, can be used to compute Reynolds-averaged Navier-Stokes closure operators using forced direct numerical simulations, MFM can also be used to directly compute moments of the effective nonlocal and anisotropic eddy diffusivities. The low-order spatial and temporal moments contain limited information about the eddy diffusivity but are often sufficient for quantification and modeling of nonlocal and anisotropic effects. However, when using MFM to compute eddy diffusivity moments, the statistical convergence can be slow for higher-order moments. In this work, we demonstrate that using the same direct numerical simulation (DNS) for all forced MFM simulations improves statistical convergence of the eddy diffusivity moments. We present its implementation in conjunction with a decomposition method that handles the MFM forcing semianalytically and allows for consistent boundary condition treatment, which we develop for both scalar and momentum transport. We demonstrate that for a two-dimensional Rayleigh-Taylor instability case study, using the same DNS for all forced MFM simulations results in convergence with 𝒪⁡(100) simulations rather than 𝒪⁡(1000) simulations. In conclusion, we then demonstrate the impacts of improved convergence on the quantification of the eddy diffusivity.

general physics↗
DOE OSTI2025

Forward modeling fluctuations in the DESI LRGs target sample using image simulations

We use the forward modeling pipeline, Obiwan, to study the imaging systematics of the Luminous Red Galaxies (LRGs) targeted by the Dark Energy Spectroscopic Instrument (DESI). Imaging systematics refers to the false fluctuation of galaxy densities due to varying observing conditions and astrophysical foregrounds corresponding to the imaging surveys from which DESI LRG target galaxies are selected. We update the Obiwan pipeline, which we previously developed to simulate the optical images used to target DESI data, to further simulate WISE images in the infrared. This addition allows simulating the DESI LRGs sample, which utilizes WISE data in the target selection. Deep DESI imaging data combined with a method to account for biases in their shapes is used to define a truth sample of potential LRG targets. We inject these data evenly throughout the DESI Legacy Imaging Survey footprint at declinations between -30 and 32.375 degrees. We simulate a total of 15 million galaxies to obtain a simulated LRG sample (Obiwan LRGs) that predicts the variations in target density due to imaging properties. We find that the simulations predict the trends with depth observed in the data, including how they depend on the intrinsic brightness of the galaxies. We observe that faint LRGs are the main contributing source of the imaging systematics trend induced by depth. We also find significant trends in the data against Galactic extinction that are not predicted by Obiwan. These trends depend strongly on the particular map of Galactic extinction chosen to test against, implying systematic contamination in the Galactic extinction maps is a likely root cause (e.g., Cosmic-Infrared Background, dust temperature correction). We additionally observe a morphological change of the DESI LRGs population evidenced by a correlation between OII emission line average intensity and the size of the z-band PSF. This effect most likely results from uncertainties in background subtraction. The detailed findings we present should be used to guide any observational systematics mitigation treatment for the clustering of the DESI LRGs sample.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Large Scale Study of Ligand–Protein Relative Binding Free Energy Calculations: Actionable Predictions from Statistically Robust Protocols

The accurate and reliable prediction of protein–ligand binding affinities can play a central role in the drug discovery process as well as in personalized medicine. Of considerable importance during lead optimization are the alchemical free energy methods that furnish an estimation of relative binding free energies (RBFE) of similar molecules. Recent advances in these methods have increased their speed, accuracy, and precision. This is evident from the increasing number of retrospective as well as prospective studies employing them. However, such methods still have limited applicability in real-world scenarios due to a number of important yet unresolved issues. Here, we report the findings from a large data set comprising over 500 ligand transformations spanning over 300 ligands binding to a diverse set of 14 different protein targets which furnish statistically robust results on the accuracy, precision, and reproducibility of RBFE calculations. We use ensemble-based methods which are the only way to provide reliable uncertainty quantification given that the underlying molecular dynamics is chaotic. These are implemented using TIES (Thermodynamic Integration with Enhanced Sampling). Results achieve chemical accuracy in all cases. Ensemble simulations also furnish information on the statistical distributions of the free energy calculations which exhibit non-normal behavior. We find that the “enhanced sampling” method known as replica exchange with solute tempering degrades RBFE predictions. We also report definitively on numerous associated alchemical factors including the choice of ligand charge method, flexibility in ligand structure, and the size of the alchemical region including the number of atoms involved in transforming one ligand into another. Our findings provide a key set of recommendations that should be adopted for the reliable application of RBFE methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Resolving Mesoscale Convective Systems: Grid Spacing Sensitivity in the Tropics and Midlatitudes

Abstract Mesoscale convective systems (MCSs) are a critical global water cycle component and drive extreme precipitation events in tropical and midlatitude regions. However, simulating deep convection remains challenging for modern numerical weather and climate models due to the complex interactions of processes from microscales to synoptic scales. Recent models with kilometer‐scale horizontal grid spacings offer notable improvements in simulating deep convection compared to coarser‐resolution models. Still, deficiencies in representing key physical processes, such as entrainment, lead to systematic biases. Additionally, evaluating model outputs using process‐oriented observational data remain difficult. This study presents an ensemble of MCS simulations with spanning the deep convective gray zone ( from 12 km to 125 m) in the Southern Great Plains of the U.S. and the Amazon Basin. Comparing these simulations with Atmospheric Radiation Measurement (ARM) wind profiler observations, we find greater sensitivity in the Amazon Basin compared to the Great Plains. Convective drafts converge structurally at sub‐kilometer scales, but some deficiencies remain. In both regions, simulated up and downdrafts are too deep and extreme downdrafts are not strong enough. Furthermore, Amazonian updrafts are too strong. Overall, we observe higher sensitivity in the tropics, including an artificial buildup in vertical kinetic energy at scales of , suggesting a need for 250 m in this region. Nevertheless, bulk convergence—agreement of storm‐average statistics—is achievable with kilometer‐scale simulations within a 10% error margin with 1 km providing a good balance between accuracy and computational cost.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Description of the LASSO Data Bundles Product

The U. S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility began a pilot project in May 2015 to design a routine, high-resolution modeling capability to complement ARM’s extensive suite of measurements. This modeling capability has evolved into the Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) datastream. The datastream, broadly termed data bundles, contains high-resolution model output, input files, observations for evaluation, and skill scores for the simulations. The initial focus of LASSO is on shallow convection at the ARM Southern Great Plains (SGP) atmospheric observatory. The availability of LES simulations with concurrent observations serves many purposes. LES helps bridge the scale gap between DOE ARM observations and models, and the use of routine LES adds value to observations. It provides a self-consistent representation of the atmosphere and a dynamical context for the observations. Further, it elucidates unobservable processes and properties. LASSO generates a simulation library for researchers that enables statistical approaches beyond a single-case mentality. It also provides tools necessary for modelers to reproduce the LES and conduct their own sensitivity experiments. The LASSO library of data bundles is designed to facilitate a wide range of research. For an observationalist, LASSO can help inform instrument remote-sensing retrievals, conduct observation system simulation experiments (OSSEs), and test implications of radar scan strategies or flight paths. For a theoretician, LASSO can help calculate estimates of fluxes and co-variability of values, and test relationships without having to run the model personally. For a modeler, LASSO can help one know ahead of time which days have good forcing, have co-registered observations at high-resolution scales, and have simulation inputs and corresponding outputs to test parameterizations. Further details on the overall LASSO project are available at https://www.arm.gov/capabilities/modeling/lasso.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

High-precision Galaxy Clustering Predictions from Small-volume Hydrodynamical Simulations via Control Variates

Abstract Cosmological simulations of galaxy formation are an invaluable tool for understanding galaxy formation and its impact on cosmological parameter inference from large-scale structures. However, their high computational cost is a significant obstacle for running simulations that probe cosmological volumes comparable to those analyzed by contemporary large-scale structure experiments. In this work, we explore the possibility of obtaining high-precision galaxy clustering predictions from small-volume hydrodynamical simulations such as MillenniumTNG and FLAMINGO via control variates. In this approach, the hydrodynamical full-physics simulation is paired with a matched low-resolution gravity-only simulation. By learning the galaxy–halo connection from the hydrodynamical simulation and applying it to the gravity-only counterpart, one obtains a galaxy population that closely mimics the one in the more expensive simulation. One can then construct an estimator of galaxy clustering that combines the clustering amplitudes in the small-volume hydrodynamical and gravity-only simulations with clustering amplitudes in a large-volume gravity-only simulation. Depending on the galaxy sample, clustering statistic, and scale, this galaxy clustering estimator can have an effective volume of up to around 100 times the volume of the original hydrodynamical simulation in the nonlinear regime. With this approach, we can construct galaxy clustering predictions from existing simulations that are precise enough for mock analyses of next-generation large-scale structure surveys such as the Dark Energy Spectroscopic Instrument and the Legacy Survey of Space and Time.

Doytcheva, Alexandra (ORCID:0009000111254888)↗
DOE OSTI2022

Structure of Offshore Low-Level Jet Turbulence and Implications to Mesoscale-to-Microscale Coupling

This paper explores realistic nonstationary atmospheric boundary layer (ABL) turbulence arising from nonstationarity at the mesoscale, particularly within offshore low-level jets with implications to offshore wind farms, using high-fidelity multiscale large-eddy simulations (LES). To this end, we analyzed the single-point turbulence statistical structure of a North-Atlantic offshore LLJ event simulated using high-resolution LES (AMR-Wind). The nonstationary LLJ is simulated using a mesoscale-to-microscale coupled (MMC) simulation procedure involving data assimilation of mesoscale velocity and temperature data from the Weather Research and Forecasting (WRF) model. Unlike the assimilation of mesoscale velocity data into the LES, the direct assimilation of temperature profiles had a strong impact on turbulence stratification, thereby causing erroneous predictions of turbulence both above and within the jet layer. Various approaches to mitigate this effect have resulted in multiple (four) variants of this MMC strategy. Outcomes from this work clearly show that the turbulence within the low-level jet is a strong function of the MMC approach as the turbulence structure within the low-level jet is dependent on the flux of residual turbulence from outside the jet, which in turn depends on the temperature forcing history. Additionally, the turbulence predicted by all these different methods (as well as the observation data) show similar deviations from equilibrium as evidenced by comparisons with idealized atmospheric turbulence structure obtained using the same numerical method. In general, we observe that the predicted LLJ turbulence tends to differ from canonical ABL turbulence with comparable shear. Particularly, the combination of shear and turbulence observed in such nonstationary low-level turbulence cannot be matched using equilibrium settings and therefore, represents a critical use-case for both testing and leveraging meso–micro coupling strategies.

17 WIND ENERGY↗
DOE OSTI2022

Statistical Significance Testing for Mixed Priors: A Combined Bayesian and Frequentist Analysis

In many hypothesis testing applications, we have mixed priors, with well-motivated informative priors for some parameters but not for others. The Bayesian methodology uses the Bayes factor and is helpful for the informative priors, as it incorporates Occam’s razor via the multiplicity or trials factor in the look-elsewhere effect. However, if the prior is not known completely, the frequentist hypothesis test via the false-positive rate is a better approach, as it is less sensitive to the prior choice. We argue that when only partial prior information is available, it is best to combine the two methodologies by using the Bayes factor as a test statistic in the frequentist analysis. We show that the standard frequentist maximum likelihood-ratio test statistic corresponds to the Bayes factor with a non-informative Jeffrey’s prior. We also show that mixed priors increase the statistical power in frequentist analyses over the maximum likelihood test statistic. We develop an analytic formalism that does not require expensive simulations and generalize Wilks’ theorem beyond its usual regime of validity. In specific limits, the formalism reproduces existing expressions, such as the p-value of linear models and periodograms. We apply the formalism to an example of exoplanet transits, where multiplicity can be more than 10 7 . We show that our analytic expressions reproduce the $p$-values derived from numerical simulations. We offer an interpretation of our formalism based on the statistical mechanics. We introduce the counting of states in a continuous parameter space using the uncertainty volume as the quantum of the state. We show that both the $p$-value and Bayes factor can be expressed as an energy versus entropy competition.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Quantitative methods and modeling to assess COVID–19–interrupted in vivo pharmacokinetic bioequivalence studies with two reference batches

The coronavirus disease 2019 (COVID-19) has presented unprecedented challenges to the generic drug development, including interruptions in bioequivalence (BE) studies. Per guidance published by the US Food and Drug Administration (FDA) during the COVID-19 public health emergency, any protocol changes or alternative statistical analysis plan for COVID-19-interrupted BE study should be accompanied with adequate justifications and not lead to biased equivalence determination. In this study, we used a modeling and simulation approach to assess the potential impact of study outcomes when two different batches of a Reference Standard (RS) were to be used in an in vivo pharmacokinetic BE study due to the RS expiration during the COVID-19 pandemic. Simulations were performed with hypothetical drugs under two scenarios: (1) uninterrupted study using a single batch of an RS, and (2) interrupted study using two batches of an RS. The acceptability of BE outcomes was evaluated by comparing the results obtained from interrupted studies with those from uninterrupted studies. The simulation results demonstrated that using a conventional statistical approach to evaluate BE for COVID-19-interrupted studies may be acceptable based on the pooled data from two batches. An alternative statistical method which includes a “batch” effect to the mixed effects model may be used when a significant “batch” effect was found in interrupted four-way crossover studies. However, such alternative method is not applicable for interrupted two-way crossover studies. Overall, the simulated scenarios are only for demonstration purpose, the acceptability of BE outcomes for the COVID19-interrupted studies could be case-specific.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Examining the Impacts of Great Lakes Temperature Perturbations on Simulated Precipitation in the Northeastern United States

Most inland water bodies are not resolved by general circulation models, requiring that lake surface temperatures be estimated. Given the large spatial and temporal variability of the surface temperatures of the North American Great Lakes, such estimations can introduce errors when used as lower boundary conditions for dynamical downscaling. Lake surface temperatures (LSTs) influence moisture and heat fluxes, thus impacting precipitation within the immediate region and potentially in regions downwind of the lakes. For this study, the Advanced Research version of the Weather Research and Forecasting Model (WRF-ARW) was used to simulate precipitation over the six New England states during a 5-yr historical period. The model simulation was repeated with perturbed LSTs, ranging from 10°C below to 10°C above baseline values obtained from reanalysis data, to determine whether the inclusion of erroneous LST values has an impact on simulated precipitation and synoptic-scale features. Results show that simulated precipitation in New England is statistically correlated with LST perturbations, but this region falls on a wet–dry line of a larger bimodal distribution. Wetter conditions occur to the north and drier conditions occur to the south with increasing LSTs, particularly during the warm season. Additionally, the precipitation differences coincide with large-scale anomalous temperature, pressure, and moisture patterns. Care must therefore be taken to ensure reasonably accurate Great Lakes surface temperatures when simulating precipitation, especially in southeastern Canada, Maine, and the mid-Atlantic region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Micro-mechanical investigation of the thermo-mechanical properties of micro-architectured tungsten coatings

The thermo-mechanical response of micro-architectured tungsten coatings is characterized in the temperature range of 293 to 673 K using both in situ micro-compression experiments inside a scanning electron microscope (SEM) as well as image-based crystal plasticity finite element method (CPFEM) simulations. The experiments were conducted on micropillar-like specimens that were focus ion beam milled into the coatings, while the simulations were conducted on columnar-grained micropillar simulation cells constructed based on the statistics of the coating’s microstructure. The experimental results show that the stress–strain response and deformation mode exhibit a strong temperature-dependence. At room temperature, catastrophic failure is observed shortly after yield and is manifested in the form of intergranular fracture and buckling of individual columnar grains. With increasing temperature, this catastrophic failure is gradually suppressed and the material exhibits a steadier strain hardening response at 693 K. The CPFEM simulations are also shown to be in good agreement with the experimental results, and these simulations indicate that the material response is strongly influenced by the local crystallographic anisotropy and microstructure inhomogeneity. Furthermore, the simulations capture the underlying mechanisms that control the temperature-dependent transition in deformation mode. The current results highlight that the micro-architectured microstructure offers a great combination of excellent mechanical strength and structural integrity at elevated temperatures, which is of importance for high temperature applications.

36 MATERIALS SCIENCE↗
DOE OSTI2021

A large-scale comparison of Artificial Intelligence and Data Mining (AI&DM) techniques in simulating reservoir releases over the Upper Colorado Region

In recent years, the Artificial Intelligence and Data Mining (AI&DM) models have become popular tools in assisting various aspects of reservoir operation. However, the practical uses are still rarely reported. Comparison experiment of many AI&DM models over a large number of reservoir cases is particularly valuable to help reservoir operators first examine the usefulness and transferability of different AI&DM models, and then identify the most stable and reliable AI&DM model in assist of various decision-making processes. In this study, a total of 12 AI&DM models with different parameterizations and simulation scenarios are comprehensively tested out and compared in simulating the controlled reservoir outflows of 33 reservoir cases over the Upper Colorado Region, United States. Results show that the Random Forecast and the Long-Short-Term-Memory model could consistently derive the best statistical performance than other models under the baseline simulation scenario. The employed AI&DM models could obtain satisfactory statistical interquartile ranges (25–75%) between [0.6–0.9], [0.3–0.8], and [0.2–0.8], for CORR, NSE, and KGE measurements, respectively, and [1.5–6.5], [–15 to 20], and [0.5–8.5] for the normalized RMSE, PBIAS and RSR measurements, respectively. Results also show Multi-Layer Perceptron model and Extreme Gradient Boosting Tree Algorithm produced more stable and superior performance than other models under more complex input scenarios. We also found that the performance of different AI&DM models are closely relevant to the reservoir elevations, sizes, and functionalities. Discussions were made about the sensitivity of AI&DM models’ parameterizations and the key advantages of AI&DM models over the rule-based reservoir models. We further identify that the main advantage of AI&DM models is the flexibility in designing input structures, whereas the rule-based simulation model is rather limited. Future studies were suggested regarding the best way reservoir operators and researchers could use, select, and apply different AI&DM models in simulating reservoir releases under different natural and modeling environments. Finally, this comparison study also serves as a reference and a piece of groundwork for further promoting the practical uses of AI&DM models in assisting reservoir operation.

54 ENVIRONMENTAL SCIENCES↗