Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “statistical model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,567 records · Page 87

A multiscale recurrent neural network model for predicting energy production from geothermal reservoirs

Optimization of energy production from geothermal reservoirs requires reliable prediction of energy production performance under alternative operation and development scenarios. Traditionally, reservoir simulation models are used for the evaluation and screening of alternative production and development plans. However, simulation models require extensive data collection and modeling efforts and are time-consuming to build, run, and update. Data-driven predictive models, on the other hand, can serve as efficient prediction tools that can be used for decision support and management of daily operations and surveillance activities. Data-driven models become particularly attractive when a reservoir simulation model for a field does not exist and/or is difficult to build. Machine learning (ML)-based data-driven models that have recently become popular in several fields exploit statistical patterns and relations in training data to generate predictions. As such, they tend to perform better in interpolation problems (that is, prediction within the training data range) than when they are used to extrapolate beyond the training data. Production data from geothermal reservoirs tend to exhibit short-term variabilities as well as long-term trends, such as monotonically declining production temperatures. Capturing both short-term features and long-term trends with ML-based models is not trivial. We evaluate the use of recurrent neural networks (RNN) for the prediction of energy production from geothermal reservoirs. RNN is a class of ML architectures that are used to represent and predict sequential/dynamic data. Thus, it can be challenging to apply RNN to problems where long-term trends must be captured and extrapolation beyond the training data range is needed. We introduce the multiscale RNN architecture to extend the application of RNN to detect and predict both short-term variabilities and long-term trends in geothermal data. The developed architecture consists of a long-term component to only capture low-frequency data patterns, and a short-term component to detect features with higher frequency and more nonlinearity. The final prediction is obtained by combining the long-term and short-term predictions. Both synthetic and field data are used to evaluate the presented multiscale RNN model. The prediction performance of the multiscale RNN is compared against those obtained from the regular RNN and the autoregressive (AR) model. The results suggest that the multiscale architecture improves the long-term prediction performance of the regular RNN and enhances its robustness against noise.

15 GEOTHERMAL ENERGY↗

The star-formation history in the last 10 billion years from CIB cross-correlations

ABSTRACT The cosmic infrared background (CIB) traces the emission of star-forming galaxies throughout all cosmic epochs. Breaking down the contribution from galaxies at different redshifts to the observed CIB maps would allow us to probe the history of star formation. In this paper, we cross-correlate maps of the CIB with galaxy samples covering the range z ≲ 2 to measure the bias-weighted star-formation rate (SFR) density 〈bρSFR〉 as a function of time in a model independent way. This quantity is complementary to direct measurements of the SFR density ρSFR, giving a higher weight to more massive haloes, and thus provides additional information to constrain the physical properties of star formation. Using cross-correlations of the CIB with galaxies from the DESI Legacy Survey and the extended Baryon Oscillation Spectroscopic Survey, we obtain high signal-to-noise ratio measurements of 〈bρSFR〉, which we then use to place constraints on halo-based models of the star-formation history. We fit halo-based SFR models to our data and compare the recovered ρSFR with direct measurements of this quantity. We find a qualitatively good agreement between both independent data sets, although the details depend on the specific halo model assumed. This constitutes a useful robustness test for the physical interpretation of the CIB, and reinforces the role of CIB maps as valuable astrophysical probes of the large-scale structure. We report our measurements of 〈bρSFR〉 as well as a thorough account of their statistical uncertainties, which can be used to constrain star-formation models in combination with other data.

Astronomy & Astrophysics↗

The entropy of galaxy spectra: how much information is encoded?

Abstract The inverse problem of extracting the stellar population content of galaxy spectra is analysed here from a basic standpoint based on information theory. By interpreting spectra as probability distribution functions, we find that galaxy spectra have high entropy, thus leading to a rather low effective information content. The highest variation in entropy is unsurprisingly found in regions that have been well studied for decades with the conventional approach. We target a set of six spectral regions that show the highest variation in entropy – the 4000 Å break being the most informative one. As a test case with real data, we measure the entropy of a set of high-quality spectra from the Sloan Digital Sky Survey, and contrast entropy-based results with the traditional method based on line strengths. The data are classified into star-forming (SF), quiescent (Q), and active galactic nucleus (AGN) galaxies, and show – independently of any physical model – that AGN spectra can be interpreted as a transition between SF and Q galaxies, with SF galaxies featuring a more diverse variation in entropy. The high level of entanglement complicates the determination of population parameters in a robust, unbiased way, and affects traditional methods that compare models with observations, as well as machine learning (especially deep learning) algorithms that rely on the statistical properties of the data to assess the variations among spectra. Entropy provides a new avenue to improve population synthesis models so that they give a more faithful representation of real galaxy spectra.

Ferreras, Ignacio (ORCID:0000000345843127)↗

Liouvillian dynamics of the open Schwinger model: String breaking and kinetic dissipation in a thermal medium

Understanding the dynamics of bound state formation is one of the fundamental questions in confining quantum field theories such as Quantum Chromodynamics (QCD). One hadronization mechanism that has garnered significant attention is the breaking of a string initially connecting a fermion and an antifermion. Deepening our understanding of real-time string-breaking dynamics with simpler, lower dimensional models like the Schwinger model can improve our understanding of the hadronization process in QCD and other confining systems found in condensed matter and statistical systems. Here in this paper, we consider the string-breaking dynamics within the Schwinger model and investigate its modification inside a thermal medium, treating the Schwinger model as an open quantum system coupled to a thermal environment. Within the regime of weak coupling between the system and environment, the real-time evolution of the system can be described by a Lindblad evolution equation. We analyze the Liouvillian gaps of this Lindblad equation and the time dependence of the system’s von Neumann entropy. We observe that the late-time relaxation rate decreases as the environment correlation length increases. Moreover, when the environment correlation length is infinite, the system exhibits two steady states, one in each of the sectors with definite charge-conjugation-parity (CP) quantum numbers. For parameter regimes where an initial string breaks in vacuum, we observe a delay of the string breaking in the medium, due to kinetic dissipation effects. Conversely, in regimes where an initial string remains intact in vacuum time evolution, we observe string breaking (melting) in the thermal medium. We further discuss how the Liouvillian dynamics of the open Schwinger model can be simulated on quantum computers and provide an estimate of the associated Trotter errors.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Battery Life Prediction Using Reduced-Order Physics Models and Machine Learning (CRADA Final Report)

Phase 1 (Original CRADA, plus no-cost extension modifications #1-3, 6/1/2017 to 3/13/2021): The Australian Department of Defence (AUDoD) is performing accelerated aging tests of Li-ion batteries to benchmark their reliability and degradation characteristics. Using its previously developed battery lifetime predictive model framework, the National Laboratory of the Rockies (NLR) will develop analytical models based the AUDoD data to predict lifetime of the multiple Li-ion battery chemistries under real-world use scenarios of interest to AUDoD. The NLR model is based on physical degradation mechanisms encountered by Li-ion batteries and has been previously validated. Phase 2 (CRADA modification #4, plus no-cost extension modification #5, 2/22/2021 to 3/30/2025): Train and support Australian Department of Defence personnel to use NLR software for model-based estimation of Li-ion battery lifetime using accelerated battery aging data collected by the Australian Department of Defence. Under separate DOE funding from 2019 to 2021, NLR enhanced its battery life-prediction software using machine learning algorithms to automate portions of the model-fitting process, requiring significantly less labor and expert judgment and also adding uncertainty quantification, increasing statistical rigor. Under Phase 2, NLR will customize NLR Software and provide it to AuDoD. NLR will enhance its NLR Model to capture aging modes of AuDoD's multi-cell modules, including cell-balancing effects. NLR will develop example single-cell and multi-cell models based on one AuDoD battery aging dataset. NLR will train AuDoD personnel on NLR Software. By the conclusion of the project, NLR will have provided AuDoD the training materials, a user manual and software needed to perform their own analysis of additional and/or future battery aging datasets.

33 ADVANCED PROPULSION SYSTEMS↗

Core-corona hadronization model and muon puzzle in extensive air showers

The discrepancy between models and measurements concerning the muon content in air showers produced by ultra-high energy cosmic rays, the so-called muon puzzle, remains unsolved. String fragmentation models currently used in hadronic interactions fail to reproduce the observations, while recent measurements at the LHC hint towards the existence of production mechanisms, such as collective statistical hadronization, which lead to an increase in the muon production after a hadronic interaction. The core-corona model of heavy ions implements both production mechanisms, where the large-density region of interaction (core) hadronizes statistically, while the low-density (corona) hadronizes following string fragmentation. In this contribution, we present a modification of the CONEX framework to implement the core-corona model in air shower simulations. We demonstrate a significant impact of the core effect, as observed at the LHC, on the muon content in air showers produced by ultra-high energy cosmic rays.

79 ASTRONOMY AND ASTROPHYSICS↗

ESM data downscaling: a comparison of super-resolution deep learning models

Abstract Climate projections at fine spatial resolutions are required to conduct accurate risk assessment for critical infrastructure and design adaptation planning. Generating these projections using advanced Earth system models (ESM) requires significant computational resources. To address this issue, various statistical downscaling techniques have been introduced to generate fine-resolution data from coarse-resolution simulations. In this study, we evaluate and compare five deep learning-based downscaling techniques, namely, super-resolution convolutional neural networks, fast super-resolution convolutional neural network ESM, efficient sub-pixel convolutional neural network, enhanced deep residual network (EDRN), and super-resolution generative adversarial network (SRGAN). These techniques are applied to a dataset generated by the Energy Exascale Earth System Model (E3SM), focusing on key surface variables such as surface temperature, shortwave heat flux, and longwave heat flux. Models are trained and validated using paired fine-resolution (0.25 $$^{\circ }$$ ∘ ) and coarse-resolution (1 $$^{\circ }$$ ∘ ) monthly data obtained from a 9-year simulation. Next, blind testing is performed using monthly data obtained from two different years outside of the training and validation set. To evaluate the efficiency of each technique, different statistical metrics are used, including mean squared error (MSE), peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and learned perceptual image patch similarity (LPIPS). The results show that EDRN outperforms other algorithms in terms of PSNR, SSIM, and MSE, but struggles to capture fine-scale features in the data. In contrast, SRGAN, a generative model that uses perceptual loss, excels in capturing fine details at boundaries and internal structures, resulting in lower LPIPS than other methods.

Pawar, Nikhil M. (ORCID:0000000211613289)↗

Modeling the Photoelectrochemical Evolution of Lead-Based, Mixed-Halide Perovskites Due to Photosegregation

Lead-based, mixed-halide perovskites such as methylammonium lead iodide-bromide [MAPb(I 1-x Br x ) 3 ] undergo anion photosegregation under illumination. This is observed as low band gap photoluminescence from photogenerated iodine-rich domains due to favorable band offsets that induce carrier funneling into them. Unfortunately, theoretical rationalizations of mixed-halide photosegregation are complicated by biases inherent to photoluminescence-based observations. Recent compositionally-weighted X-ray diffraction (XRD) measurements now reveal broad distributions of photosegregated stoichiometries not captured by existing photosegregation models. To better bridge experiment and theory, we perform kinetic Monte Carlo (KMC) simulations of photosegregation within the context of a band gap-based thermodynamic model, which has previously accounted for numerous experimental observations. Our KMC simulations are modified to consider high carrier density Fermi-Dirac statistics that result from carrier funneling and accumulation within photosegregated I-rich domains. Obtained KMC results reproduce broad x terminal distributions seen experimentally and illustrate how they are characterized by a central, heavily I-enriched stoichiometry. I-rich domain “drifting” during photosegregation rationalizes the long photosegregation timescales seen experimentally with drifting simultaneously producing a wake of variable stoichiometry I-rich inclusions that form the lion’s share of stoichiometric heterogeneities seen in compositionally-weighted XRD measurements. These simulations and accompanying rationalizations further reveal a general criterion for realizing favorable free energies to induce demixing. Central to the criterion is the statistical occupation of low gap inclusions in the parent alloy by excitations. Furthermore, the resulting model thus provides a general framework for conceptualizing mixed-halide perovskite light and temperature sensitivities, mediated by photocarriers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep learning-based model for progress variable dissipation rate in turbulent premixed flames

A deep neural network (DNN) based large eddy simulation (LES) model for progress variable dissipation rate in turbulent premixed flames is presented. The DNN model is trained using filtered data from direct numerical simulations (DNS) of statistically planar turbulent premixed flames with n-heptane as fuel. Training data was comprised of flames with varying turbulence levels leading to a range of Karlovitz numbers. Through a-priori tests the DNN model is shown to predict the subfilter contribution to progress variable dissipation rate accurately over a range of filter widths and for all Karlovitz numbers examined in this study. Superior performance of the DNN model relative to an established physics-based model is also demonstrated. Additionally, transferability of the DNN model is highlighted by a-priori evaluation of the model using filtered DNS data from multiple cases with different Karlovitz numbers and fuel species than those that were used for training the model.

33 ADVANCED PROPULSION SYSTEMS↗

DCTRGAN: improving the precision of generative models with reweighting

Significant advances in deep learning have led to more widely used and precise neural network-based generative models such as Generative Adversarial Networks (Gans). We introduce a post-hoc correction to deep generative models to further improve their fidelity, based on the Deep neural networks using the Classification for Tuning and Reweighting (Dctr) protocol. The correction takes the form of a reweighting function that can be applied to generated examples when making predictions from the simulation. We illustrate this approach using Gans trained on standard multimodal probability densities as well as calorimeter simulations from high energy physics. We show that the weighted Gan examples significantly improve the accuracy of the generated samples without a large loss in statistical power. This approach could be applied to any generative model and is a promising refinement method for high energy physics applications and beyond.

47 OTHER INSTRUMENTATION↗

General-Purpose Unsupervised Cyber Anomaly Detection via Non-Negative Tensor Factorization

Distinguishing malicious anomalous activities from unusual but benign activities is a fundamental challenge for cyber defenders. Prior studies have shown that statistical user behavior analysis yields accurate detections by learning behavior profiles from observed user activity. These unsupervised models are able to generalize to unseen types of attacks by detecting deviations from normal behavior, without knowledge of specific attack signatures. However, approaches proposed to date based on probabilistic matrix factorization are limited by the information conveyed in a two-dimensional space. Non-negative tensor factorization, on the other hand, is a powerful unsupervised machine learning method that naturally models multi-dimensional data, capturing complex and multi-faceted details of behavior profiles. Herein, our new unsupervised statistical anomaly detection methodology matches or surpasses state-of-the-art supervised learning baselines across several challenging and diverse cyber application areas, including detection of compromised user credentials, botnets, spam e-mails, and fraudulent credit card transactions.

97 MATHEMATICS AND COMPUTING↗

Accurate models of the added mass force of a uniform random distribution of spherical particles or bubbles

The added mass force resulting from the acceleration of a body in a fluid is of fundamental and practical interest in dispersed multiphase flows. Euler–Lagrange (EL) and Euler–Euler (EE) simulations require closure terms for the added mass force in order to accurately couple the conserved variables between phases. Presently, a more thorough understanding of the added mass force in a multi-particle system is developed based on potential flow resulting in a resistance matrix formulation analogous to Stokesian dynamics. This formulation is then used to generate a dataset of added mass resistance matrices for large systems of randomly generated particles. This methodology is used to create a volume fraction corrected binary model for predicting the added mass force in large systems as well as generate statistics of the added mass force in such systems. This work provides clarification to the theory of the added mass force for particle clouds, and modelling options that may be implemented in existing EL and EE codes.

42 ENGINEERING↗

Quantifying Uncertainty in All-to-All Estimates of Space Object Conjunction Probabilities using U-Statistics

Predicting space object conjunctions is inherently probabilistic due to initial state and orbit model uncertainty. A commonly considered Monte Carlo estimator of the conjunction probability is the ’all-to-all’ estimator. Given independent random samples of the trajectories of both objects, the estimator is the percentage of all pairs of trajectories that result in a conjunction. Intuitively, the all-to-all estimator is the best possible estimator of the conjunction probability since it considers all pairs of Monte Carlo samples. However, its distribution is not available in closed-form, which limits its use in practice and makes this intuition difficult to make rigorous. In this paper, the all-to-all estimator is identified as a U-statistic, which implies that it has several favorable properties. Specifically, the estimator is the minimum variance unbiased estimator of the conjunction probability and is asymptotically Gaussian distributed. An approximate confidence interval for the conjunction probability is obtained from an estimate of the asymptotic Gaussian distribution. We show how to efficiently compute the confidence interval and demonstrate that the interval has the nominal coverage level. The confidence intervals are also seen to be narrower than those based on the commonly-used each-to-each estimator. Furthermore, the all-to-all estimator is shown to allow different Monte Carlo sample sizes, whereas the each-to-each estimator requires equal sample sizes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Quantum mechanical closure of partial differential equations with symmetries

We develop a statistical framework for the dynamical closure of spatiotemporal dynamics governed by partial differential equations. Employing the mathematical framework of quantum mechanics to embed the original classical dynamics into a quantum mechanical representation, we use the space of quantum density operators to model the unresolved degrees of freedom of the original dynamics in a statistical sense, and the framework of quantum measurement to predict their contributions to the resolved dynamics. The embedded dynamics is discretized by a positivity preserving process, leading to a compressed representation that is invariant under the dynamical symmetries of the resolved dynamics. We present a data based formulation of the closure scheme and apply it to a closure problem for the shallow water equations. The numerical results demonstrate that our closure model can accurately predict the main features of the true dynamics, including for out of sample initial conditions.

Delay embedding↗

Survey on stochastic distribution systems: A full probability density function control theory with potential applications

Complex systems seen either in general engineering practice or economics are subjected to ever increased uncertainties that are mostly represented as random variables or parameters, and the characteristics of random variables are represented by their probability density functions (PDFs). Controlling their PDFs means to shape their stochastic distributions and in general it would provide a full treatment for system analysis and operational control and optimization. This leads to the development of stochastic distribution control (SDC) systems theory in the past decades, where the original aim of the controller design is to realize a shape control of the distributions of certain random variables in their PDFs sense for some engineering processes. Indeed, once the PDFs of these random variables or parameters are used to describe their distribution characters, the control task is to obtain control signals so that the output PDFs of stochastic systems are made to follow their target PDFs. The subject of SDC was initially originated for non-Gaussian stochastic control systems design but has found a wide spectrum of applications in general systems in terms of data-driven modeling, analysis, signal processing (filtering), data mining via multivariable statistics, decision-making (optimization) for systems subjected to uncertainties and even in economics. In this context, SDC constitutes an effective primer tool for complex system analysis, control and operational optimizations. In this review paper, a detailed survey of the developments on the research of SDC systems will be made together with their wide spectrum applications and future perspectives.

42 ENGINEERING↗

Distributions in CFT. Part II. Minkowski space

CFTs in Euclidean signature satisfy well-accepted rules, such as the convergent Euclidean OPE. It is nowadays common to assume that CFT correlators exist and have various properties also in Lorentzian signature. Some of these properties may represent extra assumptions, and it is an open question if they hold for familiar statistical-physics CFTs such as the critical 3d Ising model. Here we consider Wightman 4-point functions of scalar primaries in Lorentzian signature. We derive a minimal set of their properties solely from the Euclidean unitary CFT axioms, without using extra assumptions. We establish all Wightman axioms (temperedness, spectral property, local commutativity, clustering), Lorentzian conformal invariance, and distributional convergence of the s-channel Lorentzian OPE. This is done constructively, by analytically continuing the 4-point functions using the s-channel OPE expansion in the radial cross-ratios ρ, ρ¯. We prove a key fact that |ρ|, |ρ¯| < 1 inside the forward tube, and set bounds on how fast |ρ|, |ρ¯| may tend to 1 when approaching the Minkowski space.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A Markov chain Monte Carlo (MCMC) Bayesian inference approach to analyze apparent activation barriers and reaction orders from microreactor data

Statistical analysis of steady-state catalytic kinetic data is often limited by data sparsity due to the slow pace at which the data is collected. Data sparsity and limitations in statistical analysis make it difficult to differentiate between mechanistic models and catalytic sites. A Bayesian inference tool is reported for catalysis researchers to estimate error in the determination of reaction orders from steady state microreactor data. The benefits of a Bayesian inference approach are discussed, as an alternative to the more common frequentist approach. The approach incorporates prior knowledge of the system and the data collected to form an error estimate on reaction orders. We investigated the effects of three distinct data treatments—individual fitting of trials, pooled analysis, and constrained regression methods—on the precision and uncertainty of reaction order determinations. To assess the robustness of our findings, we conducted sensitivity analyses to evaluate the influence of Bayesian parameters on uncertainty estimation. Additionally, we utilized synthetic data to illustrate how data quality impacts the precision of uncertainty assessments. We show Bayesian analysis can obtain a more precise estimation of error with a sparse data set than a frequentist analysis. Finally, this work provides strong evidence that the adoption of Bayesian analysis of kinetic data may help researchers make more precise arguments as to the strength of their evidence for a particular mechanistic hypothesis, or in comparing across different catalysts.

42 ENGINEERING↗

Inadequacy of current approaches for characterizing membrane transport properties at high salinities

Cost optimal design of osmotic membrane processes requires an accurate estimate of membrane transport parameters across their full operational range. However, standard approaches for estimating these parameters rely on empirical methods, the accuracy of which remains unquantified as a function of temperature, salinity, and measurement error. Herein, we present a systematic accuracy analysis of previously developed methods for estimation of membrane transport properties in reverse osmosis, high-pressure reverse osmosis, forward osmosis, pressure retarded reverse osmosis, and osmotically assisted reverse osmosis. We use a Monte Carlo approach to sample the full range of feasible membrane water permeabilities, salt permeabilities, structural parameters, and operating conditions for these processes. These material and process parameters are then incorporated into a physical transport model for each process. Our analysis shows that the statistical uncertainty of current empirical methods for estimating membrane parameters increases by 5 times from low-salinity to high-salinity conditions. Here, the result of this work demonstrates that empirical methods are inadequate for precisely estimating membrane transport properties at high salinity and highlight a critical need for the development of statistically validated higher accuracy methods.

42 ENGINEERING↗