Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Gaussian distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Detecting outbreaks using a spatial latent field

In this paper, we present a method for estimating the infection-rate of a disease as a spatial-temporal field. Our data comprises time-series case-counts of symptomatic patients in various areal units of a region. We extend an epidemiological model, originally designed for a single areal unit, to accommodate multiple units. The field estimation is framed within a Bayesian context, utilizing a parameterized Gaussian random field as a spatial prior. We apply an adaptive Markov chain Monte Carlo method to sample the posterior distribution of the model parameters condition on COVID-19 case-count data from three adjacent counties in New Mexico, USA. Our results suggest that the correlation between epidemiological dynamics in neighboring regions helps regularize estimations in areas with high variance (i.e., poor quality) data. Using the calibrated epidemic model, we forecast the infection-rate over each areal unit and develop a simple anomaly detector to signal new epidemic waves. Our findings show that anomaly detector based on estimated infection-rates outperforms a conventional algorithm that relies solely on case-counts.

Safta, Cosmin [Sandia National Laboratories (SNL-C↗

Yet Another Discriminant Analysis (YADA): A Probabilistic Model for Machine Learning Applications

This paper presents a probabilistic model for various machine learning (ML) applications. While deep learning (DL) has produced state-of-the-art results in many domains, DL models are complex and over-parameterized, which leads to high uncertainty about what the model has learned, as well as its decision process. Further, DL models are not probabilistic, making reasoning about their output challenging. In contrast, the proposed model, referred to as Yet Another Discriminate Analysis(YADA), is less complex than other methods, is based on a mathematically rigorous foundation, and can be utilized for a wide variety of ML tasks including classification, explainability, and uncertainty quantification. YADA is thus competitive in most cases with many state-of-the-art DL models. Ideally, a probabilistic model would represent the full joint probability distribution of its features, but doing so is often computationally expensive and intractable. Hence, many probabilistic models assume that the features are either normally distributed, mutually independent, or both, which can severely limit their performance. YADA is an intermediate model that (1) captures the marginal distributions of each variable and the pairwise correlations between variables and (2) explicitly maps features to the space of multivariate Gaussian variables. Numerous mathematical properties of the YADA model can be derived, thereby improving the theoretic underpinnings of ML. Validation of the model can be statistically verified on new or held-out data using native properties of YADA. However, there are some engineering and practical challenges that we enumerate to make YADA more useful.

97 MATHEMATICS AND COMPUTING↗

Study of $\langle {p}_{\text{T}}\rangle$ and its higher moments, and extraction of the speed of sound in Pb-Pb collisions with ALICE

Ultrarelativistic heavy-ion collisions produce a state of hot and dense strongly interacting QCD matter called quark-gluon plasma (QGP). On an event-by-event basis, the volume of the QGP in ultracentral collisions is mostly constant, while its total entropy can vary significantly due to quantum fluctuations, leading to variations in the temperature of the system. Exploiting this unique feature of ultracentral collisions allows for the interpretation of the correlation of the mean transverse momentum ($\langle$p T $\rangle$) of produced charged hadrons and the number of charged hadrons as a measure for the speed of sound, c s . This speed is related to the rate at which compression waves travel in the QGP and is determined by fitting the relative increase in $\langle$p T $\rangle$ with respect to the relative change in the average charged-particle density ($\langle$dN ch /dη$\rangle$) measured at mid-rapidity. This study reports the event-average $\langle$p T $\rangle$ of charged particles as well as the variance, skewness, and kurtosis of the event-by-event transverse momentum per charged particle ([p T ]) distribution in ultracentral Pb-Pb collisions at a center-of-mass energy of 5.02 TeV per nucleon pair using the ALICE detector. Different centrality estimators based on charged-particle multiplicity or the transverse energy of the event are used to select ultracentral collisions. By ensuring a pseudorapidity gap between the region used to define the centrality and the region used to perform the measurement, the influence of biases and their potential effects on the rise of the mean transverse momentum is tested. The measured c$^{2}_{s}$ is found to strongly depend on the exploited centrality estimator and ranges between 0.1146±0.0028 (stat.)±0.0065 (syst.) and 0.4374±0.0006 (stat.)±0.0184 (syst.) in natural units. The self-normalized variance shows a steep decrease towards ultracentral collisions, while the self-normalized skewness variables show a maximum, followed by a fast decrease. These non-Gaussian features are understood in terms of the vanishing of the impact-parameter fluctuations contributing to the event-to-event [p T ] distribution.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Reanalysis of Public Galactic Bulge Gravitational Microlensing Events from OGLE-III and -IV

Abstract Modern surveys of gravitational microlensing events have progressed to detecting thousands per year, and surveys are capable of probing Galactic structure, stellar evolution, lens populations, black hole physics, and the nature of dark matter. One of the key avenues for doing this is the microlensing Einstein radius crossing time (t E) distribution. However, systematics in individual light curves as well as oversimplistic modeling can lead to biased results. To address this, we developed a model to simultaneously handle the microlensing parallax due to Earth's motion, systematic instrumental effects, and unlensed stellar variability with a Gaussian process model. We used light curves for nearly 10,000 OGLE-III and -IV Milky Way bulge microlensing events and fit each with our model. We also developed a forward model approach to infer the t E distribution by forward modeling from the data rather than using point estimates from individual events. We find that modeling the variability in the baseline removes a source of significant bias in individual events, and the previous analyses overestimated the number of t E > 100 day events due to their oversimplistic model ignoring parallax effects. We use our fits to identify the hundreds filling a regime in the microlensing parameter space that are 50% pure of black holes. Finally, we have released the largest-ever catalog of Markov Chain Monte Carlo parameter estimates for microlensing events.

79 ASTRONOMY AND ASTROPHYSICS↗

Orphaned oil and gas well methane emission rates quantified using Gaussian plume inversions of ambient observations

Abstract. Annually, ∼ 3.6 million abandoned oil and gas wells in the US emit a combined ∼ 2.6 Tg methane (CH4), adversely affecting climate and regional air quality. However, these estimates depend on emission factors derived from measuring subpopulations of wells that vary by orders of magnitude due to very limited field sampling and poorly characterized distributions. Currently, US protocols to remediate orphaned wells lacks standardized quantification methods needed to both prioritize plugging and account for emission reductions. Therefore, sensitive, reliable, affordable, and scalable CH4 flux quantification methods are needed. We report the use of a simple Gaussian plume method where the dispersion parameters are constrained by in situ ground measurements of CH4 concentration at four locations 7.5–49 m downwind of the orphan well as well as local winds to estimate the leak rate from an orphan well. We derive a flux of 10.53 ± 1.16 kg CH4 h−1 during a venting procedure in April 2023 that agrees with the directly measured volumetric flow rate of 9.00 ± 0.25 kg CH4 h−1. This is 71 % greater than the 5.3 kg CH4 h−1 flux measured 7 months prior. Additionally, we discovered a secondary leak through the surface casing inferred as 0.43–0.67 kg CH4 h−1 both by our ground Gaussian analysis and by transecting the plume with an uncrewed aerial system (UAS). We show that in situ determination of the dispersion parameters used in our Gaussian inversions allows us to measure methane emissions to 15 % accuracy, significantly reducing errors when compared to the standard practice of assuming stability class. Our results help develop simpler methods and protocols for robust orphan well emission quantification that can be used for reporting.

Follansbee, Emily↗

Enhancing Gaussian Process Surrogates for Optimization and Posterior Approximation via Random Exploration

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical GP-UCB algorithm, but the additional random exploration step accelerates their convergence, nearly achieving the optimal convergence rate. Furthermore, to facilitate Bayesian inference with intractable likelihoods, we propose to utilize optimization iterates for maximum a posteriori estimation to build a Gaussian process surrogate model for the unnormalized log-posterior density. We provide bounds for the Hellinger distance between the true and the approximate posterior distributions in terms of the number of design points. We demonstrate the effectiveness of our Bayesian optimization algorithms in nonconvex benchmark objective functions, in a machine learning hyperparameter tuning problem, and in a black-box engineering design problem. The effectiveness of our posterior approximation approach is demonstrated in two Bayesian inference problems for parameters of dynamical systems.

Bayesian inference↗

The distribution of [α/Fe] in the Milky Way disc

ABSTRACT Using a sample of red giant stars from the Apache Point Observatory Galactic Evolution Experiment (APOGEE) Data Release 16, we infer the conditional distribution $p([\alpha /{\rm Fe}]\, |\, [{\rm Fe}/{\rm H}])$ in the Milky Way disk for the α-elements Mg, O, Si, S, and Ca. In each bin of [Fe/H] and Galactocentric radius R, we model p([α/Fe]) as a sum of two Gaussians, representing ‘low-α’ and ‘high-α’ populations with scale heights $z_1=0.45\, {\rm kpc}$ and $z_2=0.95\, {\rm kpc}$, respectively. By accounting for age-dependent and z-dependent selection effects in APOGEE, we infer the [α/Fe] distributions that would be found for a fair sample of long-lived stars covering all z. Near the Solar circle, this distribution is bimodal at sub-solar [Fe/H], with the low-α and high-α peaks clearly separated by a minimum at intermediate [α/Fe]. In agreement with previous results, we find that the high-α population is more prominent at smaller R, lower [Fe/H], and larger |z|, and that the sequence separation is smaller for Si and Ca than for Mg, O, and S. We find significant intrinsic scatter in [α/Fe] at fixed [Fe/H] for both the low-α and high-α populations, typically ∼0.04-dex. The means, dispersions, and relative amplitudes of this two-Gaussian description, and the dependence of these parameters on R, [Fe/H], and α-element, provide a quantitative target for chemical evolution models and a test for hydrodynamic simulations of disk galaxy formation. We argue that explaining the observed bimodality will probably require one or more sharp transitions in the disk’s gas accretion, star formation, or outflow history in addition to radial mixing of stellar populations.

79 ASTRONOMY AND ASTROPHYSICS↗

Dispersion-enhanced sequential batch sampling for adaptive contour estimation

In computer simulation and optimal design, sequential batch sampling offers an appealing way to iteratively stipulate optimal sampling points based upon existing selections and efficiently construct surrogate modeling. Nonetheless, the issue of near duplicates poses tremendous quandary for sequential learning. It refers to the situation that selected critical points cluster together in each sampling batch, which are individually but not collectively informative towards the optimal design. Near duplicates severely diminish the computational efficiency as they barely contribute extra information towards update of the surrogate. To address this issue, we impose a dispersion criterion on concurrent selection of sampling points, which essentially forces a sparse distribution of critical points in each batch, and demonstrate the effectiveness of this approach in adaptive contour estimation. Specifically, we adopt Gaussian process surrogate to emulate the simulator, acquire variance reduction of the critical region from new sampling points as a dispersion criterion, and combine it with the modified expected improvement (EI) function for critical batch selection. The critical region here is the proximity of the contour of interest. This proposed approach is vindicated in numerical examples of a two-dimensional four-branch function, a four-dimensional function with a disjoint contour of interest and a time-delay dynamic system.

97 MATHEMATICS AND COMPUTING↗

Joint Modeling of Quasar Variability and Accretion Disk Reprocessing Using Latent Stochastic Differential Equations

Quasars are bright active galactic nuclei powered by the accretion of matter around supermassive black holes at the center of galaxies. Their stochastic brightness variability depends on the physical properties of the accretion disk and black hole. The upcoming Rubin Observatory Legacy Survey of Space and Time (LSST) is expected to observe tens of millions of quasars, so there is a need for efficient techniques like machine learning that can handle the large volume of data. Quasar variability is believed to be driven by an X-ray corona, which is reprocessed by the accretion disk and emitted as UV/optical variability. We are the first to introduce an auto-differentiable simulation of the accretion disk and reprocessing. We use the simulation as a direct component of our neural network to jointly model the driving variability and reprocessing, trained with supervised learning on simulated LSST-like 10 yr quasar light curves. We encode the light curves using a transformer encoder, and the driving variability is reconstructed using latent stochastic differential equations, a physically motivated generative deep learning method that can model continuous-time stochastic dynamics. By embedding the physical processes of the driving signal and reprocessing into our network, we achieve a model that is more robust and interpretable. We demonstrate that our model outperforms a Gaussian process regression baseline and can infer accretion disk parameters and time delays between wave bands, even for out-of-distribution driving signals. Our approach provides a powerful framework that can be adapted to solve other inverse problems in multivariate time series.

Fagin, Joshua [City Univ. of New York (CUNY), NY (↗

Multi Time-scale Imputation aided State Estimation in Distribution System

With the transition to a smart grid, we are witnessing a significant growth in sensor deployments and smart metering infrastructure in the distribution system. However, information from these sensors and meters are typically unevenly sampled at different time-scales and are incomplete. It is critical to effectively aggregate these information sources for situational awareness. In order to reconcile the heterogeneous multi-scale time-series data, we present a multi-task Gaussian process framework. This framework exploits the spatio-temporal correlation across the time-series data to impute data at any desired timescale while providing confidence bounds on the imputations. The value of the imputed data for distribution system operation is illustrated via a matrix completion based state estimation strategy. Results on the IEEE 37 bus distribution system reveals the superior performance of the proposed approach relative to linear interpolation approaches.

Dahale, Shweta↗

Atikokan Digital Twin: Machine learning in a biomass energy system

The Atikokan Generating Station, operated by Ontario Power Generation, has a 200 MW, biomass-fired tower boiler that operates on a dispatch schedule with a five-minute cycle. The boiler is generally operated in the range of 40–100 MW using two of five burner levels. In order to optimize boiler performance, we propose the implementation of a unique digital twin. Our digital twin abstraction couples Bayesian inference from science-based models and from observations (machine learning) with decision theory to predict operating-variable set points that optimize the physical asset (the boiler) in the presence of uncertainty (artificial intelligence). We focus this paper on the continuous Bayesian machine learning part of the Atikokan Digital Twin; we discuss decision theory in a companion paper. We identify and learn about 12 operational, model, and measured-output parameters and their uncertainties from high-fidelity, science-based simulations of the Atikokan boiler and from the observed measurements at the power plant. Since the goal of the Atikokan Digital Twin is to implement it online in real time, we require fast function evaluations for the quantities of interest extracted from the simulations in the Bayesian analysis. We use Gaussian process regression/interpolation to create accurate, robust surrogate models. We define the Bayesian priors and likelihood function and solve for the posterior distributions of the 12 parameters. Here we then propagate these distributions (i.e., parameters with uncertainty) into the predicted distributions of 790 quantities of interest to learn about the relative importance of various sources of error including experimental, model, and operating-parameter errors.

09 BIOMASS FUELS↗

Calomplification — the power of generative calorimeter models

Motivated by the high computational costs of classical simulations, machine-learned generative models can be extremely useful in particle physics and elsewhere. They become especially attractive when surrogate models can efficiently learn the underlying distribution, such that a generated sample outperforms a training sample of limited size. This kind of GANplification has been observed for simple Gaussian models. We show the same effect for a physics simulation, specifically photon showers in an electromagnetic calorimeter.

47 OTHER INSTRUMENTATION↗

Spoofing Cross-Entropy Measure in Boson Sampling

Cross-entropy (XE) measure is a widely used benchmark to demonstrate quantum computational advantage from sampling problems, such as random circuit sampling using superconducting qubits and boson sampling (BS). We present a heuristic classical algorithm that attains a better XE than the current BS experiments in a verifiable regime and is likely to attain a better XE score than the near-future BS experiments in a reasonable running time. The key idea behind the algorithm is that there exist distributions that correlate with the ideal BS probability distribution and that can be efficiently computed. The correlation and the computability of the distribution enable us to postselect heavy outcomes of the ideal probability distribution without computing the ideal probability, which essentially leads to a large XE. Our method scores a better XE than the recent Gaussian BS experiments when implemented at intermediate, verifiable system sizes. Much like current state-of-the-art experiments, we cannot verify that our spoofer works for quantum-advantage-size systems. However, we demonstrate that our approach works for much larger system sizes in fermion sampling, where we can efficiently compute output probabilities. Finally, we provide analytic evidence that the classical algorithm is likely to spoof noisy BS efficiently.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The DESI-Lensing Mock Challenge: large-scale cosmological analysis of 3x2-pt statistics

The current generation of large galaxy surveys will test the cosmological model by combining multiple types of observational probes. Realising the statistical promise of these new datasets requires rigorous attention to all aspects of analysis including cosmological measurements, modelling, covariance and parameter likelihood. In this paper we present the results of an end-to-end simulation study designed to test the analysis pipeline for the combination of the Dark Energy Spectroscopic Instrument (DESI) Year 1 galaxy redshift dataset and separate weak gravitational lensing information from the Kilo-Degree Survey, Dark Energy Survey and Hyper-Suprime-Cam Survey. Our analysis employs the 3x2-pt correlation functions including cosmic shear and galaxy-galaxy lensing, together with the projected correlation function of the spectroscopic DESI lenses. We build realistic simulations of these datasets including galaxy halo occupation distributions, photometric redshift errors, weights, multiplicative shear calibration biases and magnification. We calculate the analytical covariance of these correlation functions including the Gaussian, noise and super-sample contributions, and show that our covariance determination agrees with estimates based on the ensemble of simulations. We use a Bayesian inference platform to demonstrate that we can recover the fiducial cosmological parameters of the simulation within the statistical error margin of the experiment, investigating the sensitivity to scale cuts. This study is the first in a sequence of papers in which we present and validate the large-scale 3x2-pt cosmological analysis of DESI-Y1.

79 ASTRONOMY AND ASTROPHYSICS↗

Λ Baryon Production in ν¯µ Interactions in the MicroBooNE Detector

The Cabibbo suppressed production of $\Lambda$ baryons in anti-neutrino interactions with nuclei is a rare process that is yet to be measured with a modern neutrino detector with automated reconstruction. The cross section for this process is sensitive to a number of unique nuclear effects, most notably the secondary interactions of the produced hyperon while attempting to escape from the nucleus. Other interactions within the nuclear remnant can impact the estimation of neutrino energy in oscillation measurements, and thus an accurate description of the nuclear environment is required. The strangeness violating hyperon production process is only available to anti-neutrinos. The model of this interaction is implemented into the NuWro neutrino interaction Monte Carlo simulation, and some predictions are presented, focusing on the role of nuclear effects. This model introduces a hyperon-nucleus potential, which calculations from hypernuclear theory permit to be strongly repulsive in th e case of $\Sigma$ baryons. The presence of this potential is found to sculpt the shape of the differential cross section in some variables. The MicroBooNE detector will be described, followed by a description of a measurement of the flux averaged, restricted phase space cross section of Cabibbo suppressed $\Lambda$ baryon production. A sophisticated event selection is employed, as a very large quantity of background neutrino interactions must be removed to perform the measurement with any sensitivity. This selection introduces some novel techniques such as the island finding method, and achieves a background reduction of $\sim 10^6$, with an efficiency of around 7\%. The calculation of the systematic uncertainties will be explained, including two procedures explored to handle sources of background with extremely poor simulation statistics: an in-situ constraint using data from sidebands, and a visual inspection of the data and simulation to remove the troublesome background events. The sensitivity to the $\Lambda$ baryon production cross section is calculated in the form of Bayesian posterior probability distributions, combining the systematic uncertainties with data and simulation statistical uncertainties. As a rare process, the statistical uncertainties are highly non-Gaussian, and the Bayesian approach is applied to include the full shapes of these uncertainties. Data corresponding to $2.2 \times 10^{20}$ protons on target of neutrino mode running and $4.9 \times 10^{20}$ protons on target of anti-neutrino running is analysed. When the data was unblinded, five $\Lambda$ production candidates were selected from the data, consistent with the MC simulation prediction of $5.3 \pm 1.1$ events. The final estimated cross section is $1.8^{+2.0}_{-1.6} \times 10^{-40}$cm$^2/$Ar when employing the sideband constraint procedure. A similar result of $2.0^{+2.2}_{-1.8} \times 10^{-40}$cm$^2/$Ar is obtained when performing the visual scan instead. The methods used in t his analysis are intended to be easily exported to other LArTPC detectors such as the Short Baseline Near Detector.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Highly cascaded first-order fiber Bragg gratings in highly multimode optical fibers for distributed temperature sensing under harsh environment conditions

This study presents a pioneering technique for fabricating highly cascaded first-order fiber Bragg gratings (FBGs) using a femtosecond laser-assisted point-by-point inscription method in highly multimode optical fibers, specifically Sapphire crystalline fiber, and pure silica coreless fiber. Notably, it marks the first successful demonstration of a distributed array comprising 10 FBGs within highly multimode fibers. This achievement is facilitated by a high-power laser technique that yields larger reflectors characterized by a Gaussian intensity profile. These first-order FBGs offer various advantages, including enhanced reflectivity, reduced fabrication time, and simplified spectral characteristics, enhancing their accessibility for interpretation when contrasted with higher-order FBGs. In addition to that it encompasses a comprehensive analysis of the robustness and efficacy of these FBGs, with particular emphasis on their ability to endure extreme temperatures. These FBGs demonstrate an advantageous capability for localized multi-point temperature monitoring, reaching temperatures up to 1500°C with sapphire crystalline fiber and 1100°C with pure silica coreless fiber. This resilience makes them suitable for deployment in harsh environmental conditions. This innovative approach substantially broadens the potential applications of highly multimode optical fibers, particularly in the arena of sensing and communication, where challenges related to thermal gradients and harsh environments prevail. Furthermore, these groundbreaking first-order FBGs signify a substantial advancement in the realm of distributed temperature sensing, offering supreme capabilities for temperature monitoring and signal stability. As such, our work holds the promise of a substantial impact on industries and applications that demand unwavering reliability under extreme conditions.

47 OTHER INSTRUMENTATION↗

Gaussian processes meet NeuralODEs: a Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data

We present a machine learning framework (GP-NODE) for Bayesian model discovery from partial, noisy and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of differentiable programming to propagate gradient information through ordinary differential equation solvers and perform Bayesian inference with respect to unknown model parameters using Hamiltonian Monte Carlo sampling and Gaussian Process priors over the observed system states. This allows us to exploit temporal correlations in the observed data, and efficiently infer posterior distributions over plausible models with quantified uncertainty. The use of the Finnish Horseshoe as a sparsity-promoting prior for free model parameters also enables the discovery of parsimonious representations for the latent dynamics. A series of numerical studies is presented to demonstrate the effectiveness of the proposed GP-NODE method including predator–prey systems, systems biology and a 50-dimensional human motion dynamical system. This article is part of the theme issue ‘Data-driven prediction in dynamical systems’.

Science & Technology - Other Topics↗

Atacama Cosmology Telescope: Component-separated maps of CMB temperature and the thermal Sunyaev-Zel’dovich effect

Optimal analyses of many signals in the cosmic microwave background (CMB) require map-level extraction of individual components in the microwave sky, rather than measurements at the power spectrum level alone. To date, nearly all map-level component separation in CMB analyses has been performed exclusively using satellite data. In this paper, we implement a component separation method based on the internal linear combination (ILC) approach which we have designed to optimally account for the anisotropic noise (in the 2D Fourier domain) often found in ground-based CMB experiments. Using this method, we combine multi-frequency data from the Planck satellite and the Atacama Cosmology Telescope Polarimeter (ACTPol) to construct the first wide-area, arcminute-resolution component-separated maps (≈ 2100 sq. deg.) of the CMB temperature anisotropy and the thermal Sunyaev-Zel'dovich (tSZ) effect sourced by the inverse-Compton scattering of CMB photons off hot, ionized gas. Our ILC pipeline allows for explicit deprojection of various contaminating signals, including a modified blackbody approximation of the cosmic infrared background (CIB) spectral energy distribution. The cleaned CMB maps will be a useful resource for CMB lensing reconstruction, kinematic SZ cross-correlations, and primordial non-Gaussianity studies. Here, the tSZ maps will be used to study the pressure profiles of galaxies, groups, and clusters through cross-correlations with halo catalogs, with dust contamination controlled via CIB deprojection. The data products described in this paper are available on LAMBDA.

79 ASTRONOMY AND ASTROPHYSICS↗