Engineering PapersSearch

SEARCH · Engineering Papers

Results for “gaussian”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Gaussian Process Regression under Computational and Epistemic Misspecification

Gaussian process regression is a classical kernel method for function estimation and data interpolation. In large data applications, computational costs can be reduced using low-rank or sparse approximations of the kernel. This paper investigates the effect of such kernel approximations on the interpolation error. We introduce a unified framework to analyze Gaussian process regression under important classes of computational misspecification: Karhunen-Loève expansions that result in low-rank kernel approximations, multiscale wavelet expansions that induce sparsity in the covariance matrix, and finite element representations that induce sparsity in the precision matrix. Furthermore, our theory also accounts for epistemic misspecification in the choice of kernel parameters.

Gaussian process regression

Enhancing Gaussian Process Surrogates for Optimization and Posterior Approximation via Random Exploration

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical GP-UCB algorithm, but the additional random exploration step accelerates their convergence, nearly achieving the optimal convergence rate. Furthermore, to facilitate Bayesian inference with intractable likelihoods, we propose to utilize optimization iterates for maximum a posteriori estimation to build a Gaussian process surrogate model for the unnormalized log-posterior density. We provide bounds for the Hellinger distance between the true and the approximate posterior distributions in terms of the number of design points. We demonstrate the effectiveness of our Bayesian optimization algorithms in nonconvex benchmark objective functions, in a machine learning hyperparameter tuning problem, and in a black-box engineering design problem. The effectiveness of our posterior approximation approach is demonstrated in two Bayesian inference problems for parameters of dynamical systems.

Bayesian inference

Electromagnetic Scattering by Discrete Random Media Illuminated by a Gaussian Beam II: Solution of the Radiative Transfer Equation

In this paper, we present numerical methods for solving the phenomenological scalar radiative transfer equation for a discrete random medium illuminated by a Gaussian beam. These rely on the Fourier transform method for the horizontal variables and the discrete ordinate method with matrix exponential for solving the underlying one-dimensional radiative transfer equation in the wavenumber domain. The problem of a Gaussian beam at oblique and normal incidence, as well as, the searchlight problem are treated. A complete description of the methods and the numerical algorithms is provided.

Gaussian beam

Multihierarchy Gaussian Process Models for Probabilistic Aerodynamic Databases using Uncertain Nominal and Off-Nominal Configuration Data

Probabilistic aerodynamic databases are a crucial component of the development lifecycle for aerospace vehicles. A key challenge when building aerodynamic databases is that most data used to construct them represent various simplifications of the real flight vehicle. For example, wind tunnel models often simplify the vehicle geometry and surface roughness characteristics, while CFD computations often make simplifications to the physics being modeled, such as fully laminar or turbulent calculations. Multifidelity data fusion models rely on a user being able to define a hierarchy of fidelity levels anchored to some "truth" data. This approach is unsatisfactory when no data can be considered to accurately reflect real flight conditions. In this work, we provide an alternative approach by presenting a consistent mathematical framework for building probabilistic aerodynamic databases in the form of a conditional probability distribution described by an ensemble of multifidelity Gaussian Processes. Instead of relying on a single hierarchy of data fidelity levels, the presented framework identifies a "nominal" configuration and potential corrections to the nominal which represent specific physical phenomena not represented in the nominal data. The nominal and correction functions themselves are constructed as multifidelity Gaussian Processes and linearly combined to form an ensemble model which fuses the uncertainties associated nominal and correction models. Results obtained using the proposed framework on a simplified Orion Crew Module wind tunnel dataset demonstrate the predictive capability of the multihierarchy framework. We further demonstrate the benefits of such a probabilistic aerodynamic database approach through function sampling and computing the conditional distributions of derived quantities, such as the trim angle of attack and aerodynamic coefficients at trim.

Gaussian Processes

Gaussian Process for Flight Delay Prediction: Learning a Stochastic Process

This paper presents a machine-learning approach to predict flight delays. Whereas neural networks are extensively studied for predictive capabilities, they involve non-intuitive design and extensive analysis, particularly in training and optimization processes. Instead, the proposed framework employs Gaussian Processes as a supervised learning technique for flight delay prediction. This data-driven approach trains the model using prior information, specifically the mean and covariance tied to existing data. The proposed Gaussian Process Regression (GPR) model employs the day of flight as a pivotal feature for delay forecasting. We analyze flights from various routes and gauge the accuracy of the presented learning technique by comparing the predicted delays with the actual ones. Given the inherent challenges in precisely forecasting delays, we predict the delays with a 95 % confidence interval. Also, an error propagation analysis in the prediction horizon is carried out to determine the optimal time frame for prediction. The proposed method for flight delay prediction is important as airlines can strategize flight operations and issue timely advisories.

stochastic

Gaussian processes for inferring parton distributions

The extraction of parton distribution functions (PDFs) from experimental or lattice QCD data is an ill-posed inverse problem, where regularization strongly impacts both systematic uncertainties and the reliability of the results. We study a framework based on Gaussian Process Regression (GPR) to reconstruct PDFs from lattice QCD matrix elements. Within a Bayesian framework, Gaussian processes serve as flexible priors that encode uncertainties, correlations, and constraints without imposing rigid functional forms. We investigate a wide range of kernel choices, mean functions, and hyperparameter treatments. We quantify information gained from the data using the Kullback-Leibler divergence. Synthetic data tests demonstrate the consistency and robustness of the method. Our study establishes GPR as a systematic and non-parametric approach to PDF reconstruction, offering controlled uncertainty estimates and reduced model bias in lattice QCD analyses.

hadronic spectroscopy

Convergence analysis for a nonlocal gradient descent method via directional Gaussian smoothing

We analyze the convergence of a nonlocal gradient descent method for minimizing a class of high-dimensional non-convex functions, where a directional Gaussian smoothing (DGS) is proposed to define the nonlocal gradient (also referred to as the DGS gradient). The method was first proposed in [Zhang et al., Enabling long-range exploration in minimization of multimodal functions, UAI 2021], in which multiple numerical experiments showed that replacing the traditional local gradient with the DGS gradient can help the optimizers escape local minima more easily and significantly improve their performance. However, a rigorous theory for the efficiency of the method on nonconvex landscape is lacking. In this work, we investigate the scenario where the objective function is composed of a convex function, perturbed by deterministic oscillating noise. We provide a convergence theory under which the iterates exponentially converge to a tightened neighborhood of the solution, whose size is characterized by the noise wavelength. Here, we also establish a correlation between the optimal values of the Gaussian smoothing radius and the noise wavelength, thus justifying the advantage of using moderate or large smoothing radii with the method. Furthermore, if the noise level decays to zero when approaching the global minimum, we prove that DGS-based optimization converges to the exact global minimum with linear rates, similarly to standard gradient-based methods in optimizing convex functions. Several numerical experiments are provided to confirm our theory and illustrate the superiority of the approach over those based on the local gradient.

Tran, Hoang [Oak Ridge National Laboratory (ORNL),

Accurate and uncertainty-aware multi-task prediction of HEA properties using prior-guided deep Gaussian processes

Surrogate modeling techniques have become indispensable in accelerating the discovery and optimization of high-entropy alloys (HEAs), especially when integrating computational predictions with sparse experimental observations. This study systematically evaluates the training and testing performance of four prominent surrogate models—conventional Gaussian processes (cGP), Deep Gaussian processes (DGP), encoder-decoder neural networks for multi-output regression and eXtreme Gradient Boosting (XGBoost)—applied to a hybrid dataset of experimental and computational properties of the 8-component HEA system Al-Co-Cr-Cu-Fe-Mn-Ni-V. We specifically assess their capabilities in predicting correlated material properties, including yield strength, hardness, modulus, ultimate tensile strength, elongation, and average hardness under dynamic/quasi-static conditions, alongside auxiliary computational properties. The comparison highlights the strengths of hierarchical deep modeling approaches in handling heteroscedastic, heterotopic, and incomplete data commonly encountered in materials science. Our findings illustrate that combined surrogate models such as DGPs infused with machine-learned priors outperform other surrogates by effectively capturing inter-property correlations and by assimilating prior knowledge. This enhanced predictive accuracy positions the combined surrogate models as powerful tools for robust and data-efficient materials design.

36 MATERIALS SCIENCE

Beyond the two-point correlation: Constraining primordial non-Gaussianity with density-perturbation moments

Constraining primordial non-Gaussianity (PNG) on the large-scale cosmic structure (LSS) is an important step in understanding properties of the early Universe, specifically in distinguishing between different inflationary models. Measuring PNG relies on evaluating the scale-dependent correlations in the density field. New summary statistics beyond the two- and three-point correlation functions in configuration space and their Fourier-space counterparts, the power- and bispectrum may provide increased sensitivity. We introduce a new method for extracting the PNG signal imprinted on the LSS by using the first three Gaussian moments of the normalized correlation in density perturbations, evaluated on varying distance scales. We aim to assess this method’s sensitivity to local PNG, parameterized by f NL . We performed spherical convolutions on a range of scales on dark-matter-halo simulations to measure the scale-dependent correlations in the density field. From these, we computed the first three moments and compared them to a model expectation vector, parameterized to the second power in f NL . Our method provides about 21% improvement in sensitivity to f NL with respect to using the two-point correlation function alone. Notably, we find that the second moment alone carries nearly as much constraining power as the mean, highlighting the potential of higher order statistics. Given its simplicity and efficiency, this framework is well suited for application to current and upcoming large-scale surveys such as the Dark Energy Spectroscopic Instrument (DESI).

early universe

Equilibrium expectations for non-Gaussian fluctuations near a QCD critical point

With the highly anticipated results from the Beam Energy Scan II program at RHIC being recently revealed, an understanding of particle-number fluctuations and their significance as a potential signature of a possible QCD critical point is crucial. Early works that embarked on this endeavor sought to estimate the fluctuations due to the presence of a critical point assuming they stay in equilibrium. From these results came the proposal to focus efforts on higher, non-Gaussian, moments of the event-by-event distributions, in particular of the number of protons. These non-Gaussian moments are especially sensitive to critical fluctuations, as their magnitudes are proportional to high powers of the critical correlation length. As the equation of state provides key input for hydrodynamical simulations of heavy-ion collisions, we estimate equilibrium fluctuations from the BEST equation of state (EoS) that includes critical features from the 3D Ising Model. In particular, the proton factorial cumulants and their dependence on non-universal mapping parameters is investigated within the BEST EoS. Furthermore, the correlation length, as a central quantity for the assessment of fluctuations in the vicinity of a critical point, is also calculated in a consistent manner with the scaling equation of state. An understanding of the equilibrium estimates of proton factorial cumulants will be useful for further comparison to estimates of out-of-equilibrium fluctuations in order to determine the magnitude of the observable fluctuations to be expected in heavyion collision experiments, in which the time spent near a critical point is short.

Karthein, Jamie M. [Massachusetts Institute of Tec

3-center and 4-center 2-particle Gaussian AO integrals on modern accelerated processors

We report an implementation of the McMurchie–Davidson (MD) algorithm for 3-center and 4-center 2-particle integrals over Gaussian atomic orbitals (AOs) with low and high angular momenta l and varying degrees of contraction for graphical processing units (GPUs). This work builds upon our recent implementation of a matrix form of the MD algorithm that is efficient for GPU evaluation of 4-center 2-particle integrals over Gaussian AOs of high angular momenta (l ≥ 4) [A. Asadchev and E. F. Valeev, J. Phys. Chem. A 127, 10889–10895 (2023)]. The use of unconventional data layouts and three variants of the MD algorithm allow for the evaluation of integrals with double precision and sustained performance between 25% and 70% of the theoretical hardware peak. Performance assessment includes integrals over AOs with l ≤ 6 (a higher l is supported). Preliminary implementation of the Hartree–Fock exchange operator is presented and assessed for computations with up to a quadruple-zeta basis and more than 20 000 AOs. The corresponding C++ code is part of the experimental open-source LibintX library available at https://github.com/ValeevGroup/libintx.

Chemistry

Blinding scheme for the scale-dependence bias signature of local primordial non-Gaussianity for DESI 2024

The next generation of spectroscopic surveys is expected to achieve an unprecedented level of accuracy in the measurement of cosmological parameters. To avoid confirmation bias and thereby improve the reliability of these results, blinding procedures become a standard practice in the cosmological analyses of such surveys. Blinding is especially crucial when the impact of observational systematics is important relative to the cosmological signal, and a detection of that signal would have significant implications. This is the case for local primordial non-gaussianity, as probed by the scale-dependent bias of the galaxy power spectrum at large scales that are heavily sensitive to the dependence of the target selection on the imaging quality, known as imaging systematics. We propose a blinding method for the scale-dependent bias signature of local primordial non-gaussianity at the density field level which consists in generating a set of weights for the data that replicate the scale-dependent bias. The applied blinding is predictable, and can be straightforwardly combined with other catalog-level blinding procedures that have been designed for the baryon acoustic oscillation and redshift space distortion signals. The procedure is validated through simulations that replicate data from the first year of observation of the Dark Energy Spectroscopic Instrument, but may find applications to other upcoming spectroscopic surveys.

79 ASTRONOMY AND ASTROPHYSICS

Galaxy cluster profiles: a Gaussian mixture model approach to halo miscentering

Measurements of the galaxy density and weak-lensing profiles of galaxy clusters typically rely on an assumed cluster center, which is taken to be the brightest cluster galaxy or other proxies for the true halo center defined as the minimum in the potential well. Departure of the assumed cluster center from the true halo center bias the resultant profile measurements, an effect known as miscentering bias. Currently, miscentering is typically modeled in stacked profiles of clusters with a two parameter model. We use an alternate approach in which the profiles of individual clusters are used with the corresponding likelihood computed using a Gaussian mixture model. We test the approach using halos and the corresponding subhalo profiles from the IllustrisTNG hydrodynamic simulations. We obtain significantly improved estimates of the miscentering parameters for both 3D and projected 2D profiles relevant for imaging surveys. We discuss applications to upcoming cosmological surveys. Our Python package for the Gaussian mixture model is publicly available at https://github.com/KyleMiller1/Halo-Miscentering-Mixture-Model.

Bayesian reasoning

Probing primordial power spectrum and non-Gaussianities with fast radio bursts

We use the precision measurements of the arrivaltime differences of the same fast radio burst (FRB) source along multiple sightlines to measure the primordial power spectrum and Non-Gaussianities. The anticipated experiment requires a sightline separation of 100 AU, achieved by sending three or more radio telescopes to the outer solar system.The Shapiro time delays, measured relatively between different telescopes, are sensitive to the gradient field of the gravitational potential between different sightlines. Since the arrival time difference is independent of when the transient signal is emitted from the source, every measurement of the detected FRB source can be correlated. With enough FRB sources discovered, we can map the gravitational potential across the sky. We further calculate the two-point and three-point correlation function of the arrival time difference between telescopes for different FRB sources in the sky. If 10$^{4}$ FRBs were to be detected, our results suggest that this technique can test the inflationary scale-invariant power spectrum down to ∼ 10$^{3}$ Mpc$^{-1}$ and primordial Non-Gaussianities at a level of f$_{NL}$ ∼ 1.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Constraining primordial non-Gaussianity from DESI DR1 quasars and Planck PR4 CMB lensing

We present the first measurement of local-type primordial non-Gaussianity from the cross-correlation between 1.2 million spectroscopically confirmed quasars from the first data release (DR1) of the Dark Energy Spectroscopic Instrument (DESI) and the Planck PR4 CMB lensing reconstructions. The analysis is performed in three tomographic redshift bins covering 0.8 < z < 3.5, covering a sky fraction of ∼20%. We adopt a catalog-based pseudo-C ℓ estimator and apply linear imaging weights validated on noiseless mocks. Compared to previous analyses using photometric quasar samples, our results benefit from the high purity of the DESI spectroscopic sample, the reduced noise of PR4 lensing, and the absence of excess large-scale power in the spectroscopic quasar auto-correlation. Fitting simultaneously for the non-Gaussianity parameter f NL and the linear bias amplitude in each redshift bin, we obtain f NL = 2 +28 -34 for a response parameter p = 1.6, and f NL = 6 +20 -24 for p = 1.0. These results improve the constraints on f NL by ∼35% compared to the previous analysis based on the Legacy Imaging Survey DR9. Additionally, we derive an optimal weighting scheme to maximize the constraining power. In this case, and assuming p = 1.6, we obtain f NL = 19 +25 -31 . Our results demonstrate the statistical power of DESI quasars for probing inflationary physics, and highlight the promise of future DESI data releases.

cosmological parameters from CMBR

Constraining primordial non-Gaussianity from the large scale structure two-point and three-point correlation functions

Surveys of cosmological large-scale structure (LSS) are sensitive to the presence of local primordial non-Gaussianity (PNG), and may be used to constrain models of inflation. Local PNG, characterized by f NL ⁠, the amplitude of the quadratic correction to the potential of a Gaussian random field, is traditionally measured from LSS two-point and three-point clustering via the power spectrum and bi-spectrum. We propose a framework to measure f NL using the configuration space two-point correlation function (2pcf) monopole and three-point correlation function (3pcf) monopole of survey tracers. Our model estimates the effect of the scale-dependent bias induced by the presence of PNG on the 2pcf and 3pcf from the clustering of simulated dark matter haloes. We describe how this effect may be scaled to an arbitrary tracer of the cosmological matter density. The 2pcf and 3pcf of this tracer are measured to constrain the value of f NL ⁠. In LSS surveys, the effect of imaging systematics on two-point statistics is often degenerate with the PNG signal. Our proposed model employs three-point statistics primarily to break this degeneracy. Using simulations of luminous red galaxies observed by the Dark Energy Spectroscopic Instrument (DESI), we demonstrate the accuracy and constraining power of our method. Our forecast indicates the ability to constrain f NL to a precision of σf NL ≈ 22 with one year of DESI survey data, as well as the ability to constrain the imaging systematic weights in situ.

early Universe

Impact of Galactic non-Gaussian foregrounds on CMB lensing measurements

Weak gravitational lensing of the cosmic microwave background (CMB) has been established as a robust and powerful observable for precision cosmology. However, the impact of Galactic foregrounds, which has been studied less extensively than many other potential systematics, could in principle pose a problem for CMB lensing measurements. These foregrounds are inherently non-Gaussian and hence might mimic the characteristic signal that lensing estimators are designed to measure. We present an analysis that quantifies the level of contamination from Galactic dust in lensing measurements, focusing particularly on measurements with the Atacama Cosmology Telescope and the Simons Observatory. We employ a whole suite of foreground models and study the contamination of lensing measurements with both individual frequency channels and multifrequency combinations. We test the sensitivity of different estimators to the level of foreground non-Gaussianity and the dependence on sky fraction and multipole range used. We find that Galactic foregrounds do not present a problem for the Atacama Cosmology Telescope experiment (the bias in the inferred CMB lensing power spectrum amplitude remains below 0.3σ). For Simons Observatory, not all foreground models remain below this threshold. Although our results are conservative upper limits, they suggest that further work on characterizing dust biases and determining the impact of mitigation methods is well motivated, especially for the largest sky fractions.

cosmic microwave background

Gaussian-process generative model for the QCD equation of state

We develop a generative model for the nuclear matter equation of state at zero net baryon density using the Gaussian process regression method. We impose first-principles theoretical constraints from lattice quantum chromodynamics and hadron resonance gas at high- and low-temperature regions, respectively. By allowing the trained Gaussian process regression model to vary freely near the phase transition region, we generate random smooth crossover equations of state with different speeds of sound that do not rely on specific parametrizations. Here, we explore a collection of experimental observable dependencies on the generated equations of state, which paves the groundwork for future Bayesian inference studies to use experimental measurements from relativistic heavy-ion collisions to constrain the nuclear matter equation of state.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS