Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Two-point statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

124 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

2D-FFTLog: efficient computation of real-space covariance matrices for galaxy clustering and weak lensing

ABSTRACT Accurate covariance matrices for two-point functions are critical for inferring cosmological parameters in likelihood analyses of large-scale structure surveys. Among various approaches to obtaining the covariance, analytic computation is much faster and less noisy than estimation from data or simulations. However, the transform of covariances from Fourier space to real space involves integrals with two Bessel integrals, which are numerically slow and easily affected by numerical uncertainties. Inaccurate covariances may lead to significant errors in the inference of the cosmological parameters. In this paper, we introduce a 2D-FFTLog algorithm for efficient, accurate, and numerically stable computation of non-Gaussian real-space covariances for both 3D and projected statistics. The 2D-FFTLog algorithm is easily extended to perform real-space bin-averaging. We apply the algorithm to the covariances for galaxy clustering and weak lensing for a Dark Energy Survey Year 3-like and a Rubin Observatory’s Legacy Survey of Space and Time Year 1-like survey, and demonstrate that for both surveys, our algorithm can produce numerically stable angular bin-averaged covariances with the flat sky approximation, which are sufficiently accurate for inferring cosmological parameters. The code CosmoCov for computing the real-space covariances with or without the flat-sky approximation is released along with this paper.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Non-Gaussianity in the weak lensing correlation function likelihood – implications for cosmological parameter biases

ABSTRACT We study the significance of non-Gaussianity in the likelihood of weak lensing shear two-point correlation functions, detecting significantly non-zero skewness and kurtosis in 1D marginal distributions of shear two-point correlation functions in simulated weak lensing data. We examine the implications in the context of future surveys, in particular LSST, with derivations of how the non-Gaussianity scales with survey area. We show that there is no significant bias in 1D posteriors of Ωm and σ8 due to the non-Gaussian likelihood distributions of shear correlations functions using the mock data (100 deg2). We also present a systematic approach to constructing approximate multivariate likelihoods with 1D parametric functions by assuming independence or more flexible non-parametric multivariate methods after decorrelating the data points using principal component analysis (PCA). While the use of PCA does not modify the non-Gaussianity of the multivariate likelihood, we find empirically that the 1D marginal sampling distributions of the PCA components exhibit less skewness and kurtosis than the original shear correlation functions. Modelling the likelihood with marginal parametric functions based on the assumption of independence between PCA components thus gives a lower limit for the biases. We further demonstrate that the difference in cosmological parameter constraints between the multivariate Gaussian likelihood model and more complex non-Gaussian likelihood models would be even smaller for an LSST-like survey. In addition, the PCA approach automatically serves as a data compression method, enabling the retention of the majority of the cosmological information while reducing the dimensionality of the data vector by a factor of ∼5.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Quantifying resolution in cosmological N- body simulations using self-similarity

ABSTRACT We demonstrate that testing for self-similarity in scale-free simulations provides an excellent tool to quantify the resolution at small scales of cosmological N-body simulations. Analysing two-point correlation functions measured in simulations using abacus , we show how observed deviations from self-similarity reveal the range of time and distance scales in which convergence is obtained. While the well-converged scales show accuracy below 1 per cent, our results show that, with a small force softening length, the spatial resolution is essentially determined by the mass resolution. At later times, the lower cut-off scale on convergence evolves in comoving units as a−1/2 (a being the scale factor), consistent with a hypothesis that it is set by two-body collisionality. A corollary of our results is that N-body simulations, particularly at high red-shift, contain a significant spatial range in which clustering appears converged with respect to the time-stepping and force softening but has not actually converged to the physical continuum result. The method developed can be applied to determine the resolution of any clustering statistic and extended to infer resolution limits for non-scale-free simulations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Information content of higher order galaxy correlation functions

The shapes of galaxy N-point correlation functions can be used as standard rulers to constrain the distance–redshift relationship. The cosmological density fields traced by late-time galaxy formation are initially nearly Gaussian, and hence, all the cosmological information can be extracted from their two-point correlation function. Subsequent non-linear evolution under gravity, as well as halo and then galaxy formation, generates higher order correlation functions. Since the mapping of the initial to the final density field is, on large scales, invertible, it is often claimed that the information content of the initial field’s power spectrum is equal to that of all the higher order functions of the final, non-linear field. This claim implies that reconstruction of the initial density field from the non-linear field renders analysis of higher order correlation functions of the latter superfluous. We show that this claim is false when the N-point functions are used as standard rulers. Constraints available from joint analysis of the two and three-point correlation functions can, in some cases, exceed those offered by the initial power spectrum. We provide a mathematical justification for this claim and demonstrate it using a large suite of N-body simulations. In particular, we show that for the z = 0 real-space matter field in the limit of vanishing shot-noise, taking modes up to k max = 0.2 h Mpc −1 , using the bispectrum alone offers a factor of 2 reduction in the variance on the cosmic distance scale relative to that available from the linear power spectrum.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Detection of spatial clustering in the 1000 richest SDSS DR8 redMaPPer clusters with nearest neighbor distributions

ABSTRACT Distances to the k-nearest-neighbor (kNN) data points from volume-filling query points are a sensitive probe of spatial clustering. Here, we present the first application of kNN summary statistics to observational clustering measurement, using the 1000 richest redMaPPer clusters (0.1 ≤ z ≤ 0.3) from the SDSS DR8 catalog. A clustering signal is defined as a difference in the cumulative distribution functions (CDFs) of kNN distances from fixed query points to the observed clusters versus a set of unclustered random points. We find that the k = 1, 2-NN CDFs of redMaPPer deviate significantly from the randoms’ across scales of 35 to 155 Mpc, which is a robust signature of clustering. In addition to kNN, we also measure the two-point correlation function for the same set of redMaPPer clusters versus random points, which shows a noisier and less significant clustering signal within the same radial scales. Quantitatively, the χ2 distribution for both the kNN-CDFs and the two-point correlation function measured on the randoms peak at χ2 ∼ 50 (null hypothesis), whereas the kNN-CDFs (χ2 ∼ 300, p = 1.54 × 10−36) pick up a much more significant clustering signal than the two-point function (χ2 ∼ 100, p = 1.16 × 10−6) when measured on redMaPPer. Finally, the measured 3NN and 4NN CDFs deviate from the predicted k = 3, 4-NN CDFs assuming an ideal Gaussian field, indicating a non-Gaussian clustering signal for redMaPPer clusters, although its origin might not be cosmological due to observational systematics. Therefore, kNN serves as a more sensitive probe of clustering complementary to the two point correlation function, providing a novel approach for constraining cosmology and galaxy–halo connection.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Dark energy survey year 3 results: cosmological constraints from the analysis of cosmic shear in harmonic space

ABSTRACT We present cosmological constraints from the analysis of angular power spectra of cosmic shear maps based on data from the first three years of observations by the Dark Energy Survey (DES Y3). Our measurements are based on the pseudo-Cℓ method and complement the analysis of the two-point correlation functions in real space, as the two estimators are known to compress and select Gaussian information in different ways, due to scale cuts. They may also be differently affected by systematic effects and theoretical uncertainties, making this analysis an important cross-check. Using the same fiducial Lambda cold dark matter model as in the DES Y3 real-space analysis, we find ${S_8 \equiv \sigma _8 \sqrt{\Omega _{\rm m}/0.3} = 0.793^{+0.038}_{-0.025}}$, which further improves to S8 = 0.784 ± 0.026 when including shear ratios. This result is within expected statistical fluctuations from the real-space constraint, and in agreement with DES Y3 analyses of non-Gaussian statistics, but favours a slightly higher value of S8, which reduces the tension with the Planck 2018 constraints from 2.3σ in the real space analysis to 1.5σ here. We explore less conservative intrinsic alignments models than the one adopted in our fiducial analysis, finding no clear preference for a more complex model. We also include small scales, using an increased Fourier mode cut-off up to $k_{\rm max}={5}\, {h}\, {\rm Mpc}^{-1}$, which allows to constrain baryonic feedback while leaving cosmological constraints essentially unchanged. Finally, we present an approximate reconstruction of the linear matter power spectrum at present time, found to be about 20 per cent lower than predicted by Planck 2018, as reflected by the lower S8 value.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Constraining galaxy–halo connection with high-order statistics

ABSTRACT We investigate using three-point statistics in constraining the galaxy–halo connection. We show that for some galaxy samples, the constraints on the halo occupation distribution parameters are dominated by the three-point function signal (over its two-point counterpart). We demonstrate this on mock catalogues corresponding to the Luminous red galaxies (LRGs), Emission-line galaxies (ELGs), and quasars (QSOs) targeted by the Dark Energy Spectroscopic Instrument (DESI) Survey. The projected three-point function for triangle sides less up to 20 h−1 Mpc measured from a cubic Gpc of data can constrain the characteristic minimum mass of the LRGs with a preci sion of 0.46 per cent. For comparison, similar constraints from the projected two-point function are 1.55 per cent. The improvements for the ELGs and QSOs targets are more modest. In the case of the QSOs, it is caused by the high shot-noise of the sample, and in the case of the ELGs, it is caused by the range of halo masses of the host haloes. The most time-consuming part of our pipeline is the measurement of the three-point functions. We adopt a tabulation method, proposed in earlier works for the two-point function, to significantly reduce the required compute time for the three-point analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Non-local contribution from small scales in galaxy–galaxy lensing: comparison of mitigation schemes

ABSTRACT Recent cosmological analyses with large-scale structure and weak lensing measurements, usually referred to as 3 × 2pt, had to discard a lot of signal to noise from small scales due to our inability to accurately model non-linearities and baryonic effects. Galaxy–galaxy lensing, or the position–shear correlation between lens and source galaxies, is one of the three two-point correlation functions that are included in such analyses, usually estimated with the mean tangential shear. However, tangential shear measurements at a given angular scale θ or physical scale R carry information from all scales below that, forcing the scale cuts applied in real data to be significantly larger than the scale at which theoretical uncertainties become problematic. Recently, there have been a few independent efforts that aim to mitigate the non-locality of the galaxy–galaxy lensing signal. Here, we perform a comparison of the different methods, including the Y-transformation, the point-mass marginalization methodology, and the annular differential surface density statistic. We do the comparison at the cosmological constraints level in a combined galaxy clustering and galaxy–galaxy lensing analysis. We find that all the estimators yield equivalent cosmological results assuming a simulated Rubin Observatory Legacy Survey of Space and Time (LSST) Year 1 like set-up and also when applied to DES Y3 data. With the LSST Y1 set-up, we find that the mitigation schemes yield ∼1.3 times more constraining S8 results than applying larger scale cuts without using any mitigation scheme.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Cosmology with second- and third-order shear statistics for the Dark Energy Survey: Methods and simulated analysis

We present a new pipeline designed for the robust inference of cosmological parameters using both second- and third-order shear statistics. We build a theoretical model for rapid evaluation of three-point correlations using our fastnc code and integrate it into the cosmosis framework. We measure the two-point functions 𝜉 ± and the full configuration-dependent three-point shear correlation functions across all auto- and cross-redshift bins. We compress the three-point functions into the mass aperture statistic ⟨ℳ$^{3}_{ap}$⟩ for a set of 796 simulated shear maps designed to model the Dark Energy Survey Year 3 data. We estimate from it the full covariance matrix and model the effects of intrinsic alignments, shear calibration biases and photometric redshift uncertainties. We apply scale cuts to minimize the contamination from the baryonic signal as modeled through hydrodynamical simulations. We find a significant improvement of 83% on the figure of merit in the Ω m − 𝑆 8 plane when we add the ⟨ℳ$^{3}_{ap}$⟩ data to 𝜉 ± . Here, we present our findings for all relevant cosmological and systematic uncertainty parameters and discuss the complementarity of third-order and second-order statistics.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Local primordial non-Gaussian bias from time evolution

Primordial non-Gaussianity (PNG) is a signature of fundamental physics in the early Universe that is probed by cosmological observations. Here, it is well known that the local type of PNG generates a strong signal in the two-point function of large-scale structure tracers, such as galaxies. This signal, often termed “scale-dependent bias” is a generic feature of modulation of gravitational structure formation by a large-scale mode. It is less well appreciated that the coefficient controlling this signal, b ϕ , is closely connected to the time evolution of the tracer number density. This correspondence between time evolution and local PNG can be simply explained for a universal tracer whose mass function only depends on peak height and, more generally, for nonuniversal tracers in the separate universe picture, which we validate in simulations. We also describe how to recover the bias of tracers subject to a survey selection function and perform a simple demonstration on simulated galaxies. Since the local PNG amplitude in n-point statistics ($f$ NL ) is largely degenerate with the coefficient b ϕ , this proof of concept study demonstrates that Galaxy survey data can allow for more optimal and robust extraction of local PNG information from upcoming surveys.

Sullivan, James M. [University of California, Berk↗
DOE OSTI2026

Empirical investigation of nuclear correlation function distributions in lattice QCD

Two-point correlation functions of systems with baryon number 𝐵 ∈ {1,2,3,4} are investigated using lattice quantum chromodynamics (QCD). In particular, the empirical distributions of importance-sampling Monte-Carlo samples of these correlation functions are examined as a function of the spacetime separation between the two points and the baryon number. While the exact forms of these distributions are not known for QCD, recent work has determined asymptotic expressions for analogous correlation function distributions in simpler theories such as scalar field theory and the disordered phase of the 𝑂⁡(𝑁) model. The theoretical 𝑂⁡(𝑁) model distributions are found to provide an accurate description of the empirical QCD distributions at zero momentum over a wide range of temporal separations for each baryon number when assessed with a range of different statistical tests. In particular, the behavior of the baryon number 𝐵 QCD correlation function at large temporal separation is well reproduced by the 𝑂⁡(𝑁 ∼ 2/𝐵) model distribution.

Lattice field theory↗
DOE OSTI2022

Detailed analysis of excited-state systematics in a lattice QCD calculation of 𝑔 𝐴

Excited state contamination remains one of the most challenging sources of systematic uncertainty to control in lattice QCD calculations of nucleon matrix elements and form factors: early time separations are contaminated by excited states and late times suffer from an exponentially bad signal-to-noise problem. High-statistics calculations at large time separations ≳ 1 fm are commonly used to combat these issues. In this work, focusing on g A , we explore the alternative strategy of utilizing a large number of relatively low-statistics calculations at short to medium time separations (0.2–1 fm), combined with a multistate analysis. On an ensemble with a pion mass of approximately 310 MeV and a lattice spacing of approximately 0.09 fm, we find this provides a more robust and economical method of quantifying and controlling the excited state systematic uncertainty. A quantitative separation of various types of excited states enables the identification of the transition matrix elements as the dominant contamination. The excited state contamination of the Feynman-Hellmann correlation function is found to reduce to the 1% level at approximately 1 fm while, for the more standard three-point functions, this does not occur until after 2 fm. Critical to our findings is the use of a global minimization, rather than fixing the spectrum from the two-point functions and using them as input to the three-point analysis. We find that the ground state parameters determined in such a global analysis are stable against variations in the excited state model, the number of excited states, and the truncation of early-time or late-time numerical data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Data compression and covariance matrix inspection: Cosmic shear

Covariance matrices are among the most difficult pieces of end-to-end cosmological analyses. In principle, for two-point functions, each component involves a four-point function, and the resulting covariance often has hundreds of thousands of elements. We investigate various compression mechanisms capable of vastly reducing the size of the covariance matrix in the context of cosmic shear statistics. This helps identify which of its parts are most crucial to parameter estimation. We start with simple compression methods, by isolating and “removing” 200 modes associated with the lowest eigenvalues, then those with the lowest signal-to-noise ratio, before moving on to more sophisticated schemes like compression at the tomographic level and, finally, with the massively optimized parameter estimation and data compression (MOPED). We find that, while most of these approaches prove useful for a few parameters of interest, like Ω m , the simplest yield a loss of constraining power on the intrinsic alignment (IA) parameters as well as S 8 . For the case considered—cosmic shear from the first year of data from the Dark Energy Survey—only MOPED was able to replicate the original constraints in the 16-parameter space. Finally, we apply a tolerance test to the elements of the compressed covariance matrix obtained with MOPED and confirm that the IA parameter A IA is the most susceptible to inaccuracies in the covariance matrix.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

A Cross-correlation Study of High-energy Neutrinos and Tracers of Large-scale Structure

The origin of the bulk of the astrophysical neutrinos detected by the IceCube Observatory remains a mystery. Previous source-finding analyses compared the directions of IceCube events and individual sources in astrophysical catalogs. The source association method is technically challenging when the number of source candidates is much larger than the number of the observed astrophysical neutrinos. In this paper, we show that in this large source number regime, a two-point cross-correlation analysis of neutrino data and source catalog can instead be used to constrain potential source populations for the high-energy astrophysical neutrinos, and provide spatial evidence for the existence of astrophysical neutrinos. We present an analysis of the cross-correlation of the IceCube 2010–2012 point-source data and a WISE–2MASS galaxy sample. While we find no significant detection of cross-correlation with the publicly available neutrino data set, we show that, when applied to the full IceCube data, which has a longer observation time and higher astrophysical neutrino purity, our method has sufficient statistical power to detect a cross-correlation signal if the neutrino sources trace the large-scale structure of the universe.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Clustering of LRGs in the DECaLS DR8 Footprint: Distance Constraints from Baryon Acoustic Oscillations Using Photometric Redshifts

A photometric redshift sample of luminous red galaxies (LRGs) obtained from the DECam Legacy Survey (DECaLS) is analyzed to probe cosmic distances by exploiting the wedge approach of the two-point correlation function. Although the cosmological information is highly contaminated by the uncertainties existing in the photometric redshifts from the galaxy map, an angular diameter distance can be probed at the perpendicular configuration in which the measured correlation function is minimally contaminated. An ensemble of wedged correlation functions selected up to a given threshold based on having the least contamination was studied in previous work (Sridhar & Song 2019) using simulations, and the extracted cosmological information was unbiased within this threshold. Furthermore, we apply the same methodology for analyzing the LRG sample from DECaLS, which will provide the optical imaging for targeting two-thirds of the Dark Energy Spectroscopic Instrument footprint and measure the angular diameter distances at z = 0.69 and z = 0.87 to be D A (0.697) = (1529 ± 73 Mpe)(r d /r d.fid ) and D A (0.874) = (1674 ± 102 Mpe)(r d /r d.fid ) with a fractional error of 4.77% and 6.09%, respectively. We obtain a value of H 0 = 66.58 ± 5.31 km s -1 Mpc -1 , which supports the H 0 measured by all other baryon acoustic oscillation results and is consistent with the ΛCDM model.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Constraints on the Correlation of IceCube Neutrinos with a Tracer of Nearby Large-scale Structure

The IceCube Neutrino Observatory has observed extragalactic astrophysical neutrinos with an apparently isotropic distribution. Only a small fraction of the observed astrophysical neutrinos can be explained by known sources. Neutrino production is thought to occur in energetic environments that are ultimately powered by the gravitational collapse of dense regions of the large-scale mass distribution in the universe. Whatever their identity, neutrino sources likely trace this large-scale mass distribution. The clustering of neutrinos with a tracer of the large-scale structure may provide insight into the distribution of neutrino sources with respect to redshift and the identity of neutrino sources. We implement a two-point angular cross correlation of the Northern sky track events with an infrared galaxy catalog derived from the Wide-field Infrared Survey Explorer (WISE) and Two Micron All Sky Survey (2MASS) source catalogs, which trace the nearby large-scale structure. No statistically significant correlation is found between the neutrinos and this infrared galaxy catalog. We find that ≤54% of the diffuse muon neutrino flux can be attributed to sources correlated with the galaxy catalog with 90% confidence. Additionally, when assuming that the neutrino source comoving density evolves following a power law in redshift, dN s /dV ∝ (1 + z) k , we find that sources with negative evolution, in particular k < −1.75, are disfavored at the 90% confidence level.

Abbasi, R. [Loyola University, Chicago, IL (United↗