Engineering Papers⌕ Search

Engineering topics

Heitmann, Katrin

Publications and source records attributed to Heitmann, Katrin.

At least 37 records · Page 2

The Outer Rim Simulation: A Path to Many-core Supercomputers

Herein we describe the Outer Rim cosmological simulation, one of the largest high-resolution N-body simulations performed to date, aimed at promoting science to be carried out with large-scale structure surveys. The simulation covers a volume of (4.225 Gpc) 3 and evolves more than one trillion particles. It was executed on Mira, a BlueGene/Q system at the Argonne Leadership Computing Facility. We discuss some of the computational challenges posed by a system such as Mira, a many-core supercomputer, and how the simulation code, Hardware/Hybrid Accelerated Cosmology Code, has been designed to overcome these challenges. We have carried out a large range of analyses on the simulation data and we report on the results as well as the data products that have been generated. The full data set generated by the simulation totals more than 5 PB of data, making curation and handling of the data a large challenge in itself. The simulation results have been used to generate synthetic catalogs for large-scale structure surveys, including Dark Energy Spectroscopic Instrument and eBOSS, as well as experiments on the cosmic microwave background. A detailed catalog for the data challenges of the Large Synoptic Survey Telescope Dark Energy Science Collaboration has been created as well. We publicly release some of the Outer Rim halo catalogs, downsampled particle information, and lightcone data.

79 ASTRONOMY AND ASTROPHYSICS↗

CMB-S4 Decadal Survey APC White Paper

CMB-S4 is envisioned to be the ultimate ground-based cosmic microwave background experiment, crossing critical thresholds in our understanding of the origin and evolution of the Universe, from the highest energies at the dawn of time through the growth of structure to the present day. The CMB-S4 science case is spectacular: the search for primordial gravitational waves as predicted from inflation and the imprint of relic particles including neutrinos, unique insights into dark energy and tests of gravity on large scales, elucidating the role of baryonic feedback on galaxy formation and evolution, opening up a window on the transient Universe at millimeter wavelengths, and even the exploration of the outer Solar System. The CMB-S4 sensitivity to primordial gravitational waves will probe physics at the highest energy scales and cross a major theoretically motivated threshold in constraints on inflation. The CMB-S4 search for new light relic particles will shed light on the early Universe 10,000 times farther back than current experiments can reach. Finally, the CMB-S4 Legacy Survey covering 70% of the sky with unprecedented sensitivity and angular resolution from centimeter- to millimeter-wave observing bands will have a profound and lasting impact on Astronomy and Astrophysics and provide a powerful complement to surveys at other wavelengths, such as LSST and WFIRST, and others yet to be imagined. We emphasize that these critical thresholds cannot be reached without the level of community and agency investment and commitment required by CMB-S4. In particular, the CMB-S4 science goals are out of the reach of any projected precursor experiment by a significant margin.

Abazajian, Kevork↗

CMB-S4 Decadal Survey APC White Paper

We provide an overview of the science case, instrument configuration and project plan for the next-generation ground-based cosmic microwave background experiment CMB-S4, for consideration by the 2020 Decadal Survey.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The Importance of Secondary Halos for Strong Lensing in Massive Galaxy Clusters across Redshift

Cosmological cluster-scale strong gravitational lensing probes the mass distribution of the dense cores of massive dark matter halos and the structures along the line of sight from background sources to the observer. It is frequently assumed that the primary lens mass dominates the lensing, with the contribution of secondary masses along the line of sight being neglected. Secondary mass structures may, however, affect both the detectability of strong lensing in a given survey and modify the properties of the lensing that is detected. This paper focuses on the former. Herein we utilize a large cosmological N-body simulation and a multiple lens plane (and many-source plane) ray-tracing technique to quantify the influence of line-of-sight structures on the detectability of cluster-scale strong lensing in a cluster sample with a mass limit that encompasses current cluster catalogs from the South Pole Telescope. We extract both primary and secondary halos from the “Outer Rim” simulation and consider two strong lensing realizations—one with only the primary halos included, and the other with the full mass light cone for each primary halo, including all secondary halos down to a mass limit more than an order of magnitude smaller than the smallest primary halos considered. In both cases, we use the same source information extracted from the Hubble Ultra Deep Field, and create realistic lensed images consistent with moderately deep ground-based imaging; the statistics of the observed strong lensing are extracted from these simulated images. The results demonstrate that down to the mass limit considered the total number of lenses is boosted by ~13%–21% when considering the complete multi-halo light cone; the enhancement is insensitive to different length-to-width cuts applied to the lensed arcs. The increment in strong lens counts peaks at lens redshifts of $z$ ~ 0.6 with no significant effect at $z$ < 0.3. The strongest trends are observed relative to the primary halo mass, with no significant effect in the most massive quintile of the halo sample, but increasingly boosting the observed lens counts toward small primary halo masses, with an enhancement greater than 50% in the least massive quintile of the halo masses considered.

59 BASIC BIOLOGICAL SCIENCES↗

Astro2020 Science White Paper: Cosmological Synergies Enabled by Joint Analysis of Multi-probe data from WFIRST, Euclid, and LSST

NASA, NSF, and DOE will collectively spend well over $4B this decade and the next on missions and surveys that have dark energy cosmology as one of their primary drivers. WFIRST, Euclid, and LSST are all missions designed to perform dedicated surveys that offer unprecedented statistical constraining power and control of systematic uncertainties. However, there is a growing realization that these missions will be significantly more powerful when the data are processed and analyzed in unison. This will require coordinated cross-survey and interagency effort. With proper attention to how data are jointly processed and analyzed, the combination of these missions will provide constraints and systematics control that is better than the sum of their individual parts, as stated in the title of Jain, et al. (2015). We advocate for the three relevant US agencies to work together with our international partners to ensure that the synergy from these multi-probe missions is fully realized.

79 ASTRONOMY AND ASTROPHYSICS↗

The Borg Cube Simulation: Cosmological Hydrodynamics with CRK-SPH

A challenging requirement posed by next-generation observations is a firm theoretical grasp of the impact of baryons on structure formation. Cosmological hydrodynamic simulations modeling gas physics are vital in this regard. A high degree of modeling flexibility exists in this space, making it important to explore a range of methods in order to gauge the accuracy of simulation predictions. We present results from the first cosmological simulation using Conservative Reproducing Kernel Smoothed Particle Hydrodynamics (CRK-SPH). We employ two simulations: one evolved purely under gravity, and the other with nonradiative hydrodynamics. Each contains 2 × 2304 3 cold dark matter plus baryon particles in an 800 h -1 Mpc box. We compare statistics to previous nonradiative simulations including power spectra, mass functions, baryon fractions, and concentration. We find self-similar radial profiles of gas temperature, entropy, and pressure and show that a simple analytic model recovers these results to better than 40% over two orders of magnitude in mass. We quantify the level of nonthermal pressure support in halos and demonstrate that hydrostatic mass estimates are biased low by 24% (10%) for halos of mass 10 15 (10 13 ) h -1 M⊙. Here, we compute angular power spectra for the thermal and kinematic Sunyaev–Zel’dovich effects and find good agreement with the low-ℓ Planck measurements. Finally, artificial scattering between particles of unequal mass is shown to have a large impact on the gravity-only run, and we highlight the importance of better understanding this issue in hydrodynamic applications. This is the first in a simulation campaign using CRK-SPH, with future work including subresolution gas treatments.

79 ASTRONOMY AND ASTROPHYSICS↗

Outer rim simulation: Predicting matter distribution in a universe with billions of galaxies

Anticipating the completion of the Large Synoptic Survey Telescope (LSST) in 2021 in Chile, Argonne scientists have created one of the largest simulations ever produced, the Outer Rim simulation. As it follows the evolution of matter distribution in the universe and the influence of dark energy, the Outer Rim simulation helps researchers make predictions on what they should expect to see when pointing a next generation telescope like the LSST in its direction. Argonne is helping to develop advanced supercomputing and data analysis tools in support of the LSST.

79 ASTRONOMY AND ASTROPHYSICS↗

Bispectrum as baryon acoustic oscillation interferometer

The galaxy bispectrum, measuring excess clustering of galaxy triplets, offers a probe of dark energy via baryon acoustic oscillations (BAOs). However up to now it has been severely underused due to the combinatorically explosive number of triangles. Here we exploit interference in the bispectrum to identify triangles that amplify BAOs. Here, this approach reduces the computational cost of estimating covariance matrices, offers an improvement in BAO constraints equivalent to lengthening BOSS by 30% and simplifies adding bispectrum BAO information to future large-scale redshift survey analyses.

47 OTHER INSTRUMENTATION↗

The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: anisotropic clustering analysis in configuration space

We explore the cosmological implications of anisotropic clustering measurements of the quasar sample from Data Release 14 (DR14) of the Sloan Digital Sky Survey IV extended Baryon Oscillation Spectroscopic Survey (eBOSS) in configuration space. The similar to 147000 quasar sample observed by eBOSS offers a direct tracer of the density field and bridges the gap of previous baryon acoustic oscillation measurements between redshift 0.8 < z < 2.2. By analysing the two-point correlation function characterized by clustering wedges xi(wi)(s) and multipolesi xi(l)(S), we measure the angular diameter distance, Hubble parameter, and cosmic structure growth rate. We define a systematic error budget for our measurements based on the analysis of N-body simulations and mock catalogues. Based on the DR14 large-scale structure quasar sample at the effective redshift z(eff) = 1.52, we find the growth rate of cosmic structure f sigma(8)(z(eff)) = 0.396 +/- 0.079, and the geometric parameters Dv(z)/r(d) = 26.47 +/- 1.23, and F-AP(Z) = 2.53 +/- 0.22, where the uncertainties include both statistical and systematic errors. These values are in excellent agreement with the best-fitting standard A cold dark matter model to the latest cosmic microwave background data from Planck.

cosmology↗

Halo Profiles and the Concentration–Mass Relation for a ΛCDM Universe

Profiles of dark matter-dominated halos at the group and cluster scales play an important role in modern cosmology. Using results from two very large cosmological N-body simulations, which increase the available volume at their mass resolution by roughly two orders of magnitude, we robustly determine the halo concentration-mass (c-M) relation over a wide range of masses, employing multiple methods of concentration measurement. We then characterize individual halo profiles, as well as stacked profiles, relevant for galaxy-galaxy lensing and next-generation cluster surveys; the redshift range covered is 0 ≤ z ≤ 4, with a minimum halo mass of M 200c ~ 2 x 10 11 M ⊙ . Despite the complexity of a proper description of a halo (environmental effects, merger history, nonsphericity, relaxation state), when the mass is scaled by the nonlinear mass scale M * (z), we find that a simple non-power-law form for the c-M/M * relation provides an excellent description of our simulation results across eight decades in M/M * and for 0 ≤ z ≤ 4. Over the mass range covered, the c-M relation has two asymptotic forms: an approximate power law below a mass threshold M/M * ~500-1000, transitioning to a constant value, c 0 ~ 3 at higher masses. The relaxed halo fraction decreases with mass, transitioning to a constant value of ~0.5 above the same mass threshold. We compare Navarro-Frenk-White (NFW) and Einasto fits to stacked profiles in narrow mass bins at different redshifts; as expected, the Einasto profile provides a better description of the simulation results. At cluster scales at low redshift, however, both NFW and Einasto profiles are in very good agreement with the simulation results, consistent with recent weak lensing observations.

79 ASTRONOMY AND ASTROPHYSICS↗

The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: measurement of the growth rate of structure from the anisotropic correlation function between redshift 0.8 and 2.2

We present the clustering measurements of quasars in configuration space based on the Data Release 14 (DR14) of the Sloan Digital Sky Survey IV extended Baryon Oscillation Spectroscopic Survey (eBOSS). This data set includes 148 659 quasars spread over the redshift range 0.8 ≤ z ≤ 2.2 and spanning 2112.9 deg 2 . We use the Convolution Lagrangian Perturbation Theory approach with a Gaussian Streaming model for the redshift space distortions of the correlation function and demonstrate its applicability for dark matter haloes hosting eBOSS quasar tracers. At the effective redshift z eff = 1.52, we measure the linear growth rate of structure fσ 8 (zeff) = 0.426 ± 0.077, the expansion rate H(z eff ) = 159$+12\atop{-13}$(r$fid\atop{s}$ /r s ) kms -1 Mpc -1 , and the angular diameter distance DA(z eff ) = 1850$+90\atop{-115}$ (r s /r$fid\atop{s}$) Mpc, where r s is the sound horizon at the end of the baryon drag epoch and rfid s is its value in the fiducial cosmology. The quoted uncertainties include both systematic and statistical contributions. The results on the evolution of distances are consistent with the predictions of flat Λ-cold dark matter cosmology with Planck parameters, and the measurement of fσ 8 extends the validity of General Relativity to higher redshifts (z > 1). This paper is released with companion papers using the same sample. The results on the cosmological parameters of the studies are found to be in very good agreement, providing clear evidence of the complementarity and of the robustness of the first full-shape clustering measurements with the eBOSS DR14 quasar sample.

79 ASTRONOMY AND ASTROPHYSICS↗

The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: structure growth rate measurement from the anisotropic quasar power spectrum in the redshift range 0.8 < z < 2.2

We analyse the clustering of the Sloan Digital Sky Survey IV extended Baryon Oscillation Spectroscopic Survey Data Release 14 quasar sample (DR14Q).We measure the redshift space distortions using the power-spectrum monopole, quadrupole, and hexadecapole inferred from 148 659 quasars between redshifts 0.8 and 2.2, covering a total sky footprint of 2112.9 deg 2 . We constrain the logarithmic growth of structure times the amplitude of dark matter density fluctuations, fσ 8 , and the Alcock–Paczynski dilation scales that allow constraints to be placed on the angular diameter distance D A (z) and the Hubble H(z) parameter. At the effective redshift of z eff = 1.52, fσ 8 (z eff ) = 0.420 ± 0.076, H(z eff ) = [162 ± 12] (r$fid\atop{s}$ /r s ) kms -1 Mpc -1 , and DA(z eff ) = [1.85 ± 0.11] × 10 3 (r s/ r$fid\atop{s}$) Mpc, where r s is the comoving sound horizon at the baryon drag epoch and the superscript ‘fid’ stands for its fiducial value. The errors take into account the full error budget, including systematics and statistical contributions. These results are in full agreement with the current Λ-Cold Dark Matter cosmological model inferred from Planck measurements. Finally, we compare our measurements with other eBOSS companion papers and find excellent agreement, demonstrating the consistency and complementarity of the different methods used for analysing the data.

79 ASTRONOMY AND ASTROPHYSICS↗

Cosmic Visions Dark Energy: Small Projects Portfolio

Understanding cosmic acceleration is one of the key science drivers for astrophysics and high-energy physics in the coming decade (2014 P5 Report). With the Large Synoptic Survey Telescope (LSST) and the Dark Energy Spectroscopic Instrument (DESI) and other new facilities beginning operations soon, we are entering an exciting phase during which we expect an order of magnitude improvement in constraints on dark energy and the physics of the accelerating Universe. This is a key moment for a matching Small Projects portfolio that can (1) greatly enhance the science reach of these flagship projects, (2) have immediate scientific impact, and (3) lay the groundwork for the next stages of the Cosmic Frontier Dark Energy program. In this White Paper, we outline a balanced portfolio that can accomplish these goals through a combination of observational, experimental, and theory and simulation efforts.

79 ASTRONOMY AND ASTROPHYSICS↗

Building Halo Merger Trees from the Q Continuum Simulation

Cosmological N-body simulations rank among the most computationally intensive efforts today. A key challenge is the analysis of structure, substructure, and the merger history for many billions of compact particle clusters, called halos. Effectively representing the merging history of halos is essential for many galaxy formation models used to generate synthetic sky catalogs, an important application of modern cosmological simulations. Generating realistic mock catalogs requires computing the halo formation history from simulations with large volumes and billions of halos over many time steps, taking hundreds of terabytes of analysis data. We present fast parallel algorithms for producing halo merger trees and tracking halo substructure from a single-level, density-based clustering algorithm. Merger trees are created from analyzing the halo-particle membership function in adjacent snapshots, and substructure is identified by tracking the "cores" of merging halos - sets of particles near the halo center. Core tracking is performed after creating merger trees and uses the relationships found during tree construction to associate substructures with hosts. The algorithms are implemented with MPI and evaluated on a Cray XK7 supercomputer using up to 16,384 processes on data from HACC, a modern cosmological simulation framework. We present results for creating merger trees from 101 analysis snapshots taken from the Q Continuum, a large volume, high mass resolution, cosmological simulation evolving half a trillion particles.

79 ASTRONOMY AND ASTROPHYSICS↗

The Mira-Titan Universe. II. Matter Power Spectrum Emulation

We introduce a new cosmic emulator for the matter power spectrum covering eight cosmological parameters. Targeted at optical surveys, the emulator provides accurate predictions out to a wavenumber k ~ 5Mpc -1 and redshift z ≤ 2. Besides covering the standard set of CDM parameters, massive neutrinos and a dynamical dark energy of state are included. The emulator is built on a sample set of 36 cosmological models, carefully chosen to provide accurate predictions over the wide and large parameter space. For each model, we have performed a high-resolution simulation, augmented with sixteen medium-resolution simulations and TimeRG perturbation theory results to provide accurate coverage of a wide k-range; the dataset generated as part of this project is more than 1.2Pbyte. With the current set of simulated models, we achieve an accuracy of approximately 4%. Because the sampling approach used here has established convergence and error-control properties, follow-on results with more than a hundred cosmological models will soon achieve ~1% accuracy. We compare our approach with other prediction schemes that are based on halo model ideas and remapping approaches. The new emulator code is publicly available.

97 MATHEMATICS AND COMPUTING↗

Next-Generation Cosmology Simulations with HACC: Conquering the Baryon Problem

The next generation of cosmological surveys will start taking data in a few years. These surveys will cover the microwave, optical, and X-ray bands. A major challenge for the interpretation of these new observations will be to disentangle astrophysical effects (e.g., galaxy bias and evolution, baryonic feedback processes) from fundamental physics (dark energy, dark matter, neutrino properties, primordial fluctuations).

79 ASTRONOMY AND ASTROPHYSICS↗