Engineering Papers⌕ Search

Engineering topics

Heitmann, Katrin

Publications and source records attributed to Heitmann, Katrin.

At least 73 records · Page 4

The coyote universe extended: Precision emulation of the matter power spectrum

Modern sky surveys are returning precision measurements of cosmological statistics such as weak lensing shear correlations, the distribution of galaxies, and cluster abundance. To fully exploit these observations, theorists must provide predictions that are at least as accurate as the measurements, as well as robust estimates of systematic errors that are inherent to the modeling process. In the nonlinear regime of structure formation, this challenge can only be overcome by developing a large-scale, multi-physics simulation capability covering a range of cosmological models and astrophysical processes. As a first step to achieving this goal, we have recently developed a prediction scheme for the matter power spectrum (a so-called emulator), accurate at the 1% level out to k ∼ 1 Mpc{sup –1} and z = 1 for wCDM cosmologies based on a set of high-accuracy N-body simulations. It is highly desirable to increase the range in both redshift and wavenumber and to extend the reach in cosmological parameter space. To make progress in this direction, while minimizing computational cost, we present a strategy that maximally reuses the original simulations. We demonstrate improvement over the original spatial dynamic range by an order of magnitude, reaching k ∼ 10 h Mpc{sup –1}, a four-fold increase in redshift coverage, to z = 4, and now include the Hubble parameter as a new independent variable. To further the range in k and z, a new set of nested simulations run at modest cost is added to the original set. The extension in h is performed by including perturbation theory results within a multi-scale procedure for building the emulator. This economical methodology still gives excellent error control, ∼5% near the edges of the domain of applicability of the emulator. A public domain code for the new emulator is released as part of the work presented in this paper.

79 ASTRONOMY AND ASTROPHYSICS↗

COSMIC EMULATION: THE CONCENTRATION-MASS RELATION FOR wCDM UNIVERSES

The concentration-mass relation for dark matter-dominated halos is one of the essential results expected from a theory of structure formation. We present a simple prediction scheme, a cosmic emulator, for the concentration-mass (c-M) relation as a function of cosmological parameters for wCDM models. The emulator is constructed from 37 individual models, with three nested N-body gravity-only simulations carried out for each model. The mass range covered by the emulator is 2 Multiplication-Sign 10{sup 12} M{sub Sun} < M < 10{sup 15} M{sub Sun} with a corresponding redshift range of z = 0-1. Over this range of mass and redshift, as well as the variation of cosmological parameters studied, the mean halo concentration varies from c {approx} 2 to c {approx} 8. The distribution of the concentration at fixed mass is Gaussian with a standard deviation of one-third of the mean value, almost independent of cosmology, mass, and redshift over the ranges probed by the simulations. We compare results from the emulator with previously derived heuristic analytic fits for the c-M relation, finding that they underestimate the halo concentration at high masses. Using the emulator to investigate the cosmology dependence of the c-M relation over the currently allowable range of values, we find-not surprisingly-that {sigma}{sub 8} and {omega}{sub m} influence it considerably, but also that the dark energy equation-of-state parameter w has a substantial effect. In general, the concentration of lower-mass halos is more sensitive to changes in cosmological parameters as compared to cluster mass halos. The c-M emulator is publicly available from http://www.hep.anl.gov/cosmology/CosmicEmu.

79 ASTRONOMY AND ASTROPHYSICS↗

DARK MATTER HALO PROFILES OF MASSIVE CLUSTERS: THEORY VERSUS OBSERVATIONS

Dark-matter-dominated cluster-scale halos act as an important cosmological probe and provide a key testing ground for structure formation theory. Focusing on their mass profiles, we have carried out (gravity-only) simulations of the concordance {Lambda}CDM cosmology, covering a mass range of 2 Multiplication-Sign 10{sup 12} to 2 Multiplication-Sign 10{sup 15} h {sup -1} M{sub Sun} and a redshift range of z = 0-2, while satisfying the associated requirements of resolution and statistical control. When fitting to the Navarro-Frenk-White profile, our concentration-mass (c-M) relation differs in normalization and shape in comparison to previous studies that have limited statistics in the upper end of the mass range. We show that the flattening of the c-M relation with redshift is naturally expressed if c is viewed as a function of the peak height parameter, {nu}. Unlike the c-M relation, the slope of the c-{nu} relation is effectively constant over the redshift range z = 0-2, while the amplitude varies by {approx}30% for massive clusters. This relation is, however, not universal: using a simulation suite covering the allowed wCDM parameter space, we show that the c-{nu} relation varies by about {+-}20% as cosmological parameters are varied. At fixed mass, the c(M) distribution is well fit by a Gaussian with {sigma}{sub c}/(c) {approx_equal} 1/3, independent of the radius at which the concentration is defined, the halo dynamical state, and the underlying cosmology. We compare the {Lambda}CDM predictions with observations of halo concentrations from strong lensing, weak lensing, galaxy kinematics, and X-ray data, finding good agreement for massive clusters (M{sub vir} > 4 Multiplication-Sign 10{sup 14} h {sup -1} M{sub Sun }), but with some disagreements at lower masses. Because of uncertainty in observational systematics and modeling of baryonic physics, the significance of these discrepancies remains unclear.

79 ASTRONOMY AND ASTROPHYSICS↗

HACC: extreme scaling and performance across diverse architectures, In: SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

Supercomputing is evolving towards hybrid and accelerator-based architectures with millions of cores. The HACC (Hardware/Hybrid Accelerated Cosmology Code) framework exploits this diverse landscape at the largest scales of problem size, obtaining high scalability and sustained performance. Developed to satisfy the science requirements of cosmological surveys, HACC melds particle and grid methods using a novel algorithmic structure that flexibly maps across architectures, including CPU/GPU, multi/many-core, and Blue Gene systems. We demonstrate the success of HACC on two very different machines, the CPU/GPU system Titan and the BG/Q systems Sequoia and Mira, attaining unprecedented levels of scalable performance. We demonstrate strong and weak scaling on Titan, obtaining up to 99.2% parallel efficiency, evolving 1.1 trillion particles. On Sequoia, we reach 13.94 PFlops (69.2% of peak) and 90% parallel efficiency on 1,572,864 cores, with 3.6 trillion particles, the largest cosmological benchmark yet performed. HACC design concepts are applicable to several other supercomputer applications.

Computer Science↗

Supercomputing Sheds Light on the Dark Universe

At Argonne National Laboratory, scientists are using supercomputers to shed light on one of the great mysteries in science today, the Dark Universe. With Mira, a petascale supercomputer at the Argonne Leadership Computing Facility, a team led by physicists Salman Habib and Katrin Heitmann will run the largest, most complex simulation of the universe ever attempted. By contrasting the results from Mira with state-of-the-art telescope surveys, the scientists hope to gain new insights into the distribution of matter in the universe, advancing future investigations of dark energy and dark matter into a new realm. The team's research was named a finalist for the 2012 Gordon Bell Prize, an award recognizing outstanding achievement in high-performance computing.

79 ASTRONOMY AND ASTROPHYSICS↗

Nonparametric reconstruction of the dark energy equation of state from diverse data sets

The cause of the accelerated expansion of the Universe poses one of the most fundamental questions in physics today. In the absence of a compelling theory to explain the observations, a first task is to develop a robust phenomenological approach: If the acceleration is driven by some form of dark energy, then the phenomenology is determined by the form of the dark energy equation of state w(z) as a function of redshift. A major aim of ongoing and upcoming cosmological surveys is to measure w and its evolution at high accuracy. Since w(z) is not directly accessible to measurement, powerful reconstruction methods are needed to extract it reliably from observations. We have recently introduced a new reconstruction method for w(z) based on Gaussian process modeling. This method can capture nontrivial w(z) dependences and, most importantly, it yields controlled and unbiased error estimates. In this paper we extend the method to include a diverse set of measurements: baryon acoustic oscillations, cosmic microwave background measurements, and supernova data. We analyze currently available data sets and present the resulting constraints on w(z), finding that current observations are in very good agreement with a cosmological constant. In addition, we explore how well our method captures nontrivial behavior of w(z) by analyzing simulated data assuming high-quality observations from future surveys. We find that the baryon acoustic oscillation measurements by themselves already lead to remarkably good reconstruction results and that the combination of different high-quality probes allows us to reconstruct w(z) very reliably with small error bounds.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Analyzing and Visualizing Cosmological Simulations with ParaView

The advent of large cosmological sky surveys - ushering in the era of precision cosmology - has been accompanied by ever larger cosmological simulations. The analysis of these simulations, which currently encompass tens of billions of particles and up to a trillion particles in the near future, is often as daunting as carrying out the simulations in the first place. Therefore, the development of very efficient analysis tools combining qualitative and quantitative capabilities is a matter of some urgency. In this paper, we introduce new analysis features implemented within ParaView, a fully parallel, open-source visualization toolkit, to analyze large N-body simulations. A major aspect of ParaView is that it can live and operate on the same machines and utilize the same parallel power as the simulation codes themselves. In addition, data movement is in a serious bottleneck now and will become even more of an issue in the future; an interactive visualization and analysis tool that can handle data in situ is fast becoming essential. The new features in ParaView include particle readers and a very efficient halo finder that identifies friends-of-friends halos and determines common halo properties, including spherical overdensity properties. In combination with many other functionalities already existing within ParaView, such as histogram routines or interfaces to programming languages like Python, this enhanced version enables fast, interactive, and convenient analyses of large cosmological simulations. In addition, development paths are available for future extensions.

79 ASTRONOMY AND ASTROPHYSICS↗

MASS FUNCTION PREDICTIONS BEYOND {Lambda}CDM

The statistics of dark matter halos is an essential component of precision cosmology. The mass distribution of halos, as specified by the halo mass function, is a key input for several cosmological probes. The sizes of N-body simulations are now such that, for the most part, results need no longer be statistics-limited, but are still subject to various systematic uncertainties. Discrepancies in the results of simulation campaigns for the halo mass function remain in excess of statistical uncertainties and of roughly the same size as the error limits set by near-future observations; we investigate and discuss some of the reasons for these differences. Quantifying error sources and compensating for them as appropriate, we carry out a high-statistics study of dark matter halos from 67 N-body simulations to investigate the mass function and its evolution for a reference {Lambda}CDM cosmology and for a set of wCDM cosmologies. For the reference {Lambda}CDM cosmology (close to WMAP5), we quantify the breaking of universality in the form of the mass function as a function of redshift, finding an evolution of as much as 10% away from the universal form between redshifts z = 0 and z = 2. For cosmologies very close to this reference we provide a fitting formula to our results for the (evolving) {Lambda}CDM mass function over a mass range of 6 x 10{sup 11}-3 x 10{sup 15} M{sub sun} to an estimated accuracy of about 2%. The set of wCDM cosmologies is taken from the Coyote Universe simulation suite. The mass functions from this suite (which includes a {Lambda}CDM cosmology and others with w {approx_equal} -1) are described by the fitting formula for the reference {Lambda}CDM case at an accuracy level of 10%, but with clear systematic deviations. We argue that, as a consequence, fitting formulae based on a universal form for the mass function may have limited utility in high-precision cosmological applications.

79 ASTRONOMY AND ASTROPHYSICS↗

In-situ sampling of a large-scale particle simulation for interactive visualization and analysis

We propose storing a random sampling of data from large scale particle simulations, such as the Roadrunner Universe MC{sup 3} cosmological simulation, to be used for interactive post-analysis and visualization. Simulation data generation rates will continue to be far greater than storage bandwidth rates and other limiting technologies by many orders of magnitude. This implies that only a very small fraction of data generated by the simulation can ever be stored and subsequently post-analyzed. The limiting technology in this situation is analogous to the problem in many population surveys: there aren't enough human resources to query a large population. To cope with the lack of resources, statistical sampling techniques are used to create a representative data set of a large population. Mirroring that situation, we propose to store a simulation-time random sampling of the particle data to cope with the bOlllenecks and support interactive, exploratory post-analysis. The particle samples are immediately stored in a level-ol-detail format for post-visualization and analysis, which amortizes the cost of post-processing for interactive visualization. Additionally, we incorporate a system for recording and visualizing sample approximation error information for confidence and importance highlighting.

97 MATHEMATICS AND COMPUTING↗

Data-intensive computing on numerically-insensitive supercomputers

With the advent of the era of petascale supercomputing, via the delivery of the Roadrunner supercomputing platform at Los Alamos National Laboratory, there is a pressing need to address the problem of visualizing massive petascale-sized results. In this presentation, I discuss progress on a number of approaches including in-situ analysis, multi-resolution out-of-core streaming and interactive rendering on the supercomputing platform. These approaches are placed in context by the emerging area of data-intensive supercomputing.

97 MATHEMATICS AND COMPUTING↗

Nonparametric reconstruction of the dark energy equation of state

A basic aim of ongoing and upcoming cosmological surveys is to unravel the mystery of dark energy. In the absence of a compelling theory to test, a natural approach is to better characterize the properties of dark energy in search of clues that can lead to a more fundamental understanding. One way to view this characterization is the improved determination of the redshift-dependence of the dark energy equation of state parameter, w(z). To do this requires a robust and bias-free method for reconstructing w(z) from data that does not rely on restrictive expansion schemes or assumed functional forms for w(z). We present a new nonparametric reconstruction method that solves for w(z) as a statistical inverse problem, based on a Gaussian process representation. This method reliably captures nontrivial behavior of w(z) and provides controlled error bounds. We demonstrate the power of the method on different sets of simulated supernova data; the approach can be easily extended to include diverse cosmological probes.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Verification of Scientific Simulations via Hypothesis-Driven Comparative and Quantitative Visualization

This article presents a visualization-assisted process that verifies scientific-simulation codes. Code verification is necessary because scientists require accurate predictions to interpret data confidently. This verification process integrates iterative hypothesis verification with comparative, feature, and quantitative visualization. Following this process can help identify differences in cosmological and oceanographic simulations.

99 GENERAL AND MISCELLANEOUS↗

THE COYOTE UNIVERSE. I. PRECISION DETERMINATION OF THE NONLINEAR MATTER POWER SPECTRUM

Near-future cosmological observations targeted at investigations of dark energy pose stringent requirements on the accuracy of theoretical predictions for the nonlinear clustering of matter. Currently, N-body simulations comprise the only viable approach to this problem. In this paper, we study various sources of computational error and methods to control them. By applying our methodology to a large suite of cosmological simulations we show that results for the (gravity-only) nonlinear matter power spectrum can be obtained at 1% accuracy out to k {approx} 1 h Mpc{sup -1}. The key components of these high accuracy simulations are precise initial conditions, very large simulation volumes, sufficient mass resolution, and accurate time stepping. This paper is the first in a series of three; the final aim is a high-accuracy prediction scheme for the nonlinear matter power spectrum that improves current fitting formulae by an order of magnitude.

79 ASTRONOMY AND ASTROPHYSICS↗

Origin of the cosmic network in {Lambda}CDM: Nature vs nurture

The large-scale structure of the Universe, as traced by the distribution of galaxies, is now being revealed by large-volume cosmological surveys. The structure is characterized by galaxies distributed along filaments, the filaments connecting in turn to form a percolating network. Our objective here is to quantitatively specify the underlying mechanisms that drive the formation of the cosmic network: By combining percolation-based analyses with N-body simulations of gravitational structure formation, we elucidate how the network has its origin in the properties of the initial density field (nature) and how its contrast is then amplified by the nonlinear mapping induced by the gravitational instability (nurture).

79 ASTRONOMY AND ASTROPHYSICS↗

Verification of the Time Evolution of Cosmological Simulations via Hypothesis-Driven Comparative and Quantitative Visualization

We describe a visualization-assisted process for the verification of cosmological simulation codes. The need for code verification stems from the requirement for very accurate predictions in order to interpret observational data confidently. We compare different simulation algorithms in order to reliably predict differences in simulation results and understand their dependence on input parameter settings. Our verification process consists of the integration of iterative hypothesis-verification with comparative, feature and quantitative visualization. We validate this process by verifying the time evolution results of three different cosmology simulation codes. The purpose of this verification is to study the accuracy of AMR methods versus other N-body simulation methods for cosmological simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗