Engineering Papers⌕ Search

Engineering topics

Messer, Bronson

Publications and source records attributed to Messer, Bronson.

At least 37 records · Page 2

Large-scale compute-intensive analysis via a combined in-situ and co-scheduling workflow approach, In: SC '15 Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis

Large-scale simulations can produce hundreds of terabytes to petabytes of data, complicating and limiting the efficiency of workflows. Traditionally, outputs are stored on the file system and analyzed in post-processing. With the rapidly increasing size and complexity of simulations, this approach faces an uncertain future. Trending techniques consist of performing the analysis in-situ, utilizing the same resources as the simulation, and/or off-loading subsets of the data to a compute-intensive analysis system. We introduce an analysis framework developed for HACC, a cosmological N-body code, that uses both in-situ and co-scheduling approaches for handling petabyte-scale outputs. We compare different analysis set-ups ranging from purely off-line, to purely in-situ to in-situ/co-scheduling. The analysis routines are implemented using the PISTON/VTK-m framework, allowing a single implementation of an algorithm that simultaneously targets a variety of GPU, multi-core, and many-core architectures.

Computer Science↗

Large-Scale Compute-Intensive Analysis via a Combined In-situ and Co-scheduling Workflow Approach

Large-scale simulations can produce tens of terabytes of data per analysis cycle, complicating and limiting the efficiency of workflows. Traditionally, outputs are stored on the file system and analyzed in post-processing. With the rapidly increasing size and complexity of simulations, this approach faces an uncertain future. Trending techniques consist of performing the analysis in situ, utilizing the same resources as the simulation, and/or off-loading subsets of the data to a compute-intensive analysis system. We introduce an analysis framework developed for HACC, a cosmological N-body code, that uses both in situ and co-scheduling approaches for handling Petabyte-size outputs. An initial in situ step is used to reduce the amount of data to be analyzed, and to separate out the data-intensive tasks handled off-line. The analysis routines are implemented using the PISTON/VTK-m framework, allowing a single implementation of an algorithm that simultaneously targets a variety of GPU, multi-core, and many-core architectures.

Big data↗

Essential ingredients in core-collapse supernovae

Carrying 10{sup 44} joules of kinetic energy and a rich mix of newly synthesized atomic nuclei, core-collapse supernovae are the preeminent foundries of the nuclear species which make up our solar system and ourselves. Signaling the inevitable death of a massive star, and the birth of a neutron star or black hole, core-collapse supernovae combine physics over a wide range in spatial scales, from kilometer-sized hydrodynamic motions (eventually growing to gigameter scale) down to femtometer-scale nuclear reactions. We will discuss our emerging understanding of the convectively-unstable, neutrino-driven explosion mechanism, based on increasingly realistic neutrino radiation hydrodynamic simulations that include progressively better nuclear and particle physics. Multi-dimensional models with spectral neutrino transport from several research groups, which slowly develop successful explosions for a range of progenitors, have recently motivated changes in our understanding of the neutrino reheating mechanism. In a similar fashion, improvements in nuclear physics, most notably explorations of weak interactions on nuclei and the nuclear equation of state, continue to refine our understanding of the births of neutron stars and the supernovae that result. Recent progress on both the macroscopic and microscopic effects that affect core-collapse supernovae are discussed.

79 ASTRONOMY AND ASTROPHYSICS↗

On numerical considerations for modeling reactive astrophysical shocks

Simulating detonations in astrophysical environments is often complicated by numerical approximations to shock structure. A common prescription to ensure correct detonation speeds and associated quantities is to prohibit burning inside the numerically broadened shock. We have performed a series of simulations to verify the efficacy of this approximation and to understand how resolution and dimensionality might affect its use. Our results show that in one dimension, prohibiting burning in the shock is important wherever the carbon burning length is not resolved, in keeping with the results of Fryxell et al. In two dimensions, we find that the prohibition of shock burning effectively inhibits the development of cellular structure for all but the most highly resolved cases. We discuss the possible impacts this outcome may have on sub-grid models and detonation propagation in models of Type Ia supernovae, including potential impacts on observables.

79 ASTRONOMY AND ASTROPHYSICS↗

Near Real-time Data Analysis of Core-Collapse Supernova Simulations With Bellerophon

We present an overview of a software system, Bellerophon, built to support a production-level HPC application called CHIMERA, which simulates core-collapse supernova events at the petascale. Developed over the last four years, Bellerophon enables CHIMERA s geographically dispersed team of collaborators to perform data analysis in near real-time. Its n-tier architecture provides an encapsulated, end-to-end software solution that enables the CHIMERA team to quickly and easily access highly customizable animated and static views of results from anywhere in the world via a web-deliverable, cross-platform desktop application. In addition, Bellerophon addresses software engineering tasks for the CHIMERA team by providing an automated mechanism for performing regression testing on a variety of supercomputing platforms. Elements of the team s workflow management needs are met with software tools that dynamically generate code repository statistics, access important online resources, and monitor the current status of several supercomputing resources.

Lingerfelt, Eric J↗

AXISYMMETRIC AB INITIO CORE-COLLAPSE SUPERNOVA SIMULATIONS OF 12-25 M{sub Sun} STARS

We present an overview of four ab initio axisymmetric core-collapse supernova simulations employing detailed spectral neutrino transport computed with our CHIMERA code and initiated from Woosley and Heger progenitors of mass 12, 15, 20, and 25 M{sub Sun }. All four models exhibit shock revival over {approx}200 ms (leading to the possibility of explosion), driven by neutrino energy deposition. Hydrodynamic instabilities that impart substantial asymmetries to the shock aid these revivals, with convection appearing first in the 12 M{sub Sun} model and the standing accretion shock instability appearing first in the 25 M{sub Sun} model. Three of the models have developed pronounced prolate morphologies (the 20 M{sub Sun} model has remained approximately spherical). By 500 ms after bounce the mean shock radii in all four models exceed 3000 km and the diagnostic explosion energies are 0.33, 0.66, 0.65, and 0.70 Bethe (B = 10{sup 51} erg) for the 12, 15, 20, and 25 M{sub Sun} models, respectively, and are increasing. The three least massive of our models are already sufficiently energetic to completely unbind the envelopes of their progenitors (i.e., to explode), as evidenced by our best estimate of their explosion energies, which first become positive at 320, 380, and 440 ms after bounce. By 850 ms the 12 M{sub Sun} diagnostic explosion energy has saturated at 0.38 B, and our estimate for the final kinetic energy of the ejecta is {approx}0.3 B, which is comparable to observations for lower mass progenitors.

79 ASTRONOMY AND ASTROPHYSICS↗

High Performance Computing Facility Operational Assessment, 2012 Oak Ridge Leadership Computing Facility

Oak Ridge National Laboratory’s Leadership Computing Facility (OLCF) continues to deliver the most powerful resources in the United States for open science. At 2.33 petaflops peak performance, the Cray XT Jaguar delivered more than 1.4 billion core hours in calendar year (CY) 2012 to researchers around the world for performing computational simulations relevant to national and energy security; advancing the frontiers of knowledge in physical sciences and areas of biological, medical, environmental, and computer sciences; and providing world-class research facilities for the nation’s science enterprise. OLCF users achieved numerous wide-ranging research accomplishments and technological innovations in 2012. It is not possible to fully summarize the breadth and impact of their productivity within this brief report—OLCF researchers published more than 300 research articles in 2012 alone. Here we identify selected accomplishments that advance the state of the art in science and engineering research and development. The work was recognized through peer-review publications in notable journals such as Science, Nature, and The Proceedings of the National Academy of Sciences (PNAS), among the many noted in this report. Exploration of the nuclear landscape carried out by Innovative and Novel Computational Impact on Theory and Experiment (INCITE) researchers and their theoretical prediction of isotopes were featured in Nature in 2012 (see Section 3.2.2). On the other end of the physical-scale spectrum, researchers executed a 22,000-year transient Earth System Model simulation that explained the misleading lag of carbon dioxide behind Antarctic temperature records and pointed to carbon dioxide’s role in driving global climate change over glacial cycles. This deglaciation study and related work by OLCF users were featured in Nature and PNAS in 2012 (see Section 3.2.3). Other representative achievements by OLCF users include generation of spectroscopic and photometric data for more accurate distance measurements, necessary for planning future National Science Foundation and Department of Energy (DOE) missions such as the Large Synoptic Survey Telescope and the Palomar Transient Factory; calculations to enable the experimental verification of Bose glass; and screening of 2 million compounds against a targeted receptor in a matter of days, as opposed to the months that would be required for computing clusters, creating a vast library of molecular compounds that can be used for future screenings of potential drug candidates. These and other accomplishments are described in Section 3.

OA↗

Core-collapse Supernovae

Marking the inevitable death of a massive star, and the birth of a neutron star or black hole, core-collapse supernovae bring together physics at a wide range in spatial scales, from kilometer-sized hydrodynamic motions (growing to gigameter scale) down to femtometer scale nuclear reactions. Carrying 10$^{51}$ ergs of kinetic energy and a rich-mix of newly synthesized atomic nuclei, core-collapse supernovae are the preeminent foundries of the nuclear species which make up ourselves and our solar system. We will discuss our emerging understanding of the convectively unstable, neutrino-driven explosion mechanism, based on increasingly realistic neutrino-radiation hydrodynamic simulations that include progressively better nuclear and particle physics. Recent multi-dimensional models with spectral neutrino transport from several research groups, which slowly develop successful explosions for a range of progenitors, have motivated changes in our understanding of the neutrino reheating mechanism. In a similar fashion, improvements in nuclear physics, most notably explorations of weak interactions on nuclei and the nuclear equation of state, continue to refine our understanding of how supernovae explode. Recent progress on both the macroscopic and microscopic effects that affect core-collapse supernovae are discussed.

Hix, William Raphael↗

Multicore and Accelerator Development for a Leadership-Class Stellar Astrophysics Code

We describe recent development work on the core-collapse supernova code CHIMERA. CHIMERA has consumed more than 100 million cpu-hours on Oak Ridge Leadership Computing Facility (OLCF) platforms in the past 3 years, ranking it among the most important applications at the OLCF. Most of the work described has been focused on exploiting the multicore nature of the current platform (Jaguar) via, e.g., multithreading using OpenMP. In addition, we have begun a major effort to marshal the computational power of GPUs with CHIMERA. The impending upgrade of Jaguar to Titan a 20+ PF machine with an NVIDIA GPU on many nodes makes this work essential.

Messer, Bronson↗

INTERPLAY OF NEUTRINO OPACITIES IN CORE-COLLAPSE SUPERNOVA SIMULATIONS

We have conducted a series of numerical experiments using spherically symmetric, general relativistic, neutrino radiation hydrodynamics with the code Agile-BOLTZTRAN to examine the effects of modern neutrino opacities on the development of supernova simulations. We test the effects of opacities by removing opacities or by undoing opacity improvements for individual opacities and groups of opacities. We find that improvements to electron capture (EC) on nuclei, namely EC on an ensemble of nuclei using modern nuclear structure models rather than the simpler independent-particle approximation (IPA) for EC on a mean nucleus, plays the most important role during core collapse of all tested neutrino opacities. Low-energy neutrinos emitted by modern nuclear EC preferentially escape during collapse without the energy downscattering on electrons required to enhance neutrino escape and deleptonization for the models with IPA nuclear EC. During shock breakout the primary influence on the emergent neutrinos arises from non-isoenergetic scattering (NIS) on electrons. For the accretion phase, NIS on free nucleons and pair emission by e {sup +} e {sup -} annihilation have the largest impact on the neutrino emission and shock evolution. Other opacities evaluated, including nucleon-nucleon bremsstrahlung and especially neutrino-positron scattering, have little measurable impact on neutrino emission or shock dynamics. Modern treatments of nuclear EC, e {sup +} e {sup -}-annihilation pair emission, and NIS on electrons and free nucleons are critical elements of core-collapse simulations of all dimensionality.

79 ASTRONOMY AND ASTROPHYSICS↗

ON THE REQUIREMENTS FOR REALISTIC MODELING OF NEUTRINO TRANSPORT IN SIMULATIONS OF CORE-COLLAPSE SUPERNOVAE

We have conducted a series of numerical experiments with the spherically symmetric, general relativistic, neutrino radiation hydrodynamics code AGILE-BOLTZTRAN to examine the effects of several approximations used in multidimensional core-collapse supernova simulations. Our code permits us to examine the effects of these approximations quantitatively by removing, or substituting for, the pieces of supernova physics of interest. These approximations include: (1) using Newtonian versus general relativistic gravity, hydrodynamics, and transport; (2) using a reduced set of weak interactions, including the omission of non-isoenergetic neutrino scattering, versus the current state-of-the-art; and (3) omitting the velocity-dependent terms, or observer corrections, from the neutrino Boltzmann kinetic equation. We demonstrate that each of these changes has noticeable effects on the outcomes of our simulations. Of these, we find that the omission of observer corrections is particularly detrimental to the potential for neutrino-driven explosions and exhibits a failure to conserve lepton number. Finally, we discuss the impact of these results on our understanding of current, and the requirements for future, multidimensional models.

79 ASTRONOMY AND ASTROPHYSICS↗

High Performance Computing Facility Operational Assessment, CY 2011 Oak Ridge Leadership Computing Facility

Oak Ridge National Laboratory's Leadership Computing Facility (OLCF) continues to deliver the most powerful resources in the U.S. for open science. At 2.33 petaflops peak performance, the Cray XT Jaguar delivered more than 1.4 billion core hours in calendar year (CY) 2011 to researchers around the world for computational simulations relevant to national and energy security; advancing the frontiers of knowledge in physical sciences and areas of biological, medical, environmental, and computer sciences; and providing world-class research facilities for the nation's science enterprise. Users reported more than 670 publications this year arising from their use of OLCF resources. Of these we report the 300 in this review that are consistent with guidance provided. Scientific achievements by OLCF users cut across all range scales from atomic to molecular to large-scale structures. At the atomic scale, researchers discovered that the anomalously long half-life of Carbon-14 can be explained by calculating, for the first time, the very complex three-body interactions between all the neutrons and protons in the nucleus. At the molecular scale, researchers combined experimental results from LBL's light source and simulations on Jaguar to discover how DNA replication continues past a damaged site so a mutation can be repaired later. Other researchers combined experimental results from ORNL's Spallation Neutron Source and simulations on Jaguar to reveal the molecular structure of ligno-cellulosic material used in bioethanol production. This year, Jaguar has been used to do billion-cell CFD calculations to develop shock wave compression turbo machinery as a means to meet DOE goals for reducing carbon sequestration costs. General Electric used Jaguar to calculate the unsteady flow through turbo machinery to learn what efficiencies the traditional steady flow assumption is hiding from designers. Even a 1% improvement in turbine design can save the nation billions of gallons of fuel.

99 GENERAL AND MISCELLANEOUS↗

Two- and three-dimensional simulations of core-collapse supernovae with CHIMERA

Ascertaining the core-collapse supernova mechanism is a complex, and yet unsolved, problem dependent on the interaction of general relativity, hydrodynamics, neutrino transport, neutrino-matter interactions, and nuclear equations of state and reaction kinetics. Ab initio modeling of core-collapse supernovae and their nucleosynthetic outcomes requires care in the coupling and approximations of the physical components. We have built our multi-physics CHIMERA code for supernova modeling in 1-, 2-, and 3-D, using ray-by-ray neutrino transport, approximate general relativity, and detailed neutrino and nuclear physics. We discuss some early results from our current series of exploding 2D simulations and our work to perform computationally tractable simulations in 3D using the ``Yin--Yang'' grid.

Lentz, Eric J↗

High Performance Computing Facility Operational Assessment, FY 2011 Oak Ridge Leadership Computing Facility

Oak Ridge National Laboratory's Leadership Computing Facility (OLCF) continues to deliver the most powerful resources in the U.S. for open science. At 2.33 petaflops peak performance, the Cray XT Jaguar delivered more than 1.5 billion core hours in calendar year (CY) 2010 to researchers around the world for computational simulations relevant to national and energy security; advancing the frontiers of knowledge in physical sciences and areas of biological, medical, environmental, and computer sciences; and providing world-class research facilities for the nation's science enterprise. Scientific achievements by OLCF users range from collaboration with university experimentalists to produce a working supercapacitor that uses atom-thick sheets of carbon materials to finely determining the resolution requirements for simulations of coal gasifiers and their components, thus laying the foundation for development of commercial-scale gasifiers. OLCF users are pushing the boundaries with software applications sustaining more than one petaflop of performance in the quest to illuminate the fundamental nature of electronic devices. Other teams of researchers are working to resolve predictive capabilities of climate models, to refine and validate genome sequencing, and to explore the most fundamental materials in nature - quarks and gluons - and their unique properties. Details of these scientific endeavors - not possible without access to leadership-class computing resources - are detailed in Section 4 of this report and in the INCITE in Review. Effective operations of the OLCF play a key role in the scientific missions and accomplishments of its users. This Operational Assessment Report (OAR) will delineate the policies, procedures, and innovations implemented by the OLCF to continue delivering a petaflop-scale resource for cutting-edge research. The 2010 operational assessment of the OLCF yielded recommendations that have been addressed (Reference Section 1) and where appropriate, changes in Center metrics were introduced. This report covers CY 2010 and CY 2011 Year to Date (YTD) that unless otherwise specified, denotes January 1, 2011 through June 30, 2011. User Support remains an important element of the OLCF operations, with the philosophy 'whatever it takes' to enable successful research. Impact of this center-wide activity is reflected by the user survey results that show users are 'very satisfied.' The OLCF continues to aggressively pursue outreach and training activities to promote awareness - and effective use - of U.S. leadership-class resources (Reference Section 2). The OLCF continues to meet and in many cases exceed DOE metrics for capability usage (35% target in CY 2010, delivered 39%; 40% target in CY 2011, 54% January 1, 2011 through June 30, 2011). The Schedule Availability (SA) and Overall Availability (OA) for Jaguar were exceeded in CY2010. Given the solution to the VRM problem the SA and OA for Jaguar in CY 2011 are expected to exceed the target metrics of 95% and 90%, respectively (Reference Section 3). Numerous and wide-ranging research accomplishments, scientific support, and technological innovations are more fully described in Sections 4 and 6 and reflect OLCF leadership in enabling high-impact science solutions and vision in creating an exascale-ready center. Financial Management (Section 5) and Risk Management (Section 7) are carried out using best practices approved of by DOE. The OLCF has a valid cyber security plan and Authority to Operate (Section 8). The proposed metrics for 2012 are reflected in Section 9.

99 GENERAL AND MISCELLANEOUS↗

A Multitier System for the Verification, Visualization and Management of CHIMERA

CHIMERA is a multi-dimensional radiation hydrodynamics code designed to study core-collapse supernovae. The code is made up of three essentially independent parts: a hydrodynamics module, a nuclear burning module, and a neutrino transport solver combined within an operator-split approach. Given CHIMERA s complexity and pace of ongoing development, a new support system, Bellerophon, has been designed and implemented to perform automated verification, visualization and management tasks while integrating with other workflow systems utilized by CHIMERA s development group. In order to achieve these goals, a multitier approach has been adopted. By integrating supercomputing platforms, visualization clusters, a dedicated web server and a client-side desktop application, this system attempts to provide an encapsulated, end-to-end solution to these needs.

code verification↗