Performance Portability in the Uintah Runtime System Through the Use of Kokkos.
Abstract not provided.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Abstract not provided.
In this study, we have established CCSD(T)/CBS (Complete Basis Set) limits for 3 stationary points on the benzene dimer potential energy surface, corresponding to the π∙∙∙π (parallel displaced or PD(C 2h ), minimum) and CH∙∙∙π (T-shaped or T(C 2v ), transition state) and tilted T-shaped (or TT(Cs), minimum) bonding scenarios considering both the structure and binding energy. The CCSD(T)/CBS binding energies are -2.65 ± 0.02 (PD), -2.74 ± 0.03 (T), and -2.83 ± 0.01 kcal mol -1 (TT). To this end, the CH∙∙∙π is ~0.2 kcal mol -1 stronger than the π∙∙∙π interaction, whereas the tilting of the CH donating benzene molecule with respect to the other benzene is worth 0.1 kcal mol -1 . As previously discussed in the literature, the MP2 level of theory does not provide a close match for either the energy or structure, yet the SCS-MP2 yields structures in excellent agreement with respect to the CCSD(T) result. It is found that the SCS-MI-MP2 also gives optimized structures very close to SCS-MP2 (within ~0.01 Å of the benchmark). Despite the closer match in structure, the spin-biased MP2 methods (SCS-, SCS-MI-, and SOS-MP2) incorrectly predict the relative stabilities of the isomers. That said, none of the spin biased MP2 methods offers a good compromise between energy and structure for the systems examined. Finally, the CCSD(T)/CBS benchmarks were used to assess the performance of 13 DFT functionals selected from different rungs of Jacob's ladder. Several functionals such as TPSS-D3, B3LYP-D3, B97-D, B97-D3, and B2PLYP-D3 provided a good description of the binding energies for both CH∙∙∙π and π∙∙∙π interactions, yielding values within 6% of the CCSD(T)/CBS benchmark values. Unlike the MP2 methods, these functionals correctly predict the relative stability of the PD(C 2h ) and T(C 2v ) dimers. Further, we find that there is no systematic improvement as Jacob's ladder is ascended (increased complexity of functional). The best functionals that result in a good compromise between structure and energy accuracy are B97-D3 and B2PLYP-D3 for both the CH∙∙∙π and π∙∙∙π interaction. Despite the impressive performance of these functionals, a challenge that remains is ensuring the transferability of these density functionals in accurately describing the interaction between dimers of larger aromatic molecules, the latter requiring high-level benchmarks for these systems.
The next generation of capability-class, massively parallel processing (MPP) systems is expected to have hundreds of thousands to millions of processors, In such environments, it is critical to have fault-tolerance mechanisms, including checkpoint/restart, that scale with the size of applications and the percentage of the system on which the applications execute. For application-driven, periodic checkpoint operations, the state-of-the-art does not provide a scalable solution. For example, on today's massive-scale systems that execute applications which consume most of the memory of the employed compute nodes, checkpoint operations generate I/O that consumes nearly 80% of the total I/O usage. Motivated by this observation, this project aims to improve I/O performance for application-directed checkpoints through the use of lightweight storage architectures and overlay networks. Lightweight storage provide direct access to underlying storage devices. Overlay networks provide caching and processing capabilities in the compute-node fabric. The combination has potential to signifcantly reduce I/O overhead for large-scale applications. This report describes our combined efforts to model and understand overheads for application-directed checkpoints, as well as implementation and performance analysis of a checkpoint service that uses available compute nodes as a network cache for checkpoint operations.
Knowledge Gap: The aggregation of clay minerals—layered silicate nanoparticles—strongly impacts fluid flow, solute migration, and solid mechanics in soils, sediments, and sedimentary rocks. Experimental and computational characterization of clay aggregation is inhibited by the delicate water-mediated nature of clay colloidal interactions and by the range of spatial scales involved, from 1 nm thick platelets to flocs with dimensions up to micrometers or more. Simulations: Using a new coarse-grained molecular dynamics (CGMD) approach, we predicted the microstructure, dynamics, and rheology of hydrated smectite (more precisely, montmorillonite) clay gels containing up to 2,000 clay platelets on length scales up to 0.1 μm. Further, simulations investigated the impact of simulation time, platelet diameters (6 to 25nm), and the ratio of Na to Ca exchangeable cations on the assembly of tactoids (i.e., stacks of parallel clay platelets) and larger aggregates (i.e., assemblages of tactoids). We analyzed structural features including tactoid size and size distribution, basal spacing, counterion distribution in the electrical double layer, clay association modes, and the rheological properties of smectite gels. Findings: Our results demonstrate new potential to characterize and understand clay aggregation in dilute suspensions and gels on a scale of thousands of particles with explicit representation of counterion clouds and with accuracy approaching that of all-atom molecular dynamics (MD) simulations. For example, our simulations predict the strong impact of Na/Ca ratio on clay tactoid formation and the shear-thinning rheology of clay gels.
This paper describes code and methods development at the Oak Ridge National Laboratory focused on enabling high-fidelity, large-scale reactor analyses with Monte Carlo (MC). Current state-of-the-art tools and methods used to perform real commercial reactor analyses have several undesirable features, the most significant of which is the non-rigorous spatial decomposition scheme. Monte Carlo methods, which allow detailed and accurate modeling of the full geometry and are considered the gold standard for radiation transport solutions, are playing an ever-increasing role in correcting and/or verifying the deterministic, multi-level spatial decomposition methodology in current practice. However, the prohibitive computational requirements associated with obtaining fully converged, system-wide solutions restrict the role of MC to benchmarking deterministic results at a limited number of state-points for a limited number of relevant quantities. The goal of this research is to change this paradigm by enabling direct use of MC for full-core reactor analyses. The most significant of the many technical challenges that must be overcome are the slow, non-uniform convergence of system-wide MC estimates and the memory requirements associated with detailed solutions throughout a reactor (problems involving hundreds of millions of different material and tally regions due to fuel irradiation, temperature distributions, and the needs associated with multi-physics code coupling). To address these challenges, our research has focused on the development and implementation of (1) a novel hybrid deterministic/MC method for determining high-precision fluxes throughout the problem space in k-eigenvalue problems and (2) an efficient MC domain-decomposition (DD) algorithm that partitions the problem phase space onto multiple processors for massively parallel systems, with statistical uncertainty estimation. The hybrid method development is based on an extension of the FW-CADIS method, which attempts to achieve uniform statistical uncertainty throughout a designated problem space. The MC DD development is being implemented in conjunction with the Denovo deterministic radiation transport package to have direct access to the 3-D, massively parallel discrete-ordinates solver (to support the hybrid method) and the associated parallel routines and structure. This paper describes the hybrid method, its implementation, and initial testing results for a realistic 2-D quarter core pressurized-water reactor model and also describes the MC DD algorithm and its implementation.
This paper describes code and methods development at the Oak Ridge National Laboratory focused on enabling high-fidelity, large-scale reactor analyses with Monte Carlo (MC). Current state-of-the-art tools and methods used to perform ''real'' commercial reactor analyses have several undesirable features, the most significant of which is the non-rigorous spatial decomposition scheme. Monte Carlo methods, which allow detailed and accurate modeling of the full geometry and are considered the ''gold standard'' for radiation transport solutions, are playing an ever-increasing role in correcting and/or verifying the deterministic, multi-level spatial decomposition methodology in current practice. However, the prohibitive computational requirements associated with obtaining fully converged, system-wide solutions restrict the role of MC to benchmarking deterministic results at a limited number of state-points for a limited number of relevant quantities. The goal of this research is to change this paradigm by enabling direct use of MC for full-core reactor analyses. The most significant of the many technical challenges that must be overcome are the slow, non-uniform convergence of system-wide MC estimates and the memory requirements associated with detailed solutions throughout a reactor (problems involving hundreds of millions of different material and tally regions due to fuel irradiation, temperature distributions, and the needs associated with multi-physics code coupling). To address these challenges, our research has focused on the development and implementation of (1) a novel hybrid deterministic/MC method for determining high-precision fluxes throughout the problem space in k-eigenvalue problems and (2) an efficient MC domain-decomposition (DD) algorithm that partitions the problem phase space onto multiple processors for massively parallel systems, with statistical uncertainty estimation. The hybrid method development is based on an extension of the FW-CADIS method, which attempts to achieve uniform statistical uncertainty throughout a designated problem space. The MC DD development is being implemented in conjunction with the Denovo deterministic radiation transport package to have direct access to the 3-D, massively parallel discrete-ordinates solver (to support the hybrid method) and the associated parallel routines and structure. This paper describes the hybrid method, its implementation, and initial testing results for a realistic 2-D quarter core pressurized-water reactor model and also describes the MC DD algorithm and its implementation.
We describe a new model for the study of weakly collisional, magnetised plasmas derived from exploiting the separation of the dynamics parallel and perpendicular to the magnetic field. This unique system of equations retains the particle dynamics parallel to the magnetic field while approximating the perpendicular dynamics through a spectral expansion in the perpendicular degrees of freedom, analogous to moment-based fluid approaches. In so doing, a hybrid approach is obtained that is computationally efficient enough to allow for larger-scale modelling of plasma systems while eliminating a source of difficulty in deriving fluid equations applicable to magnetised plasmas. We connect this system of equations to historical asymptotic models and discuss advantages and disadvantages of this approach, including the extension of this parallel-kinetic-perpendicular moment beyond the typical region of validity of these more traditional asymptotic models. This paper forms the first of a multi-part series on this new model, covering the theory and derivation, alongside demonstration benchmarks of this approach that include shocks and magnetic reconnection.
We present the optical characterization of two-scale hierarchical phased-array antenna kinetic inductance detectors (KIDs) for millimeter/submillimeter wavelengths. Our KIDs have a lumped-element architecture with parallel plate capacitors and aluminum inductors. The incoming light is received with a hierarchical phased array of slot dipole antennas, split into 4 frequency bands (between 125 GHz and 365 GHz) with on-chip lumped-element band-pass filters, and routed to different KIDs using microstriplines. Individual pixels detect light for the 3 higher-frequency bands (190–365 GHz), and the signals from four individual pixels are coherently summed to create a larger pixel detecting light for the lowest frequency band (125–175 GHz). The spectral response of the band-pass filters was measured using Fourier transform spectroscopy (FTS), the far-field beam pattern of the phased-array antennas was obtained using an infrared source mounted on a 2-axis translating stage, and the optical efficiency of the KIDs was characterized by observing loads at 294 K and 77 K. We report on the results of these three measurements.
The anisotropic twofold symmetry of Ge(1 1 0) makes it a unique substrate for the growth of single-crystalline graphene. However, the underlying mechanism during the initial stage of growth of graphene on Ge(1 1 0) surface is not well understood. Here, we use in-situ cryogenic scanning tunneling microscopy (STM) and spectroscopy (STS), to study the initial growth properties of graphene synthesized on Ge(1 1 0) surface with ethylene precursor gases. The STM results reveal that the unidirectional growth of the graphene nanoribbons (GNRs) initiates from carbon cluster seeds on terraces during the early stage of the growth. The orientations of the GNRs show the same directions which are nearly parallel to the direction of the Ge(1 1 0) surface. This orientation is the same as that of the wafer-scale graphene grown on Ge(1 1 0). Subsequent growth, transformed the GNRs to graphene nanoislands (GNIs), which eventually coalesced to form single crystalline monolayer graphene. STS measurements demonstrated that the GNRs have small bandgaps induced by the confinement effect of graphene. Furthermore, this study provides an in-depth understanding of the growth mechanism of graphene on Ge(1 1 0) surface in various synthesis conditions.
ALMA (Anti-symmetric, Large-Moment, Accelerated) is a fast, flexible, and scalable toolkit designed to solve hyperbolic conservation law systems in hybrid supercomputers. Here this manuscript describes the theoretical background and implementation of ALMA, which uses the anti-symmetric formulation of fluids to obtain simple, robust, and easily paralellizable code. Practical GPU acceleration is realized on entire applications with an overall gain factor of 2 to 4. ALMA also provides a parallel, GPU accelerated sparse solver based on geometric multigrid, capable of diagonalizing linear systems with 239 unknowns. Here we demonstrate ALMA's scaling and performance in petascale supercomputers and use standard fluid models to verify the overall approach with canonical benchmark problems.
Non-volatile devices, such as SSDs, will be an integral part of the deepening storage hierarchy on large-scale HPC systems. These devices can be on the compute nodes as part of a distributed burst buffer service or they can be external. Wherever they are located in the hierarchy, one critical design issue is the SSD endurance under the write-heavy workloads, such as the checkpoint I/O for scientific applications. For these environments, it is widely assumed that checkpoint operations can occur once every 60 min and for each checkpoint step as much as half of the system memory can be written out. Unfortunately, for large-scale HPC applications, the burst buffer SSDs can be worn out much more quickly given the extensive amount of data written at every checkpoint step. One possible solution is to control the amount of data written by reducing the checkpoint frequency. However, a direct effect caused by reduced checkpoint frequency is the increased vulnerability window of system failures and therefore potentially wasted computation time, especially for large-scale compute jobs.
GronOR is a program package for nonorthogonal configuration interaction calculations. Electronic wave functions are constructed in terms of antisymmetrized products of multiconfiguration molecular fragment wave functions. The computational complexity of the nonorthogonal methodologies implemented in GronOR applied to large molecular assemblies requires a design that takes full advantage of massively parallel supercomputer architectures and accelerator technologies. This work describes the implementation strategy and resulting performance characteristics. In addition to parallelization and acceleration, the software development strategy includes aspects of fault resiliency and heterogeneous computing. The program was designed for large-scale supercomputers but also runs effectively on small clusters and workstations for small molecular systems. GronOR is available as open source to the scientific community.
A nonlinear equation similar to the Hasegawa-Mima equation for drift waves in dense quantum plasmas has been obtained. Therefore, electrostatic drift vortices can appear in nonuniform dense magnetoplasmas. These nonlinear structures can be of dipolar form as well as street-type vortices. It is noticed that these structures are formed on very short spatial scales. Further, it is discussed that quantum drift waves can couple with quantum ion acoustic waves, like classical plasmas, if the ion parallel dynamics is also considered.
The effective transverse behaviour of elastic materials periodically reinforced by linear parallel slender elastic inclusions is derived through the homogenization method of periodic media. Assuming the cell size (h) much smaller than the scale of macro deformation (L), and using scaling and the specificity induced by the 1D geometry of the inclusions, the macro-behaviour is established at the leading order of the scale ratio {epsilon} = h/L. A contrast between the shear modulus of the material and of the inclusions of the order of {epsilon}{sup 2} leads to a full coupling between the bending of the inclusions and the shear of the continuum matrix. The description is that of a generalized continua that accounts for the deformation and the curvature gradient at the leading order and differs differs from Cosserat media. When the contrast is decreased or increased the behaviour degenerate respectively into the Cauchy behaviour of elastic composite or Euler-Bernouilli beam behaviour.
One-dimensional (1D) nanostructure devices are at the frontline of studies on future electronics, although issues like massive parallelization, doping control, surface effects, and compatibility with silicon industrial requirements are still open challenges. The recent progresses in atomic to nanometer scale control of materials morphology, size, and composition including the growth of axial, radial, and branched nanowire (NW)-based heterostructures make the NW an ideal building block for implementing rectifying diodes or detectors that could be well operated into the Terahertz (THz), thanks to their typical achievable attofarad-order capacitance. Here, we report on our recent progresses in the development of 1D InAs or InAs/InSb NW-based field effect transistors exploiting novel morphologies and/or material combinations effective for addressing the goal of a semiconductor plasma-wave THz detector array technology. Through a critical review of material-related parameters (NW doping concentration, geometry, and/or material choice) and antenna-related issues, here we underline the crucial aspects that can affect detection performance across the THz frequency region.
We present results of a semianalytic model (SAM) that includes cold accretion and a porosity-based prescription for star formation. We can recover the puzzling observational results of low V/{sigma} seen in various massive disk or disk-like galaxies, if we allow 18% of the accretion energy from cold flows to drive turbulence in gaseous disks at z = 2. The increase of gas mass through cold flows is by itself not sufficient to increase the star formation rate sufficiently to recover the number density of M-dot{sub *}>120 M{sub odot} yr{sup -1} galaxies in our model. In addition, it is necessary to increase the star formation efficiency. This can be achieved naturally in the porosity model, where star formation efficiency scales {proportional_to}{sigma}, which scales as cloud velocity dispersion. As cold accretion is the main driver for gas velocity dispersion in our model, star formation efficiency parallels cold accretion rates and allows fast conversion into stars. At z {approx} 2, we find a space density 10{sup -4} Mpc{sup -3} in star-forming galaxies with M-dot{sub *}>120 M{sub odot} yr{sup -1}, in better agreement than earlier estimates from SAMs. However, the fundamental relation between M-dot{sub *} and M {sub *} is still offset from the observed relation, indicating the need for possibly more efficient star formation at high-z perhaps associated with a role for active galactic nucleus (AGN) triggering.
We present a new approach to handling the demanding I/O workload incurred during checkpoint writes encountered in High Performance Computing. Prior efforts to improve performance have been primarily bound by mechanical limitations of the hard drive. Our research surpasses this limitation by providing a method to: (1) write checkpoint data to a high-speed, non-volatile buffer, and (2) asynchronously write this data to permanent storage while resuming computation. This removes the hard drive from the critical data path because our I/O node based buffers isolate the compute nodes from the storage servers. This solution is feasible because of industry declines in cost for high-capacity, non-volatile storage technologies. Testing was conducted on a small-scale cluster to prove the design, and then scaled at Los Alamos National Laboratory. Results show a definitive speedup factor for select workloads over writing directly to a typical global parallel file system; the Panasas ActiveScale File System.
A surprising development in recently announced HPC platforms is the addition of, sometimes massive amounts of, persistent (nonvolatile) memory (NVM) in order to increase memory capacity and compensate for plateauing I/O capabilities. However, there are no portable and scalable programming interfaces using aggregate NVM effectively. This paper introduces Papyrus: a new software system built to exploit emerging capability of NVM in HPC architectures. Papyrus (or Parallel Aggregate Persistent -YRU- Storage) is a novel programming system that provides features for scalable, aggregate, persistent memory in an extreme-scale system for typical HPC usage scenarios. Papyrus mainly consists of Papyrus Virtual File System (VFS) and Papyrus Template Container Library (TCL). Papyrus VFS provides a uniform aggregate NVM storage image across diverse NVM architectures. It enables Papyrus TCL to provide a portable and scalable high-level container programming interface whose data elements are distributed across multiple NVM nodes without requiring the user to handle complex communication, synchronization, replication, and consistency model. We evaluate Papyrus on two HPC systems, including UTK Beacon and NERSC Cori, using real NVM storage devices.