Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “MPI characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Communication Characterization and Optimization of Applications Using Topology-Aware Task Mapping on Large Supercomputers

On large supercomputers, the job scheduling systems may assign a non-contiguous node allocation for user applications depending on available resources. With parallel applications using MPI (Message Passing Interface), the default process ordering does not take into account the actual physical node layout available to the application. This contributes to non-locality in terms of physical network topology and impacts communication performance of the application. In order to mitigate such performance penalties, this work describes techniques to identify suitable task mapping that takes the layout of the allocated nodes as well as the application's communication behavior into account. During the first phase of this research, we instrumented and collected performance data to characterize communication behavior of critical US DOE (United States - Department of Energy) applications using an augmented version of the mpiP tool. Subsequently, we developed several reordering methods (spectral bisection, neighbor join tree etc.) to combine node layout and application communication data for optimized task placement. We developed a tool called mpiAproxy to facilitate detailed evaluation of the various reordering algorithms without requiring full application executions. This work presents a comprehensive performance evaluation (14,000 experiments) of the various task mapping techniques in lowering communication costs on Titan, the leadership class supercomputer at Oak Ridge National Laboratory.

Sreepathi, Sarat↗

Characterization of passive oxide film on a Ti-5%Ta-1.8%Nb alloy on exposure to severe oxidizing conditions

This paper presents the results of a study on the characteristics of the passive oxide film that forms on the surface of an {alpha} + {beta} Ti-5%Ta-1.8%Nb alloy, which possesses good corrosion resistance in severe oxidizing environment of boiling 11.5 M nitric acid. Through systematic structure-property studies, the microstructure with low corrosion rate (< 1 mpy) in liquid, vapor and condensate phases of nitric acid was identified. The characteristics of the passive film, which imparts corrosion resistance to the alloy, are influenced by its microstructure, temperature and concentration of the acid. The microstructure, thickness and composition of the oxide film were characterized using different techniques. TiO{sub 2}, Nb{sub 2}O{sub 5} and Ta{sub 2}O{sub 5} formed on exposure to vapor and condensate phases, while TiO{sub 2} was observed on exposure to the liquid phase. Detailed microstructural studies showed that the passive film consists of nano-crystalline phases of titanium and tantalum oxides, predominantly anatase in an amorphous matrix. Based on these studies, the mechanism of corrosion of the alloy is derived. - Research Highlights: {yields}Liquid phase corrosion results in a thicker and protective oxide film. {yields}Oxide film is a mixture of amorphous and nano-crystalline anatase. {yields}Higher amounts of Nb{sub 2}O{sub 5} and Ta{sub 2}O{sub 5} form on vapor and condensate phase corrosion. {yields}High corrosion rate in condensate phase is due to selective dissolution of Ti in {alpha} phase.

36 MATERIALS SCIENCE↗

Towards understanding HPC users and systems: A NERSC case study

High performance computing (HPC) scheduling landscape currently faces new challenges due to thechanges in the workload. Previously, HPC centers were dominated by tightly coupled MPI jobs. HPCworkloads increasingly include high-throughput, data-intensive, and stream-processing applications. Asa consequence, workloads are becoming more diverse at both application and job levels, posing newchallenges to classical HPC schedulers. There is a need to understand the current HPC workloads andtheir evolution to facilitate informed future scheduling research and enable efficient scheduling in futureHPC systems.In this paper, we present a methodology to characterize workloads and assess their heterogeneity,at a particular time period and its evolution over time. We apply this methodology to the workloads ofthree systems (Hopper, Edison, and Carver) at the National Energy Research Scientific Computing Center(NERSC). We present the resulting characterization of jobs, queues, heterogeneity, and performance thatincludes detailed information of a year of workload (2014) and evolution through the systems’ lifetime(2010–2014).

Rodrigo, Gonzalo P.↗

Algorithm for solving the linear Cauchy problem for large systems of ordinary differential equations with the use of parallel computations

An algorithm for solving the linear Cauchy problem for large systems of ordinary differential equations is presented. The algorithm for systems of first-order differential equations is implemented in the EDELWEISS code with the possibility of parallel computations on supercomputers employing the MPI (Message Passing Interface) standard for the data exchange between parallel processes. The solution is represented by a series of orthogonal polynomials on the interval [0, 1]. The algorithm is characterized by simplicity and the possibility to solve nonlinear problems with a correction of the operator in accordance with the solution obtained in the previous iterative process.

74 ATOMIC AND MOLECULAR PHYSICS↗

Methodology and Application of HPC I/O Characterization with MPIProf and IOT

Combining the strengths of MPIProf and IOT, an efficient and systematic method is devised for I/O characterization at the per-job, per-rank, per-file and per-call levels of HPC programs running on the NASA Advanced Supercomputing Center. This method is applied to answer four I/O questions in this paper. A total of 13 MPI programs and 15 cases, ranging from 24 to 5968 ranks, are analyzed to establish the I/O landscape from answers to the four questions. Four of the 13 programs use MPI I/O and the behavior of their collective writes depends on the specific implementation of the MPI library used. The SGI MPT library, the prevailing MPI library for our systems, was found to gather small writes from a large number of ranks to perform larger writes by a small subset of collective buffering ranks. The number of collective buffering ranks invoked by MPT depends on the Lustre stripe count and the number of nodes used for the run. A demonstration of varying the stripe count to achieve double-digit speedup of one program's I/O was presented. Another program, which concurrently opens private files by all ranks and could potentially create a heavy load on the Lustre servers, was identified. The ability to systematically characterize I/O for a large number of programs running on a supercomputer, seek I/O optimization opportunity and identify programs that could cause a high load and instability on the filesystems is important for pursuing exascale in a real production environment.

Characterization↗

GPU-accelerated red blood cells simulations with transport dissipative particle dynamics

Mesoscopic numerical simulations provide a unique approach for the quantification of the chemical influences on red blood cell functionalities. The transport Dissipative Particle Dynamics (tDPD) method can lead to such effective multiscale simulations due to its ability to simultaneously capture mesoscopic advection, diffusion, and reaction. In this paper, we present a GPU-accelerated red blood cell simulation package based on a tDPD adaptation of our red blood cell model, which can correctly recover the cell membrane viscosity, elasticity, bending stiffness, and cross-membrane chemical transport. The package essentially processes all computational workloads in parallel by GPU, and it incorporates multi-stream scheduling and non-blocking MPI communications to improve inter-node scalability. Our code is validated for accuracy and compared against the CPU counterpart for speed. Strong scaling and weak scaling are also presented to characterize scalability. We observe a speedup of on one GPU over all cores within a single node, and a weak scaling efficiency of across nodes. The program enables quick-turnaround and high-throughput numerical simulations for investigating chemical-driven red blood cell phenomena and disorders.

Computer Science↗

A Reference Implementation for a Quantum Message Passing Interface

Practical applications of quantum computing are currently limited by the number of qubits that can be set with reasonable fidelities for each system. Therefore, a distributed quantum computing system with multiple quantum computers coherently connected is highly demanding. To realize the internode communication of quantum information, the software interface, Quantum Message Passing Interface (QMPI), leveraging the framework built for classical MPI but taking advantage of quantum teleportation to communicate between different quantum nodes was proposed. In this project, we develop the QMPI with point-to-point and collective operations in Qiskit and characterize its performance by demonstrating the application implementations. Moreover, we developed a new technique for optimizing collective communication of the distributed quantum programs with Multi-Controlled Toffoli gates. This technique beats the state-of-the-art in terms of fidelity and the number of remote EPR pairs consumed in both simulations and experiments.

Shi, Yue↗

Exploration of Nirmatrelvir Derivatives as Optimized SARS‐CoV‐2 Antivirals

Nirmatrelvir (NMV) is a SARS‐CoV‐2 antiviral component of the approved COVID‐19 therapeutic Paxlovid. It is a reversible covalent inhibitor of SARS‐CoV‐2 main protease (M Pro ) that is effluxed from human cells by P‐glycoprotein (P‐gp). To identify NMV analogs with improved potency and reduced P‐gp efflux, a structure–activity relationship campaign was conducted. Warheads alternative to nitrile for engaging the active site cysteine were tested showing aldehyde and dichloroacetamide with better enzyme inhibition potency. Crystal structure of MPI‐136−M Pro shows its aldehyde warhead forming a thiohemiacetal with active Cys145 of M Pro . Several S4 binders were explored revealing that an O‐to‐S shift at the N ‐terminal amide leads to better enzyme inhibition. By exploring different combinations of S2, S3, and S4 binders, two inhibitors with better enzyme inhibition potency than NMV were found. Crystal structure of MPI‐148, with ( S )‐2‐azaspiro[4,5]decane‐3‐carboxylate as an alternative S2 binder, shows extensive hydrogen‐bond networks for locking the inhibitor in active site, explaining high affinity of NMV analogs. Further characterization of cellular M Pro engagement and antiviral potency against SARS‐CoV‐2 revealed four inhibitors with greater potency than NMV in P‐gp‐expressing cells. Studies with the P‐gp inhibitor CP‐100356 showed that these compounds were less sensitive to P‐gp inhibition than NMV, consistent with reduced P‐gp‐mediated efflux.

Alugubelli, Yugendar R. [Texas A&M Drug Discovery ↗

Fast Fault Injection and Sensitivity Analysis for Collective Communications, In: 2015 IEEE International Conference on Cluster Computing

The collective communication operations, which are widely used in parallel applications for global communication and synchronization are critical for application's performance and scalability. However, how faulty collective communications impact the application and how errors propagate between the application processes is largely unexplored. One of the critical reasons for this situation is the lack of fast evaluation method to investigate the impacts of faulty collective operations. The traditional random fault injection methods relying on a large amount of fault injection tests to ensure statistical significance require a significant amount of resources and time. These methods result in prohibitive evaluation cost when applied to the collectives. In this paper, we introduce a novel tool named Fast Fault Injection and Sensitivity Analysis Tool (FastFIT) to conduct fast fault injection and characterize the application sensitivity to faulty collectives. The tool achieves fast exploration by reducing the exploration space and predicting the application sensitivity using Machine Learning (ML) techniques. A basis for these techniques are implicit correlations between MPI semantics, application context, critical application features, and application responses to faulty collective communications. The experimental results show that our approach reduces the fault injection points and tests by 97% for representative benchmarks (NAS Parallel Benchmarks (NPB)) and a realistic application (Large-scale Atomic/Molecular Massively Parallel Simulator (LAMMPS)) on a production supercomputer. Further, we statistically generalize the application sensitivity to faulty collective communications for these workloads, and present correlation between application features and the sensitivity.

Computer Science↗

Design and Performance Characterization of RADICAL-Pilot on Leadership-Class Platforms

Many extreme scale scientific applications have workloads comprised of a large number of individual highperformance tasks. The Pilot abstraction decouples workload specification, resource management, and task execution via job placeholders and late-binding. As such, suitable implementations of the Pilot abstraction can support the collective execution of large number of tasks on supercomputers. We introduce RADICAL-Pilot (RP) as a portable, modular and extensible Pilot enabled runtime system. We describe RP's design, architecture and implementation. We characterize its performance and show its ability to scalably execute workloads comprised of tens of thousands heterogeneous tasks on DOE and NSF leadership-class HPC platforms. Specifically, we investigate RP's weak/strong scaling with CPU/GPU, single/multi core, (non)MPI tasks and python functions when using most of ORNL Summit and TACC Frontera. RADICAL-Pilot can be used stand-alone, as well as the runtime for third-party workflow systems.

97 MATHEMATICS AND COMPUTING↗

Characterization of UMT2013 Performance on Advanced Architectures

This paper presents part of a larger effort to make detailed assessments of several proxy applications on various advanced architectures, with the eventual goal of extending these assessments to codes of programmatic interest running more realistic simulations. The focus here is on UMT2013, a proxy implementation of deterministic transport for unstructured meshes. I present weak and strong MPI scaling results and studies of OpenMP efficiency on the Sequoia BG/Q system at LLNL, with comparison against similar tests on an Intel Sandy Bridge TLCC2 system. The hardware counters on BG/Q provide detailed information on many aspects of on-node performance, while information from the mpiP tool gives insight into the reasons for the differing scaling behavior on these two different architectures. Preliminary tests that exploit NVRAM as extended memory on an Ivy Bridge machine designed for “Big Data” applications are also included.

97 MATHEMATICS AND COMPUTING↗

High Resolution Aerospace Applications using the NASA Columbia Supercomputer

This paper focuses on the parallel performance of two high-performance aerodynamic simulation packages on the newly installed NASA Columbia supercomputer. These packages include both a high-fidelity, unstructured, Reynolds-averaged Navier-Stokes solver, and a fully-automated inviscid flow package for cut-cell Cartesian grids. The complementary combination of these two simulation codes enables high-fidelity characterization of aerospace vehicle design performance over the entire flight envelope through extensive parametric analysis and detailed simulation of critical regions of the flight envelope. Both packages. are industrial-level codes designed for complex geometry and incorpor.ats. CuStomized multigrid solution algorithms. The performance of these codes on Columbia is examined using both MPI and OpenMP and using both the NUMAlink and InfiniBand interconnect fabrics. Numerical results demonstrate good scalability on up to 2016 CPUs using the NUMAIink4 interconnect, with measured computational rates in the vicinity of 3 TFLOP/s, while InfiniBand showed some performance degradation at high CPU counts, particularly with multigrid. Nonetheless, the results are encouraging enough to indicate that larger test cases using combined MPI/OpenMP communication should scale well on even more processors.

Mavriplis, Dimitri J.↗

What Scientific Applications can Benefit from Hardware Transactional Memory?

Achieving efficient and correct synchronization of multiple threads is a difficult and error-prone task at small scale and, as we march towards extreme scale computing, will be even more challenging when the resulting application is supposed to utilize millions of cores efficiently. Transactional Memory (TM) is a promising technique to ease the burden on the programmer, but only recently has become available on commercial hardware in the new Blue Gene/Q system and hence the real benefit for realistic applications has not been studied, yet. This paper presents the first performance results of TM embedded into OpenMP on a prototype system of BG/Q and characterizes code properties that will likely lead to benefits when augmented with TM primitives. We first, study the influence of thread count, environment variables and memory layout on TM performance and identify code properties that will yield performance gains with TM. Second, we evaluate the combination of OpenMP with multiple synchronization primitives on top of MPI to determine suitable task to thread ratios per node. Finally, we condense our findings into a set of best practices. These are applied to a Monte Carlo Benchmark and a Smoothed Particle Hydrodynamics method. In both cases an optimized TM version, executed with 64 threads on one node, outperforms a simple TM implementation. MCB with optimized TM yields a speedup of 27.45 over baseline.

97 MATHEMATICS AND COMPUTING↗

Characterization of Proxy Application Performance on Advanced Architectures. UMT2013, MCB, AMG2013

Three codes were tested at LLNL as part of a Tri-Lab effort to make detailed assessments of several proxy applications on various advanced architectures, with the eventual goal of extending these assessments to codes of programmatic interest running more realistic simulations. Teams from Sandia and Los Alamos tested proxy apps of their own. The focus in this report is on the LLNL codes UMT2013, MCB, and AMG2013. We present weak and strong MPI scaling results and studies of OpenMP efficiency on a large BG/Q system at LLNL, with comparison against similar tests on an Intel Sandy Bridge TLCC2 system. The hardware counters on BG/Q provide detailed information on many aspects of on-node performance, while information from the mpiP tool gives insight into the reasons for the differing scaling behavior on these two different architectures. Results from three more speculative tests are also included: one that exploits NVRAM as extended memory, one that studies performance under a power bound, and one that illustrates the effects of changing the torus network mapping on BG/Q.

97 MATHEMATICS AND COMPUTING↗

Adaptable Metadata Rich IO Methods for Portable High Performance IO

Since IO performance on HPC machines strongly depends on machine characteristics and configuration, it is important to carefully tune IO libraries and make good use of appropriate library APIs. For instance, on current petascale machines, independent IO tends to outperform collective IO, in part due to bottlenecks at the metadata server. The problem is exacerbated by scaling issues, since each IO library scales differently on each machine, and typically, operates efficiently to different levels of scaling on different machines. With scientific codes being run on a variety of HPC resources, efficient code execution requires us to address three important issues: (1) end users should be able to select the most efficient IO methods for their codes, with minimal effort in terms of code updates or alterations; (2) such performance-driven choices should not prevent data from being stored in the desired file formats, since those are crucial for later data analysis; and (3) it is important to have efficient ways of identifying and selecting certain data for analysis, to help end users cope with the flood of data produced by high end codes. This paper employs ADIOS, the ADaptable IO System, as an IO API to address (1)-(3) above. Concerning (1), ADIOS makes it possible to independently select the IO methods being used by each grouping of data in an application, so that end users can use those IO methods that exhibit best performance based on both IO patterns and the underlying hardware. In this paper, we also use this facility of ADIOS to experimentally evaluate on petascale machines alternative methods for high performance IO. Specific examples studied include methods that use strong file consistency vs. delayed parallel data consistency, as that provided by MPI-IO or POSIX IO. Concerning (2), to avoid linking IO methods to specific file formats and attain high IO performance, ADIOS introduces an efficient intermediate file format, termed BP, which can be converted, at small cost, to the standard file formats used by analysis tools, such as NetCDF and HDF-5. Concerning (3), associated with BP are efficient methods for data characterization, which compute attributes that can be used to identify data sets without having to inspect or analyze the entire data contents of large files.

97 MATHEMATICS AND COMPUTING↗

Workshop on Extraterrestrial Materials from Cold and Hot Deserts

The workshop was held July 6-8, 1999 before the Meteoritical Society meeting in Johannesburg, South Africa. The venue was Kwa Maritane Resort in the Pilanesburg Game Reserve. Conveners were Ludolf Schultz (Chair, MPI fur Chemie), Ian Franchi (Open University), Arch Reid (University of Houston), and Mike Zolensky (NASA JSC). Extended abstracts will be published as an LPI Technical Report. In the first session, Marvin discussed three African iron meteorites: Cape of Good Hope, Gibeon, and Hoba. Grady presented a statistical analysis of meteorites from hot and cold deserts. Wasson discussed types of Antarctic iron meteorites. Several presentations characterized populations of meteorites from individual desert areas: Libyan Desert (Weber et al.), Nullarbor Region (Bevan et al.), and Mojave Desert (Kring et al. and Verish et al). Pairing among EET87503-group howardites was discussed by Buchanan et al. Based on 14C terrestrial ages of Allan Hills ordinary chondrites, Bland et al. suggested that ice flow may be the principal sink for Antarctic meteorites. The effects of preterrestrial and terrestrial alteration were considered in the second session. Nakamura et al. and Lipschutz discussed asteroidal metamorphism of carbonaceous chondrites. Zolensky presented evidence for preterrestrial halide and sulfide in meteorites. Crozaz and Wadhwa described terrestrial alteration of Dar al Gani 476. Welten and Nishiizumi discussed terrestrial weathering of chondrites from Frontier Mountain, Antarctica. Most of the third session dealt with terrestrial meteorite ages. Based on 14C-10Be ages, Jull et al. discussed the exponential decay in numbers of meteorites with increased age. Nishiizumi et al. concluded that some Allan Hills meteorites have much older terrestrial ages than any meteorites from Lewis Cliffs. Welten et al. discussed terrestrial ages determined by 41Ca/36CI of metal separates from hot desert meteorites. Based on a comparison with large IDPs, Flynn et al. suggested that polar micrometeorites, lost a water-soluble sulfate phase by terrestrial alteration. Nyquist suggested that Type I cosmic spheres from deep sea sediments and polar ice were derived from carbonaceous chondrite-like asteroidal sources. The final session considered noble gases, cosmic ray effects, and thermoluminescence. Calculations presented by Reedy indicate that cosmic ray-produced nuclides are more likely to be preserved in small objects than in larger objects. Murty and Mohapatra. reported that trapped gas in Dar al Gani 476 includes a Martian atmospheric component. Wieler et al. and Scherer et al. reported noble gas abundances in different types of desert meteorites. Patzer and Schultz discussed the influence of terrestrial weathering on cosmic ray exposure ages of enstatite chondrites. Franchi et al. suggested that it is difficult to discriminate whether differences in gas release profiles of lunar meteorites from hot deserts and returned lunar samples are the result of terrestrial weathering or shock metamorphism. Benoit and Sears surveyed natural and induced thermoluminescence of Antarctic ordinary chondrites. Merchel et al. analyzed Saharan meteorites with short or complex exposure histories.

Buchanan, Paul C.↗

CLOMP: Accurately Characterizing OpenMP Application Overheads

Despite its ease of use, OpenMP has failed to gain widespread use on large scale systems, largely due to its failure to deliver sufficient performance. Our experience indicates that the cost of initiating OpenMP regions is simply too high for the desired OpenMP usage scenario of many applications. In this paper, we introduce CLOMP, a new benchmark to characterize this aspect of OpenMP implementations accurately. CLOMP complements the existing EPCC benchmark suite to provide simple, easy to understand measurements of OpenMP overheads in the context of application usage scenarios. Our results for several OpenMP implementations demonstrate that CLOMP identifies the amount of work required to compensate for the overheads observed with EPCC.We also show that CLOMP also captures limitations for OpenMP parallelization on SMT and NUMA systems. Finally, CLOMPI, our MPI extension of CLOMP, demonstrates which aspects of OpenMP interact poorly with MPI when MPI helper threads cannot run on the NIC.

99 GENERAL AND MISCELLANEOUS↗

IGMS: An Integrated ISO-to-Appliance Scale Grid Modeling System

This paper describes the Integrated Grid Modeling System (IGMS), a novel electric power system modeling platform for integrated transmission-distribution analysis that co-simulates off-the-shelf tools on high performance computing (HPC) platforms to offer unprecedented resolution from ISO markets down to appliances and other end uses. Specifically, the system simultaneously models hundreds or thousands of distribution systems in co-simulation with detailed Independent System Operator (ISO) markets and AGC-level reserve deployment. IGMS uses a new MPI-based hierarchical co-simulation framework to connect existing sub-domain models. Our initial efforts integrate opensource tools for wholesale markets (FESTIV), bulk AC power flow (MATPOWER), and full-featured distribution systems including physics-based end-use and distributed generation models (many instances of GridLAB-D[TM]). The modular IGMS framework enables tool substitution and additions for multi-domain analyses. This paper describes the IGMS tool, characterizes its performance, and demonstrates the impacts of the coupled simulations for analyzing high-penetration solar PV and price responsive load scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗