Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Towards Scalable Optimal Sequence Homology Detection

Abstract—The field of bioinformatics and computational biol- ogy is experiencing a data revolution — experimental techniques to procure data have increased in throughput, improved in accuracy and reduced in costs. This has spurred an array of high profile sequencing and data generation projects. While the data repositories represent untapped reservoirs of rich information critical for scientific breakthroughs, the analytical software tools that are needed to analyze large volumes of such sequence data have significantly lagged behind in their capacity to scale. In this paper, we address homology detection, which is a funda- mental problem in large-scale sequence analysis with numerous applications. We present a scalable framework to conduct large- scale optimal homology detection on massively parallel super- computing platforms. Our approach employs distributed memory work stealing to effectively parallelize optimal pairwise alignment computation tasks. Results on 120,000 cores of the Hopper Cray XE6 supercomputer demonstrate strong scaling and up to 2.42 × 107 optimal pairwise sequence alignments computed per second (PSAPS), the highest reported in the literature.

Daily, Jeffrey A.↗

Dynamic Equivalence of Large-Scale Power Systems Based on Boundary Measurements

Parallel computing helped speed up many tasks that can be done independently. The advance in gaming industry did not produce a technology that helps the power industry to reduce the computation time for dynamic simulation in individual cases. To perform faster than real-time simulation for the purpose of predicting power system dynamic trajectory, power industry continues to struggle to reduce the system size and simulation time of large-scale power systems while keeping its dynamic behavior under various disturbances. There is also an acute need for real-time dynamic model reduction as more renewables enter the generation mix with dramatic changes in the generation outputs. All existing model reduction solutions are based on having access to a detailed dynamic model of the system. The system changes by the minutes, dynamic models are only updated annually. To solve this problem, wide-area measurements obtained by the phasor measurement unit (PMU) at the boundaries between the reduced system and the study system is used to represent the external area. An artificial neuro-fuzzy inference system (ANFIS) is established to perform the mapping of the measurement to the external equivalent model. Here the external area is regarded as a black-box. Model reduction studies are conducted on the Northeast Power Coordinating Council (NPCC) under various types of contingencies, by using a co-simulation approach between PSS/E and MATLAB. The results look very promising and will be discussed in this paper.

Tong, Ning↗

Massively parallel solvers for elliptic partial differential equations in numerical weather and climate prediction

The demand for substantial increases in the spatial resolution of global weather and climate prediction models makes it essential to use numerically efficient and highly scalable algorithms to solve the equations of large-scale atmospheric fluid dynamics. For stability and efficiency reasons, several of the operational forecasting centres, in particular the Met Office and the European Centre for Medium-Range Weather Forecasts (ECMWF) in the UK, use semi-implicit semi-Lagrangian time-stepping in the dynamical core of the model. The additional burden with this method is that a three-dimensional elliptic partial differential equation (PDE) for the pressure correction has to be solved at every model time step and this often constitutes a significant proportion of the time spent in the dynamical core. In global models, this PDE must be solved in a thin spherical shell. To run within tight operational time-scales, the solver has to be parallelized and there seems to be a (perceived) misconception that elliptic solvers do not scale to large processor counts and hence implicit time-stepping cannot be used in very high-resolution global models. After reviewing several methods for solving the elliptic PDE for the pressure correction and their application in atmospheric models, we demonstrate the performance and very good scalability of Krylov subspace solvers and multigrid algorithms for a representative model equation with more than 1010 unknowns on 65 536 cores on the High-End Computing Terascale Resource (HECToR), the UK's national supercomputer. Here, we tested and optimized solvers from two existing numerical libraries (the Distributed and Unified Numerics Environment (DUNE) and Parallel High Performance Preconditioners (hypre)) and implemented both a conjugate gradient solver and a geometric multigrid algorithm based on a tensor-product approach, which exploits the strong vertical anisotropy of the discretized equation. We study both weak and strong scalability and compare the absolute solution times for all methods; in contrast to one-level methods, the multigrid solver is robust with respect to parameter variations.

58 GEOSCIENCES↗

SPARC-X: Quantum simulations at extreme scale - reactive dynamics from first principles

We have developed the massively parallel electronic structure code SPARC-X: a computational framework for performing Kohn-Sham Density Functional Theory (DFT) calculations that can scale linearly with the number of atoms in the system, while being able to leverage petascale and emerging exascale parallel computers to study chemical phenomena at unprecedented length and time scales. SPARC-X exploits a recent breakthrough in electronic structure methodologies: systematically improvable, strictly local, orthonormal, discontinuous real-space bases that efficiently and systematically capture the local chemistry of the system. With further adaptation using new machine-learning techniques and the use of the massively parallel Spectral Quadrature (SQ) electronic structure method, the algorithmic complexity and prefactor associated with DFT calculations involving semilocal as well as hybrid functionals are dramatically reduced. Using petascale computational resources, SPARC-X enables quantum mechanical simulations at length and time scales previously accessible only by empirical approaches, e.g., 1,000,000 atoms for a few picoseconds using semilocal functionals or 1,000 atoms for a few picoseconds using hybrid functionals. Using exascale resources, the sizes and times targeted are two orders of magnitude larger. Such a capability has applications in a wide variety of chemical sciences, including reactive interfaces where large length- and/or long time-scales are needed and traditional force fields fail. This is particularly important in dynamic catalysis, where bond breaking and formation must be understood in detail. We developed, tested, and employed the SPARC-X framework to understand the photocatalytic properties of TiO 2 nanoparticles, revealing finite size effects that cannot be captured with standard model systems or functionals. This integrated development and application strategy ensures that SPARC-X remains a robust, efficient, and scalable software package for quantum simulations on current petascale and emerging exascale computing resources.

97 MATHEMATICS AND COMPUTING↗

Turbulence driven widening of the near-SOL power width in ASDEX Upgrade H-Mode discharges

Divertor heat flux data from infra red (IR) from various tokamaks in H-Mode regime show that the power width, $\lambda_{q}$, scales approximately like 1.6 $(R/a) ρ_{s,pol}$. However, the IR based scaling comes with the restriction that only discharges were considered with attached divertor conditions. Here we set up a new data base covering low edge density data but also including high density plasmas reaching the H-mode density limit. We use Thomson-scattering to measure the electron temperature decay length which will set the near-SOL power width through parallel heat conduction. We present scaling results for the density, temperature and pressure separatrix fall-off lengths. As the principal result we derive a generalized power width scaling which reads as $\lambda_{q}\propto\,\rho_{s,pol}\cdot(1+2.1\alpha_{t}^{1.7})$ where $\alpha_{t}$ describes a normalized collisionality ($\alpha_{t} = 3\cdot\,10^{-18}\,R\,q^2\,n\,Z_{eff}T^{-2}$). The parameter $\alpha_{t}$ describes the relative importance of the interchange effect on drift-wave turbulence as proposed by Scott and is found to be closely linked to the diamagnetic parameter αd introduced by Rogers, Drake and Zeiler (RDZ). The edge operational space for ASDEX Upgrade displays a boundary qualitatively in agreement with the region labelled as density limit in the edge plasma phase space proposed by RDZ. The data base shows in the limit of low edge densities ($\alpha_{t}\simeq\,0.2$) accurate agreement to the IR based power width scaling. At elevated separatrix densities ($\alpha_{t}\simeq\,1$) the power width is broadened by a factor of up to about three accompanied by a reduction of the $\text{H}_{98,y2}$ confinement factor. Finally, plasmas with higher triangularity show higher values for $\text{H}_{98,y2}$ in the same range of normalized collisionality.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Ultrascalable petaflop parallel supercomputer

A massively parallel supercomputer of petaOPS-scale includes node architectures based upon System-On-a-Chip technology, where each processing node comprises a single Application Specific Integrated Circuit (ASIC) having up to four processing elements. The ASIC nodes are interconnected by multiple independent networks that optimally maximize the throughput of packet communications between nodes with minimal latency. The multiple networks may include three high-speed networks for parallel algorithm message passing including a Torus, collective network, and a Global Asynchronous network that provides global barrier and notification functions. These multiple independent networks may be collaboratively or independently utilized according to the needs or phases of an algorithm for optimizing algorithm processing performance. The use of a DMA engine is provided to facilitate message passing among the nodes without the expenditure of processing resources at the node.

97 MATHEMATICS AND COMPUTING↗

Influence of Vane Trailing Edge Flow on the Formation of Cavity Cells and Rim Sealing

Abstract Hot gas ingestion into the turbine rim seal cavity is an important concern for engine designers. To prevent ingestion, rim seals use high-pressure purge flow; however, the penalty is that excessive use of the purge flow decreases engine thermal efficiency. In this paper, a one-stage turbine operating at engine-representative conditions was used to study the effect of steady and time-resolved under-platform cavity temperatures and pressures across a range of coolant flowrates in the presence of vane trailing edge (VTE) flow. This study correlates time-resolved pressure with time-resolved temperature to identify primary frequencies driving ingestion. At certain flowrates, the time-resolved pressures are out of phase with the temperatures, indicating ingestion. Measurements from high-frequency response pressure sensors in the rim seal and vane platform were also used to determine rotational speed and quantity of large-scale structures (cells). In a parallel effort, a computational model using Unsteady Reynolds-averaged Navier–Stokes (URANS) was applied to determine swirl ratio in the rim seal cavity and time-resolved rim sealing effectiveness. The experimental results confirm that at low purge flowrates, the VTE flow influences the unsteady flow field by decreasing pressure unsteadiness in the rim seal cavity. Results show an increase in purge flow increases the number of unsteady large-scale structures in the rim seal and decreases their rotational speed. However, VTE flow was shown to not significantly change the cell speed and count in the rim seal. Simulations point to the importance of the large-scale cell structures in influencing rim sealing unsteadiness, which is not captured in current rim sealing predictive models.

Engineering↗

Understanding Soot Development and Thermal Stratification in Combustion Engines through Hyperspectral Non-linear Optical Diagnostics Development

Progress towards next-generation internal combustion engine technologies is dramatically hindered by the complexity of both simulating and measuring key processes, such as thermal stratification and soot formation, in an operating prototype. In general, spectroscopic methods for in-operando probing become limitingly complex at the high pressures and temperature encountered in such systems, and numerical methods for simulating device performance become computationally expensive due to the turbulent flow field, detailed chemistry, and range of important length-scales involved. This report presents parallel experimental and theoretical advances to conquer these limitations. We report the development of high pressure and high temperature ultrafast coherent anti-Stokes Raman spectroscopy measurements, up to a pressure and temperature regime relevant to engine conditions. This report also presents theoretical results using a stochastic one-dimensional turbulence (ODT) model providing insight into the local thermochemical state and its consequences by resolving the full range of reaction-diffusion scales in a stochastic model.

36 MATERIALS SCIENCE↗

Statistical properties of the population of the Galactic centre filaments – II. The spacing between filaments

ABSTRACT We carry out a population study of magnetized radio filaments in the Galactic centre using MeerKAT data by focusing on the spacing between the filaments that are grouped. The morphology of a sample of 43 groupings containing 174 magnetized radio filaments are presented. Many grouped filaments show harp-like, fragmented cometary tail-like, or loop-like structures in contrast to many straight filaments running mainly perpendicular to the Galactic plane. There are many striking examples of a single filament splitting into two prongs at a junction, suggestive of a flow of plasma along the filaments. Spatial variations in spectral index, brightness, bending, and sharpening along the filaments indicate that they are evolving on a 105−6-yr time-scale. The mean spacings between parallel filaments in a given grouping peaks at ∼16 arcsec. We argue by modeling that the filaments in a grouping all lie on the same plane and that the groupings are isotropically oriented in 3D space. One candidate for the origin of filamentation is interaction with an obstacle, which could be a compact radio source, before a filament splits and bends into multiple filaments. In this picture, the obstacle or sets the length scale of the separation between the filaments. Another possibility is synchrotron cooling instability occurring in cometary tails formed as a result of the interaction of cosmic ray driven Galactic centre outflow with obstacles such as stellar winds. In this picture, the mean spacing and the mean width of the filaments are expected to be a fraction of a parsec, consistent with observed spacing.

79 ASTRONOMY AND ASTROPHYSICS↗

Simplifying Performance Analysis of Large-scale Adaptive Scientific Applications

Performance analysis of parallel scientific codes is becoming increasingly difficult due to the rapidly growing complexity of applications and architectures. Existing tools fall short in providing intuitive views that facilitate the process of performance debugging and tuning. In this paper, we exploit a recent idea of projecting and visualizing performance data on the communication and hardware domain for faster, more intuitive analysis of applications. We leverage several performance analysis and visualization tools to showcase the discovery of scalability bottlenecks in a structured AMR library. Using novel techniques to project per-phase timing data, application data, and communication data on a communication graph, we identify a previously elusive scaling bottleneck in the library. We present solutions that mitigate this problem, resulting in 22% improvement in the performance for a 65,536-core run on an IBM Blue Gene/P system.

97 MATHEMATICS AND COMPUTING↗

Saturation of Gyrokinetic Turbulence through Damped Eigenmodes

In the context of toroidal gyrokinetic simulations, it is shown that a hierarchy of damped modes is excited in the nonlinear turbulent state. These modes exist at the same spatial scales as the unstable eigenmodes that drive the turbulence. The larger amplitude subdominant modes are weakly damped and exhibit smooth, large-scale structure in velocity space and in the direction parallel to the magnetic field. Modes with increasingly fine-scale structure are excited to decreasing amplitudes. In aggregate, damped modes define a potent energy sink. This leads to an overlap of the spatial scales of energy injection and peak dissipation, a feature that is in contrast with more traditional turbulent systems.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Athena++ Adaptive Mesh Refinement Framework: Design and Magnetohydrodynamic Solvers

The design and implementation of a new framework for adaptive mesh refinement calculations are described. It is intended primarily for applications in astrophysical fluid dynamics, but its flexible and modular design enables its use for a wide variety of physics. The framework works with both uniform and nonuniform grids in Cartesian and curvilinear coordinate systems. It adopts a dynamic execution model based on a simple design called a "task list" that improves parallel performance by overlapping communication and computation, simplifies the inclusion of a diverse range of physics, and even enables multiphysics models involving different physics in different regions of the calculation. We describe physics modules implemented in this framework for both nonrelativistic and relativistic magnetohydrodynamics (MHD). These modules adopt mature and robust algorithms originally developed for the Athena MHD code and incorporate new extensions: support for curvilinear coordinates, higher-order time integrators, more realistic physics such as a general equation of state, and diffusion terms that can be integrated with super-time-stepping algorithms. The modules show excellent performance and scaling, with well over 80% parallel efficiency on over half a million threads. The source code has been made publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗

Rapid in situ diversification rates in Rhamnaceae explain the parallel evolution of high diversity in temperate biomes from global to local scales

Summary The macroevolutionary processes that have shaped biodiversity across the temperate realm remain poorly understood and may have resulted from evolutionary dynamics related to diversification rates, dispersal rates, and colonization times, closely coupled with Cenozoic climate change. We integrated phylogenomic, environmental ordination, and macroevolutionary analyses for the cosmopolitan angiosperm family Rhamnaceae to disentangle the evolutionary processes that have contributed to high species diversity within and across temperate biomes. Our results show independent colonization of environmentally similar but geographically separated temperate regions mainly during the Oligocene, consistent with the global expansion of temperate biomes. High global, regional, and local temperate diversity was the result of high in situ diversification rates, rather than high immigration rates or accumulation time, except for Southern China, which was colonized much earlier than the other regions. The relatively common lineage dispersals out of temperate hotspots highlight strong source‐sink dynamics across the cosmopolitan distribution of Rhamnaceae. The proliferation of temperate environments since the Oligocene may have provided the ecological opportunity for rapid in situ diversification of Rhamnaceae across the temperate realm. Our study illustrates the importance of high in situ diversification rates for the establishment of modern temperate biomes and biodiversity hotspots across spatial scales.

Plant Sciences↗

Divertor heat flux challenge and mitigation in SPARC

Owing to its high magnetic field, high power, and compact size, the SPARC experiment will operate with divertor conditions at or above those expected in reactor-class tokamaks. Power exhaust at this scale remains one of the key challenges for practical fusion energy. Based on empirical scalings, the peak unmitigated divertor parallel heat flux is projected to be greater than 10 GW m -2 . This is nearly an order of magnitude higher than has been demonstrated to date. Furthermore, the divertor parallel Edge-Localized Mode (ELM) energy fluence projections (~11–34 MJ m -2 ) are comparable with those for ITER. However, the relatively short pulse length (~25 s pulse, with a ~10 s flat top) provides the opportunity to consider mitigation schemes unsuited to long-pulse devices including ITER and reactors. The baseline scenario for SPARC employs a ~1 Hz strike point sweep to spread the heat flux over a large divertor target surface area to keep tile surface temperatures within tolerable levels without the use of active divertor cooling systems. In addition, SPARC operation presents a unique opportunity to study divertor heat exhaust mitigation at reactor-level plasma densities and power fluxes. Not only will SPARC test the limits of current experimental scalings and serve for benchmarking theoretical models in reactor regimes, it is also being designed to enable the assessment of long-legged and X-point target advanced divertor magnetic configurations. Experimental results from SPARC will be crucial to reducing risk for a fusion pilot plant divertor design.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Redundant Execution of HPC Applications with MR-MPI

This paper presents a modular-redundant Message Passing Interface (MPI) solution, MR-MPI, for transparently executing high-performance computing (HPC) applications in a redundant fashion. The presented work addresses the deficiencies of recovery-oriented HPC, i.e., checkpoint/restart to/from a parallel file system, at extreme scale by adding the redundancy approach to the HPC resilience portfolio. It utilizes the MPI performance tool interface, PMPI, to transparently intercept MPI calls from an application and to hide all redundancy-related mechanisms. A redundantly executed application runs with r*m native MPI processes, where r is the number of MPI ranks visible to the application and m is the replication degree. Messages between redundant nodes are replicated. Partial replication for tunable resilience is supported. The performance results clearly show the negative impact of the O(m^m) messages between replicas. For low-level, point-to-point benchmarks, the impact can be as high as the replication degree. For applications, performance highly depends on the actual communication types and counts. On single-core systems, the overhead can be 0% for embarrassingly parallel applications independent of the employed redundancy configuration or up to 70-90% for communication-intensive applications in a dual-redundant configuration. On multi-core systems, the overhead can be significantly higher due to the additional communication contention.

Engelmann, Christian↗