Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

T-FSM: A Scalable Distributed Task-Based System for Frequent Subgraph Pattern Mining from a Big Graph

Finding frequent subgraph patterns in a big graph is an important problem with many applications such as classifying chemical compounds and building indexes to speed up graph queries. Since this problem is NP-hard, some recent parallel and distributed systems have been developed to accelerate the mining. However, they often have a huge memory cost, very long running time, suboptimal load balancing, poor scale-out capability, and possibly inaccurate results. In this article, we propose an efficient system called T-FSM for parallel mining of frequent subgraph patterns in a big graph. T-FSM supports a new anti-monotonic frequentness measure called Fraction-Score, which is more accurate than the widely used MNI measure. The execution engine of T-FSM supports both intra-machine parallelism and inter-machine parallelism. For intra-machine parallelism, T-FSM adopts a novel task-based execution model to ensure high multithreading concurrency, bounded memory consumption, and effective load balancing. For inter-machine parallelism, T-FSM ensures good scale-out performance with a lightweight pattern rebalancing approach that reduces workload skewness of pattern evaluations among machines. To avoid recomputing the contexts for migrated patterns, we design a novel context cache table to support concurrent and asynchronous requesting and caching of remote context data, which can timely evict and garbage collect used pattern contexts that are no longer needed to keep memory consumption bounded. Extensive experiments show that T-FSM is orders of magnitude faster than existing state-of-the-art parallel systems (more than 10×, 51×, 131×, 55× speedup over ScaleMine, DistGraph, Pangolin and Peregrine, respectively) and distributed systems (more than 42× and 88× over ScaleMine and DistGraph, respectively) for frequent subgraph pattern mining, and it scales out satisfactorily to 512 CPU cores on the Polaris supercomputer at Argonne National Laboratory.

97 MATHEMATICS AND COMPUTING↗

CO 2 Capture by Cold Membrane Operation with Actual Power Plant Flue Gas

The main objective of the project was to develop a post-combustion CO 2 capture process based on the hybrid cold temperature membrane operation. The CO 2 in the flue gas from coal fired power plant is pre-concentrated to >60% CO 2 in the first stage membrane operation followed by further liquefaction of permeate stream to achieve >99% CO 2 purity. The aim of the project was based on DOE program goal of 90% CO 2 capture with >95% CO 2 purity from Pulverized Coal (PC) fired power plants with $40/tonne of carbon capture cost by 2025. The project moves the technology from TRL 4 to TRL 5. The project involved optimization of Air Liquide commercial 12” PI-1 bundle to improve the bundle productivity by >30% compared to the previous baseline (DE-FE0004278) using computational fluid dynamics (CFD) modeling and bundle testing with synthetic flue gas at 0.1 MWe bench scale skid located at Delaware Research and Technology Center (DRTC). In parallel, the next generation polyimide based novel PI-2 membrane was developed with 10 times CO 2 permeance compared to the commercial PI-1 membrane. The novel PI-2 membrane was scaled from mini-permeator to 1” permeator and 1” bundle for testing. Bundle development was conducted with a Development Spin Unit (DSU) installed at MEDAL. Air Liquide’s cold membrane technology was demonstrated with real coal fired flue gas at the National Carbon Capture Center (NCCC) with a 0.3 MWe field-test unit (FTU). The FTU was designed to incorporate testing of two PI-1 commercial membrane bundles (12” or 6” diameter) in parallel or series. A slip stream was sent to the next generation PI-2 membrane for testing with real flue gas. The system exceeded performance targets with stable PI-1 membrane operation for over 500 hours of single bundle, steady state testing. The 12” PI-1 bundle exceeded the productivity target by achieving ~600 Nm3/hr, where the target was set at ~455 Nm3/hr at 90% capture rate. The cost of 90% CO 2 capture from a 550 MWe net coal power plant was estimated between 40 and $45/tonne. A 6” PI-1 bundle exhibited superior bundle performance compared to the 12” PI-1 bundle. However, the carbon capture cost was not lower with the 6” PI-1 bundle due to the higher bundle installed cost. A 1” PI-1 bundle was tested to compare bundles with different length / diameter ratios. This bundle exhibited the lowest performance due to the different fiber winding pattern and increased bundle non-ideality. Several long-term and parametric tests were conducted with 3,200 hours of total run-time at NCCC. Finally, the new PI-2 membrane fiber was tested at a small scale (1” modules) in real flue gas and exhibited up to 10 times the CO 2 permeance and slightly lower CO 2 /N 2 selectivity as the commercial PI-1 fiber. This corresponded to a projected 4 - 5 times increase in the productivity per bundle and a potential cost reduction of $3/tonne for CO2 capture, as compared with PI-1. An analytical campaign was conducted to trace different impurities such as NOx, mercury, Arsenic, Selenium in gas and liquid samples through the carbon capture system. An Environmental, Health and Safety (EH&S) analysis was completed to estimate emissions from a 550 MWe net power plant with carbon capture using cold membrane. A preliminary design and cost analysis was completed for 550 tpd (~25 MWe) plant to assess the capital investment and carbon capture cost for PI-1 and PI-2 membrane solutions from coal fired flue gas. A comparison was made with an amine based solution with significant cost advantage for the membrane at this scale. Additional preliminary design and cost analysis was completed between coal, natural gas and SMR flue gas for carbon capture at 550 tpd (~25 MWe) plant.

01 COAL, LIGNITE, AND PEAT↗

Towards Generic Parallel Programming in Computer Science Education with Kokkos

Parallel patterns, views, and spaces are promising abstractions to capture the programmer's intent as well as the contextual information that can be used by an underlying runtime to efficiently map software to parallel hardware. These abstractions can be valuable in cases where an algorithm must accommodate requirements of code and performance portability across hardware architectures and vendor programming models. Kokkos is a parallel programming model for host- and accelerator architectures that relies on these abstractions and targets these requirements. It consists of a pure C++ interface, a specification, and a programming library. The programming library exposes patterns and types and maps them to an underlying abstract machine model. The abstract machine model offers a generic view of parallel hardware. While Kokkos is gaining popularity in large-scale HPC applications at some DOE laboratories, we believe that the implemented concepts are of interest to a broader audience including academia as they may contribute to a generic, vendor, and architecture-independent education of parallel programming. In this work, we give an insight into the design considerations of this programming model and list important abstractions. Further, we document best practices obtained from giving virtual classes on Kokkos and give pointers to resources that the reader may consider valuable for a lecture on generic parallel programming for students with preexisting knowledge on this matter.

Ciesko, Jan↗

A Parallel Alternative for Energy-Efficient Neural Network Training and Inferencing

Energy efficiency of training and inferencing with large neural network models is a critical challenge facing the future of sustainable large-scale machine learning workloads. This paper introduces an alternative strategy, called phantom parallelism, to minimize the net energy consumption of traditional tensor (model) parallelism, the most energy-inefficient component of large neural network training. The approach is presented in the context of feed-forward network architectures as a preliminary, but comprehensive, proof-of-principle study of the proposed methodology. We derive new forward and backward propagation operators for phantom parallelism, implement them as custom autograd operations within an end-to-end phantom parallel training pipeline and compare its parallel performance and energy-efficiency against those of conventional tensor parallel training pipelines. Formal analyses that predict lower bandwidth and FLOP counts are presented with supporting empirical results on up to 256 GPUs that corroborate these gains. Experiments are shown to deliver ∼50% reduction in the energy consumed to train FFNs using the proposed phantom parallel approach when compared with conventional tensor parallel methods. Additionally, the proposed approach is shown to train smaller phantom models to the same model loss on smaller GPU counts as larger tensor parallel models on larger GPU counts offering the possibility for even greater energy savings.

Seal, Sudip [ORNL] (ORCID:0000000332330656)↗

IOPro: a parallel I/O profiling and visualization framework for high-performance storage systems

Efficient execution of large-scale scientific applications requires high-performance computing systems designed to meet the I/O requirements. To achieve high-performance, such data-intensive parallel applications use a multi-layer layer I/O software stack, which consists of high-level I/O libraries such as PnetCDF and HDF5, the MPI library, and parallel file systems. To design efficient parallel scientific applications, understanding the complicated flow of I/O operations and the involved interactions among the libraries is quintessential. Such comprehension helps identify I/O bottlenecks and thus exploits the potential performance in different layers of the storage hierarchy. To profile the performance of individual components in the I/O stack and to understand complex interactions among them, we have implemented a GUI-based integrated profiling and analysis framework, IOPro. IOPro automatically generates an instrumented I/O stack, runs applications on it, and visualizes detailed statistics based on the user-specified metrics of interest. We present experimental results from two different real-life applications and show how our framework can be used in practice. By generating an end-to-end trace of the whole I/O stack and pinpointing I/O interference, IOPro aids in understanding I/O behavior and improving the I/O performance significantly.

97 MATHEMATICS AND COMPUTING↗

Dynamic model-based sensor network design algorithm for system efficiency maximization

Here, a dynamic model-based sensor network design (DMSND) algorithm has been developed for maximizing system efficiency for an estimator-based control system. The algorithm synthesizes the optimal sensor network in the face of disturbances or set point changes. Computational expense of the large-scale combinatorial optimization problem is significantly reduced by parallel computing and by using combination of three novel strategies: multi-rate sampling frequency, model order reduction, and use of an incumbent solution that enables early termination of evaluation of infeasible sensor sets. The developed algorithm is applied to an acid gas removal unit as part of an integrated gasification combined cycle power plant with carbon capture. Even though there are more than thousand process states and more than hundred candidate sensor locations, the optimal sensor network design problem for maximizing process efficiency could be solved within couple of hours for a given budget.

47 OTHER INSTRUMENTATION↗

Accelerating nuclear configuration interaction calculations through a preconditioned block iterative eigensolver

We describe a number of recently developed techniques for improving the performance of large-scalenuclear configuration interaction calculations on high performance parallel computers. We show thebenefit of using a preconditioned block iterative method to replace the Lanczos algorithm that hastraditionally been used to perform this type of computation. The rapid convergence of the block iterativemethod is achieved by a proper choice of starting guesses of the eigenvectors and the construction of aneffective preconditioner. These acceleration techniques take advantage of special structure of the nuclearconfiguration interaction problem which we discuss in detail. The use of a block method also allows usto improve the concurrency of the computation, and take advantage of the memory hierarchy of modernmicroprocessors to increase the arithmetic intensity of the computation relative to data movement. Wealso discuss the implementation details that are critical to achieving high performance on massivelyparallel multi-core supercomputers, and demonstrate that the new block iterative solver is two to threetimes faster than the Lanczos based algorithm for problems of moderate sizes on a Cray XC30 system.

Shao, Meiyue↗

Billion-atom synchronous parallel kinetic Monte Carlo simulations of critical 3D Ising systems

An extension of the synchronous parallel kinetic Monte Carlo (spkMC) algorithm developed by Martinez et al. [J. Comp. Phys. 227 (2008) 3804] to discrete lattices is presented. The method solves the master equation synchronously by recourse to null events that keep all processors' time clocks current in a global sense. Boundary conflicts are resolved by adopting a chessboard decomposition into non-interacting sublattices. We find that the bias introduced by the spatial correlations attendant to the sublattice decomposition is within the standard deviation of serial calculations, which confirms the statistical validity of our algorithm. We have analyzed the parallel efficiency of spkMC and find that it scales consistently with problem size and sublattice partition. We apply the method to the calculation of scale-dependent critical exponents in billion-atom 3D Ising systems, with very good agreement with state-of-the-art multispin simulations.

97 MATHEMATICS AND COMPUTING↗

A generalized parallel replica dynamics

Metastability is a common obstacle to performing long molecular dynamics simulations. Many numerical methods have been proposed to overcome it. One method is parallel replica dynamics, which relies on the rapid convergence of the underlying stochastic process to a quasi-stationary distribution. Two requirements for applying parallel replica dynamics are knowledge of the time scale on which the process converges to the quasi-stationary distribution and a mechanism for generating samples from this distribution. By combining a Fleming–Viot particle system with convergence diagnostics to simultaneously identify when the process converges while also generating samples, we can address both points. This variation on the algorithm is illustrated with various numerical examples, including those with entropic barriers and the 2D Lennard-Jones cluster of seven atoms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Optical neural engine for solving scientific partial differential equations

Abstract Solving partial differential equations (PDEs) is the cornerstone of scientific research and development. Data-driven machine learning (ML) approaches are emerging to accelerate time-consuming and computation-intensive numerical simulations of PDEs. Although optical systems offer high-throughput and energy-efficient ML hardware, their demonstration for solving PDEs is limited. Here, we present an optical neural engine (ONE) architecture combining diffractive optical neural networks for Fourier space processing and optical crossbar structures for real space processing to solve time-dependent and time-independent PDEs in diverse disciplines, including Darcy flow equation, the magnetostatic Poisson’s equation in demagnetization, the Navier-Stokes equation in incompressible fluid, Maxwell’s equations in nanophotonic metasurfaces, and coupled PDEs in a multiphysics system. We numerically and experimentally demonstrate the capability of the ONE architecture, which not only leverages the advantages of high-performance dual-space processing for outperforming traditional PDE solvers and being comparable with state-of-the-art ML models but also can be implemented using optical computing hardware with unique features of low-energy and highly parallel constant-time processing irrespective of model scales and real-time reconfigurability for tackling multiple tasks with the same architecture. The demonstrated architecture offers a versatile and powerful platform for large-scale scientific and engineering computations.

Tang, Yingheng (ORCID:0009000153622546)↗

Solar wind compressible turbulence near proton scales: Cluster observations

The solar wind compressible turbulence attracts more attention recently due to its possible role in plasma heating. Using the plasma density and magnetic field measured simultaneously by the Cluster C1 probe, we statistically investigate the wave characteristics of the proton-scale compressible turbulence. In most cases, the density and magnetic field strength fluctuations almost show no positive correlation, suggesting the absence of fast mode waves. Moreover, the magnetic compressibility C{sub b} as measured by the level of magnetic fluctuations parallel to the background field, is enhanced continuously around proton scales and is consistent with kinetic Alfvén wave (KAW) prediction. Interestingly, kinetic slow mode waves (KSW) are identified in a few cases through large values of C{sub b} and plasma compressibility C{sub p}, together with the the anti-correlation between n and B. We suggest that both KAW and KSW can account for the compressible fluctuations energy, while their relative proportions under certain plasma condition require further studies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Theory of the ion–electron temperature relaxation rate in strongly magnetized plasmas

Recent works have shown that strongly magnetized plasmas characterized by having a gyrofrequency greater than the plasma frequency exhibit novel transport properties. One example is that the friction force on a test charge shifts, obtaining components perpendicular to its velocity in addition to the typical stopping power component antiparallel to its velocity. Here, we apply a recent generalization of the Boltzmann equation for strongly magnetized plasmas to calculate the ion–electron temperature relaxation rate. Strong magnetization is generally found to increase the temperature relaxation rate perpendicular to the magnetic field and to cause the temperatures parallel and perpendicular to the magnetic field to not relax at equal rates. This, in turn, causes a temperature anisotropy to develop during the equilibration. Strong magnetization also breaks the symmetry of independence of the sign of the charges of the interacting particles on the collision rate, commonly known as the “Barkas effect.” Furthermore, it is found that the combination of oppositely charged interaction and strong magnetization causes the ion–electron parallel temperature relaxation rate to be significantly suppressed, scaling inversely proportional to the magnetic field strength.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

LUPUS I observations from the 2010 flight of the Balloon-borne large aperture submillimeter telescope for polarimetry

The Balloon-borne Large Aperture Submillimeter Telescope for Polarimetry (BLASTPol) was created by adding polarimetric capability to the BLAST experiment that was flown in 2003, 2005, and 2006. BLASTPol inherited BLAST's 1.8 m primary and its Herschel/SPIRE heritage focal plane that allows simultaneous observation at 250, 350, and 500 μm. We flew BLASTPol in 2010 and again in 2012. Both were long duration Antarctic flights. Here we present polarimetry of the nearby filamentary dark cloud Lupus I obtained during the 2010 flight. Despite limitations imposed by the effects of a damaged optical component, we were able to clearly detect submillimeter polarization on degree scales. We compare the resulting BLASTPol magnetic field map with a similar map made via optical polarimetry. (The optical data were published in 1998 by J. Rizzo and collaborators.) The two maps partially overlap and are reasonably consistent with one another. We compare these magnetic field maps to the orientations of filaments in Lupus I, and we find that the dominant filament in the cloud is approximately perpendicular to the large-scale field, while secondary filaments appear to run parallel to the magnetic fields in their vicinities. This is similar to what is observed in Serpens South via near-IR polarimetry, and consistent with what is seen in MHD simulations by F. Nakamura and Z. Li.

79 ASTRONOMY AND ASTROPHYSICS↗

Solid structure of Li 2 BeF 4 (FLiBe) from room temperature to melting studied by neutron and X-ray diffraction

Molten fluoride salts such as Li 2 BeF 4 (FLiBe) are used in molten salt reactors, fluoride-salt-cooled high-temperature reactors and fusion reactors as a fuel solvent, coolant and/or tritium breeding medium. In engineered systems that use molten salt, solid-state material will be present during melting and freezing scenarios, and therefore the temperature-dependent properties of the solid and solid/liquid phase transition merit investigation. To observe the behavior of the solid state of Li 2 BeF 4 from room temperature to melting, this work used neutron and X-ray diffraction to measure the changes in the lattice parameters and volume of the crystalline unit cell and compared the results with prior low-temperature data for solid Li 2 BeF 4 . From neutron diffraction data it is also possible to identify anisotropy: centimetre-scaled crystals align preferentially with the a axes parallel to the direction of freezing front propagation, and the c axes expand 54% more than the a axes. This work provides the lattice constants as a function of temperature, quantifies the thermal expansion, and determines the equation describing the change in density for solid Li 2 BeF 4 from room temperature to 459°C to be ρ solid (kg m −3 ) = 2182 (3) − 0.115 (2) T (°C) and the volume expansion upon melting to be less than 5%. This density changes depending on molecular weight and enrichment.

36 MATERIALS SCIENCE↗

Parallel DTFE Surface Density Field Reconstruction

We improve the interpolation accuracy and efficiency of the Delaunay tessellation field estimator (DTFE) for surface density field reconstruction by proposing an algorithm that takes advantage of the adaptive triangular mesh for line-of-sight integration. The costly computation of an intermediate 3D grid is completely avoided by our method and only optimally chosen interpolation points are computed, thus, the overall computational cost is significantly reduced. The algorithm is implemented as a parallel shared-memory kernel for large-scale grid rendered field reconstructions in our distributed-memory framework designed for N-body gravitational lensing simulations in large volumes. We also introduce a load balancing scheme to optimize the efficiency of processing a large number of field reconstructions. Our results show our kernel outperforms existing software packages for volume weighted density field reconstruction, achieving ~ 10x speedup, and our load balancing algorithm gains an additional ~ 3.6x speedup at scales with ~ 16k processes.

97 MATHEMATICS AND COMPUTING↗

Characterizing Machine Learning I/O Workloads on Leadership Scale HPC Systems

High performance computing (HPC) is no longer solely limited to traditional workloads such as simulation and modeling. With the increase in the popularity of machine learning (ML) and deep learning (DL) technologies, we are observing that an increasing number of HPC users are incorporating ML methods into their workflow and scientific discovery processes, across a wide spectrum of science domains such as biology, earth science, and physics. This gives rise to a diverse set of I/O patterns than the traditional checkpoint/restart-based HPC I/O behavior. The details of the I/O characteristics of such ML I/O workloads have not been studied extensively for large-scale leadership HPC systems. This paper aims to fill that gap by providing an in-depth analysis to gain an understanding of the I/O behavior of ML I/O workloads using darshan - an I/O characterization tool designed for lightweight tracing and profiling. We study the darshan logs of more than 23, 000 HPC ML I/O jobs over a time period of one year running on Summit - the second-fastest supercomputer in the world. This paper provides a systematic I/O characterization of ML I/O jobs running on a leadership scale supercomputer to understand how the I/O behavior differs across science domains and the scale of workloads, and analyze the usage of parallel file system and burst buffer by ML I/O workloads.

Paul, Arnab↗

Cyber-Power Co-Simulation for End-to-End Synchrophasor Network Analysis and Applications

The resiliency, reliability and security of the next generation cyber-power smart grid depend upon efficiently leveraging advanced communication and computing technologies. Also, developing real-time data-driven applications is critical to enable wide-area monitoring and control of the cyber-power grid given high-resolution data from Phasor Measurement Units (PMUs). North American Synchrophasor Initiative Network (NASPlnet) provides guidance for PMU data exchanges. With the advancement in networking and grid operation, it is necessary to evaluate the performance of different data flow architectures suggested by NASPInet and analyze the impact on applications. Therefore, we need a cyber-power co-simulation framework that supports very large-scale co-simulation capable of running in parallel, high-performance computing platforms and capturing real-life network behavior. This work presents an end-to-end automated and user-driven cyber-power co-simulation using NS3 to model communication networks, GridPACK to model the power grid, and HELICS as a co-simulation engine. Comparative analysis of latency in synchrophasor networks and a performance evaluation of a power system stabilizer application utilizing PMU data in an IEEE 39 bus test system is presented using this cosimulation testbed.

Mustafa, Hussain M.↗