Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

AENET–LAMMPS and AENET–TINKER : Interfaces for accurate and efficient molecular dynamics simulations with machine learning potentials

Machine-learning potentials (MLPs) trained on data from quantum-mechanics based first-principles methods can approach the accuracy of the reference method at a fraction of the computational cost. To facilitate efficient MLP-based molecular dynamics and Monte Carlo simulations, an integration of the MLPs with sampling software is needed. Here, we develop two interfaces that link the atomic energy network (ænet) MLP package with the popular sampling packages TINKER and LAMMPS. The three packages, ænet, TINKER, and LAMMPS, are free and open-source software that enable, in combination, accurate simulations of large and complex systems with low computational cost that scales linearly with the number of atoms. Scaling tests show that the parallel efficiency of the ænet–TINKER interface is nearly optimal but is limited to shared-memory systems. The ænet–LAMMPS interface achieves excellent parallel efficiency on highly parallel distributed memory systems and benefits from the highly optimized neighbor list implemented in LAMMPS. We demonstrate the utility of the two MLP interfaces for two relevant example applications: the investigation of diffusion phenomena in liquid water and the equilibration of nanostructured amorphous battery materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

MAGNETIC FIELD LINE RANDOM WALK FOR DISTURBED FLUX SURFACES: TRAPPING EFFECTS AND MULTIPLE ROUTES TO BOHM DIFFUSION

The magnetic field line random walk (FLRW) is important for the transport of energetic particles in many astrophysical situations. While all authors agree on the quasilinear diffusion of field lines for fluctuations that mainly vary parallel to a large-scale field, for the opposite case of fluctuations that mainly vary in the perpendicular directions, there has been an apparent conflict between concepts of Bohm diffusion and percolation/trapping effects. Here computer simulation and non-perturbative analytic techniques are used to re-examine the FLRW in magnetic turbulence with slab and two-dimensional (2D) components, in which 2D flux surfaces are disturbed by the slab fluctuations. Previous non-perturbative theories for D{sub perpendicular}, based on Corrsin's hypothesis, have identified a slab contribution with quasilinear behavior and a 2D contribution due to Bohm diffusion with diffusive decorrelation (DD), combined in a quadratic formula. Here we present analytic theories for other routes to Bohm diffusion, with random ballistic decorrelation (RBD) either due to the 2D component itself (for a weak slab contribution) or the total fluctuation field (for a strong slab contribution), combined in a direct sum with the slab contribution. Computer simulations confirm the applicability of RBD routes for weak or strong slab contributions, while the DD route applies for a moderate slab contribution. For a very low slab contribution, interesting trapping effects are found, including a depressed diffusion coefficient and subdiffusive behavior. Thus quasilinear, Bohm, and trapping behaviors are all found in the same system, together with an overall viewpoint to explain these behaviors.

79 ASTRONOMY AND ASTROPHYSICS↗

A MILLIMETER-WAVE GALACTIC PLANE SURVEY WITH THE BICEP POLARIMETER

In order to study inflationary cosmology and the Milky Way Galaxy's composition and magnetic field structure, Stokes I, Q, and U maps of the Galactic plane covering the Galactic longitude range 260 Degree-Sign < l < 340 Degree-Sign in three atmospheric transmission windows centered on 100, 150, and 220 GHz are presented. The maps sample an optical depth 1 {approx}< A{sub V} {approx}< 30, and are consistent with previous characterizations of the Galactic millimeter-wave frequency spectrum and the large-scale magnetic field structure permeating the interstellar medium. The polarization angles in all three bands are generally perpendicular to those measured by starlight polarimetry as expected and show changes in the structure of the Galactic magnetic field on the scale of 60 Degree-Sign . The frequency spectrum of degree-scale Galactic emission is plotted between 23 and 220 GHz (including WMAP data) and is fit to a two-component (synchrotron and dust) model showing that the higher frequency BICEP data are necessary to tightly constrain the amplitude and spectral index of Galactic dust. Polarized emission is detected over the entire region within two degrees of the Galactic plane, indicating the large-scale magnetic field is oriented parallel to the plane of the Galaxy. A trend of decreasing polarization fraction with increasing total intensity is observed, ruling out the simplest model of a constant Galactic magnetic field orientation along the line of sight in the Galactic plane. A generally increasing trend of polarization fraction with electromagnetic frequency is found, varying from 0.5%-1.5% at frequencies below 50 GHz to 2.5%-3.5% above 90 GHz. The effort to extend the capabilities of BICEP by installing 220 GHz band hardware is described along with analysis of the new band.

79 ASTRONOMY AND ASTROPHYSICS↗

Hardware Design and Demonstration of a 100kW, 99% Efficiency Dual Active Half Bridge Converter Based on 1700V SiC Power MOSFET

High efficiency, high density and galvanically isolated power converters are attractive for numerous medium voltage high power applications. This paper presents a 1.5kVdc, 100kW bidirectional Dual Active Half Bridge (DAHB) using newly developed 1.7kV SiC MOSFET modules. The DAHB achieved an efficiency of 98.6% at full load of 100kW and a maximum of 99% at 45kW, operating as an isolated DC/DC converter. The converter also achieved an efficiency of 97.8% operating as an isolated DC/AC inverter. An optimized PCB-based busbar design has significantly reduced the voltage overshoot across the device, making the design suitable for 1500Vdc input application such as 1500V PV inverters. Typical partial discharge inception voltage (PDIV) of the optimized PCB busbar is 1.7kVpeak with total charge <10pC. The power density of the DAHB converter is 1.8MVA/m 3 which is much higher than traditional two-stage industry products. The DAHB converter can be used as a building block for a 4.16kV/1MVA utility scale PV systems with input parallel and output series configuration.

Xu, Wei↗

AMRZone: A Runtime AMR Data Sharing Framework For Scientific Applications

Frameworks that facilitate runtime data sharing across multiple applications are of great importance for scientific data analytics. Although existing frameworks work well over uniform mesh data, they can not effectively handle adaptive mesh refinement (AMR) data. Among the challenges to construct an AMR-capable framework include: (1) designing an architecture that facilitates online AMR data management; (2) achieving a load-balanced AMR data distribution for the data staging space at runtime; and (3) building an effective online index to support the unique spatial data retrieval requirements for AMR data. Towards addressing these challenges to support runtime AMR data sharing across scientific applications, we present the AMRZone framework. Experiments over real-world AMR datasets demonstrate AMRZone's effectiveness at achieving a balanced workload distribution, reading/writing large-scale datasets with thousands of parallel processes, and satisfying queries with spatial constraints. Moreover, AMRZone's performance and scalability are even comparable with existing state-of-the-art work when tested over uniform mesh data with up to 16384 cores; in the best case, our framework achieves a 46% performance improvement.

Zhang, Wenzhao↗

FitCache: A Transparent Drop-In Framework for Multi-Tier Caching to Accelerate Distributed Deep Learning Workloads

Training in Deep learning (DL) remains highly compute- and data-intensive, with I/O becoming a critical bottleneck as models and datasets scale. Recent studies report that data loading can dominate training time, especially on large-scale HPC systems with shared parallel file systems (PFS). Existing caching approaches either rely on single-tier designs or require intrusive modifications to training pipelines, limiting their portability and effectiveness. In this work, we present FitCache, a transparent drop-in framework for multi-tier caching to accelerate distributed DL training by coordinating fast local memory (e.g., DRAM, Persistent Memory (PMem)) and NVMe as hierarchical caches atop PFS. Our design adapts to hardware diversity, i.e., if NVMe is missing, memory transparently acts as a caching tier, ensuring stable performance. FitCache transparently intercepts I/O requests and issues concurrent fetches across all tiers, returning data from the fastest responder without centralized metadata or static redirection paths. FitCache adapts to dynamic workloads and heterogeneous clusters while maintaining POSIX compatibility. Experiments on Frontier (2048 GPUs) and smaller research clusters show that FitCache reduces training time by up to 40% and per-batch I/O latency by up to 71.6% compared to Lustre Orion PFS, offering a drop-in solution for scalable DL training.

Hu, Guangxing [ORNL] (ORCID:0009000283203614)↗

Quantification of Arctic Soil and Permafrost Properties Using Ground-Penetrating Radar and Electrical Resistivity Tomography Datasets

Improving understanding of Arctic ecosystem climate feedback and parameterization of models that simulate freeze-Thaw dynamics require advances in quantifying soil and snow properties. Due to the significant spatiotemporal variability of soil properties and the limited information provided by point-scale measurements (e.g., cores), geophysical methods hold potential for improving soil and permafrost characterization. In this study, we evaluate the use of a ground-penetrating radar (GPR) to estimate thaw layer thickness, snow depth, and ice-wedge characteristics in an ice-wedge-dominated tundra region near Barrow, AK, USA. To this end, we analyze GPR and point-scale measurements collected along several parallel transects at the end of the growing season and the end of frozen season. In addition, we compare the structural information extracted from the GPR data with electrical resistivity tomography (ERT) information about ice-wedge characteristics. Our study generally highlights the value of GPR data collected in the frozen season, when conditions lead to the improved GPR signal-To-noise ratio, facilitate data acquisition, and reduce acquisition-related ecosystem disturbance relative to growing season. We document for the first time that GPR data collected during the frozen season can provide reliable estimates of active layer thickness and geometry of ice wedges. We find that the ice-wedge geometry extracted from GPR data collected during the frozen season is consistent with ERT data, and that GPR data can be used to constrain the ERT inversion. Consistent with recent studies, we also find that GPR data collected during the frozen season can provide good estimates of snow thickness, and that GPR data collected during the growing season can provide reliable estimate thaw depth. As a result, our quantification of the value of the GPR and ERT data collected during growing and frozen seasons paves the way for coupled inversion of the datasets to improve understanding of permafrost variability.

54 ENVIRONMENTAL SCIENCES↗

End-to-end data movement using MPI-IO over routed terabits infrastructures. In: NDM '13 Proceedings of the Third International Workshop on Network-Aware Data Management, Article No. 9

Scientific discovery is nowadays driven by large-scale simulations running on massively parallel high-performance computing (HPC) systems. These applications each generate a large amount of data, which then needs to be post-processed for example for data mining or visualization. Unfortunately, the computing platform used for post processing might be different from the one on which the data is initially generated, introducing the challenge of moving large amount of data between computing platforms. This is especially challenging when these two platforms are geographically separated since the data needs to be moved between computing facilities. This is even more critical when scientists tightly couple their domain specific applications with a post processing application. The paper presents a solution for the data transfer between MPI applications using a dedicated wide area network (WAN) terabit infrastructure. The proposed solution is based on parallel access to data files and the Message Passing Interface (MPI) over the Common Communication Infrastructure (CCI) for the data transfer over a routed infrastructure. In the context of this research, the Energy Sciences Network (ESnet) of the U.S. Department of Energy (DOE) is targeted for the transfer of data between DOE national laboratories.

Vallée, Geoffroy↗

Pushing back the limit of ab-initio quantum transport simulations on hybrid supercomputers, In: SC '15 Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis

The capabilities of CP2K, a density-functional theory package and OMEN, a nano-device simulator, are combined to study transport phenomena from first-principles in unprecedentedly large nanostructures. Based on the Hamiltonian and overlap matrices generated by CP2K for a given system, OMEN solves the Schrödinger equation with open boundary conditions (OBCs) for all possible electron momenta and energies. To accelerate this core operation a robust algorithm called SplitSolve has been developed. It allows to simultaneously treat the OBCs on CPUs and the Schrödinger equation on GPUs, taking advantage of hybrid nodes. Our key achievements on the Cray-XK7 Titan are (i) a reduction in time-to-solution by more than one order of magnitude as compared to standard methods, enabling the simulation of structures with more than 50000 atoms, (ii) a parallel efficiency of 97% when scaling from 756 up to 18564 nodes, and (iii) a sustained performance of 15 DP-PFlop/s.

Computer Science↗

Python-based in situ analysis and visualization

This work focuses on enabling the use of Python-based methods for the purpose of performing in situ analysis and visualization. This approach facilitates access to and use of a rapidly growing collection of Python-based, third-party libraries for analysis and visualization, as well as lowering the barrier to entry for user-written Python analysis codes. Beginning with a simulation code that is instrumented to use the SENSEI in situ interface, we present how to couple it with a Python-based data consumer, which may be run in situ, and in parallel at the same concurrency as the simulation. We present two examples that demonstrate the new capability. One is an analysis of the reaction rate in a proxy simulation of a chemical reaction on a 2D substrate, while the other is a coupling of an AMR simulation to Yt, a parallel visualization and analysis library written in Python. In the examples, both the simulation and Python in situ method run in parallel on a large-scale HPC platform.

Loring, Burlen↗

AdaParse

SF-25-127AdaParse (Adaptive Parallel PDF Parsing and Resource Scaling Engine) enables scalable, high-accuracy PDF parsing. AdaParse is a data-driven strategy that assigns an appropriate parser to each document, offering high accuracy for any computational budget. Moreover, it offers a workflow of various PDF parsing software that includes extraction tools: PyMuPDF, pypdf traditional OCR: Tesseract, modern OCR (e.g., Vision Transformers): Nougat and Marker

Siebenschuh, Carlo↗

Performance and scalability evaluation of "Big Memory" on Blue Gene Linux.

We address memory performance issues observed in Blue Gene Linux and discuss the design and implementation of 'Big Memory' - an alternative, transparent memory space introduced to eliminate the memory performance issues. We evaluate the performance of Big Memory using custom memory benchmarks, NAS Parallel Benchmarks, and the Parallel Ocean Program, at a scale of up to 4,096 nodes. We find that Big Memory successfully resolves the performance issues normally encountered in Blue Gene Linux. For the ocean simulation program, we even find that Linux with Big Memory provides better scalability than does the lightweight compute node kernel designed solely for high-performance applications. Originally intended exclusively for compute node tasks, our new memory subsystem dramatically improves the performance of certain I/O node applications as well. We demonstrate this performance using the central processor of the LOw Frequency ARray radio telescope as an example.

59 BASIC BIOLOGICAL SCIENCES↗

Projective Hedging Algorithms for Multistage Stochastic Programming, Supporting Distributed and Asynchronous Implementation

Here we propose a decomposition algorithm for multistage stochastic programming that resembles the progressive hedging method of Rockafellar and Wets but is provably capable of several forms of asynchronous operation. We derive the method from a class of projective operator splitting methods fairly recently proposed by Combettes and Eckstein, significantly expanding the known applications of those methods. Our derivation assures convergence for convex problems whose feasible set is compact, subject to some standard regularity conditions and a mild “fairness” condition on subproblem selection. The method’s convergence guarantees are deterministic and do not require randomization, in contrast to other proposed asynchronous variations of progressive hedging. Computational experiments described in an online appendix show the method to outperform progressive hedging on large-scale problems in a highly parallel computing environment.

97 MATHEMATICS AND COMPUTING↗

Performance Characterization and Validation of mocfe_bone (Contribution to the CESAR Annual Report FY12)

In the first phase of CESAR, the performance analysis task focused on understanding the baseline performance characteristics of mocfe bone | studying its behavior under different parallelization scenarios and comparing its scaling behavior to the MOCFE solver in the main application, UNIC. The results will help drive the co-design process for this application, which is one of the three target applications in CESAR, and will help identify current and future scaling bottlenecks.

97 MATHEMATICS AND COMPUTING↗

Cloud feedback studies with a physics grid

During this project the investigators implemented a fully parallel version of dual-grid approach in main frame code ICON, implemented a fully conservative first-order interpolation scheme for horizontal remapping, integrated UCLA-LES micro-scale model into ICON to run parallely in selected columns, and did cloud feedback studies on aqua-planet setup to evaluate the classical parameterization on a small domain. The micro-scale model may be run in parallel with the classical parameterization, or it may be run on a "physics grid" independent of the dynamics grid.

54 ENVIRONMENTAL SCIENCES↗

Sight Application Analysis Tool

The scale and complexity of scientific applications makes it very difficult to optimize, debug and extend them to support new capabilities. We have developed a tool that supports developers’ efforts to understand the logical flow of their applications and interactions between application components and hardware in a way that scales with application complexity and parallelism.

97 MATHEMATICS AND COMPUTING↗

Frameworks, Algorithms, and Scalable Technologies for Mathematics (FASTMath) SciDAC Institute

The FASTMath SciDAC Institute addressed two key challenges that application scientists faced at the beginning of SciDAC-3. First, FASTMath helped them continue to improve the quality of their simulations by increasing accuracy and reliability of both their software and algorithms. Second, FASTMath helped them adapt their computations to make effective use of high-end computing facilities acquired by DOE over the past five years. This required the development of new mathematical algorithms that were appropriate for the physics problems being solved, implementations that scaled to million-way parallelism, and software that effectively leveraged both distributed memory and on-node parallelism. The Rensselaer Polytechnic Institute team’s efforts focused on the unstructured mesh technologies developed by FASTMath.

97 MATHEMATICS AND COMPUTING↗

Seamless Hybrid-integrated Interconnect NEtwork (SHINE)

Large-scale date centers are becoming increasingly limited by the capacity of interconnects due to the rapid increasing power consumption and bandwidth demands driven by the rigorous down scaling of CMOS critical dimensions in according with the Moore’s Law. As a result of the continuing bandwidth scaling, optical interconnects based on parallel optics, where data are simultaneously transmitted along more than one lane, have becoming a preferred interconnected solution over copper cables. To building an efficient optical interconnect system, optical coupling between different elements, such as optical fibers, photonics chips, is a critical step, which is challenging due to the mode mismatch of varies optical ports. In this project, we proposed and demonstrated an optical interfacing scheme, which provided a light coupling approach with low energy loss, broadband operation, high alignment tolerance and compatible with scalable fabrication and testing. Here, the mode transformation is achieved by a total internal reflection from a chip integrated microscale freefrom surface. Due to the enormous light wavefront manipulating ability associated with the gigantic design space, the freeform couplers platform is universally applicable to a wide range of optical coupling scenarios, such as the interfacing between a waveguide to a fiber, another waveguide, surface normal device, or free space.

42 ENGINEERING↗