Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

Taming parallel I/O complexity with auto-tuning

We present an auto-tuning system for optimizing I/O performance of HDF5 applications and demonstrate its value across platforms, applications, and at scale. The system uses a genetic algorithm to search a large space of tunable parameters and to identify effective settings at all layers of the parallel I/O stack. The parameter settings are applied transparently by the auto-tuning system via dynamically intercepted HDF5 calls. To validate our auto-tuning system, we applied it to three I/O benchmarks (VPIC, VORPAL, and GCRM) that replicate the I/O activity of their respective applications. We tested the system with different weak-scaling configurations (128, 2048, and 4096 CPU cores) that generate 30 GB to 1 TB of data, and executed these configurations on diverse HPC platforms (Cray XE6, IBM BG/P, and Dell Cluster). In all cases, the auto-tuning framework identified tunable parameters that substantially improved write performance over default system settings. In conclusion, we consistently demonstrate I/O write speedups between 2x and 100x for test configurations.

97 MATHEMATICS AND COMPUTING↗

Intrinsic cooperativity potentiates parallel cis-regulatory evolution

Convergent evolutionary events in independent lineages provide an opportunity to understand why evolution favors certain outcomes over others. We studied such a case where a large set of genes—those coding for the ribosomal proteins—gained cis-regulatory sequences for a particular transcription regulator (Mcm1) in independent fungal lineages. We present evidence that these gains occurred because Mcm1 shares a mechanism of transcriptional activation with an ancestral regulator of the ribosomal protein genes, Rap1. Specifically, we show that Mcm1 and Rap1 have the inherent ability to cooperatively activate transcription through contacts with the general transcription factor TFIID. Because the two regulatory proteins share a common interaction partner, the presence of one ancestral cis-regulatory sequence can ‘channel’ random mutations into functional sites for the second regulator. At a genomic scale, this type of intrinsic cooperativity can account for a pattern of parallel evolution involving the fixation of hundreds of substitutions.

54 ENVIRONMENTAL SCIENCES↗

A survey on software methods to improve the energy efficiency of parallel computing

Energy consumption is one of the top challenges for achieving the next generation of supercomputing. Codesign of hardware and software is critical for improving energy efficiency (EE) for future large-scale systems. Many architectural power-saving techniques have been developed, and most hardware components are approaching physical limits. Accordingly, parallel computing software, including both applications and systems, should exploit power-saving hardware innovations and manage efficient energy use. In addition, new power-aware parallel computing methods are essential to decrease energy usage further. This article surveys software-based methods that aim to improve EE for parallel computing. It reviews the methods that exploit the characteristics of parallel scientific applications, including load imbalance and mixed precision of floating-point (FP) calculations, to improve EE. In addition, this article summarizes widely used methods to improve power usage at different granularities, such as the whole system and per application. In particular, it describes the most important techniques to measure and to achieve energy-efficient usage of various parallel computing facilities, including processors, memories, and networks. Overall, this article reviews the state-of-the-art of energy-efficient methods for parallel computing to motivate researchers to achieve optimal parallel computing under a power budget constraint.

97 MATHEMATICS AND COMPUTING↗

Hvac: Removing I/O Bottleneck for Large-Scale Deep Learning Applications

Scientific communities are increasingly adopting deep learning (DL) models in their applications to accelerate scientific discovery processes. However, with rapid growth in the computing capabilities of HPC supercomputers, large-scale DL applications have to spend a significant portion of training time performing I/O to a parallel storage system. Previous research works have investigated optimization techniques such as prefetching and caching. Unfortunately, there exist non-trivial challenges to adopting the existing solutions on HPC supercomputers for large-scale DL training applications, which include non-performance and/or failures at extreme scale, lack of portability and generality in design, complex deployment methodology, and being limited to a specific application or dataset. To address these challenges, we propose High-Velocity AI Cache (HVAC), a distributed read-cache layer that targets and fully exploits the node-local storage or near node-local storage technology. HVAC seamlessly accelerates read I/O by aggregating node-local or near node-local storage, avoiding metadata lookups and file locking while preserving portability in the application code. We deploy and evaluate HVAC on 1,024 nodes (with over 6000 NVIDIA V100 GPUS) of the Summit supercomputer. In particular, we evaluate the scalability, efficiency, accuracy, and load distribution of HVAC compared to GPFS and XFS-on-NVMe. With four different DL applications, we observe an average 25 % performance improvement atop GPFS and 9% drop against XFS-on-NVMe, which scale linearly and are considered the performance upper bound. We envision HVAC as an important caching library for upcoming HPC supercomputers such as Frontier.

Khan, Awais↗

Trilinos for emerging parallel computing systems.

Trilinos is an object-oriented software framework to enabled the solution of large-scale, complex multiphysics engineering and scientific problems. Different Trilinos packages build on each other to create a stack providing the necessary capability: (1) Non-linear solver; (2) Linear solver/preconditioner; (3) Distributed linear algebra; and (4) Local linear algebra.

99 GENERAL AND MISCELLANEOUS↗

Single-point parallel disk correction for asymptotically nonlinear oscillatory shear

We derive exact single-point corrections for parallel disk measurements of all four asymptotically nonlinear measures under strain-controlled oscillatory shear. In this regime, sometimes called medium-amplitude oscillatory shear (MAOS), the derivatives appearing in the general stress correction are constant over the range of interest. This enables an exact single-point correction of all four shear stress components and material functions in the asymptotically nonlinear regime. This greatly simplifies the data processing and allows convenient measurements of true nonlinear material functions with parallel disk geometries. We use a strain amplitude expansion for the stress response, introducing a general non-integer strain amplitude scaling for the leading order nonlinearity, σ ~ γ α , where typically α = 3 has been assumed in the past. The stress corrections are a multiplicative amplification by a factor f(α) = α+3/4, shown for the first time for all four asymptotically nonlinear coefficients. Experimental measurements are presented for the four asymptotically nonlinear signals on an entangled polymer melt of cis-1,4-polyisoprene, using both parallel disk and cone fixtures. The polymer melt follows a cubic (α = 3) strain amplitude scaling in the MAOS regime. Furthermore, the theoretical corrections indicate a 50 % amplification of the apparent signals measured with the parallel disk fixture. The corrected (amplified) signals match the measurements with the cone.

42 ENGINEERING↗

Performance Evaluation of Multi-Vendor Grid-Forming Inverters for Grid-Connected Operation Through Hardware Experimentation: Preprint

Existing real-world projects of GFM inverters that operate in parallel to power grids typically are sized between dozens and a few hundreds Megawatt (MW) scale according to a recent NERC GFM inverter white paper. These large systems are often difficult to evaluate prior to deployments because of their large size. The performance of smaller GFM inverters (dozens to a few hundreds MW) that operate parallel with power grids (distribution systems) is even less understood. There is an opportunity to better understand these systems through hardware testing under controlled laboratory conditions. Therefore, this paper presents the functional performance evaluation tests of multiple (three) commercial GFM inverters when they operate in parallel with the grid through hardware experiments. The goal of these tests is to explore the GFM inverters' functionalities and dynamic response when in parallel with power grids to eventually develop universal specifications for GFM inverters. Both steady state (changing the inverter's frequency and voltage droop) and transient (adding step change in grid's frequency/voltage) tests are performed for each GFM inverter with the same testing circuit and testing protocol. The experimental results indicate the bench-marked performance that: 1) the GFM inverters can be dispatched through frequency and voltage droop intercepts to output the target power when paralleled to the grid; 2) the GFM inverters automatically respond to system frequency and voltage events to output the needed power, however, the GFM inverters all show stability issues when absorbing reactive power from the grid.

grid-forming inverters↗

High Fidelity Simulations of Large-Scale Wireless Networks

The worldwide proliferation of wireless connected devices continues to accelerate. There are 10s of billions of wireless links across the planet with an additional explosion of new wireless usage anticipated as the Internet of Things develops. Wireless technologies do not only provide convenience for mobile applications, but are also extremely cost-effective to deploy. Thus, this trend towards wireless connectivity will only continue and Sandia must develop the necessary simulation technology to proactively analyze the associated emerging vulnerabilities. Wireless networks are marked by mobility and proximity-based connectivity. The de facto standard for exploratory studies of wireless networks is discrete event simulations (DES). However, the simulation of large-scale wireless networks is extremely difficult due to prohibitively large turnaround time. A path forward is to expedite simulations with parallel discrete event simulation (PDES) techniques. The mobility and distance-based connectivity associated with wireless simulations, however, typically doom PDES and fail to scale (e.g., OPNET and ns-3 simulators). We propose a PDES-based tool aimed at reducing the communication overhead between processors. The proposed solution will use light-weight processes to dynamically distribute computation workload while mitigating communication overhead associated with synchronizations. This work is vital to the analytics and validation capabilities of simulation and emulation at Sandia. We have years of experience in Sandia’s simulation and emulation projects (e.g., MINIMEGA and FIREWHEEL). Sandia’s current highly-regarded capabilities in large-scale emulations have focused on wired networks, where two assumptions prevent scalable wireless studies: (a) the connections between objects are mostly static and (b) the nodes have fixed locations.

Onunkwo, Uzoma↗

Coherent structures, intermittent turbulence, and dissipation in high-temperature plasmas

An unsolved problem in plasma turbulence is how energy is dissipated at small scales. Particle collisions are too infrequent in hot plasmas to provide the necessary dissipation. Simulations either treat the fluid scales and impose an ad hoc form of dissipation (e.g., resistivity) or consider dissipation arising from resonant damping of small amplitude disturbances where damping rates are found to be comparable to that predicted from linear theory. Here, we report kinetic simulations that span the macroscopic fluid scales down to the motion of electrons. We find that turbulent cascade leads to generation of coherent structures in the form of current sheets that steepen to electron scales, triggering strong localized heating of the plasma. The dominant heating mechanism is due to parallel electric fields associated with the current sheets, leading to anisotropic electron and ion distributions which can be measured with NASA's upcoming Magnetospheric Multiscale mission. The motion of coherent structures also generates waves that are emitted into the ambient plasma in form of highly oblique compressional and shear Alfven modes. In 3D, modes propagating at other angles can also be generated. This indicates that intermittent plasma turbulence will in general consist of both coherent structures and waves. However, the current sheet heating is found to be locally several orders of magnitude more efficient than wave damping and is sufficient to explain the observed heating rates in the solar wind.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Propagation of acoustic shock waves between parallel rigid boundaries and into shadow zones

The study of acoustic shock propagation in complex environments is of great interest for urban acoustics, but also for source localization, an underlying problematic in military applications. To give a better understanding of the phenomenon taking place during the propagation of acoustic shocks, laboratory-scale experiments and numerical simulations were performed to study the propagation of weak shock waves between parallel rigid boundaries, and into shadow zones created by corners. In particular, this work focuses on the study of the local interactions taking place between incident, reflected, and diffracted waves according to the geometry in both regular or irregular – also called Von Neumann – regimes of reflection. In this latter case, an irregular reflection can lead to the formation of a Mach stem that can modify the spatial distribution of the acoustic pressure. Short duration acoustic shock waves were produced by a 20 kilovolts electric spark source and a schlieren optical method was used to visualize the incident shockfront and the reflection/diffraction patterns. Experimental results are compared to numerical simulations based on the high-order finite difference solution of the two dimensional Navier-Stokes equations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Transport equations in tokamak plasmas

Tokamak plasma transport equations are usually obtained by flux surface averaging the collisional Braginskii equations. However, tokamak plasmas are not in collisional regimes. Also, ad hoc terms are added for neoclassical effects on the parallel Ohm's law, fluctuation-induced transport, heating, current-drive and flow sources and sinks, small magnetic field nonaxisymmetries, magnetic field transients, etc. A set of self-consistent second order in gyroradius fluid-moment-based transport equations for nearly axisymmetric tokamak plasmas has been developed using a kinetic-based approach. The derivation uses neoclassical-based parallel viscous force closures, and includes all the effects noted above. Plasma processes on successive time scales and constraints they impose are considered sequentially: compressional Alfven waves (Grad-Shafranov equilibrium, ion radial force balance), sound waves (pressure constant along field lines, incompressible flows within a flux surface), and collisions (electrons, parallel Ohm's law; ions, damping of poloidal flow). Radial particle fluxes are driven by the many second order in gyroradius toroidal angular torques on a plasma species: seven ambipolar collision-based ones (classical, neoclassical, etc.) and eight nonambipolar ones (fluctuation-induced, polarization flows from toroidal rotation transients, etc.). The plasma toroidal rotation equation results from setting to zero the net radial current induced by the nonambipolar fluxes. The radial particle flux consists of the collision-based intrinsically ambipolar fluxes plus the nonambipolar fluxes evaluated at the ambipolarity-enforcing toroidal plasma rotation (radial electric field). The energy transport equations do not involve an ambipolar constraint and hence are more directly obtained. The 'mean field' effects of microturbulence on the parallel Ohm's law, poloidal ion flow, particle fluxes, and toroidal momentum and energy transport are all included self-consistently. The final comprehensive equations describe radial transport of plasma toroidal rotation, and poloidal and toroidal magnetic fluxes, as well as the usual particle and energy transport.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Columnar Grain-driven Plasticity and Cracking in Nanotwinned FCC Metals

The mechanisms of strengthening and plasticity in columnar-grained metals with preferentially oriented nano-sized twins have been examined traditionally by considering dislocation processes, but rarely from the perspective of grain boundary (GB) deformation. Here, the effects of GB strain accommodation on plastic deformation in four different columnar-grained nanocrystalline nanotwinned (nt) face-centered-cubic metals (Cu, Ag, Al, and Ni) were studied by large-scale molecular dynamics simulations. It is observed that in tensile deformation parallel to coherent twin boundaries (CTBs), the dislocation mechanisms in each metal are identical and associated with GB emissions of jog and threading dislocations at small and large CTB spacings, respectively. However, CTB strengthening effects are increasingly more pronounced in columnar-grained nt metals as their shear modulus increases, which is rationalized by the dependence of GB stress concentrations on twin size, metal type and strain rate. Also, while flow stresses in nt-Cu, nt-Ag, and nt-Al metals increase linearly with decreasing CTB spacing, a maximum strength limit is reached in nt-Ni below a critical CTB spacing of 6 nm. The strength limit in nt-Ni results from columnar GB cracking induced by prominent GB sliding. For columnar-grained microstructures, GB sliding is equivalent in nt-Ag and nt-Al and slightly lower in nt-Cu but markedly higher in nt-Ni. These findings underscore the importance of new GB deformation mechanisms on plasticity and fracture in columnar-grained nt metals and enrich our understanding of CTB strengthening in fcc metals synthesized in the literature.

36 MATERIALS SCIENCE↗

Direct NeTS sampling of nuclear graphite $S(α, β, T)$ in Serpent

For advanced reactor applications, Neural Thermal Scattering (NeTS) modules were developed to predict the thermal scattering law (TSL or $S(α, β, T)$) of a nuclear graphite neutron moderator. NeTS are multi-layer, feedforward artificial neural networks, which act as universal function approximators designed for TSL datasets. In this case, a 4-layer neural network with 164 neurons per layer is trained using FLASSH evaluated data in PyTorch and serialized as a torchscript dictionary to predict $S(α, β, T)$ on-the-fly. Relative, absolute and maximum percent deviations of NeTS from File 7 data generated using the FLASSH code are on the order of 0.01%, 0.1% and 1%, respectively, with low inference latencies of 0.000172 s per $S(α, β, T)$ at a given temperature. Capturing the full dimensionality of possible inelastic neutron-lattice interactions, NeTS functionality is embedded in the Serpent Monte Carlo code, where $S(α, β, T)_{NeTS}$ sampling is conducted on-the-fly and compared to ACE look-up-tables for predicting TREAT criticality. k-eff differences between sampling algorithms of 6 pcm are observed and are within the order of Monte Carlo uncertainty. Compared to discrete and continuous-energy ACE files (30 MB and 131 MB per temperature), the NeTS format is on the order of 200–300 kB for a continuous-temperature, interpolation-free representation of $S(α, β, T)$ and cross sections. NeTS-in-Serpent runtimes comparable with ACE look-up tables are achieved by scaling NeTS for high performance computing architectures with hybrid OpenMP + MPI parallelization. This work validates a novel, self-contained reactor physics framework for predictive cross sections, and demonstrates a general methodology for embedding modern machine learning libraries within existing neutronic analysis frameworks.

Nuclear Criticality Safety Program (NCSP)↗

MFC 5.0: An exascale many-physics flow solver

Many problems of interest in engineering, medicine, and the fundamental sciences rely on high-fidelity flow simulation, making performant computational fluid dynamics solvers a mainstay of the open-source software community. Previous work MFC 3.0 was made a published, documented, and open-source solver via Bryngelson et al. Comp. Phys. Comm. (2021) with numerous physical features, numerical methods, and scalable infrastructure. MFC 5.0 is a significant update to MFC 3.0, featuring a broad set of well-established and novel physical models and numerical methods, as well as the introduction of GPU and APU (or superchip) acceleration. Here, we exhibit state-of-the-art performance and ideal scaling on the first two exascale supercomputers, OLCF Frontier and LLNL El Capitan. Combined with MFC’s single-accelerator performance, MFC achieves exascale computation in practice, and achieved the largest-to-date public CFD simulation at 200 trillion grid points as a 2025 ACM Gordon Bell Prize finalist. New physical features include the immersed boundary method, N-fluid phase change, Euler–Euler and Euler–Lagrange sub-grid bubble models, fluid-structure interaction, hypo- and hyper-elastic materials, chemically reacting flow, two-material surface tension, magnetohydrodynamics (MHD), and more. Numerical techniques now represent the current state-of-the-art, including general relaxation characteristic boundary conditions, WENO variants, Strang splitting for stiff sub-grid flow features, and low Mach number treatments. Weak scaling to tens of thousands of GPUs on OLCF Summit and Frontier and LLNL El Capitan achieves efficiencies within 5% of ideal to over 90% of their respective system sizes. Strong scaling results for a 16-times increase in device count show parallel efficiencies over 90% on OLCF Frontier. MFC’s software stack has undergone further improvements, including continuous integration, which ensures code resilience and correctness through over 300 regression tests; metaprogramming, which reduces code length while maintaining performance portability; and code generation for computing chemical reactions

Computational fluid dynamics↗

Kinematics of the 2015 San Ramon, California earthquake swarm: Implications for fault zone structure and driving mechanisms

Earthquake swarms represent a sudden increase in seismicity that may indicate a heterogeneous fault-zone, the involvement of crustal fluids and/or slow fault slip. Swarms sometimes precede major earthquake ruptures. An earthquake swarm occurred in October 2015 near San Ramon, California in an extensional right step-over region between the northern Calaveras Fault and the Concord–Mt. Diablo fault zone, which has hosted ten major swarms since 1970. The 2015 San Ramon swarm is examined here from 11 October through 18 November using template matching analysis. The relocated seismicity catalog contains ~4000 events with magnitudes between -0.2 < M d < 3.6. The swarm illuminated three sub-parallel, southwest striking and northwest dipping fault segments of km-scale dimension and thickness of up to 200 m. The segments contain coexisting populations of different focal-mechanisms, suggesting a complex fault zone structure with several sets of en échelon fault orientations. The migration of events along the three planar structures indicates a complex fluid and faulting interaction processes. We searched for correlations between seismic activity and tidal stresses and found some suggestive features, but nothing that we can be confident is statistically significant.

58 GEOSCIENCES↗

A parallel domain decomposition-based implicit method for the Cahn–Hilliard–Cook phase-field equation in 3D

We present a numerical algorithm for simulating the spinodal decomposition described by the three dimensional Cahn–Hilliard–Cook (CHC) equation, which is a fourth-order stochastic partial differential equation with a noise term. The equation is discretized in space and time based on a fully implicit, cell-centered finite difference scheme, with an adaptive time-stepping strategy designed to accelerate the progress to equilibrium. At each time step, a parallel Newton–Krylov–Schwarz algorithm is used to solve the nonlinear system. We discuss various numerical and computational challenges associated with the method. The numerical scheme is validated by a comparison with an explicit scheme of high accuracy (and unreasonably high cost). We present steady state solutions of the CHC equation in two and three dimensions. The effect of the thermal fluctuation on the spinodal decomposition process is studied. We show that the existence of the thermal fluctuation accelerates the spinodal decomposition process and that the final steady morphology is sensitive to the stochastic noise. We also show the evolution of the energies and statistical moments. In terms of the parallel performance, it is found that the implicit domain decomposition approach scales well on supercomputers with a large number of processors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Swift heavy-ion irradiation-induced shape and structural transformation in cobalt nanoparticles

The shape and structural evolution of Co nanoparticles embedded in SiO{sub 2} and subjected to swift heavy-ion irradiation have been investigated over a wide energy and fluence range. Modifications of the nanoparticle size and shape were characterized with transmission electron microscopy and small-angle x-ray scattering. Nanoparticles below a threshold diameter remained spherical in shape and progressively decreased in size under irradiation due to dissolution. Nanoparticles above the threshold diameter transformed into nanorods with their major dimension parallel to the incident ion direction. Modifications of the atomic-scale structure of the Co nanoparticles were identified with x-ray absorption spectroscopy. Analysis of the x-ray absorption near-edge spectra showed that prior to irradiation all Co atoms were in a metallic state, while after irradiation Co atoms were in both oxidized and metallic environments, the former consistent with dissolution. The evolution of the nanoparticle short-range order was determined from extended x-ray absorption fine structure spectroscopy. Structural changes in the Co nanoparticles as a function of ion fluence included an increase in disorder and asymmetric deviation from a Gaussian interatomic distance distribution coupled with a decrease in bondlength. Such changes resulted from the irradiation-induced decrease in nanoparticle size and subsequent dissolution.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

In situ nanomechanical testing in focused ion beam and scanning electron microscopes

The recent interest in size-dependent deformation of micro- and nanoscale materials has paralleled both technological miniaturization and advancements in imaging and small-scale mechanical testing methods. Here we describe a quantitative in situ nanomechanical testing approach adapted to a dual-beam focused ion beam and scanning electron microscope. A transducer based on a three-plate capacitor system is used for high-fidelity force and displacement measurements. Specimen manipulation, transfer, and alignment are performed using a manipulator, independently controlled positioners, and the focused ion beam. Gripping of specimens is achieved using electron-beam assisted Pt-organic deposition. Local strain measurements are obtained using digital image correlation of electron images taken during testing. Examples showing results for tensile testing of single-crystalline metallic nanowires and compression of nanoporous Au pillars will be presented in the context of size effects on mechanical behavior and highlight some of the challenges of conducting nanomechanical testing in vacuum environments.

36 MATERIALS SCIENCE↗