Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Quantitative EP Studies and Results for SRF Nb Cavity Production

Cavities and their performance quality are major cost drivers in SRF-based projects. EP is a superior chemical treatment, and now is replacing BCP for producing high gradient SRF cavities. To achieve high performance and reliability, which is essential for Nb SRF cavities production, it is important for us to understand Nb EP in detail so that we can tailor it to the best effect. The analytical tools of electrochemistry and surface topography are the means of developing such understanding. In this talk, the recent incorporation of analytic electrochemical techniques into the development of well controlled protocols for Nb electroplishing will be reported, such as using three electrode method for polarization curve measurements, electrochemical impedance spectroscopy (EIS) to understand the mechanism of EP, and rotating disk electrode (RDE) to study the diffusion coefficient of active species of F ions, and the related diffusion layers etc. In parallel, investigations for monitoring scale-dependent Nb surface morphology evolution under different Nb EP parameters, which is expected to lead to matrix a best EP parameter and have a predictive power to describe the Nb surface evolution during EP will be demonstrated. Early lessons learned that are relevant to Nb cavities will be introduced, and directions for the future are aimed at well control, high reproducibility, efficient, and geometry independent EP process for coming SRF-based projects.

Tian, H.↗

Multi-physics Preconditioning for Thermally Activated Batteries

Thermal batteries, also known as molten-salt batteries, are single-use reserve power systems activated by pyrotechnic heat generation, which transitions the solid electrolyte into a molten state. The simulation of these batteries relies on multiphysics modeling to evaluate performance and behavior under various conditions. This paper presents advancements in scalable preconditioning strategies for the Thermally Activated Battery Simulator (TABS) tool, enabling efficient solutions to the coupled electrochemical systems that dominate computational costs in thermal battery simulations. We propose a hierarchical block Gauss-Seidel preconditioner implemented through the Teko package in Trilinos, which effectively addresses the challenges posed by tightly coupled physics, including charge transport, porous flow, and species diffusion. The preconditioner leverages scalable subblock solvers, including smoothed aggregation algebraic multigrid (SA-AMG) methods and domain-decomposition techniques, to achieve robust convergence and parallel scalability. Strong and weak scaling studies demonstrate the solver’s ability to handle problem sizes up to 51.3 million degrees of freedom on 2048 processors, achieving near sub-second setup and solve times for the end-to-end electrochemical solve. These advancements significantly improve the computational efficiency and turnaround time of thermal battery simulations, paving the way for higher-resolution models and enabling the transition from 2D axisymmetric to full 3D simulations.

25 ENERGY STORAGE↗

Observability of fidelity decay at the Lyapunov rate in few-qubit quantum simulations

In certain regimes, the fidelity of quantum states will decay at a rate set by the classical Lyapunov exponent. This serves both as one of the most important examples of the quantum-classical correspondence principle and as an accurate test for the presence of chaos. While detecting this phenomenon is one of the first useful calculations that noisy quantum computers without error correction can perform, a thorough study of the quantum sawtooth map reveals that observing the Lyapunov regime is just beyond the reach of present-day devices. We prove that there are three bounds on the ability of any device to observe the Lyapunov regime and give the first quantitatively accurate description of these bounds: (1) the Fermi golden rule decay rate must be larger than the Lyapunov rate, (2) the quantum dynamics must be diffusive rather than localized, and (3) the initial decay rate must be slow enough for Lyapunov decay to be observable. This last bound, which has not been recognized previously, places a limit on the maximum amount of noise that can be tolerated. The theory implies that an absolute minimum of 6 qubits is required. Recent experiments on IBM-Q and IonQ imply that some combination of a noise reduction by up to 100x per gate and large increases in connectivity and gate parallelization are also necessary. Finally, scaling arguments are given that quantify the ability of future devices to observe the Lyapunov regime based on trade-offs between hardware architecture and performance.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Thermal Analysis of SRF Cavity Couplers Using Parallel Multiphysics Tool TEM3P

SLAC has developed a multi-physics simulation code TEM3P for simulating integrated effects of electromagnetic, thermal and structural loads. TEM3P shares the same software infrastructure with SLAC’s paralell finite element electromagnetic codes, thus enabling all physics simulations within a single framework. The finite-element approach allows high fidelity, high-accuracy simulations and the parallel implementation facilitates large-scale computation with fast turnaround times. In this paper, TEM3P is used to analyze thermal loading at coupler end of the JLAB SRF cavity.

Source record↗

End-to-End Data Movement Using MPI-IO Over Routed Terabots Infrastructures

Scientific discovery is nowadays driven by large-scale simulations running on massively parallel high-performance computing (HPC) systems. These applications each generate a large amount of data, which then needs to be post-processed for example for data mining or visualization. Unfortunately, the computing platform used for post processing might be different from the one on which the data is initially generated, introducing the challenge of moving large amount of data between computing platforms. This is especially challenging when these two platforms are geographically separated since the data needs to be moved between computing facilities. This is even more critical when scientists tightly couple their domain specific applications with a post processing application. The paper presents a solution for the data transfer between MPI applications using a dedicated wide area network (WAN) terabit infrastructure. The proposed solution is based on parallel access to data files and the Message Passing Interface (MPI) over the Common Communication Infrastructure (CCI) for the data transfer over a routed infrastructure. In the context of this research, the Energy Sciences Network (ESnet) of the U.S. Department of Energy (DOE) is targeted for the transfer of data between DOE national laboratories.

Vallee, Geoffroy R↗

Supporting the Development of Resilient Message Passing Applications using Simulation

An emerging aspect of high-performance computing (HPC) hardware/software co-design is investigating performance under failure. The work in this paper extends the Extreme-scale Simulator (xSim), which was designed for evaluating the performance of message passing interface (MPI) applications on future HPC architectures, with fault-tolerant MPI extensions proposed by the MPI Fault Tolerance Working Group. xSim permits running MPI applications with millions of concurrent MPI ranks, while observing application performance in a simulated extreme-scale system using a lightweight parallel discrete event simulation. The newly added features offer user-level failure mitigation (ULFM) extensions at the simulated MPI layer to support algorithm-based fault tolerance (ABFT). The presented solution permits investigating performance under failure and failure handling of ABFT solutions. The newly enhanced xSim is the very first performance tool that supports ULFM and ABFT.

Engelmann, Christian↗

An Adaptive-Mesh-Refinement Based Computational Tool for Simulating Catalysis at Mesoscale

In this work, we present a computational tool for mesoscale applications using open-source exascale- computing compatible adaptive-mesh-refinement (AMR) library, AMReX [2]. AMReX is software library that enables development of application solvers with block-structured Cartesian AMR. Our tool has capabilities to include realistic geometry representation, chemical species transport, reactions and thermodynamics that are critical for capturing mesoscale physics. A significant achievement is the ability of our solver to automatically import electron microscopy data in the form of a stereolithography (STL) or pixelated file format (mrc, tiff) without undergoing the tedious task of unstructured mesh generation. This feature allows for rapid simulation of catalyst particles with complex morphologies using an immersed-boundary formulation. The use of AMR allows for higher resolutions at catalyst surface interfaces, which in turn provides an accurate description of surface reactions and transport. Our solver uses a hybrid distributed and shared memory parallelism (OpenMP/GPU-based) with which strong scaling up to 10,000 processors for realistic catalyst particle simulations have been demonstrated.

BIOMASS FUELS,MATHEMATICS AND COMPUTING↗

What Clinical Trials Can Teach Us About the Development of More Resilient AI for Cybersecurity

Policy-mandated, rigorously administered scientific testing is needed to provide transparency into the efficacy of artificial intelligence-–based (AI-based) cyber defense tools for consumers and to prioritize future research and development. In this work, we propose a model that is informed by our experience, urged forward by massive-scale cyberattacks, and inspired by parallel developments in the biomedical field and the unprecedentedly fast development of new vaccines to combat global pathogens.

97 MATHEMATICS AND COMPUTING↗

Thermal Analysis of SRF Cavity Couplers Using Parallel Multiphysics Tool TEM3P

SLAC has developed a multi-physics simulation code TEM3P for simulating integrated effects of electromagnetic, thermal and structural loads. TEM3P shares the same software infrastructure with SLAC's parallel finite element electromagnetic codes, thus enabling all physics simulations within a single framework. The finite-element approach allows high-fidelity, high-accuracy simulations and the parallel implementation facilitates large-scale computation with fast turnaround times. In this paper, TEM3P is used to analyze thermal loading at coupler end of the JLAB SRF cavity.

43 PARTICLE ACCELERATORS↗

Modeling of Sediment Bed Behavior for Critical Velocity in Horizontal Piping

This paper compares results from a predictive tool for modeling transport of a multiphase mixture (solids in a liquid) in a pipeline, (up to and including plugging) with experiments performed to support the Hanford site’s Waste Treatment and Immobilization Plant (WTP). The treatment of high-level waste at the DOE Office of River Protection’s WTP will involve the transfer of high solid content suspensions through pipelines. Pipeline plugging was identified as a significant potential issue by a panel of external experts. In response to their concerns an experimental effort was initiated at PNNL to determine the critical velocities for a variety of operating conditions. A computational method has been developed to predict the dynamic behavior of a sediment bed in response to the surrounding suspension flow. The flow field is modeled using a lattice kinetics method, similar to the lattice Boltzmann method, which scales very well on highly parallel computers. Turbulent quantities are calculated using a k-epsilon RANS model. This work is part of a larger effort to develop a process simulation capability for a wide range of applications. Solids are represented using two different continuum fields. The suspended solids are treated as passive scalars in the flow field, including terms for hindered settling and Brownian diffusion. Normal stresses created by the irreversible collisions of particles during shearing are added to the pressure tensor. The sediment bed interface is represented using a continuum phase field with a diffuse interface. The bed may change with time due to settling, erosion and deposition through convection. The erosion rates are calculated using the local shear stress obtained from the turbulence model. The method is compared with data from the PNNL pipeline experiments conducted at PNNL (Poloski et al. 2008). The experimental flow loop consists of 3-inch schedule 40 piping with instrumentation for determining flow rate and pressure gradient. The simulant test particles ranged in density from 2.5 to 8 g/cc while the nominal particle size ranged from 10 to 100 μm. At the beginning of each test, the slurry flow velocity was nominally set to 8 ft/sec. The flow was incrementally ramped down, and a steady-state pressure gradient was obtained at each flow condition. A rise in pressure gradient as the flow rate drops indicates that the pipe cross-sectional area is beginning to fill with sediment. This point is referred to as the “critical velocity”. Visualization information is provided using Electrical Resistance Tomography (ERT). The paper will show favorable comparison of results with data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Kinetic Monte Carlo simulation of the aging of nanoporous metals.

Nanoporous metallic particles are of great interest for a range of applications including catalysis, gas storage, and electrical energy storage. In particular, recent work has shown that bulk powders of porous palladium can be synthesized in a scalable fashion. This material has pore sizes in the 2-5 nm range and has promise for use in hydrogen storage applications. However, because of the small pore size such materials are very susceptible to morphological evolution during aging, especially at elevated temperatures, leading to degradation of their storage properties. To better understand and predict the phenomena at work in nanoporous metal aging, we have developed a kinetic Monte Carlo (kMC) model for the simulation of atomic diffusion in a Pd lattice. The model is implemented in Sandia's parallelized kMC code SPPARKS. SPPARKS utilizes a spatial decomposition parallelization scheme, allowing large-scale simulations including millions of atoms. The diffusion model includes single-atom hops as well as Schwoebel barrier events that mimic concerted atom motions involving multiple lattice sites. Our simulations show that for statistically homogeneous nanoporous networks, coarsening at elevated temperature as measured by the surface area can be described by a scaling law that closely follows the L {approx} {sup 1/4} scaling predicted by continuum surface diffusion theory. This scaling holds despite the presence of surface faceting due to our simulations being run at temperatures below the roughening temperature of the material. Sensitivities of the rate of coarsening, the scaling exponent, and the amount of surface faceting to model parameters including temperature and event activation rates are explored. Because of the large spatial scales attainable in our computations, we are able to simulate nanoporous particle geometries similar to those synthesized in the laboratory, and compare directly to material aging experiments including porosimetry measurements and TEM images of particles.

08 HYDROGEN↗

Multiple Independent File Parallel I/O with HDF5

The HDF5 library has supported the I/O requirements of HPC codes at Lawrence Livermore National Labs (LLNL) since the late 90’s. In particular, HDF5 used in the Multiple Independent File (MIF) parallel I/O paradigm has supported LLNL code’s scalable I/O requirements and has recently been gainfully used at scales as large as O(10 6 ) parallel tasks.

97 MATHEMATICS AND COMPUTING↗

ENERGETIC PARTICLE DIFFUSION IN CRITICALLY BALANCED TURBULENCE

Observations and modeling suggest that the fluctuations in magnetized plasmas exhibit scale-dependent anisotropy, with more energy in the fluctuations perpendicular to the mean magnetic field than in the parallel fluctuations and the anisotropy increasing at smaller scales. The scale dependence of the anisotropy has not been studied in full-orbit simulations of particle transport in turbulent plasmas so far. In this paper, we construct a model of critically balanced turbulence, as suggested by Goldreich and Sridhar, and calculate energetic particle spatial diffusion coefficients using full-orbit simulations. The model uses an enveloped turbulence approach, where each two-dimensional wave mode with wavenumber k is packed into envelopes of length L following the critical balance condition, L{proportional_to}k {sup -2/3} , with the wave mode parameters changing between envelopes. Using full-orbit particle simulations, we find that both the parallel and perpendicular diffusion coefficients increase by a factor of two, compared to previous models with scale-independent anisotropy.

79 ASTRONOMY AND ASTROPHYSICS↗

Multi-Node Program Fuzzing on High Performance Computing Resources

Significant effort is placed on tuning the internal parameters of fuzzers to explore the state space, measured as coverage, of binaries. In this work, we investigate the effects of the external environment on the resulting coverage after fuzzing two binaries with AFL for 24 hours. Parameters such as scaling to multiple nodes, node saturation, and parallel file system type on HPC resources are controlled in order to maximize coverage. It will be shown that employing a parallel file system such as IBM's General Parallel File System offers an advantage for fuzzing operations, since it contains enhancements for performance optimization. When combined with scaling to two and four nodes, while simultaneously restricting the number of coordinated AFL tasks per node on the low end (10-50% of available physical cores), coverage may be enhanced within a shorter period of time. Thus, controlling the external environment is a useful effort.

97 MATHEMATICS AND COMPUTING↗

A block-tridiagonal solver with two-level parallelization for finite element-spectral codes

Two-level parallelization is introduced to solve a massive block-tridiagonal matrix system. One-level is used for distributing blocks whose size is as large as the number of block rows due to the spectral basis, and the other level is used for parallelizing in the block row dimension. The reason for the added parallelization dimension is to retard the saturation of the scaling due to communication overhead and inefficiencies in the single-level parallelization only distributing blocks. As a technique for parallelizing the tridiagonal matrix, the combined method of “Partitioned Thomas method” and “Cyclic Odd–Even Reduction” is implemented in an MPI-Fortran90 based finite element-spectral code (TORIC) that calculates the propagation of electromagnetic waves in a tokamak. The two-level parallel solver using thousands of processors shows more than 5 times improved computation speed with the optimized processor grid compared to the single-level parallel solver under the same conditions. Three-dimensional RF field reconstructions in a tokamak are reflected as examples of the physics simulations that have been enabled by this algorithmic advance.

97 MATHEMATICS AND COMPUTING↗

HydraGNN v5.0

HydraGNN v5.0 expands the code base into a more portable, scalable, and flexible framework for scientific graph learning, with particular strength in atomistic machine-learning interatomic potentials and large-scale distributed training. The release adds Fully Sharded Data Parallel (FSDP) support alongside existing DDP and DeepSpeed paths, including FSDP-aware checkpointing and optimizer integration, and introduces a configurable multi-precision training workflow supporting FP32, BF16, and FP64 across GPUs and Intel XPUs. For atomistic modeling, HydraGNN v5.0 strengthens its MLIP capabilities through dynamic graph construction at every forward pass, energy-conserving force prediction via automatic differentiation, and per-atom energy loss formulations, while extending EGNN models to properly handle periodic boundary conditions. The release also broadens model expressiveness through graph-level attribute conditioning, adds new multi-task and model-parallel extensions such as MACE support and encoder/decoder branch optimization, and expands application coverage with integrated examples for datasets including OC25, Nabla2-DFT, QCML, Open Polymers 2026, and OPF. In parallel, HydraGNN v5.0 improves production readiness through performance optimizations for large-scale runs, stratified sampling and linear-regression preprocessing utilities, and tested installation scripts for DOE supercomputers including Frontier, Aurora, Perlmutter, and Andes. Overall, the release advances HydraGNN as a robust software platform for scalable graph neural networks across materials science, chemistry, and scientific machine learning workflows

Lupo Pasini, Massimiliano [Oak Ridge National Labo↗

Extreme-Scale Bayesian Inference for Uncertainty Quantification of Complex Simulations

Uncertainty quantification (UQ)—that is, quantifying uncertainties in complex mathematical models and their large-scale computational implementations—is widely viewed as one of the outstanding challenges facing the field of CS&E over the coming decade. The EUREKA project set to address the most difficult class of UQ problems: those for which both the underlying PDE model as well as the uncertain parameters are of extreme scale. In the project we worked on these extreme-scale challenges in the following four areas: 1. Scalable parallel algorithms for sampling and characterizing the posterior distribution that exploit the structure of the underlying PDEs and parameter-to-observable map. These include structure-exploiting versions of the randomized maximum likelihood method, which aims to overcome the intractability of employing conventional MCMC methods for solving extreme-scale Bayesian inversion problems by appealing to and adapting ideas from large-scale PDE-constrained optimization, which have been very successful at exploring high-dimensional spaces. 2. Scalable parallel algorithms for construction of prior and likelihood functions based on learning methods and non-parametric density estimation. Constructing problem-specific priors remains a critical challenge in Bayesian inference, and more so in high dimensions. Another challenge is construction of likelihood functions that capture unmodeled couplings between observations and parameters. We will create parallel algorithms for non-parametric density estimation using high dimensional N-body methods and combine them with supervised learning techniques for the construction of priors and likelihood functions. 3. Bayesian inadequacy models, which augment physics models with stochastic models that represent their imperfections. The success of the Bayesian inference framework depends on the ability to represent the uncertainty due to imperfections of the mathematical model of the phenomena of interest. This is a central challenge in UQ, especially for large-scale models. We propose to develop the mathematical tools to address these challenges in the context of extreme-scale problems. 4. Parallel scalable algorithms for Bayesian optimal experimental design (OED). Bayesian inversion yields quantified uncertainties in the model parameters, which can be propagated forward through the model to yield uncertainty in outputs of interest. This opens the way for designing new experiments to reduce the uncertainties in the model parameters and model predictions. Such experimental design problems have been intractable for large-scale problems using conventional methods; we will create OED algorithms that exploit the structure of the PDE model and the parameter-to-output map to overcome these challenges. Parallel algorithms for these four problems were created, analyzed, prototyped, implemented, tuned, and scaled up for leading-edge supercomputers, including UT-Austin’s own 10 petaflops Stampede system, ANL’s Mira system, and ORNL’s Titan system. While our focus is on fundamental mathematical/computational methods and algorithms, we will assess our methods on model problems derived from several DOE mission applications, including multiscale mechanics and ice sheet dynamics.

97 MATHEMATICS AND COMPUTING↗

A compact linear accelerator based on a scalable microelectromechanical-system RF-structure

Here, a new approach for a compact radio-frequency (RF) accelerator structure is presented. The new accelerator architecture is based on the Multiple Electrostatic Quadrupole Array Linear Accelerator (MEQALAC) structure that was first developed in the 1980s. The MEQALAC utilized RF resonators producing the accelerating fields and providing for higher beam currents through parallel beamlets focused using arrays of electrostatic quadrupoles (ESQs). While the early work obtained ESQs with lateral dimensions on the order of a few centimeters, using a printed circuit board (PCB), we reduce the characteristic dimension to the millimeter regime, while massively scaling up the potential number of parallel beamlets. Using Microelectromechanical systems scalable fabrication approaches, we are working on further red ucing the characteristic dimension to the sub-millimeter regime. The technology is based on RF-acceleration components and ESQs implemented in the PCB or silicon wafers where each beamlet passes through beam apertures in the wafer. The complete accelerator is then assembled by stacking these wafers. This approach has the potential for fast and inexpensive batch fabrication of the components and flexibility in system design for application specific beam energies and currents. For prototyping the accelerator architecture, the components have been fabricated using the PCB. In this paper, we present proof of concept results of the principal components using the PCB: RF acceleration and ESQ focusing. Finally, ongoing developments on implementing components in silicon and scaling of the accelerator technology to high currents and beam energies are discussed.

43 PARTICLE ACCELERATORS↗