Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “weak scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Reducing communication in algebraic multigrid with multi-step node aware communication

Algebraic multigrid (AMG) is often viewed as a scalable [Formula: see text] solver for sparse linear systems. Yet, AMG lacks parallel scalability due to increasingly large costs associated with communication, both in the initial construction of a multigrid hierarchy and in the iterative solve phase. This work introduces a parallel implementation of AMG that reduces the cost of communication, yielding improved parallel scalability. It is common in Message Passing Interface (MPI), particularly in the MPI-everywhere approach, to arrange inter-process communication, so that communication is transported regardless of the location of the send and receive processes. Performance tests show notable differences in the cost of intra- and internode communication, motivating a restructuring of communication. In this case, the communication schedule takes advantage of the less costly intra-node communication, reducing both the number and the size of internode messages. Node-centric communication extends to the range of components in both the setup and solve phase of AMG, yielding an increase in the weak and strong scaling of the entire method.

Computer Science↗
DOE OSTI2024

The Pele Simulation Suite for Reacting Flows at Exascale

In this work, we present the Pele suite of software tools for compressible and incompressible reacting flows. The Pele suite leverages several different libraries, notably AMReX and SUNDIALS, to achieve performance portability on heterogeneous computing architectures across the supercomputing landscape. The Pele suite is comprised of PeleC, a compressible reacting flow block-structured adaptive mesh refinement solver, PeleLMeX, a low-Mach number reacting flow block-structured adaptive mesh refinement solver, Pele-Physics, a library for transport, thermodynamics, finite rate chemistry, soot, spray and radiation physics. The objective of this paper is (i) to present the code development efforts necessary to achieve highly effective and scalable applications for exascale machines and (ii) to detail the performance results of the Combustion-Pele project applications on Oak Ridge National Laboratory's Frontier. We show good weak and strong scaling results for both PeleC and PeleLMeX up to more than 50 billion cells on more than 4096 Frontier graphics processing unit nodes. We also present a capability demonstration simulation of a dual-fuel pulse compression ignition engine (six adaptive mesh refinement levels, and 60 billion cells or 2.1 trillion degrees of freedom) on Frontier, to date one of the largest simulations performed on the first exascale-class supercomputer.

adaptive mesh refinement↗
DOE OSTI2021

Grid Forming Inverter: Laboratory-Scale Hardware Test Bed Setup and Weak Grid Operation

In recent times, the concept of grid forming inverters has gained popularity. Grid forming inverters have proven to be a promising alternative to the grid following inverters. In this paper, we present the hardware test bed implementation of grid forming inverter in islanding mode as well as in grid connected mode. The control structure includes inverter-level inner current control and outer voltage control, and plant-level P - f and Q - V droop control. The Q - V droop provides the voltage command, whereas P - f droop provides the frequency command and is also key for the synchronization process. While it is straightforward to set up the test bed for the islanded operation, it is a challenging process to set up the grid-forming inverter in the grid-connected mode. We present the key technologies and demonstrate the start-up process and weak grid operation using the hardware experiment results. Results from EMT model developed in MATLAB/SimPowerSystems are also presented for side-by-side comparison.

Mittal, Ratik↗
DOE OSTI2023

Non-local contribution from small scales in galaxy–galaxy lensing: comparison of mitigation schemes

ABSTRACT Recent cosmological analyses with large-scale structure and weak lensing measurements, usually referred to as 3 × 2pt, had to discard a lot of signal to noise from small scales due to our inability to accurately model non-linearities and baryonic effects. Galaxy–galaxy lensing, or the position–shear correlation between lens and source galaxies, is one of the three two-point correlation functions that are included in such analyses, usually estimated with the mean tangential shear. However, tangential shear measurements at a given angular scale θ or physical scale R carry information from all scales below that, forcing the scale cuts applied in real data to be significantly larger than the scale at which theoretical uncertainties become problematic. Recently, there have been a few independent efforts that aim to mitigate the non-locality of the galaxy–galaxy lensing signal. Here, we perform a comparison of the different methods, including the Y-transformation, the point-mass marginalization methodology, and the annular differential surface density statistic. We do the comparison at the cosmological constraints level in a combined galaxy clustering and galaxy–galaxy lensing analysis. We find that all the estimators yield equivalent cosmological results assuming a simulated Rubin Observatory Legacy Survey of Space and Time (LSST) Year 1 like set-up and also when applied to DES Y3 data. With the LSST Y1 set-up, we find that the mitigation schemes yield ∼1.3 times more constraining S8 results than applying larger scale cuts without using any mitigation scheme.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Detecting dark matter substructures on small scales with fast radio bursts

The matter power spectrum is only weakly constrained on subgalactic scales, while physics beyond the Standard Model can leave unique imprints, especially on sub-parsec scales. We propose measuring the arrival-time difference of fast radio bursts (FRBs) along two adjacent sightlines as a new probe to dark matter substructures on scales down to ∼ 1 AU . We discuss two observational scenarios in which it may be possible to place interesting constraints on such models through the monitoring of repeating FRB sources: (i) By sending radio receivers to space to form a baseline of tens of AU or more and measuring the temporal variation of the arrival-time difference between receivers. (ii) By measuring the temporal variation of the arrival-time difference between two lensed images of one strongly lensed repeater. In both scenarios, obtaining interesting constraints requires correlating the voltage time series to measure the radio signal arrival time to sub-nanosecond precision. We find that two radio dishes separated by 20 AU may be sensitive to the enhancement of small-scale structures at ∼ 10 - 8 M ⊙ masses in the QCD axion dark matter scenario, or from an early epoch of matter domination with a reheating temperature up to 60 MeV. Other dark matter models, such as those composed of ∼ 10 - 13 M ⊙ primordial black holes produced during inflation, would also be probed by this method. We further show that a strong lensing situation of multiple images provides an equivalent ∼ 2000 AU ( σ v / 10 3 km s - 1 ) ( δ t / 10 yr ) baseline, for a typical velocity of dark matter substructures σ v and an observational time span δ . This is much more sensitive, but with the uncertainty that intervening decoherence from the interstellar medium may degrade the timing precision, and that spatial variation in the FRB emission spot may result in confounding signals. We show that the lensing magnifications of Type Ia supernovae constrain a similar quantity to such FRB timing, with present limits being equivalent to ruling out the same parameter space that would be probed by a 0.14 AU baseline.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Galaxy Zoo DESI: large-scale bars as a secular mechanism for triggering AGNs

ABSTRACT Despite the evidence that supermassive black holes (SMBHs) co-evolve with their host galaxy, and that most of the growth of these SMBHs occurs via merger-free processes, the underlying mechanisms which drive this secular co-evolution are poorly understood. We investigate the role that both strong and weak large-scale galactic bars play in mediating this relationship. Using 48 871 disc galaxies in a volume-limited sample from Galaxy Zoo DESI, we analyse the active galactic nucleus (AGN) fraction in strongly barred, weakly barred, and unbarred galaxies up to $z = 0.1$ over a range of stellar masses and colours. After controlling for stellar mass and colour, we find that the optically selected AGN fraction is $31.6 \pm 0.9$ per cent in strongly barred galaxies, $23.3 \pm 0.8$ per cent in weakly barred galaxies, and $14.2 \pm 0.6$ per cent in unbarred disc galaxies. These are highly statistically robust results, strengthening the tantalizing results in earlier works. Strongly barred galaxies have a higher fraction of AGNs than weakly barred galaxies, which in turn have a higher fraction than unbarred galaxies. Thus, while bars are not required in order to grow an SMBH in a disc galaxy, large-scale galactic bars appear to facilitate AGN fuelling, and the presence of a strong bar makes a disc galaxy more than twice as likely to host an AGN than an unbarred galaxy at all galaxy stellar masses and colours.

Astronomy & Astrophysics↗
DOE OSTI2025

Quantum simulation of Lindbladian dynamics via repeated interactions

The Lindblad equation generalizes the Schrödinger equation to quantum systems that undergo dissipative dynamics. The quantum simulation of Lindbladian dynamics is therefore non-unitary, preventing a naive application of state-of-the-art quantum algorithms. Here, we make use of an approximate correspondence between Lindbladian dynamics and evolution based on repeated interaction (RI) CPTP maps to write down a Hamiltonian formulation of the Lindblad dynamics and derive a rigorous error bound on the master equation. Specifically, we show that the number of interactions needed to simulate the Liouvillian within error e scales in most physical scenarios as . This is significant because the error in the Lindbladian approximation to the dynamics is not explicitly bounded in existing quantum algorithms for open system simulations. We then provide quantum algorithms to simulate RI maps using an iterative qubitization approach and Trotter–Suzuki formulas, and specifically show that for iterative qubitization the number of operations needed to simulate the dynamics (for a fixed value of ?) scales as in the limit where a0 (the coefficient 1-norm for the system and bath Hamiltonians) asymptotically dominates over the corresponding factor for the interaction Hamiltonian, which is often the case in weak coupling. This scaling would appear to be optimal if the complexity of ? is not considered, which underscores the importance of considering the error in the Liouvillian that we reveal in this work.

Quantum Computing↗
DOE OSTI2020

The Case for Strong Scaling in Deep Learning: Training Large 3D CNNs with Hybrid Parallelism

Here, we present scalable hybrid-parallel algorithms for training large-scale 3D convolutional neural networks. Deep learning-based emerging scientific workflows often require model training with large, high-dimensional samples, which can make training much more costly and even infeasible due to excessive memory usage. We solve these challenges by extensively applying hybrid parallelism throughout the end-to-end training pipeline, including both computations and I/O. Our hybrid-parallel algorithm extends the standard data parallelism with spatial parallelism, which partitions a single sample in the spatial domain, realizing strong scaling beyond the mini-batch dimension with a larger aggregated memory capacity. We evaluate our proposed training algorithms with two challenging 3D CNNs, CosmoFlow and 3D U-Net. Our comprehensive performance studies show that good weak and strong scaling can be achieved for both networks using up to 2K GPUs. More importantly, we enable training of CosmoFlow with much larger samples than previously possible, realizing an order-of-magnitude improvement in prediction accuracy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Ion thermal transport in the H-mode edge transport barrier on DIII-D

The power balance ion heat flux in the pedestal region on DIII-D increases and becomes increasingly anomalous (above conventional neoclassical) in experiments with higher temperature and lower density pedestals where the ion collisionality ($v^*_i$) is lowered toward values expected on ITER. Direct measurements of the main-ion temperature are shown to be essential on DIII-D when calculating the ion heat flux due to differences between the temperature of $D^+$ and the more commonly measured $C^{6+}$ impurity ions approaching the separatrix. Neoclassical transport calculations from NEO and non-linear gyrokinetic calculations using CGYRO are consistent with these observations and show that while neoclassical transport plays an important role, the turbulent ion heat flux due to ion scale electrostatic turbulence is significant and can contribute similar or larger ion heat fluxes at lower collisionality. Beam emission spectroscopy and Doppler backscattering measurements in the steep gradient region of the H-mode pedestal reveal increased broadband, long-wavelength ion scale fluctuations for the low $v^*_i$ discharges at the radius where the non-linear CGYRO simulations were run. Taken together, increased fluctuations, power balance calculations, and gyrokinetic simulations show that the above neoclassical ion heat fluxes, including the increases at lower $v^*_i$, are likely due to weakly suppressed ion scale electrostatic turbulence. These new results are based on world first inferred ion and electron heat fluxes in the pedestal region of deuterium plasmas using direct measurements of the deuterium temperature for power balance across ion collisionalities covering an order of magnitude from high $v^*_i$ values of 1.3 down to ITER relevant $v^*_i$ ~0.1.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

The UV fate of anomalous U(1)s and the Swampland

Massive U(1) gauge theories featuring parametrically light vectors are suspected to belong in the Swampland of consistent EFTs that cannot be embedded into a theory of quantum gravity. We study four-dimensional, chiral U(1) gauge theories that appear anomalous over a range of energies up to the scale of anomaly-cancelling massive chiral fermions. We show that such theories must be UV-completed at a finite cutoff below which a radial mode must appear, and cannot be decoupled — a Stückelberg limit does not exist. When the infrared fermion spectrum contains a mixed U(1)-gravitational anomaly, this class of theories provides a toy model of a boundary into the Swampland, for sufficiently small values of the vector mass. In this context, we show that the limit of a parametrically light vector comes at the cost of a quantum gravity scale that lies parametrically below MP1, and our result provides field theoretic evidence for the existence of a Swampland of EFTs that is disconnected from the subset of theories compatible with a gravitational UV-completion. Moreover, when the low energy theory also contains a U(1) 3 anomaly, the Weak Gravity Conjecture scale makes an appearance in the form of a quantum gravity cutoff for values of the gauge coupling above a certain critical size.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Parallel physics-informed neural networks via domain decomposition

Here we develop a distributed framework for the physics-informed neural networks (PINNs) based on two recent extensions, namely conservative PINNs (cPINNs) and extended PINNs (XPINNs), which employ domain decomposition in space and in time-space, respectively. This domain decomposition endows cPINNs and XPINNs with several advantages over the vanilla PINNs, such as parallelization capacity, large representation capacity, efficient hyperparameter tuning, and is particularly effective for multi-scale and multi-physics problems. Here, we present a parallel algorithm for cPINNs and XPINNs constructed with a hybrid programming model described by MPI + X, where X ∈ {CPUs, GPUs}. The main advantage of cPINN and XPINN over the more classical data and model parallel approaches is the flexibility of optimizing all hyperparameters of each neural network separately in each subdomain. We compare the performance of distributed cPINNs and XPINNs for various forward problems, using both weak and strong scalings. Our results indicate that for space domain decomposition, cPINNs are more efficient in terms of communication cost but XPINNs provide greater flexibility as they can also handle time-domain decomposition for any differential equations, and can deal with any arbitrarily shaped complex subdomains. To this end, we also present an application of the parallel XPINN method for solving an inverse diffusion problem with variable conductivity on the United States map, using ten regions as subdomains.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Spectrum of kinetic-Alfvén-wave turbulence: intermittency or tearing mediation?

We investigate the spectral properties of the electromagnetic fluctuations of sub-ion scale turbulence in weakly collisional, low-beta plasmas using a two-field isothermal gyrofluid model. The numerical results strongly support a description of the turbulence as a critically balanced Kolmogorov-like cascade of kinetic Alfvén wave fluctuations, as amended by previous studies to include intermittency effects. The measured universal index of the energy spectra from systems with different flux-unfreezing mechanisms excludes the role of tearing mediation in determining the spectra. The fluctuations remain isotropic in the plane perpendicular to the strong background magnetic fields as they cascade to smaller scales, which explains the absence of tearing mediation. The calculation of high-order, multipoint structure functions of magnetic fluctuations suggests that the intermittent structures have a quasi-2D, sheet-type morphology. In conclusion, these results are useful for explaining recent observations of the spectrum and structure of magnetic and density fluctuations in the solar wind at sub-proton scales, and are relevant for modelling the energy dissipation in a broad range of astrophysical systems.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Photon counting with intensified charge coupled device (ICCD) – I. In-depth detector characterization

While the adsorption properties of transition metal catalysts have been widely studied, leading to the discovery of various scaling relations, descriptors of catalytic activity, and well-established computational models, a similar understanding of semiconductor catalysts has not yet been achieved. In this work, we present a high-throughput density functional theory investigation into the adsorption properties of 5 oxides of interest to the photocatalytic CO 2 reduction reaction: TiO 2 (rutile and anatase), SrTiO 3 , NaTaO 3 , and CeO 2 . Using a systematic approach, we exhaustively identify unique surfaces and construct adsorption structures to undergo geometry optimizations. We then perform a data-driven analysis, which reveals the presence of weak adsorption energy scaling relations, the propensity of adsorbates of interest to interact with oxygen surface sites, and the importance of slab deformation upon adsorption. Our findings are presented in the context of experimental observations and in comparison to previously studied classes of catalysts, such as pure metals and tellurium-containing semiconductors, and reinforce the need for a comprehensive approach to the study of site-specific surface phenomena on semiconductors.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Systematic computational study of oxide adsorption properties for applications in photocatalytic CO 2 reduction

While the adsorption properties of transition metal catalysts have been widely studied, leading to the discovery of various scaling relations, descriptors of catalytic activity, and well-established computational models, a similar understanding of semiconductor catalysts has not yet been achieved. In this work, we present a high-throughput density functional theory investigation into the adsorption properties of 5 oxides of interest to the photocatalytic CO 2 reduction reaction: TiO 2 (rutile and anatase), SrTiO 3 , NaTaO 3 , and CeO 2 . Using a systematic approach, we exhaustively identify unique surfaces and construct adsorption structures to undergo geometry optimizations. We then perform a data-driven analysis, which reveals the presence of weak adsorption energy scaling relations, the propensity of adsorbates of interest to interact with oxygen surface sites, and the importance of slab deformation upon adsorption. Our findings are presented in the context of experimental observations and in comparison to previously studied classes of catalysts, such as pure metals and tellurium-containing semiconductors, and reinforce the need for a comprehensive approach to the study of site-specific surface phenomena on semiconductors.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Planetary normal mode computation: Parallel algorithms, performance and reproducibility

This report is an extension of work entitled “Computing planetary interior normal modes with a highly parallel polynomial filtering eigensolver.” by Shi et al., [1] originally presented at the SC18 conference. A highly parallel polynomial filtered eigensolver was developed and exploited to calculate the planetary normal modes. The proposed method is ideally suited for computing interior eigenpairs for large-scale eigenvalue problems as it greatly enhances memory and computational efficiency. In this article, the second-order finite element method is used to further improve the accuracy as only the first-order finite element method was deployed in the previous work. The parallel algorithm, its parallel performance up to 20k processors, and the great computational accuracy are illustrated. The reproducibility of the previous work was successfully performed on the Student Cluster Competition at the SC19 conference by several participant teams using a completely different Mars-model dataset on different clusters. Both weak and strong scaling performances of the reproducibility by the participant teams were impressive and encouraging. The analysis and reflection of their results are demonstrated and future direction is discussed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Direct numerical simulations for hybrid rocket boundary layers: Performance modeling and scaling

This paper presents a comprehensive performance and scaling analysis of direct numerical simulations for reacting boundary layers, focusing on slab burner configurations. Using a PETSc-based finite volume CFD framework, the study evaluates the scalability and computational cost of flow, chemistry, and radiation evaluations across 2D and 3D simulations. Polymethyl methacrylate (PMMA) is the fuel with pure O 2 as the oxidizer, modeled using a detailed chemical kinetics mechanism with 113 species and 660 reactions. A ray-tracing-based radiation solver, designed for distributed memory applications, is implemented to model radiation heat transfer. Parallel scalability is analyzed for the coupled flow, chemistry, and radiation heat transfer processes. Weak and strong scaling studies are conducted on up to 15,000 computational ranks, revealing robust performance when flow cells exceed 200 per rank. Chemistry evaluations dominate the computational cost in large 3D simulations, accounting for approximately 40% of the total runtime, while flow processes contribute around 35%, and radiation solver contributions remain below 10% due to reduced evaluation frequencies. GPU accelerated chemistry evaluation, implemented with Zero-RK, demonstrates significant promise, achieving up to a 4x speedup for workloads exceeding 30,000 cells per GPU. However, diminishing returns are observed for smaller workloads due to CPU-GPU communication overhead. This study identifies key challenges, including memory bottlenecks and the effects of domain partitioning on flow scalability, while highlighting the potential of GPU-accelerated chemistry to reduce computational costs. In conclusion, these findings provide realizable run configurations for 2D, 3D, and GPU-accelerated cases, offering insights for optimizing reactive flow solvers.

CFD Scalability↗
DOE OSTI2025

OpenSn: A massively parallel, open-source simulation environment for discrete ordinates radiation transport

OpenSn is an open-source, massively parallel deterministic radiation transport code for solving the discrete-ordinates ( S N ) form of the Boltzmann transport equation on unstructured, arbitrary polyhedral meshes. It supports high-fidelity simulations involving steady-state, eigenvalue, and adjoint problems for neutral particles (e.g., neutrons, photons, multi-particles), using the multigroup approximation in energy. OpenSn combines angular discretization via discrete ordinates with a discontinuous Galerkin finite element method (DGFEM) in space, enabling accurate resolution of transport physics on arbitrary polyhedral cells, included locally refined spatial grids. It includes multiple angular quadrature types, including locally refined angular quadratures. Written in modern C++ with a Python API, OpenSn runs efficiently on platforms ranging from laptops to supercomputers. The transport sweep algorithm is implemented using a task-based, directed-acyclic-graph (DAG) approach for each angle and supports asynchronous parallelism across thousands of MPI ranks. Group-set aggregation improves compute intensity, and synthetic acceleration techniques (e.g., diffusion synthetic acceleration, second-moment method) enhance solver convergence. OpenSn has been verified on reactor physics problems and demonstrated excellent weak and strong scaling performance on more than 32,768 processes, making it a versatile and robust platform for large-scale transport simulations in complex geometries.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Determining Spatial Scales of Soil Moisture—Cloud Coupling Pathways Using Semi-Idealized Simulations

The spatial scales of land-atmosphere interactions over heterogeneous, realistic soil moisture patterns are critical to improve our understanding of land-atmosphere interactions. However, these scales are poorly quantified. We use high-resolution numerical experiments to quantify the spatial scales for a selected day during the Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) campaign in Oklahoma. A semi-idealized approach (removing background winds and surface topography while retaining the real-world data for other boundary conditions) enables examination of the local influence from the surface. Simulations that apply uniform surface, variable land cover with uniform soil moisture, and variable land cover with variable soil moisture are then compared. Land cover variations, especially water and urban surfaces, create two variance peaks in the surface sensible heat flux in the scales >10 km (meso-β) and <6 km (meso-γ). Both peaks are enhanced by the observation-based soil moisture distribution that has most of its variance in the meso-β scale. Atmospheric response in the meso-β scale is hydrostatic with weak vertical motion. The land cover variations induce secondary circulations in the scales of 2.5–6 km. The additional soil moisture variability intensifies extreme circulations over dry soil patches and sharp sensible heat flux gradients, slightly extending the characteristic scales to 2.5–9 km. While their areal coverage is small, soil moisture variations on such “hotspots” lead to substantially larger convective cloud structure and domain-mean rainfall, calling for a consideration of their non-linear effect in large-scale models.

54 ENVIRONMENTAL SCIENCES↗