Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “weak scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

The Case for Strong Scaling in Deep Learning: Training Large 3D CNNs with Hybrid Parallelism

Here, we present scalable hybrid-parallel algorithms for training large-scale 3D convolutional neural networks. Deep learning-based emerging scientific workflows often require model training with large, high-dimensional samples, which can make training much more costly and even infeasible due to excessive memory usage. We solve these challenges by extensively applying hybrid parallelism throughout the end-to-end training pipeline, including both computations and I/O. Our hybrid-parallel algorithm extends the standard data parallelism with spatial parallelism, which partitions a single sample in the spatial domain, realizing strong scaling beyond the mini-batch dimension with a larger aggregated memory capacity. We evaluate our proposed training algorithms with two challenging 3D CNNs, CosmoFlow and 3D U-Net. Our comprehensive performance studies show that good weak and strong scaling can be achieved for both networks using up to 2K GPUs. More importantly, we enable training of CosmoFlow with much larger samples than previously possible, realizing an order-of-magnitude improvement in prediction accuracy.

97 MATHEMATICS AND COMPUTING↗

Venus - Limited extension and volcanism along zones of lithospheric weakness

Three global-scale zones of possible tectonic origin are described as occurring along broad, low rises within the Equatorial Highlands on Venus (lat 50 deg N to 50 deg S, long 60 deg to 310 deg). The two longest of these tectonic zones, the Aphrodite-Beta and Themis-Atla zones, extend for 21,000 and 14,000 km, respectively. Several lines of evidence indicate that Beta and Atla Regiones, located at the only two intersections of the three major tectonic zones, are dynamically supported volcanic terranes associated with currently active volcanism. Rift valleys south of Aphrodite Terra and between Beta and Phoebe Regiones are characterized by 75- to 100-km widths, raised rims, and extensions of only a few tens of kilometers, about the same magnitudes as in continental rifts on the earth. Horizontal extension on Venus was probably restricted by an early choking-off of plate motion by high crustal and upper-mantle temperatures, and the subsequent loss of water and an asthenosphere.

Schaber, G. G.↗

Weak gravitational lensing due to large-scale structure of the universe

The effect of the large-scale structure of the universe on the propagation of light rays is studied. The development of the large-scale density fluctuations in the omega = 1 universe is calculated within the cold dark matter scenario using a smooth particle approximation. The propagation of about 10 to the 6th random light rays between the redshift z = 5 and the observer was followed. It is found that the effect of shear is negligible, and the amplification of single images is dominated by the matter in the beam. The spread of amplifications is very small. Therefore, the filled-beam approximation is very good for studies of strong lensing by galaxies or clusters of galaxies. In the simulation, the column density was averaged over a comoving area of approximately (1/h Mpc)-squared. No case of a strong gravitational lensing was found, i.e., no 'over-focused' image that would suggest that a few images might be present. Therefore, the large-scale structure of the universe as it is presently known does not produce multiple images with gravitational lensing on a scale larger than clusters of galaxies.

Jaroszynski, Michal↗

Ion thermal transport in the H-mode edge transport barrier on DIII-D

The power balance ion heat flux in the pedestal region on DIII-D increases and becomes increasingly anomalous (above conventional neoclassical) in experiments with higher temperature and lower density pedestals where the ion collisionality ($v^*_i$) is lowered toward values expected on ITER. Direct measurements of the main-ion temperature are shown to be essential on DIII-D when calculating the ion heat flux due to differences between the temperature of $D^+$ and the more commonly measured $C^{6+}$ impurity ions approaching the separatrix. Neoclassical transport calculations from NEO and non-linear gyrokinetic calculations using CGYRO are consistent with these observations and show that while neoclassical transport plays an important role, the turbulent ion heat flux due to ion scale electrostatic turbulence is significant and can contribute similar or larger ion heat fluxes at lower collisionality. Beam emission spectroscopy and Doppler backscattering measurements in the steep gradient region of the H-mode pedestal reveal increased broadband, long-wavelength ion scale fluctuations for the low $v^*_i$ discharges at the radius where the non-linear CGYRO simulations were run. Taken together, increased fluctuations, power balance calculations, and gyrokinetic simulations show that the above neoclassical ion heat fluxes, including the increases at lower $v^*_i$, are likely due to weakly suppressed ion scale electrostatic turbulence. These new results are based on world first inferred ion and electron heat fluxes in the pedestal region of deuterium plasmas using direct measurements of the deuterium temperature for power balance across ion collisionalities covering an order of magnitude from high $v^*_i$ values of 1.3 down to ITER relevant $v^*_i$ ~0.1.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The UV fate of anomalous U(1)s and the Swampland

Massive U(1) gauge theories featuring parametrically light vectors are suspected to belong in the Swampland of consistent EFTs that cannot be embedded into a theory of quantum gravity. We study four-dimensional, chiral U(1) gauge theories that appear anomalous over a range of energies up to the scale of anomaly-cancelling massive chiral fermions. We show that such theories must be UV-completed at a finite cutoff below which a radial mode must appear, and cannot be decoupled — a Stückelberg limit does not exist. When the infrared fermion spectrum contains a mixed U(1)-gravitational anomaly, this class of theories provides a toy model of a boundary into the Swampland, for sufficiently small values of the vector mass. In this context, we show that the limit of a parametrically light vector comes at the cost of a quantum gravity scale that lies parametrically below MP1, and our result provides field theoretic evidence for the existence of a Swampland of EFTs that is disconnected from the subset of theories compatible with a gravitational UV-completion. Moreover, when the low energy theory also contains a U(1) 3 anomaly, the Weak Gravity Conjecture scale makes an appearance in the form of a quantum gravity cutoff for values of the gauge coupling above a certain critical size.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Latitudinal variability of large-scale coronal temperature and its association with the density and the global magnetic field

In this paper we utilize the latitiude distribution of the coronal temperature during the period 1984-1992 that was derived in a paper by Guhathakurta et al, 1993, utilizing ground-based intensity observations of the green (5303 A Fe XIV) and red (6374 A Fe X) coronal forbidden lines from the National Solar Observatory at Sacramento Peak, and establish it association with the global magnetic field and the density distributions in the corona. A determination of plasma temperature, T, was estimated from the intensity ratio Fe X/Fe XIV (where T is inversely proportional to the ratio), since both emission lines come from ionized states of Fe, and the ratio is only weakly dependent on density. We observe that there is a large-scale organization of the inferred coronal temperature distribution that is associated with the large-scale, weak magnetic field structures and bright coronal features; this organization tends to persist through most of the magnetic activity cycle. These high-temperature structures exhibit time-space characteristics which are similar to those of the polar crown filaments. This distribution differs in spatial and temporal characterization from the traditional picture of sunspot and active region evolution over the range of the sunspot cycle, which are manifestations of the small-scale, strong magnetic field regions.

Guhathakurta, M.↗

Real-Time Assimilation of Goes-Derived Products into A Mesoscale Model and It's Impact on Short-Term (06-36hr) Forecasts from 17 October 1998 through the Present

As the parameterizations of surface energy budgets in regional models have become more complete physically, models have the potential to be much more realistic in simulations of coupling between surface radiation, hydrology, and surface energy transfer. Realizing the importance of properly specifying the surface energy budget, many institutions are using land-surface models to represent the lower boundary forcing associated with biophysical processes and soil hydrology. However, the added degrees of freedom due to inclusion of such land-surface schemes require the specification of additional parameters within the model system such as vegetative resistances, green vegetation fraction, leaf area index, soil physical and hydraulic characteristics, stream flow, runoff, and the vertical distribution of soil moisture. Spatial heterogeneity of these parameters makes correct specification problematic since measurements are not routinely available. A technique has been developed for assimilating GOES-IR skin temperature tendencies, solar insolation, and surface albedo into the surface energy budget equation of a mesoscale model so that the simulated rate of temperature change closely agrees with the satellite observations. The technique has been successfully employed in a number of mesoscale models in case-study mode. We have taken the next step and developed a study to determine if assimilating these types of data into mesoscale models in real-time can improve short-term (648h) forecasts of temperature, relative humidity, and QPF on a daily basis over relatively large regions. Therefore, an operational modeling/assimilation system has been developed at the GHCC during the past summer that allows us to produce simulations out to 48 hours in a timely manor. The PSU/NCAR MM5 is used in a nested configuration with a 25 km grid covering the southeastern third of the US. The model has been on-line since 1 July 1998 and forecast products are posted on our web site. The satellite algorithms that generate data to be assimilated came on-line 17 October 1998. Quantitative assessment of the forecast quality is performed via traditional verification statistics. In addition, invaluable qualitative information is obtained through close collaboration with several NWSFO's who are using the MM5 products in real-time on a daily basis. The assimilation technique has been applied in an off-line mode since 17 October. Results based on bulk statistical verification of surface meteorology over the entire Southeastern US show that assimilating the GOES-derived land surface tendencies and solar radiation results in a significant reduction of the shelter air temperature and RH bias on a daily basis. In fact, the assimilation technique has produced improved temperature and RH forecasts for 97% of the 100 simulations performed to date. Work is currently underway to determine the sensitivity of the assimilation procedure to the availability of satellite data, length of assimilation period, model initialization, and synoptic-scale meteorological conditions. In addition, results from a detailed energy budget analysis using the Early Eta, our operational MM5, and the assimilation runs will help us to better understand the satellite assimilation the land-surface energy budge. Research during the spring-summer of 1999 will focus on the impact of the assimilation technique during the warm season where it is hypothesized that it can have a positive impact on QPF during conditions of weak synoptic-scale forcing.

Lapenta, William M.↗

Parallel physics-informed neural networks via domain decomposition

Here we develop a distributed framework for the physics-informed neural networks (PINNs) based on two recent extensions, namely conservative PINNs (cPINNs) and extended PINNs (XPINNs), which employ domain decomposition in space and in time-space, respectively. This domain decomposition endows cPINNs and XPINNs with several advantages over the vanilla PINNs, such as parallelization capacity, large representation capacity, efficient hyperparameter tuning, and is particularly effective for multi-scale and multi-physics problems. Here, we present a parallel algorithm for cPINNs and XPINNs constructed with a hybrid programming model described by MPI + X, where X ∈ {CPUs, GPUs}. The main advantage of cPINN and XPINN over the more classical data and model parallel approaches is the flexibility of optimizing all hyperparameters of each neural network separately in each subdomain. We compare the performance of distributed cPINNs and XPINNs for various forward problems, using both weak and strong scalings. Our results indicate that for space domain decomposition, cPINNs are more efficient in terms of communication cost but XPINNs provide greater flexibility as they can also handle time-domain decomposition for any differential equations, and can deal with any arbitrarily shaped complex subdomains. To this end, we also present an application of the parallel XPINN method for solving an inverse diffusion problem with variable conductivity on the United States map, using ten regions as subdomains.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Spectrum of kinetic-Alfvén-wave turbulence: intermittency or tearing mediation?

We investigate the spectral properties of the electromagnetic fluctuations of sub-ion scale turbulence in weakly collisional, low-beta plasmas using a two-field isothermal gyrofluid model. The numerical results strongly support a description of the turbulence as a critically balanced Kolmogorov-like cascade of kinetic Alfvén wave fluctuations, as amended by previous studies to include intermittency effects. The measured universal index of the energy spectra from systems with different flux-unfreezing mechanisms excludes the role of tearing mediation in determining the spectra. The fluctuations remain isotropic in the plane perpendicular to the strong background magnetic fields as they cascade to smaller scales, which explains the absence of tearing mediation. The calculation of high-order, multipoint structure functions of magnetic fluctuations suggests that the intermittent structures have a quasi-2D, sheet-type morphology. In conclusion, these results are useful for explaining recent observations of the spectrum and structure of magnetic and density fluctuations in the solar wind at sub-proton scales, and are relevant for modelling the energy dissipation in a broad range of astrophysical systems.

79 ASTRONOMY AND ASTROPHYSICS↗

Scale-Free Networks and Commercial Air Carrier Transportation in the United States

Network science, or the art of describing system structure, may be useful for the analysis and control of large, complex systems. For example, networks exhibiting scale-free structure have been found to be particularly well suited to deal with environmental uncertainty and large demand growth. The National Airspace System may be, at least in part, a scalable network. In fact, the hub-and-spoke structure of the commercial segment of the NAS is an often-cited example of an existing scale-free network After reviewing the nature and attributes of scale-free networks, this assertion is put to the test: is commercial air carrier transportation in the United States well explained by this model? If so, are the positive attributes of these networks, e.g. those of efficiency, flexibility and robustness, fully realized, or could we effect substantial improvement? This paper first outlines attributes of various network types, then looks more closely at the common carrier air transportation network from perspectives of the traveler, the airlines, and Air Traffic Control (ATC). Network models are applied within each paradigm, including discussion of implied strengths and weaknesses of each model. Finally, known limitations of scalable networks are discussed. With an eye towards NAS operations, utilizing the strengths and avoiding the weaknesses of scale-free networks are addressed.

Conway, Sheila R.↗

Photon counting with intensified charge coupled device (ICCD) – I. In-depth detector characterization

While the adsorption properties of transition metal catalysts have been widely studied, leading to the discovery of various scaling relations, descriptors of catalytic activity, and well-established computational models, a similar understanding of semiconductor catalysts has not yet been achieved. In this work, we present a high-throughput density functional theory investigation into the adsorption properties of 5 oxides of interest to the photocatalytic CO 2 reduction reaction: TiO 2 (rutile and anatase), SrTiO 3 , NaTaO 3 , and CeO 2 . Using a systematic approach, we exhaustively identify unique surfaces and construct adsorption structures to undergo geometry optimizations. We then perform a data-driven analysis, which reveals the presence of weak adsorption energy scaling relations, the propensity of adsorbates of interest to interact with oxygen surface sites, and the importance of slab deformation upon adsorption. Our findings are presented in the context of experimental observations and in comparison to previously studied classes of catalysts, such as pure metals and tellurium-containing semiconductors, and reinforce the need for a comprehensive approach to the study of site-specific surface phenomena on semiconductors.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Systematic computational study of oxide adsorption properties for applications in photocatalytic CO 2 reduction

While the adsorption properties of transition metal catalysts have been widely studied, leading to the discovery of various scaling relations, descriptors of catalytic activity, and well-established computational models, a similar understanding of semiconductor catalysts has not yet been achieved. In this work, we present a high-throughput density functional theory investigation into the adsorption properties of 5 oxides of interest to the photocatalytic CO 2 reduction reaction: TiO 2 (rutile and anatase), SrTiO 3 , NaTaO 3 , and CeO 2 . Using a systematic approach, we exhaustively identify unique surfaces and construct adsorption structures to undergo geometry optimizations. We then perform a data-driven analysis, which reveals the presence of weak adsorption energy scaling relations, the propensity of adsorbates of interest to interact with oxygen surface sites, and the importance of slab deformation upon adsorption. Our findings are presented in the context of experimental observations and in comparison to previously studied classes of catalysts, such as pure metals and tellurium-containing semiconductors, and reinforce the need for a comprehensive approach to the study of site-specific surface phenomena on semiconductors.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Planetary normal mode computation: Parallel algorithms, performance and reproducibility

This report is an extension of work entitled “Computing planetary interior normal modes with a highly parallel polynomial filtering eigensolver.” by Shi et al., [1] originally presented at the SC18 conference. A highly parallel polynomial filtered eigensolver was developed and exploited to calculate the planetary normal modes. The proposed method is ideally suited for computing interior eigenpairs for large-scale eigenvalue problems as it greatly enhances memory and computational efficiency. In this article, the second-order finite element method is used to further improve the accuracy as only the first-order finite element method was deployed in the previous work. The parallel algorithm, its parallel performance up to 20k processors, and the great computational accuracy are illustrated. The reproducibility of the previous work was successfully performed on the Student Cluster Competition at the SC19 conference by several participant teams using a completely different Mars-model dataset on different clusters. Both weak and strong scaling performances of the reproducibility by the participant teams were impressive and encouraging. The analysis and reflection of their results are demonstrated and future direction is discussed.

97 MATHEMATICS AND COMPUTING↗

Direct numerical simulations for hybrid rocket boundary layers: Performance modeling and scaling

This paper presents a comprehensive performance and scaling analysis of direct numerical simulations for reacting boundary layers, focusing on slab burner configurations. Using a PETSc-based finite volume CFD framework, the study evaluates the scalability and computational cost of flow, chemistry, and radiation evaluations across 2D and 3D simulations. Polymethyl methacrylate (PMMA) is the fuel with pure O 2 as the oxidizer, modeled using a detailed chemical kinetics mechanism with 113 species and 660 reactions. A ray-tracing-based radiation solver, designed for distributed memory applications, is implemented to model radiation heat transfer. Parallel scalability is analyzed for the coupled flow, chemistry, and radiation heat transfer processes. Weak and strong scaling studies are conducted on up to 15,000 computational ranks, revealing robust performance when flow cells exceed 200 per rank. Chemistry evaluations dominate the computational cost in large 3D simulations, accounting for approximately 40% of the total runtime, while flow processes contribute around 35%, and radiation solver contributions remain below 10% due to reduced evaluation frequencies. GPU accelerated chemistry evaluation, implemented with Zero-RK, demonstrates significant promise, achieving up to a 4x speedup for workloads exceeding 30,000 cells per GPU. However, diminishing returns are observed for smaller workloads due to CPU-GPU communication overhead. This study identifies key challenges, including memory bottlenecks and the effects of domain partitioning on flow scalability, while highlighting the potential of GPU-accelerated chemistry to reduce computational costs. In conclusion, these findings provide realizable run configurations for 2D, 3D, and GPU-accelerated cases, offering insights for optimizing reactive flow solvers.

CFD Scalability↗

Effects of oxygen stoichiometry on the scaling behaviors of YBa2Cu3O(x) grain boundary weak-links

The effects of oxygen stoichiometry on the transport properties of the pulsed laser deposited YBa2Cu3O(x) bicrystalline grain boundary weak-link junctions were studied. It is found that not only the cross boundary resistive transition foot structure can be manipulated repeatedly with oxygen annealing processes but the junction behaviors are also altered in accordance. In the fully oxygenated state i.e with x = 7.0 in YBa2Cu3O(x) stoichiometry, the junction critical current exhibits a power of 2 scaling behavior with temperature. In contrast, when annealed in the conditions of oxygen-deficient state (e.g with x = 6.9 in YBa2Cu3O(x) stoichiometry) the junction critical current switches to a linear temperature dependence behavior. The results are tentatively attributed to the modification of the structure in the boundary area upon oxygen annealing, which, in turn, will affect the effective dimension of the geometrically constrained weak-link bridges. The detailed discussion on the responsible physical mechanisms as well as the implications of the present results on device applications will be given.

Wu, K. H.↗

OpenSn: A massively parallel, open-source simulation environment for discrete ordinates radiation transport

OpenSn is an open-source, massively parallel deterministic radiation transport code for solving the discrete-ordinates ( S N ) form of the Boltzmann transport equation on unstructured, arbitrary polyhedral meshes. It supports high-fidelity simulations involving steady-state, eigenvalue, and adjoint problems for neutral particles (e.g., neutrons, photons, multi-particles), using the multigroup approximation in energy. OpenSn combines angular discretization via discrete ordinates with a discontinuous Galerkin finite element method (DGFEM) in space, enabling accurate resolution of transport physics on arbitrary polyhedral cells, included locally refined spatial grids. It includes multiple angular quadrature types, including locally refined angular quadratures. Written in modern C++ with a Python API, OpenSn runs efficiently on platforms ranging from laptops to supercomputers. The transport sweep algorithm is implemented using a task-based, directed-acyclic-graph (DAG) approach for each angle and supports asynchronous parallelism across thousands of MPI ranks. Group-set aggregation improves compute intensity, and synthetic acceleration techniques (e.g., diffusion synthetic acceleration, second-moment method) enhance solver convergence. OpenSn has been verified on reactor physics problems and demonstrated excellent weak and strong scaling performance on more than 32,768 processes, making it a versatile and robust platform for large-scale transport simulations in complex geometries.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Determining Spatial Scales of Soil Moisture—Cloud Coupling Pathways Using Semi-Idealized Simulations

The spatial scales of land-atmosphere interactions over heterogeneous, realistic soil moisture patterns are critical to improve our understanding of land-atmosphere interactions. However, these scales are poorly quantified. We use high-resolution numerical experiments to quantify the spatial scales for a selected day during the Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) campaign in Oklahoma. A semi-idealized approach (removing background winds and surface topography while retaining the real-world data for other boundary conditions) enables examination of the local influence from the surface. Simulations that apply uniform surface, variable land cover with uniform soil moisture, and variable land cover with variable soil moisture are then compared. Land cover variations, especially water and urban surfaces, create two variance peaks in the surface sensible heat flux in the scales >10 km (meso-β) and <6 km (meso-γ). Both peaks are enhanced by the observation-based soil moisture distribution that has most of its variance in the meso-β scale. Atmospheric response in the meso-β scale is hydrostatic with weak vertical motion. The land cover variations induce secondary circulations in the scales of 2.5–6 km. The additional soil moisture variability intensifies extreme circulations over dry soil patches and sharp sensible heat flux gradients, slightly extending the characteristic scales to 2.5–9 km. While their areal coverage is small, soil moisture variations on such “hotspots” lead to substantially larger convective cloud structure and domain-mean rainfall, calling for a consideration of their non-linear effect in large-scale models.

54 ENVIRONMENTAL SCIENCES↗

Linking Synoptic Patterns to Cloud Properties and Local Circulations Over Southeastern Texas

This report classifies meteorological regimes in the southeastern Texas region to identify environmental conditions that favor sea-breeze induced convection. The classification is accomplished using a Self-Organizing Map (SOM) approach. We applied SOM to 10 years of 700-hPa geopotential height anomalies during the summer months from reanalysis data to distinguish three dominant synoptic regimes, with a continuum of transitional states between those. The primary regimes include: (a) a pre-trough regime associated with a synoptic trough, (b) a post-trough regime with upper-level northerly flow, and (c) an anticyclonic regime within the westward extent of the Bermuda High. We project the data from the Geostationary Operational Environmental Satellite and the Next Generation Weather Radar system onto each SOM node to investigate the characteristics of cloud and precipitation properties in different regimes. When southeastern Texas is positioned to the southwest quadrant of a maritime high pressure system, an increased cloud frequency is observed over the region during the afternoon hours due to significant moisture advection. A confluence of synoptic southerly flow and sea-breeze circulation commonly occurs in this regime. When a high pressure system is over southeastern Texas, the area is dominated by large-scale subsidence with weak pressure gradients and moderate precipitable water vapor. This weak synoptic forcing is favorable for the formation of a sea-breeze circulation. This is confirmed by an enhanced onshore flow and a decreased temperature at the surface in the early afternoon, as well as a sharp increase in radar echo top height.

54 ENVIRONMENTAL SCIENCES↗