Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed parallelization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

rustpix

rustpix is a high-performance, open-source Rust library with first-class Python bindings (via PyO3) for processing pixel-detector data in neutron imaging. It targets time-stamping detectors such as Timepix3 (TPX3) at ORNL's Spallation Neutron Source (VENUS beamline), where each detected neutron deposits charge across a cluster of pixels within a very high-rate event stream (96M+ hits/sec). rustpix parses TPX3 event data in parallel using memory-mapped I/O, offers four interchangeable clustering algorithms (ABS adjacency-based search, DBSCAN, graph/union-find connected components, and a parallel grid method), and extracts weighted, super-resolved centroids to produce neutron-event lists. A streaming architecture lets it process files larger than available memory. rustpix is distributed as a pip-installable Python package (with NumPy integration), Rust crates, a command-line tool, and an interactive GUI; it writes HDF5, Apache Arrow, and CSV; and it is designed to extend to TPX4 and other detector types. Released as open-source under the MIT License.

Zhang, Chen [Oak Ridge National Laboratory (ORNL),↗
DOE OSTI2020

Progress in modelling fast-ion D-alpha spectra and neutral particle analyzer fluxes using FIDASIM

FIDASIM is a code that models signals produced by charge-exchange reactions between neutrals and ions (both fast and thermal) in magnetically confined plasmas. With the ion distribution function as input, the code predicts the efflux to a neutral particle analyzer diagnostic and the photon radiance of Balmer-alpha light to a fast-ion D α diagnostic, in addition to many other related quantities. A new, parallelized version of the Monte Carlo code FIDASIM has been developed in Fortran90 that is substantially faster than the original interactive data language version. Modified algorithms include more accurate treatments of the time dependent collisional-radiative equations that describe neutral energy levels, of the cloud of ‘halo’ neutrals that surround the injected neutral beam, and of finite Larmor radius effects. Enhanced physics capabilities include modelling ‘passive’ signals from cold edge neutrals, the ability to treat general three-dimensional magnetic confinement configurations, and calculations of diagnostic-specific weight functions that enable tomographic reconstructions of the fast-ion distribution function. Neutral beam attenuation, beam emission, and fast-ion birth profiles are also modelled. Finally, the new algorithms have been successfully validated against experimental data and new features have been tested through benchmarks between two independently developed versions of the code.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Optimizing High Performance Markov Clustering for Pre-Exascale Architectures

HipMCL is a high-performance distributed memory implementation of the popular Markov Cluster Algorithm (MCL) and can cluster large-scale networks within hours using a few thousand CPU-equipped nodes. It relies on sparse matrix computations and heavily makes use of the sparse matrix-sparse matrix multiplication kernel (SpGEMM). The existing parallel algorithms in HipMCL are not scalable to Exascale architectures, both due to their communication costs dominating the runtime at large concurrencies and also due to their inability to take advantage of accelerators that are increasingly popular. In this work, we systematically remove scalability and performance bottlenecks of HipMCL. We enable GPUs by performing the expensive expansion phase of the MCL algorithm on GPU. Additionally, we propose a CPU-GPU joint distributed SpGEMM algorithm called pipelined Sparse SUMMA and integrate a probabilistic memory requirement estimator that is fast and accurate. Furthermore, we develop a new merging algorithm for the incremental processing of partial results produced by the GPUs, which improves the overlap efficiency and the peak memory usage. We also integrate a recent and faster algorithm for performing SpGEMM on CPUs. We validate our new algorithms and optimizations with extensive evaluations. With the enabling of the GPUs and integration of new algorithms, HipMCL is up to 12.4x faster, being able to cluster a network with 70 million proteins and 68 billion connections just under 15 minutes using 1024 nodes of ORNL's Summit supercomputer.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Microstructure and CPO evolution of dynamically recrystallized olivine during complex deformation conditions: a full-field numerical modeling approach

The rheological properties of mantle rocks are strongly dependent on their crystallographic preferred orientation (CPO). Olivine CPO, defined by the orientation of seismically fast [100] axes parallel to flow direction, is also thought to be a dominant contributor to seismic anisotropy in the Earth's upper mantle. However, the amount of deformation needed to overprint a new CPO on a pre-existing fabric and the impact of the inherited CPOs on the transient microstructure evolution, remain unknown. This study employs a full-field numerical approach (VPFFT-ELLE) to explore the dynamic recrystallization and microstructural evolution of olivine polycrystalline aggregates under complex deformation conditions. We test four combinations of successive pure shear and simple shear boundary conditions. Findings indicate that inherited CPOs influence subsequent deformation in a manner dependent on the kinematic relationship between successive stages. In all cases, a minor strain increment (ε ∼0.3–0.6) is sufficient to erase the previous microstructure and CPO. However, when deformation conditions change dramatically (e.g., stretching direction changes orthogonally), the intensity of the new CPO developed is significantly lower and strain distribution are specially altered. During a transient strain stage, pre-existing microstructures undergo extensive reworking, especially when deformation conditions are changed dramatically, such as switching from simple shear to a pure shear condition with a parallel shortening direction relative to the stretching direction. We estimate the significance of these results in interpreting observations of seismic velocity anisotropy, concluding that P-wave seismic anisotropy is significantly and positively correlated with the evolution of olivine CPO with deformation history. This research underscores the transient nature of microstructural rearrangement in olivine aggregates and the necessity for caution in interpreting seismic anisotropy in regions with complex deformation histories, as inherited CPOs can influence current fabric development and induce deviation to the present deformation conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2020

A New Configuration of Paralleled Modular ANPC Multilevel Converter Controlled by an Improved Modulation Method for 1 MHz, 1 MW EV Charger

In this work, a new configuration of the modular multilevel converter (MLC) based on the parallel connection of three-level active-neutral-point-clamped (3L-ANPC) cells as well as its improved modulation method is proposed for 1 MHz, 1 MW electric vehicle (EV) megacharger. In the proposed paralleled modular ANPC-MLC, only six high-frequency silicon carbide (SiC) power switches operating at 333 kHz are required to generate 1 MHz switching frequency spectrum. Moreover, the operating voltage of all power devices is halved, the magnitude of the first switching frequency harmonic cluster is decreased by the factor of five, and the load current is equally distributed between the 3L-ANPC legs by employing the proposed improved modulation method. Hence, the modularity, efficiency, and power density of the proposed converter are notably increased, whereas the value of passive components and the overall switching loss are remarkably decreased. In addition, an optimized design of the one 3L-ANPC cell of the proposed paralleled modular ANPC-MLC for 1 MHz, 1MW EV megacharger using Ansys SIwave, Icepak, and Q3D finite element method platforms is presented and analyzed in detail. The provided experimental results of the down-scaled setup verify the feasibility and viability of the proposed configuration as well as its improved switching pattern.

42 ENGINEERING↗
DOE OSTI2020

Kinetic entropy-based measures of distribution function non-Maxwellianity: theory and simulations

We investigate kinetic entropy-based measures of the non-Maxwellianity of distribution functions in plasmas, i.e. entropy-based measures of the departure of a local distribution function from an associated Maxwellian distribution function with the same density, bulk flow and temperature as the local distribution. First, we consider a form previously employed by Kaufmann & Paterson (J. Geophys. Res., vol. 114, 2009, A00D04), assessing its properties and deriving equivalent forms. To provide a quantitative understanding of it, we derive analytical expressions for three common non-Maxwellian plasma distribution functions. We show that there are undesirable features of this non-Maxwellianity measure including that it can diverge in various physical limits and elucidate the reason for the divergence. We then introduce a new kinetic entropy-based non-Maxwellianity measure based on the velocity-space kinetic entropy density, which has a meaningful physical interpretation and does not diverge. We use collisionless particle-in-cell simulations of two-dimensional anti-parallel magnetic reconnection to assess the kinetic entropy-based non-Maxwellianity measures. We show that regions of non-zero non-Maxwellianity are linked to kinetic processes occurring during magnetic reconnection. We also show the simulated non-Maxwellianity agrees reasonably well with predictions for distributions resembling those calculated analytically. These results can be important for applications, as non-Maxwellianity can be used to identify regions of kinetic-scale physics or increased dissipation in plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Parallel convection and E × B drifts in the TCV snowflake divertor and their effects on target heat-fluxes

Parallel convection and E × B drifts act together to redistribute heat between the strike-points in the low field side snowflake minus (LFS SF–). The cumulative heat convection from both mechanisms is enhanced near the secondary X-point and is shown to dominate over heat conduction, partly explaining why the LFS SF– distributes power more evenly than the single null (SN) or other snowflake (SF) configurations. Pressure profiles at the entrance of the divertor are strongly affected by the position of the secondary X-point and magnetic field direction indicating the importance of E × B drifts. Pressure drops of up to 50% appear between the outer-midplane (OMP) and the divertor entrance enhancing the role of parallel heat convection. The electron temperature and density profiles and the radial turbulent fluxes measured at the OMP are largely unaffected by the changes in divertor geometry, even on flux surfaces where the connection length is infinite.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Full spectrum optical constant interface to the Materials Project

Optical constants characterize the interaction of materials with light and are important properties in material design. Here we present a Python-based Corvus workflow for simulations of full spectrum optical constants from the visible and ultraviolet to hard x-ray wavelengths based on the real-space Green’s function code FEFF10 and structural data from the Materials Project (MP). The Corvus workflow manager and its associated tools provide an interface to FEFF10 and the MP database. The workflow parallelizes the FEFF computations of optical constants over all absorption edges for each material in the MP database specified by a unique MP-ID. The workflow tools determine the distribution of computational resources needed for that case. Similarly, the optical constants for selected sets of materials can be computed in a single-shot. Additionally, to illustrate the approach, we present results for several elemental solids in the periodic table, as well as a sample compound, and compare our predictions with experimental results. In addition, we provide a database of calculated results for all elements for which there is a stable elemental solid at standard conditions available in the Materials Project database. As in x-ray absorption spectra, these results are interpreted in terms of an atomic-like background and fine-structure contributions.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Effects of fiber dosage, loading orientation and stress on frequency response of enhanced Carbon Nano-Fiber Aggregates

Nanomaterial additives have been broadly used in cement and concrete-based sensors to measure the stress and strain in the structure. Most of the studies focused on measuring the resistivity of sensors with Direct Current (DC) or relatively low-frequency. Here in this work, the impedance responses of enhanced Carbon Nano-Fiber Aggregates (CNFAs) at different frequencies are rigorously studied and utilized as a tool for real-time structural health monitoring (SHM). The CNFA impedance measurements at different measurement frequencies provide an extra dimension (frequency dimension) to allow the characterization of different phenomena and multimodal measurements simultaneously. First, a comprehensive physical model is established to understand the frequency responses of the CNFA impedance. Second, COMSOL Multiphysics is used to simulate the frequency responses of the CNFA impedance, which provides more insights into the electric field and current density distribution. The impedance of CNFAs decreased with the increased dosage of carbon nanofibers (CNFs). Third, experimental studies are reported in detail. The electrical impedance variation (EZV) of the CNFA in parallel orientation is 151% higher than that of perpendicular orientation at the frequency of 2612 Hz and uniaxial compression stress of 4.65 MPa. The strain-EZV curve obtained from the response spectrum is linear for frequencies ranging from 98 Hz to 463.9 kHz. The strain-EZV curve for 5625 Hz has a linear fit with the gauge factor of 147.78. At 1000 Hz, the CNFA exhibited a repeatable behavior up to 9.35 MPa and detection limit up to the stress of 18.62 MPa.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Overview of ASDEX upgrade results in view of ITER and DEMO

Experiments on ASDEX Upgrade (AUG) in 2021 and 2022 have addressed a number of critical issues for ITER and EU DEMO. A major objective of the AUG programme is to shed light on the underlying physics of confinement, stability, and plasma exhaust in order to allow reliable extrapolation of results obtained on present day machines to these reactor-grade devices. Concerning pedestal physics, the mitigation of edge localised modes (ELMs) using resonant magnetic perturbations (RMPs) was found to be consistent with a reduction of the linear peeling-ballooning stability threshold due to the helical deformation of the plasma. Conversely, ELM suppression by RMPs is ascribed to an increased pedestal transport that keeps the plasma away from this boundary. Candidates for this increased transport are locally enhanced turbulence and a locked magnetic island in the pedestal. The enhanced D-alpha (EDA) and quasi-continuous exhaust (QCE) regimes have been established as promising ELM-free scenarios. Here, the pressure gradient at the foot of the H-mode pedestal is reduced by a quasi-coherent mode, consistent with violation of the high-n ballooning mode stability limit there. This is suggestive that the EDA and QCE regimes have a common underlying physics origin. In the area of transport physics, full radius models for both L- and H-modes have been developed. These models predict energy confinement in AUG better than the commonly used global scaling laws, representing a large step towards the goal of predictive capability. A new momentum transport analysis framework has been developed that provides access to the intrinsic torque in the plasma core. In the field of exhaust, the X-Point Radiator (XPR), a cold and dense plasma region on closed flux surfaces close to the X-point, was described by an analytical model that provides an understanding of its formation as well as its stability, i.e., the conditions under which it transitions into a deleterious MARFE with the potential to result in a disruptive termination. With the XPR close to the divertor target, a new detached divertor concept, the compact radiative divertor, was developed. Here, the exhaust power is radiated before reaching the target, allowing close proximity of the X-point to the target. No limitations by the shallow field line angle due to the large flux expansion were observed, and sufficient compression of neutral density was demonstrated. With respect to the pumping of non-recycling impurities, the divertor enrichment was found to mainly depend on the ionisation energy of the impurity under consideration. In the area of MHD physics, analysis of the hot plasma core motion in sawtooth crashes showed good agreement with nonlinear 2-fluid simulations. This indicates that the fast reconnection observed in these events is adequately described including the pressure gradient and the electron inertia in the parallel Ohm’s law. Concerning disruption physics, a shattered pellet injection system was installed in collaboration with the ITER International Organisation. Thanks to the ability to vary the shard size distribution independently of the injection velocity, as well as its impurity admixture, it was possible to tailor the current quench rate, which is an important requirement for future large devices such as ITER. Progress was also made modelling the force reduction of VDEs induced by massive gas injection on AUG. The H-mode density limit was characterised in terms of safe operational space with a newly developed active feedback control method that allowed the stability boundary to be probed several times within a single discharge without inducing a disruptive termination. Regarding integrated operation scenarios, the role of density peaking in the confinement of the ITER baseline scenario (high plasma current) was clarified. The usual energy confinement scaling ITER98(p,y) does not capture this effect, but the more recent H20 scaling does, highlighting again the importance of developing adequate physics based models. Advanced tokamak scenarios, aiming at large non-inductive current fraction due to non-standard profiles of the safety factor in combination with high normalised plasma pressure were studied with a focus on their access conditions. A method to guide the approach of the targeted safety factor profiles was developed, and the conditions for achieving good confinement were clarified. Based on this, two types of advanced scenarios (‘hybrid’ and ‘elevated’

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Virtual Cable Impedance based Load Sharing in a Microgrid for Parallel Connected Grid Forming Converters

This paper presents a novel approach to power sharing between direct connected grid-forming converters, utilizing virtual cable impedance and droop-based outer loop control. To enhance stability, resistive droop is implemented, while virtual cable impedance with non-zero resistive and inductive components ensures improved power sharing. The inner loop controller employs a Lyapunov energy function to achieve superior dynamic performance. The proposed control architecture is validated through comprehensive modeling and real-time processor-in-the-loop simulations, demonstrating its robustness and efficiency under various operating conditions. The results highlight the potential of this control strategy to improve the reliability and efficiency of renewable energy systems. Additionally, a comparative analysis with traditional methods underscores the advantages of the proposed approach in terms of stability and performance. The proposed control architecture offers a scalable and flexible solution for grid-forming converters, enabling seamless integration of renewable energy sources. Its robustness and adaptability make it an attractive solution for real-world applications. Furthermore, the approach can be extended to other power electronic systems, enhancing overall system performance and efficiency. By providing a reliable and efficient control strategy, this paper contributes to the advancement of renewable energy systems and their adoption in the energy sector. The proposed control strategy has far-reaching implications for the widespread adoption of renewable energy sources, enabling a more sustainable and efficient energy future. The overall system is modeled in MATLAB/Simulink and PLECS software domain.

grid forming converters (GFM)↗
DOE OSTI2021

Structured Adaptive Mesh Refinement Adaptations to Retain Performance Portability With Increasing Heterogeneity

Adaptive mesh refinement (AMR) is an important method that enables many mesh-based applications to run at effectively higher resolution within limited computing resources by allowing high resolution only where really needed. This advantage comes at a cost, however: greater complexity in the mesh management machinery and challenges with load distribution. With the current trend of increasing heterogeneity in hardware architecture, AMR presents an orthogonal axis of complexity. Additionally, the usual techniques, such as asynchronous communication and hierarchy management for parallelism and memory that are necessary to obtain reasonable performance are very challenging to reason about with AMR. Different groups working with AMR are bringing different approaches to this challenge. Here, we examine the design choices of several AMR codes and also the degree to which demands placed on them by their users influence these choices.

42 ENGINEERING↗
DOE OSTI2020

Isochronous Architecture-Based Voltage-Active Power Droop for Multi-Inverter Systems

This article proposes an isochronous architecture for parallel inverters with only voltage-active power droop (VP-D) control for improving active power sharing as well as plug-and-play of multi-inverter-based distributed energy resources (DERs). The isochronous framework obviates the need for an explicit regulation of the frequency while allowing for sharing of reactive power. The article shows that the detrimental effects of circulating currents between inverters can be addressed in the framework developed. The isochronous architecture is implemented by employing a GPS to disseminate clock timing signals that enable the microgrid to maintain the nominal system frequency. Small signal eigenvalue analysis of a Multi-inverter Microgrid system near the steady-state operating point is presented to evaluate the system stability. Moreover, unlike traditional droop-based methods, the isochronous strategy lends itself to analytical guarantees which are developed in the article. Furthermore, the effect of delays in receiving GPS clock signals by an inverter is experimentally characterized and an inverter isolation mechanism is proposed that disconnects inverters facing large GPS communication delays. Hardware experiments on an 1.2 kVA-prototype and controller-hardware-in-the-loop validation on the CIGRE distribution network are conducted to demonstrate the effectiveness of the proposed architecture towards active and reactive power sharing between inverters with load scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models

Vision-based scientific foundation models hold significant promise for advancing scientific discovery and innovation. This potential stems from their ability to aggregate images from diverse sources—such as varying physical groundings or data acquisition systems—and to learn spatio-temporal correlations using transformer architectures. However, tokenizing and aggregating images can be compute-intensive, a challenge not fully addressed by current distributed methods. In this work, we introduce the Distributed Cross-Channel Hierarchical Aggregation (D-CHAG) approach designed for datasets with a large number of channels across image modalities. Our method is compatible with any model-parallel strategy and any type of vision transformer architecture, significantly improving computational efficiency. We evaluated D-CHAG on hyperspectral imaging and weather forecasting tasks. When integrated with tensor parallelism and model sharding, our approach achieved up to a 75% reduction in memory usage and more than doubled sustained throughput on up to 1,024 AMD GPUs on the Frontier Supercomputer.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
DOE OSTI2022

DistGANS- Distributed Generative Adversarial Neural Networks

DistGANs is a Python package to perform distributed training of conditional generative adversarial neural networks for multi-class labeled image data. DistGANs partitionins the training data according to data labels, and enhances scalability by performing a parallel training where multiple generators are concurrently trained, each one of them focusing on a single data label.

Lupo Pasini, Massimiliano [Oak Ridge National Lab.↗
DOE OSTI2022

EdgeAI: Machine learning via direct attached accelerator for streaming data processing at high shot rate x-ray free-electron lasers

We present a case for low batch-size inference with the potential for adaptive training of a lean encoder model. We do so in the context of a paradigmatic example of machine learning as applied in data acquisition at high data velocity scientific user facilities such as the Linac Coherent Light Source-II x-ray Free-Electron Laser. We discuss how a low-latency inference model operating at the data acquisition edge can capitalize on the naturally stochastic nature of such sources. We simulate the method of attosecond angular streaking to produce representative results whereby simulated input data reproduce high-resolution ground truth probability distributions. By minimizing the mean-squared error between the decoded output of the latent representation and the ground truth distributions, we ensure that the encoding layers and resulting latent representation maintains full fidelity for any downstream task, be it classification or regression. We present throughput results for data-parallel inference of various batch sizes, some with throughput exceeding 100 k images per second. We also show in situ training below 10 s per epoch for the full encoder–decoder model as would be relevant for streaming and adaptive real-time data production at our nation’s scientific light sources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Enabling Recycling of Composites: Understanding the Impacts of Multiple Thermal Processing Cycles

When considering the utilization of recycled short carbon fiber feedstock materials for advanced manufacturing, understanding the material degradation behavior is essential in determining how many times a composite material can be effectively reprocessed and remanufactured. This study characterizes the degradation behavior of short carbon fiber acrylonitrile butadiene (CF-ABS) that has been reprocessed five times with twin screw extrusion. Parallel plate rheology was completed to observe the degradation in complex viscosity of the recycled feedstock materials. Gel permeation chromatography (GPC) was utilized to characterize the changes in molecular weight distribution of the recycled materials as a result of thermal and mechanical degradation during the re-processing steps. Rheological characterization, GPC, and twin-screw processing data help inform the process optimizations required to process the recycled feedstock material. Successful characterization of the degradation behavior of short fiber composite feedstock materials aids in increased understanding of the lifespan of high value carbon fiber composite materials and aids in process optimization of recycled composite materials.

Walker, Roo↗
DOE OSTI2024

A parallel and performance portable implementation of a full-field crystal plasticity model

We have developed a parallel implementation of an Elasto-Viscoplastic Fast Fourier Transform-based (EVPFFT) micromechanical solver to enable computationally efficient crystal plasticity modeling for polycrystalline materials. Our primary focus lies in achieving performance portability, allowing a single EVPFFT implementation to run optimally on various homogeneous architectures, including multi-core Central Processing Units (CPUs), as well as on heterogeneous computer architectures comprising multi-core CPUs and Graphics Processing Units (GPUs) from different vendors. To accomplish this goal, we have leveraged MATAR, a C++ software library that simplifies the creation and utilization of multidimensional dense or sparse matrix and array data structures. These data structures are designed to be portable across diverse architectures through the use of Kokkos, a performance-portable library. Additionally, we have employed the Message Passing Interface (MPI) to efficiently distribute the computational workload among processors. The heFFTe (Highly Efficient FFT for Exascale) library is used to facilitate the performance portability of the fast Fourier transforms (FFTs) computation. The computational performance of EVPFFT is evaluated and presented in terms of parallel scalability and simulation runtime on different high-performance computing (HPC) architectures. As a result, the utility of the developed framework to efficiently simulate the micro-mechanical fields in polycrystalline microstructures in engineering applications is discussed.

36 MATERIALS SCIENCE↗