Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Parallel processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Development of MGMC: A proxy Multi-Group Monte Carlo Particle Transport Application

This document details the development and current state of MGMC: a proxy Multi-Group Monte Carlo transport application. The goal of this work was to develop a light-weight Monte Carlo transport solver that could be easily reconfigured to test parallelization strategies targeting advanced architectures and heterogeneous computing environments. Additionally, MGMC is able to act as a proxy-app for testing the development of algorithms and the integration of other libraries and into Monte Carlo transport codes. MGMC is currently able to run in parallel using OpenMP for CPU threads or CUDA for NVIDIA GPUs. MGMC was also used to investigate the using SYCL for portable parallelization targeting either CPU threads, vender-agnostic GPUs, and ARM chips, detailed in Section II. In the process of developing MGMC, several other C++ libraries have been created with the intent for re-use in future research projects and potential inclusion in production-level codes, detailed in Section III. The physics capabilities in MGMC are detailed in Section IV, code verification is detailed in Section V, and performance results are detailed in Section VI.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Current Practices in Distribution Utility Resilience Planning for Winter Storms

This report is part of a series of hazard-focused case studies examining common practices in electric utility resilience planning. We use standard terminology defining resilience as the ability to anticipate, withstand, absorb, and recover from hazards that cause long duration outages. We distinguish between reliability and resilience using Institute of Electrical and Electronics Engineers (IEEE) 1366-2022, which defines major events as an event that exceeds reasonable design and/or operational limits of the electric power system. Resilience planning is focused on major event days and reliability planning is focused on nonmajor event days. Utility resilience plans are assessed according to common resilience components identified in existing resilience frameworks. The focus of this report is on winter storms in which the primary hazards are heavy snowfall, freezing rain, ice, extreme cold, severe wind, and flooding. These hazards can also contribute to generation shortages, resulting in bulk power system impacts that have consequences for the distribution system, such as load shedding. Stand-alone reports focusing on wildfires and nonwinter storms have been published in parallel with this report. This report can be used as a starting point for understanding potential investment prioritization processes and investment options. This report is intended to improve utility resilience planning by supporting constructive dialogue among utilities, regulators, and other stakeholders.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Current Practices in Distribution Utility Resilience Planning for Wildfires

This report is part of a series of hazard-focused case studies examining common practices in electric utility resilience planning. We use standard terminology defining resilience as the ability to anticipate, withstand, absorb, and recover from hazards that cause long duration outages. We distinguish between reliability and resilience using IEEE 1366-2022, which defines major events as "an event that exceeds reasonable design and/or operational limits of the electric power system." Resilience planning is focused on major event days, and reliability planning is focused on non-major event days. Utility resilience plans are assessed according to common resilience components identified in existing resilience frameworks. The focus of this report is on wildfires. Standalone reports focusing on severe storms (including hurricanes and non-winter storms) and winter storms have been published in parallel with this report. This report can be used as a starting point for understanding potential investment prioritization processes and investment options. This report is intended to improve utility resilience planning by supporting constructive dialogue among utilities, regulators, and other stakeholders.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Current Practices in Distribution Utility Resilience Planning for Hurricanes and Non-Winter Storms

This report is part of a series of hazard-focused case studies examining common practices in electric utility resilience planning. We use standard terminology defining resilience as the ability to anticipate, withstand, absorb, and recover from hazards that cause long duration outages. We distinguish between reliability and resilience using IEEE 1366-2022, which defines "major events" as "an event that exceeds reasonable design and/or operational limits of the electric power system." Resilience planning is focused on "major event days" and reliability planning is focused on non-major event days. Utility resilience plans are assessed according to common recommended resilience components that we have identified in existing resilience frameworks. The focus of this report is on hurricanes and severe storms in which the primary hazards are precipitation or high winds. We exclude winter storms with primary hazards of ice and extreme cold, as they are a unique set of hazards with different resilience considerations. Standalone reports focusing on wildfires and winter storms have been published in parallel with this report. This report can be used as a starting point for understanding potential investment prioritization processes and investment options. This report is intended to improve utility resilience planning by supporting constructive dialogue among utilities, regulators, and other stakeholders.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Chromatin Changes in Phytochrome Interacting Factor-Regulated Genes Parallel Their Rapid Transcriptional Response to Light

As sessile organisms, plants must adapt to a changing environment, sensing variations in resource availability and modifying their development in response. Light is one of the most important resources for plants, and its perception by sensory photoreceptors (e.g., phytochromes) and subsequent transduction into long-term transcriptional reprogramming have been well characterized. Chromatin changes have been shown to be involved in photomorphogenesis. However, the initial short-term transcriptional changes produced by light and what factors enable these rapid changes are not well studied. Here, we define rapidly light-responsive, Phytochrome Interacting Factor (PIF) direct-target genes (LRP-DTGs). We found that a majority of these genes also show rapid changes in Histone 3 Lysine-9 acetylation (H3K9ac) in response to the light signal. Detailed time-course analysis of transcript and chromatin changes showed that, for light-repressed genes, H3K9 deacetylation parallels light-triggered transcriptional repression, while for light-induced genes, H3K9 acetylation appeared to somewhat precede light-activated transcript accumulation. However, direct, real-time imaging of transcript elongation in the nucleus revealed that, in fact, transcriptional induction actually parallels H3K9 acetylation. Collectively, the data raise the possibility that light-induced transcriptional and chromatin-remodeling processes are mechanistically intertwined. Histone modifying proteins involved in long term light responses do not seem to have a role in this fast response, indicating that different factors might act at different stages of the light response. This work not only advances our understanding of plant responses to light, but also unveils a system in which rapid chromatin changes in reaction to an external signal can be studied under natural conditions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

A Scalable Parallel Hypergraph Generator (HyGen)

Graphs are extensively used to model real-world complex systems. An edge in a graph can model pairwise relationships. However, multiway relationships (connections between three or more vertices) are common in many complex systems such as cellular process, image segmentation, and circuit design. A graph edge cannot model multiway relationships. A hypergraph, which can connect more than two vertices, is thus a better option to model multiway relationships. A large-scale hypergraph analysis has the potential to find useful insights from a complex system and assist in knowledge discovery. Currently a limited number of hypergraphs exists that are representative of real-world datasets. Moreover, real-world hypergraph datasets are small in size and inadequate to incorporate future needs. A graph generator that can produce large-scale synthetic hypergraphs can solve the above mentioned problems. In this paper, we present a scalable parallel hypergraph generator (HyGen) based on the Message Passing Interface (MPI) standard. To generate hypergraphs, HyGen takes the following parameter values as inputs: i) number of vertices, ii) number of hyperedges, iii) number of clusters, iv) vertex distribution, v) hyperedge distribution, vi) local cluster cardinality, and vii) global cluster cardinality. We have demonstrated that HyGen can generate hypergraphs of various sizes in a scalable fashion. HyGen takes approximately four minutes to generate a hypergraph with 4.8 million vertices, 1.6 million hyperedges, and 800 clusters using 1,024 processes on a leadership class computing platform. Our strong and weak scaling experiments on supercomputers demonstrate that HyGen can quickly create large-scale hypergraphs in a parallel manner, thus providing a useful capability for hypergraph analysis.

Hasan, S M Shamimul↗
DOE OSTI2021

A Step Towards the Final Frontier: Lessons Learned from Acceptance Testing of the First HPE/Cray EX 3000 System at ORNL

In this paper, we summarize the deployment of the Air Force Weather (AFW) HPC11 system at Oak Ridge National Laboratory (ORNL) including the process followed to successfully complete acceptance testing of the system. HPC11 is the first HPE/Cray EX 3000 system that has been successfully released to its user community in a federal facility. HPC11 consists of two identical 800-node supercomputers, Fawbush and Miller, with access to two independent and identical Lustre parallel file systems. HPC11 is equipped with Slingshot 10 interconnect technology and relies on the HPE Performance Cluster Manager (HPCM) software for system configuration. ORNL has a clearly defined acceptance testing process used to ensure that every new system deployed can provide the necessary capabilities to support user workloads. We worked closely with HPE and AFW to develop a set of tests that used the United Kingdom’s Meteorological Office’s Unified Model (UM) and 4DVAR. We also included benchmarks and applications from the Oak Ridge Leadership Computing Facility (OLCF) portfolio to fully exercise the HPE/Cray programming environment and evaluate the functionality and performance of the system. Acceptance testing of HPC11 required parallel execution of each element on Fawbush and Miller. In addition, careful coordination was needed to ensure successful acceptance of the newly deployed Lustre file systems alongside the compute resources. In this work, we present test results from specific system components and provide an overview of the issues identified, challenges encountered, and the lessons learned along the way.

Melesse Vergara, Veronica↗
DOE OSTI2026

Multi-task Parallelism for Robust Pre-training of Graph Foundation Models on Multi-source, Multi-fidelity Atomistic Modeling Data

Graph foundation models using graph neural networks promise sustainable, efficient atomistic modeling. To tackle challenges of processing multi-source, multi-fidelity data during pre-training, recent studies employ multi-task learning, in which shared message passing layers initially process input atomistic structures regardless of source, then route them to multiple decoding heads that predict data-specific outputs. This approach stabilizes pre-training and enhances a model’s transferability to unexplored chemical regions. Preliminary results on approximately four million structures are encouraging, yet questions remain about generalizability to larger, more diverse datasets and scalability on supercomputers. We propose a multi-task parallelism method that distributes each head across computing resources with GPU acceleration. Implemented in the open-source HydraGNN architecture, our method was trained on over 24 million structures from five datasets and tested on the Perlmutter, Aurora, and Frontier supercomputers, demonstrating efficient scaling on all three highly heterogeneous super-computing architectures.

Lupo Pasini, Massimiliano [ORNL] (ORCID:0000000249↗
DOE OSTI2026

Tuning Shinkarev’s Bicycle: Separating the Parallel Cycles of Photosystem II Using Empirical Wavelet Transform

The oxygen-evolving complex (OEC) of Photosystem II (PSII) catalyzes light-driven water oxidation, a process necessary to sustain Earth’s atmospheric oxygen. Oxygen yields measured during single-turnover flash sequences exhibit period-four oscillations, which form the basis of the Joliot–Kok (S-state) model. However, when the oscillations of other processes contribute to the measured oxygen yield, fitting methods can conflate these signals and distort estimates of inefficiencies and initial S-state populations. To address this, we applied the empirical wavelet transform (EWT) as a model-independent method to separate overlapping oscillators and capture damping dynamics that are not well represented in Fourier analysis. We tested this framework on polarographic flash-oxygen traces from both our Synechocystis sp. PCC 6803 thylakoid membrane preparations and archival datasets on Chlorella and isolated chloroplasts. EWT consistently resolves the expected period-four component alongside a distinct binary oscillation. Simulations suggest that fitting this isolated period-four signal recovers VZAD parameters more accurately than analysis of raw traces, yielding different estimates for S-state distributions and transition probabilities. Notably, this binary oscillation aligns closely with semiquinone dynamics predicted solely from period-four fit parameters. These findings indicate that EWT can effectively distinguish complex signals in oxygen evolution, offering a framework potentially applicable to other spectroscopic probes of the S-state cycle.

Ferrari, Nicholas [Louisiana State Univ., Baton Ro↗
DOE OSTI2020

Time-resolved RIXS experiment with pulse-by-pulse parallel readout data collection using X-ray free electron laser

Abstract Time-resolved resonant inelastic X-ray scattering (RIXS) is one of the developing techniques enabled by the advent of X-ray free electron laser (FEL). It is important to evaluate how the FEL jitter, which is inherent in the self-amplified spontaneous emission process, influences the RIXS measurement. Here, we use a microchannel plate (MCP) based Timepix soft X-ray detector to conduct a time-resolved RIXS measurement at the Ti L 3 -edge on a charge-density-wave material TiSe 2 . The fast parallel Timepix readout and single photon sensitivity enable pulse-by-pulse data acquisition and analysis. Due to the FEL jitter, low detection efficiency of spectrometer, and low quantum yield of RIXS process, we find that less than 2% of the X-ray FEL pulses produce signals, preventing acquiring sufficient data statistics while maintaining temporal and energy resolution in this measurement. These limitations can be mitigated by using future X-ray FELs with high repetition rates, approaching MHz such as the European XFEL in Germany and LCLS-II in the USA, as well as by utilizing advanced detectors, such as the prototype used in this study.

36 MATERIALS SCIENCE↗
DOE OSTI2020

On the Efficient Evaluation of the Exchange Correlation Potential on Graphics Processing Unit Clusters

The predominance of Kohn–Sham density functional theory (KS-DFT) for the theoretical treatment of large experimentally relevant systems in molecular chemistry and materials science relies primarily on the existence of efficient software implementations which are capable of leveraging the latest advances in modern high-performance computing (HPC). With recent trends in HPC leading toward increasing reliance on heterogeneous accelerator-based architectures such as graphics processing units (GPU), existing code bases must embrace these architectural advances to maintain the high levels of performance that have come to be expected for these methods. In this work, we purpose a three-level parallelism scheme for the distributed numerical integration of the exchange-correlation (XC) potential in the Gaussian basis set discretization of the Kohn–Sham equations on large computing clusters consisting of multiple GPUs per compute node. In addition, we purpose and demonstrate the efficacy of the use of batched kernels, including batched level-3 BLAS operations, in achieving high levels of performance on the GPU. We demonstrate the performance and scalability of the implementation of the purposed method in the NWChemEx software package by comparing to the existing scalable CPU XC integration in NWChem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

From NWChem to NWChemEx: Evolving with the Computational Chemistry Landscape

Since the advent of the first computers, chemists have been at the forefront of using computers to understand and solve complex chemical problems. As the hardware and software have evolved, so have the theoretical and computational chemistry methods and algorithms. Parallel computers clearly changed the common computing paradigm in the late 1970s and 80s, and the field has again seen a paradigm shift with the advent of graphical processing units. This review explores the challenges and some of the solutions in transforming software from the terascale to the petascale and now to the upcoming exascale computers. While discussing the field in general, NWChem and its redesign, NWChemEx, will be highlighted as one of the early codesign projects to take advantage of massively parallel computers and emerging software standards to enable large scientific challenges to be tackled.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

TuckerMPI: A Parallel C++/MPI Software Package for Large-scale Data Compression via the Tucker Tensor Decomposition

With this study, our goal is compression of massive-scale grid-structured data, such as the multi-terabyte output of a high-fidelity computational simulation. For such data sets, we have developed a new software package called TuckerMPI, a parallel C++/MPI software package for compressing distributed data. The approach is based on treating the data as a tensor, i.e., a multidimensional array, and computing its truncated Tucker decomposition, a higher-order analogue to the truncated singular value decomposition of a matrix. The result is a low-rank approximation of the original tensor-structured data. Compression efficiency is achieved by detecting latent global structure within the data, which we contrast to most compression methods that are focused on local structure. In this work, we describe TuckerMPI, our implementation of the truncated Tucker decomposition, including details of the data distribution and in-memory layouts, the parallel and serial implementations of the key kernels, and analysis of the storage, communication, and computational costs. We test the software on 4.5 and 6.7 terabyte data sets distributed across 100 s of nodes (1,000 s of MPI processes), achieving compression ratios between 100 and 200,000×, which equates to 99--99.999% compression (depending on the desired accuracy) in substantially less time than it would take to even read the same dataset from a parallel file system. Moreover, we show that our method also allows for reconstruction of partial or down-sampled data on a single node, without a parallel computer so long as the reconstructed portion is small enough to fit on a single machine, e.g., in the instance of reconstructing/visualizing a single down-sampled time step or computing summary statistics. The code is available at https://gitlab.com/tensors/TuckerMPI.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

FLEET: Flexible Efficient Ensemble Training for Heterogeneous Deep Neural Networks

Parallel training of an ensemble of Deep Neural Networks (DNN) on a cluster of nodes is an effective approach to shorten the process of neural network architecture search and hyper-parameter tuning for a given learning task. Prior efforts have shown that data sharing, where the common preprocessing operation is shared across the DNN training pipelines, saves computational resources and improves pipeline efficiency. Data sharing strategy, however, performs poorly for a heterogeneous set of DNNs where each DNN has varying computational needs and thus different training rate and convergence speed. This paper proposes FLEET, a flexible ensemble DNN training framework for efficiently training a heterogeneous set of DNNs. We build FLEET via several technical innovations. We theoretically prove that an optimal resource allocation is NP-hard and propose a greedy algorithm to efficiently allocate resources for training each DNN with data sharing. We integrate data-parallel DNN training into ensemble training to mitigate the differences in training rates and introduce checkpointing into this context to address the issue of different convergence speeds. Experiments show that FLEET significantly improves the training efficiency of DNN ensembles without compromising the quality of the result.

Guan, Hui↗
DOE OSTI2022

Manufacturing Supply Chain Development for Modular Solar-Thermochemical Conversion Platform - CRADA 387 (Final Report)

Modular chemical process intensification (MCPI) is an emerging field where chemical processing is performed using small-scale modular equipment instead of conventional large centralized chemical plants. Conventional chemical plants benefit from economies of scale that encourage scale-up to ever larger plants. A goal of MCPI is to develop technology that intensifies processing so that equipment can be dramatically smaller and integrated into modular systems. Scale-up occurs by adding more modules in parallel rather than making the equipment larger. A key concept is that equipment and modules can ultimately be cheaper by leveraging economies of mass production, analogous to the automotive industry, in manufacturing the equipment. This project made significant progress toward this outcome by meeting the RAPID institute metric to reduce equipment cost by 20% for each doubling in manufacturing volume. The MCPI application was thermochemical technology that is being commercialized by STARS Technology Corporation, one of the CRADA partners. The technology converts solar and renewable power to chemical energy to produce renewable hydrogen, fuels, and chemicals. The benefit to the public is reduction in greenhouse gases that are contributing to climate change. The project transitioned the steam methane reforming (SMR) reactor from conventional fabrication methods to additive manufacturing (AM) direct metal laser sintering (DMLS) process. This is projected to reduce the cost of making a reactor by 58% when producing 100 reactors per year. Innovations in the DMLS process produced a patented design that reduces reactor weight by 60%. Reductions in material costs and processing time extend the DMLS advantage to higher production volumes. The new design promises to be 38% cheaper than the conventional processes at 1000 units per year. The resulting 87% reduction in the steam methane reforming (SMR) module cost in scaling from current costs meets the RAPID metric. The project was successful in producing and testing the first ever additively manufactured SMR reactors. A reactor achieved over 82% efficiency in converting electric power to chemical energy, which is a world record for an inductively heated SMR. The project has contributed to the design and assembly of a first demonstration plant that is headed to a hydrogen bus filling station in Thousand Palms, CA.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Observation of Topological Chirality Switching Induced Freezing of a Skyrmion Crystal

Magnetic skyrmions are topologically protected quasi-particles with a well-defined chirality. Control over their chirality is proposed as an additional feature for encoding data bits or as qubits in quantum computing due to their high efficiency and stability against achiral magnetic textures. Here it is shown that an in-plane magnetic field can be utilized to reshape the energy barriers between different skyrmionic bubbles (e.g., Bloch type, type-II) enabling spontaneous chirality fluctuations with a frequency that increases with the strength of the in-plane field. The insulating van der Waals ferromagnet CrBr3 is used as an archetypal system for low damping, reduced energy dissipation and a high number of magnetic phases to capture the chirality dynamics in real time through cryo-Lorentz transmission electron microscopy. It is observed that the interplay between the intrinsic Dzyaloshinskii–Moriya interaction and out-of-plane field biased the chirality dynamics, favoring one handedness over the other. A remarkable consequence of the spontaneous chirality switching mechanism is that it induces a freezing (or crystallization) process in the skyrmion lattice. As the bubbles fluctuate between Bloch and type-II they elongate and shrink parallel to the in-plane field. Subsequently, the overall lattice crystallizes along the in-plane field direction, inducing a phase transition from a disordered liquid state to a hexatic phase where skyrmions are highly ordered resembling that of a solid. The results indicate chirality as an active element in the creation of topologically protected skyrmion crystals unveiling pathways toward chiral spintronic device platforms with tunable embedded configuration.

2D Phase Transition↗
DOE OSTI2025

Observations of Subduction, Downward Heat Flux and Dense Filament Collapse in the Northern Gulf of Mexico

Submesoscale processes are important contributors to the global heat budget and generally support upward heat transport through restratification. However, in salinity‐stratified regions, such as the northern Gulf of Mexico with its influx of freshwater from the Mississippi‐Atchafalaya river system, temperature can act like a passive tracer and submesoscale processes can contribute to downward heat transport. Oceanic heat content is a factor in many environmental risks the region faces, for example, hurricane intensification, and marine heatwaves. During the 2022 field campaign of the Submesoscales Under Near‐Resonant Inertial Shear Experiment, a sampling plan was developed to study such submesoscale processes in high resolution. Over 31 hr, four assets (two research ships and two remotely controlled boats) drove in parallel across a dense filament, capturing its evolution in time and space. The observations show that surface waters, warmed by daytime solar radiation, were subducted and that the associated overturning circulation transported heat below the surface layer where it was later irreversibly mixed away. The estimated downward heat flux was as strong as the concurrent net air‐sea heat flux into the ocean. The filament was then observed to rapidly collapse which we attribute to boundary layer turbulence and the breakdown of geostrophic balance. The collapsing fronts display behaviors indicative of gravity currents. These observations highlight how in salinity‐stratified regions, frontal dynamics can be associated with downward heat flux and how the submesoscale can play an important role in the oceanic heat budget.

58 GEOSCIENCES↗
DOE OSTI2020

HPC4Mobilty w/ UCB

The purpose of this project is to examine the energy impact of urban-scale traffic for the Los Angeles Basin by developing and implementing a scalable traffic assignment model. An energy optimization function will be posed and when integrated into the optimization code for travel assignment it can be mathematically proven to converge. The energy optimization function can then be compared to the typical travel time optimization that is traditionally used in traffic assignment models. The analysis will begin with static traffic assignment models with the routing for all origin and destinations computed in parallel on high performance computing facilities. Convergence of the numerical methods rely on the solution of convex programs (or extensions of these). This step will mostly consist of demonstrating the ability to parallelize the Frank Wolfe algorithm on various platforms. This work will contribute to LBNL’s efforts to develop new processes, analytical tools, program designs, and business models to advance the state of the art in next-generation sustainable transportation solutions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗