Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “heterogeneous computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Exploring utilization options of heterogeneous architectures for multi-physics simulations

Top supercomputers in the TOP500 list have transitioned from homogeneous node architectures toward heterogeneous manycore nodes with accelerators and CPUs. These new architectures present significant challenges to developers of large-scale multiphysics applications, especially at DOE laboratories that have invested heavily in scalable MPI codes over decades. Much of these scientific application porting efforts for the new heterogeneous architectures are focused on running the computation on the accelerators, which usually comprise > 90% of the FLOPS of the system, typically using one core per GPU to offload work. Furthermore, we describe an approach to utilizing the remaining FLOPS on a heterogeneous machine by running a portion of the computation on the CPUs cooperatively with the GPU computation. Orthogonally, we evaluate using the additional cores to also offload work to GPUs, effectively oversubscribing the GPUs. We present a proof-of-concept implementation in ARES, a multiphysics ALE-AMR code at LLNL. ARES uses a portability layer, RAJA, which enables us to utilize the same source code for both the CPU and the GPU. We develop an approach to utilize both types of processors cooperatively in a heterogeneous system. Our implementation divides the work between the computing resources via domain decomposition, and utilizes all cores of the CPU and all of the GPUs on the node for computation. Load balancing is necessary to use the heterogeneous resources effectively. We present preliminary results on early delivery pre-Sierra machines at LLNL, showing up to 40% performance benefit of oversubscribing the GPUs (with caveats), and up to an 18% performance benefit of using the CPUs on the heterogeneous nodes for computing in addition to using the GPUs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Implementation of CMFD Acceleration Scheme in PROTEUS-MOC

The PROTEUS-MOC code is a three-dimensional (3D) transport code, which is being developed at Argonne National Laboratory under the DOE-NE's Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. It provides a fully consistent 3D discretization of the transport equation by combining the two-dimensional (2D) method of characteristics (MOC) for the planar direction with the discontinuous Galerkin method for the treatment of the axial variable. PROTEUS-MOC uses the unstructured finite element method (FEM) and thus allows the explicit representation of any extruded geometries. It also has a capability of massively parallel computation in energy group, angle, plane, and space using a top-level GMRES linear algebra solver. For parallel computation in space, it uses an unstructured domain decomposition by adapting METIS. The computational burden for direct heterogeneous core calculations based on unstructured geometries is excessive for practical reactor problems, and hence it is essential to implement an efficient acceleration scheme in PROTEUS-MOC. Recently, the coarse mesh finite difference (CMFD) method, which was originally applied to the nodal diffusion methods, has been successfully applied to the MOC transport solvers, resulting in a remarkable reduction in the number of fission source iterations. In addition, a modified CMFD method has been developed to overcome the limitation of the conventional CMFD that is applicable only to neutronics solvers with a conservative discretization. This CMFD method was derived to be consistent with the FEM, which is based on a nonconservative discretization. In this method, the neutron balance in each coarse mesh is enforced by introducing a pseudo absorption cross section (PAXS), and the well-established alternating solution process of CMFD and transport calculations is employed to accelerate source convergence. This modified CMFD acceleration scheme was adopted in PROTEUS-MOC to accelerate the fission source iteration. Pin-cell and assembly based CMFD schemes have been implemented by defining individual pin cells or assemblies as a coarse mesh. For this, an algorithm to map the finite elements to coarse meshes was developed, and the routines were developed to determine the coupling coefficients and PAXS of the CMFD equations from the transport solution. Preliminary performance tests were carried out using the C5G7 benchmark problem. This paper presents the main features of this CMFD acceleration scheme and the preliminary test results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Tandem bulk oxygen diffusion and surface reactions in reducible metal oxides control redox cycle dynamics

The interplay between bulk oxygen diffusion and surface reactions in reducible metal oxides is key in heterogeneous catalysts, but direct measurements of oxygen mobility, transient kinetics, and in situ spectroscopies have been lacking. Here, we reveal complex dynamic behavior of ceria-zirconia by H 2 using transient kinetics via mass spectrometry and in situ Raman and near-ambient pressure x-ray photoelectron spectroscopies. Molecular dynamics simulations with a machine learning potential delineate competitive oxygen diffusion mechanisms, with an optimal mobility at intermediate reductions. We expose a compensation between vacancy availability and lattice distortion at intermediate to high reductions and Frenkel defects at low reductions, underscoring a potential deficiency of 16 O/ 18 O exchange experiments in deducing oxygen mobility. Vacancies in proximity require electron localization on Ce atoms further away. The continuous replenishment of surface oxygen results in a varying reduction rate, with H 2 dissociation being the rate-limiting step. Multiscale transient simulations, consistent with experiments, indicate catalysts of potentially spatially varying oxidation states. The approach is broadly applicable to reducible oxide materials.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Roadmap for transforming heterogeneous catalysis with artificial intelligence

Artificial intelligence (AI) is poised to transform heterogeneous catalysis, opening avenues for catalytic materials discovery. By uncovering intricate patterns in high-dimensional data, AI has been reshaping our pursuit of sustainable catalytic processes across the energy, environmental and chemical sectors. This promise, however, hinges on overcoming fundamental barriers, including limitations in data availability and quality, challenges in the generalizability and interpretability of data-augmented decisions, and the persistent gap between in silico predictions and experiments. Furthermore, we outline a forward-looking roadmap for deeply integrating AI into heterogeneous catalysis with an AI-ready data ecosystem, multimodal foundation models, and ultimately autonomous laboratories to accelerate the development of next-generation catalytic technologies via AI-empowered human–machine collaboration.

Computational methods↗
DOE OSTI2016

Planning Target Volume D95 and Mean Dose Should Be Considered for Optimal Local Control for Stereotactic Ablative Radiation Therapy

Purpose: To identify the optimal dose parameters predictive for local/lobar control after stereotactic ablative radiation therapy (SABR) in early-stage non-small cell lung cancer (NSCLC). Methods and Materials: This study encompassed a total of 1092 patients (1200 lesions) with NSCLC of clinical stage T1-T2 N0M0 who were treated with SABR of 50 Gy in 4 fractions or 70 Gy in 10 fractions, depending on tumor location/size, using computed tomography-based heterogeneity corrections and a convolution superposition calculation algorithm. Patients were monitored by chest CT or positron emission tomography/CT and/or biopsy after SABR. Factors predicting local/lobar recurrence (LR) were determined by competing risk multivariate analysis. Continuous variables were divided into 2 subgroups at cutoff values identified by receiver operating characteristic curves. Results: At a median follow-up time of 31.7 months (interquartile range, 14.8-51.3 months), the 5-year time to local recurrence within the same lobe and overall survival rates were 93.8% and 44.8%, respectively. Total cumulative number of patients experiencing LR was 40 (3.7%), occurring at a median time of 14.4 months (range, 4.8-46 months). Using multivariate competing risk analysis, independent predictive factors for LR after SABR were minimum biologically effective dose (BED{sub 10}) to 95% of planning target volume (PTVD95 BED{sub 10}) ≤86 Gy (corresponding to PTV D95 physics dose of 42 Gy in 4 fractions or 55 Gy in 10 fractions) and gross tumor volume ≥8.3 cm{sup 3}. The PTVmean BED{sub 10} was highly correlated with PTVD95 BED{sub 10.} In univariate analysis, a cutoff of 130 Gy for PTVmean BED{sub 10} (corresponding to PTVmean physics dose of 55 Gy in 4 fractions or 75 Gy in 10 fractions) was also significantly associated with LR. Conclusions: In addition to gross tumor volume, higher radiation dose delivered to the PTV predicts for better local/lobar control. We recommend that both PTVD95 BED{sub 10} >86 Gy and PTVmean BED{sub 10} >130 Gy should be considered for SABR plan optimization.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2023

Distributed out-of-memory NMF on CPU/GPU architectures

We propose an efficient distributed out-of-memory implementation of the non-negative matrix factorization (NMF) algorithm for heterogeneous high-performance-computing systems. The proposed implementation is based on prior work on NMFk, which can perform automatic model selection and extract latent variables and patterns from data. In this work, we extend NMFk by adding support for dense and sparse matrix operation on multi-node, multi-GPU systems. The resulting algorithm is optimized for out-of-memory problems where the memory required to factorize a given matrix is greater than the available GPU memory. Memory complexity is reduced by batching/tiling strategies, and sparse and dense matrix operations are significantly accelerated with GPU cores (or tensor cores when available). Input/output latency associated with batch copies between host and device is hidden using CUDA streams to overlap data transfers and compute asynchronously, and latency associated with collective communications (both intra-node and inter-node) is reduced using optimized NVIDIA Collective Communication Library (NCCL) based communicators. Benchmark results show significant improvement, from 32X to 76x speedup, with the new implementation using GPUs over the CPU-based NMFk. Good weak scaling was demonstrated on up to 4096 multi-GPU cluster nodes with approximately 25,000 GPUs when decomposing a dense 340 Terabyte-size matrix and an 11 Exabyte-size sparse matrix of density 10 -6 .

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Region templates: Data representation and management for high-throughput image analysis

Compartment fires exhibit unique features associated with smoke accumulation and restricted air ventilation. The objective of the present study is to evaluate the ability of CFD-based fire models to simulate these features and in particular the effects of flame extinction that results from under-ventilated fire conditions. The study is performed using FireFOAM; FireFOAM is an advanced fire modeling software developed by FM Global and is based on a general-purpose open-source software called OpenFOAM. A new flame extinction model based on the concept of a critical value of the flame Damköhler number is incorporated into FireFOAM. The performance of the extinction model is evaluated via comparisons with a previously developed experimental database corresponding to a reduced-scale, heptane-fueled, compartment fire configuration. The numerical simulations also include a description of fuel evaporation driven by the computed gas-to-liquid heat feedback. Comparisons between experimental data and numerical results provide a suitable test bed to evaluate the ability of CFD-based fire models to describe the transition from over- to under-ventilated fire conditions, as well as the transition from extinction-free conditions to conditions in which the flame experiences partial or total quenching.

Energy & Fuels↗
DOE OSTI2019

Graph Theory Approach to High-Throughput Surface Adsorption Structure Generation

We present a methodology for graph based enumeration of surfaces and unique chemical adsorption structures bonded to those surfaces. Utilizing the graph produced from a bulk structure, we create a unique graph representation for any general slab cleave and further extend that representation to include a large variety of catalytically relevant adsorbed molecules. Here, we also demonstrate simple geometric procedures to generate 3D initial guesses of these enumerated structures. While generally useful for generating a wide variety of structures used in computational surface science and heterogeneous catalysis, these techniques are also key to facilitating an informatics approach to the high-throughput search for more effective catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Size-Transferable Prediction of Excited State Properties for Molecular Assemblies with a Machine Learning Exciton Model

Computational modeling of the excited states of molecular aggregates faces significant computational challenges and size heterogeneity. Current machine learning (ML) models, typically trained on specific-sized aggregates, struggle with scalability. We found that the exciton model Hamiltonian of large aggregates can be decomposed into dimer pairs, allowing an ML model trained on dimers to reconstruct Hamiltonians for aggregates of any size. We also proposed a new method to address the phase-correction problem by introducing coupling terms’ approximations. Our model accurately predicted the excitation energies of the trimer and tetramer of perylene and tetracene and estimated S1 oscillator strengths of perylene aggregates. Leveraging our ML model, the optical gaps of nanosized perylene aggregates with up to 50 monomers are analyzed, qualitatively revealing the role of different couplings on their size dependency. Future work will explore transferability across different monomers to predict optical properties in heterogeneous assemblies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Highly active, ultra-low loading single-atom iron catalysts for catalytic transfer hydrogenation

Highly effective and selective noble metal-free catalysts attract significant attention. Here, a single-atom iron catalyst is fabricated by saturated adsorption of trace iron onto zeolitic imidazolate framework-8 (ZIF-8) followed by pyrolysis. Its performance toward catalytic transfer hydrogenation of furfural is comparable to state-of-the-art catalysts and up to four orders higher than other Fe catalysts. Isotopic labeling experiments demonstrate an intermolecular hydride transfer mechanism. First principles simulations, spectroscopic calculations and experiments, and kinetic correlations reveal that the synthesis creates pyrrolic Fe(II)-plN 3 as the active center whose flexibility manifested by being pulled out of the plane, enabled by defects, is crucial for collocating the reagents and allowing the chemistry to proceed. The catalyst catalyzes chemoselectively several substrates and possesses a unique trait whereby the chemistry is hindered for more acidic substrates than the hydrogen donors. This work paves the way toward noble-metal free single-atom catalysts for important chemical reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Impact of cross-linking of polymers on transport of salt and water in polyelectrolyte membranes: A mesoscopic simulation study

Our recent atomistic simulation studies demonstrated that the transport properties of salt ions and water in non-crosslinked polymer electrolyte membrane exhibit an intriguing dependence on salt concentration that is opposite to that seen in electrolyte solutions. Here in this paper, we extend our study to probe the influence of the degree of cross-linking of the polymer on the transport properties of salt and water in polymer electrolyte membranes. Towards this objective, we use a coarse-grained model embedded within dissipative particle dynamics (DPD) mesoscale simulations, which allows us to access time scales necessary for studying crosslinked polymer systems. Our DPD simulations on non-crosslinked membranes reproduce results that are in qualitative agreement with our atomistic simulations. For the case of crosslinked membranes, our results demonstrate that the diffusion of salt ions and water is reduced significantly relative to crosslinked systems. However, the trends exhibited by the salt concentration dependence of diffusivities and the coordination of the cations with anions and with the polymer backbone remain qualitatively similar to those observed in non-crosslinked membranes.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Dependent scattering and fractal microstructure determine the transparency of aerogel monoliths

This study reveals how dependent scattering and microstructure significantly affect electromagnetic wave propagation through aerogel monoliths, contributing to their transparency. Light scattering by particle ensembles is considered “dependent” when the scattering properties rely not only on particle size and optical constants but also on their spatial distribution, typically occurring when the average interparticle distance is small in comparison with the wavelength of incident radiation. Addressing dependent scattering requires solving Maxwell’s equations for complex heterogeneous structures, which is computationally demanding and usually limited to sample thicknesses on the same scale as the wavelength. This study combines computer-generated ambigel microstructures of fractal aggregates of polydisperse nanoparticles and the radiative transfer with reciprocal transaction method to predict the transmittance of thick ambigel slabs. Transmittance measurements of ambiently dried aerogel monoliths (ambigels) with porosities from about 50% to 90% closely matched the predicted values for their digital twins. However, ignoring dependent scattering or particle aggregation led to inaccurate predictions. This study validated the computational framework, and its findings offer insights for designing photonic metamaterials and analyzing their interactions with electromagnetic waves.

Yalcin, Refet A. (ORCID:0000000339973494)↗
DOE OSTI2021

Optimizing Error-Bounded Lossy Compression for Scientific Data on GPUs

Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. With ever-emerging heterogeneous high-performance computing (HPC) architecture, GPU-accelerated error-bounded compressors (such as CUSZ and cuZFP) have been developed. However, they suffer from either low performance or low compression ratios. To this end, we propose CUSZ+ to target both high compression ratios and throughputs. We identify that data sparsity and data smoothness are key factors for high compression throughputs. Our key contributions in this work are fourfold: (1) We propose an efficient compression workflow to adaptively perform run-length encoding and/or variable-length encoding. (2) We derive Lorenzo reconstruction in decompression as multidimensional partial-sum computation and propose a fine-grained Lorenzo reconstruction algorithm for GPU architectures. (3) We carefully optimize each of CUSZ kernels by leveraging state-of-the-art CUDA parallel primitives. (4) We evaluate CUSZ+ using seven real-world HPC application datasets on V100 and A100 GPUs. Experiments show CUSZ+ improves the compression throughputs and ratios by up to 18.4x and 5.3x, respectively, over CUSZ on the tested datasets.

Tian, Jiannan↗
DOE OSTI2024

IRIS: Exploring Performance Scaling of the Intelligent Runtime System and its Dynamic Scheduling Policies

High-Performance Computing is becoming increasingly heterogeneous, relying on a diverse mix of hardware to achieve good performance. Paradoxically, current drivers and frameworks for these devices typically require separate languages and implementations for each vendor. Furthermore, there are few tools and little support to schedule codes between these devices in a truly heterogeneous manner-partly because of this fragmentation between vendors and the languages each supports. To overcome both limitations, the Intelligent Runtime System (IRIS) was developed. It allows a common task abstraction to automatically be shared among contemporary vendors and is run from a single host-side API. At runtime, IRIS queries the host system and registers which frameworks and drivers are available, these determine which kernels can be used by the scheduler-CPUs via OpenMP, Nvidia GPUs (CUDA), AMD GPUs (HIP), and Intel and Xilinx FPGAs with OpenCL. IRIS enables tasks to be scheduled to any heterogeneous device and resolves to the appropriate kernel binary at runtimeit only uses the devices supported by the system on which it is run. IRIS supports single-task and graph-based expressions of dependencies of tasks. Additionally, IRIS features a range of dynamic scheduling policies, allowing complex chains of tasks and interactions to be executed, relieving the programmer/user from considering the system to assign tasks to devices optimally. This paper presents the peak performance attainable by IRIS over a range of systems-each with different numbers and types of accelerator devices, it highlights the flexibility of IRIS since these devices are truly heterogeneous, relying on different backends (drivers, frameworks, and languages) which historically required unique implementations to utilize them. We then use this peak performance as a baseline to compare increasingly complex chains of tasks (with increasingly complex task dependencies) and evaluate how IRIS copes. Finally, we consider the performance of different IRIS scheduling policies on this range of task graphs.

Johnston, Beau↗
DOE OSTI2024

EchemAMR (electro-chemical microsctructure scale models with adaptive meshing) [SWR-23-111]

A 3D microstructure resolving electrochemical transport and interfacial chemistry solver. Electrode microstructure plays an important role in determining the performance of an electrochemical system, e.g. lithium ion battery. EchemAMR is a microstructure scale model that solves the governing equations for ion transport, electrical current continuity, interfacial chemistry and structural mechanics. Complex microstructure geometries from imaging can be directly imported into EchemAMR. A volume fraction based description of the geometry on Cartesian grid with an immersed interface formulation enables simplified meshing and large-scale simulations with millions of degrees of freedom. EchemAMR has been tested against systems with analytic solutions for numerical convergence and highly resolved lithium ion battery microstructures. EchemAMR demonstrates excellent mass conversation and efficient scaling on heterogenous High-Performance Computing (HPC) with central and graphics processing units.

Sitaraman, Hariswaran↗
DOE OSTI2016

Towards performance-portability of the Albany Finite Element analysis code using the Kokkos library of Trilinos

Performance portability on heterogeneous high-performance computing (HPC) systems is a major challenge faced today by code developers: parallel code needs to execute correctly as well as with high performance on machines with different architectures, operating systems, and software libraries. The Finite Element Method (FEM) is a popular and flexible method for discretizing partial differential equations arising in a wide variety of scientific, engineering, and industry applications that require HPC. This paper presents some preliminary results pertaining to our development of a performance portable implementation of the FEM-based Albany code. Performance portability is achieved using the Kokkos library of Trilinos. We present performance results for two different physics simulations modules in Albany: the Aeras global atmosphere dynamical code and the FELIX land-ice solver. As a result, numerical experiments show that our single code implementation gives reasonable performance across two multi-core/many-core architectures: NVIDIA GPUs and multi-core CPUs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Fréchet kernels based on a fractional viscoacoustic wave equation

Incorporating the seismic attenuation into the waveform inversion framework could not only improve the accuracy of the velocity model but also provide an additional Q model. Recently, we proposed a viscoacoustic wave equation assisted by the fractional Laplacian operators to accurately model the wave propagation in heterogeneous attenuating media with computational efficiency. The explicit presence of Q as a coefficient in this equation suggests the potential to conveniently develop its full waveform inversion scheme. In this study, we utilize the adjoint-state method to formulate the computation of the Fréchet kernels with respect to both velocity and attenuation based on this wave equation. These kernels will play a fundamental role in the viscoacoustic multiparameter waveform inversion.

Xing, Guangchi↗
DOE OSTI2021

Rapid simulations of hyperspectral near-field images of three-dimensional heterogeneous surfaces

The scattering-type scanning near-field optical microscope (s-SNOM) has emerged as a powerful tool for resolving nanoscale inhomogeneities in laterally heterogeneous samples. However, most analytical models used to predict the scattering near-field signals are assuming homogenous landscapes (bulk materials), resulting in inconsistencies when applied to samples with more complex configurations. In this work, we combine the point-dipole model (PDM) to the finite-element method (FEM) to account for the lateral and vertical heterogeneities while keeping the computation time manageable. Full images, spectra, or hyperspectral line profiles can be simulated by calculating the self-consistent dipole radiation demodulated at higher harmonics of the tip oscillation, mimicking real experimental procedures. Using this formalism, we clarify several important yet puzzling experimental observations in near-field images on samples with rich typography and complex material compositions, heterostructures of two-dimensional material flakes, and plasmonic antennas. The developed method serves as a basis for future investigations of nano-systems with nontrivial topography.

36 MATERIALS SCIENCE↗