Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Heterogeneous computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2012

Comparison of Different Upscaling Methods for Predicting Thermal Conductivity of Complex Heterogeneous Materials System: Application on Nuclear Waste Forms

To develop a strategy in thermal conductivity prediction of a complex heterogeneous materials system, loaded nuclear waste forms, the computational efficiency and accuracy of different upscaling methods have been evaluated. The effective thermal conductivity, obtained from microstructure information and local thermal conductivity of different components, is critical in predicting the life and performance of waste form during storage. Several methods, including the Taylor model, Sachs model, self-consistent model, and statistical upscaling method, were developed and implemented. Microstructure based finite element method (FEM) prediction results were used to as benchmark to determine the accuracy of the different upscaling methods. Micrographs from waste forms with varying waste loadings were used in the prediction of thermal conductivity in FEM and homogenization methods. Prediction results demonstrated that in term of efficiency, boundary models (e.g., Taylor model and Sachs model) are stronger than the self-consistent model, statistical upscaling method, and finite element method. However, when balancing computational efficiency and accuracy, statistical upscaling is a useful method in predicting effective thermal conductivity for nuclear waste forms.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Extracting Knowledge from Data through Catalysis Informatics

Catalysis informatics is a distinct sub-field that lies at the intersection of cheminformatics and materials informatics, but with unique challenges arising from the dynamic, surface-sensitive, multi-scale nature of heterogeneous catalysis. The ideas behind catalysis informatics can be traced back decades, but the field is only recently emerging due to advances in data infrastructure, statistics, machine learning, and computational methods. In this work we review the field from early works on expert systems and knowledge engines to more recent approaches utilizing machine-learning and uncertainty quantification. The data-information-knowledge hierarchy is introduced and used to classify various developments. The chemical master equation and micro-kinetic models are proposed as a quantitative representation of catalysis knowledge, which can be used to generate explanative and predictive hypotheses for the understanding and discovery of catalytic materials. We discuss future prospects for the field, including improved quantitative coupling of experiment/theory, advanced micro-kinetic models, and the development of open-source software tools. As a result, integration of existing chemical and physical models with emerging statistical and computational tools presents a promising route toward the automated design, discovery, and optimization of heterogeneous catalytic processes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Prediction of Adsorption Energies for Chemical Species on Metal Catalyst Surfaces Using Machine Learning

Computational catalyst screening has the potential to significantly accelerate heterogeneous catalyst discovery. Typically, this involves developing microkinetic reactor models that are based on parameters obtained from density functional theory and transition-state theory. To reduce the large computational cost involved in computing various adsorption and transition-state energies of all possible surface states on a large number of catalyst models, linear scaling relations for surface intermediates and transition states have been developed that only depend on a few, typically one or two descriptors, such as the carbon atom adsorption energy. As a result, only the descriptor values have to be computed for various active site models to generate volcano curves in activity or selectivity. Unfortunately, for more complex chemistries the predictability of linear scaling relations is unknown. Also, the selection of descriptors is essentially a trial and error process. Here, using a database of adsorption energies of the surface species involved in the decarboxylation and decarbonylation of propionic acid over eight monometalic transition-metal catalyst surfaces (Ni, Pt, Pd, Ru, Rh, Re, Cu, Ag), we tested if nonlinear machine learning (ML) models can outperform the linear scaling relations in prediction accuracy when predicting the adsorption energy for various species on a metal surface based on data from the rest of the metal surfaces. We found linear scaling relations to hold well for predictions across metals with a mean-absolute error of 0.12 eV, and ML methods being unable to outperform linear scaling relations when the training dataset contains a complete set of energies for all of the species on various metal surfaces. Only when the training dataset is incomplete, namely, contains a random subset of species’ energies for each metal, a currently unlikely scenario for catalyst screening, do kernel-based ML models significantly outperform linear scaling relations. We also found that simple coordinate-free species descriptors, such as bond counts, achieve as good results as sophisticated coordinate-based descriptors. Finally, we propose an approach for automatic discovery of appropriate metal descriptors using principal component analysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Celeritas R&D Report: Accelerating Geant4

Celeritas is a new Monte Carlo (MC) detector simulation code designed for computationally intensive applications on high-performance heterogeneous architectures. In the past two years Celeritas has advanced from prototyping a Graphics Processing Unit (GPU)-based single physics model in infinite medium to implementing a full set of electromagnetic (EM) physics processes in complex geometries. The current release of Celeritas, version 0.4, has incorporated full device-based navigation, an event loop in the presence of magnetic fields, and detector hit scoring. New functionality incorporates a scheduler to offload electromagnetic physics to the GPU within a Geant4-driven simulation, enabling straightforward integration of Celeritas into the high energy physics (HEP) experimental frameworks CMSSW and ATLAS FullSimLight. On the Perlmutter supercomputer, Celeritas performs EM physics between 3× and 18× faster using the machine’s Nvidia GPUs compared to using only CPUs, corresponding to an electrical power efficiency up to a factor of 5. When running a multithreaded Geant4 ATLAS test beam application with full hadronic physics, using Celeritas to accelerate the EM physics results in an overall simulation speedup of 1.7–2.2× on GPU and 1.2× on CPU. In a CMS test application using tt¯ events and the prototype Run 4 configuration, compared to Geant4 CPU, Celeritas with a Nvidia A100 improves overall throughput up to a factor of 2.7× but cannot be efficiently shared with more than 8 cores.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Iterative methods in GPU-resident linear solvers for nonlinear constrained optimization

Linear solvers are major computational bottlenecks in a wide range of decision support and optimization computations. The challenges become even more pronounced on heterogeneous hardware, where traditional sparse numerical linear algebra methods are often inefficient. For example, methods for solving ill-conditioned linear systems have relied on conditional branching, which degrades performance on hardware accelerators such as graphical processing units (GPUs). To improve the efficiency of solving ill-conditioned systems, our computational strategy separates computations that are efficient on GPUs from those that need to run on traditional central processing units (CPUs). Our strategy maximizes the reuse of expensive CPU computations. Iterative methods, which thus far have not been broadly used for ill-conditioned linear systems, play an important role in our approach. In particular, we extend ideas from Arioli et al., (2007) to implement iterative refinement using inexact LU factors and flexible generalized minimal residual (FGMRES), with the aim of efficient performance on GPUs. In conclusion, we focus on solutions that are effective within broader application contexts, and discuss how early performance tests could be improved to be more predictive of the performance in a realistic environment.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Scalable Computation of 2D-Minkowski Sum of Arbitrary Non-Convex Domains: Modeling Flexibility in Energy Resources

The flexibility of active ($p$) and reactive power ($q$) consumption in distributed energy resources (DERs) can be represented as a (potentially non-convex) set of points in the $p$-$q$ plane. Modeling of the aggregated flexibility in a heterogeneous ensemble of DERs as a Minkowski sum (M-sum) is computationally intractable even for moderately sized populations. In this article, we propose a scalable method of computing the M-sum of the flexibility domains of a heterogeneous ensemble of DERs, which are allowed to be non-convex, non-compact. In particular, the proposed algorithm computes a guaranteed superset of the true M-sum, with desired accuracy. The worst-case complexity of the algorithm is computed. Special cases are considered, and it is shown that under certain scenarios, it is possible to achieve a complexity that is linear with the size of the ensemble. Numerical examples are provided by computing the aggregated flexibility of different mix of DERs under varying scenarios.

Kundu, Soumya↗
DOE OSTI2019

Highly-scalable, physics-informed GANs for learning solutions of stochastic PDEs

Uncertainty quantification for forward and inverse problems is a central challenge across physical and biomedical disciplines. We address this challenge for the problem of modeling subsurface flow at the Hanford Site by combining stochastic computational models with observational data using physics-informed GAN models. The geographic extent, spatial heterogeneity, and multiple correlation length scales of the Hanford Site require training a computationally intensive GAN model to thousands of dimensions. We develop a highly optimized implementation that scales to {\herogpucount} NVIDIA Volta GPUs. We develop a hierarchical scheme based on a multi-player game-theoretic approach for exploiting domain parallelism, map discriminators and generators to multiple GPUs, and employ efficient communication schemes to ensure training stability and convergence. Our implementation scales to {\heronodecount} nodes on the Summit supercomputer with a \weakscalingeff\% scaling efficiency, achieving peak and sustained half-precision rates of {\heropeakperf} PF/s and {\herosustainedperf} PF/s.

physics informed ML, machine learning, generative ↗
DOE OSTI2020

Contributions to Lignomics: Stochastic Generation of Oligomeric Lignin Structures for Interpretation of MALDI–FT‐ICR‐MS Results

The lack of standards to identify oligomeric molecules is a challenge for the analysis of complex organic mixtures. High-resolution mass spectrometry—specifically, Fourier-transform ion cyclotron resonance mass spectrometry (FT-ICR MS)—offers new opportunities for analysis of oligomers with the assignment of formulae (C x H y O z ) to detected peaks. However, matching a specific structure to a given formula remains a challenge due to the inability of FT-ICR MS to distinguish between isomers. Additional separation techniques and other analyses (e.g., NMR spectroscopy) coupled with comparison of results to those from pure compounds is one route for assignment of MS peaks. Unfortunately, this strategy may be impractical for complete analysis of complex, heterogeneous samples. In this study we use computational stochastic generation of lignin oligomers to generate a molecular library for supporting the assignment of potential candidate structures to compounds detected during FT-ICR MS analysis. Furthermore, this approach may also be feasible for other macromolecules beyond lignin.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Numerical study of multiscale compaction-initiated detonation

A multiscale model of heterogeneous condensed-phase explosives is examined computationally to determine the course of transient events following the application of a piston-driven stimulus. The model is a modified version of that introduced by Gonthier (Combust Sci Technol 175(9):1679–1709, 2003. https://doi.org/10.1080/00102200302373) in which the explosive is treated as a porous, compacting medium at the macro-scale and a collection of closely packed spherical grains capable of undergoing reaction and diffusive heat transfer at the meso-scale. A separate continuum description is ascribed to each scale, and the two scales are coupled together in an energetically consistent manner. Following piston-induced compaction, localized energy deposition at the sites of intergranular contact creates hot spots where reaction begins preferentially. Reaction progress at the macro-scale is determined by the spatial average of that at the grain scale. A parametric study shows that combustion at the macro-scale produces an unsteady detonation with a cyclical character, in which the lead shock loses strength and is overtaken by a stronger secondary shock generated in the partially reacted material behind it. Finally, the secondary shock in turn becomes the new lead shock and the process repeats itself.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Physics-informed machine learning with differentiable programming for heterogeneous underground reservoir pressure management

Abstract Avoiding over-pressurization in subsurface reservoirs is critical for applications like CO $$_2$$ 2 sequestration and wastewater injection. Managing the pressures by controlling injection/extraction are challenging because of complex heterogeneity in the subsurface. The heterogeneity typically requires high-fidelity physics-based models to make predictions on CO $$_2$$ 2 fate. Furthermore, characterizing the heterogeneity accurately is fraught with parametric uncertainty. Accounting for both, heterogeneity and uncertainty, makes this a computationally-intensive problem challenging for current reservoir simulators. To tackle this, we use differentiable programming with a full-physics model and machine learning to determine the fluid extraction rates that prevent over-pressurization at critical reservoir locations. We use DPFEHM framework, which has trustworthy physics based on the standard two-point flux finite volume discretization and is also automatically differentiable like machine learning models. Our physics-informed machine learning framework uses convolutional neural networks to learn an appropriate extraction rate based on the permeability field. We also perform a hyperparameter search to improve the model’s accuracy. Training and testing scenarios are executed to evaluate the feasibility of using physics-informed machine learning to manage reservoir pressures. We constructed and tested a sufficiently accurate simulator that is 400 000 times faster than the underlying physics-based simulator, allowing for near real-time analysis and robust uncertainty quantification.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

Characterization of NiFe oxyhydroxide electrocatalysts by integrated electronic structure calculations and spectroelectrochemistry

NiFe oxyhydroxide materials are highly active electrocatalysts for the oxygen evolution reaction (OER), an important process for carbon-neutral energy storage. Recent spectroscopic and computational studies increasingly support iron as the site of catalytic activity but differ with respect to the relevant iron redox state. A combination of hybrid periodic density functional theory calculations and spectroelectrochemical experiments elucidate the electronic structure and redox thermodynamics of Ni-only and mixed NiFe oxyhydroxide thin-film electrocatalysts. The UV/visible light absorbance of the Ni-only catalyst depends on the applied potential as metal ions in the film are oxidized before the onset of OER activity. In contrast, absorbance changes are negligible in a 25% Fe-doped catalyst up to the onset of OER activity. First-principles calculations of proton-coupled redox potentials and magnetizations reveal that the Ni-only system features oxidation of Ni2+ to Ni3+, followed by oxidation to a mixed Ni3+/4+ state at a potential coincident with the onset of OER activity. Calculations on the 25% Fedoped system show the catalyst is redox inert before the onset of catalysis, which coincides with the formation of Fe4+ and mixed Ni oxidation states. The calculations indicate that introduction of Fe dopants changes the character of the conduction band minimum from Ni-oxide in the Ni-only to predominantly Fe-oxide in the NiFe electrocatalyst. These findings provide a unified experimental and theoretical description of the electrochemical and optical properties of Ni and NiFe oxyhydroxide electrocatalysts and serve as an important benchmark for computational characterization of mixedmetal oxidation states in heterogeneous catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

Advancing Genome-Resolved Metagenomics beyond the Shotgun

Exploration of environmental microbiomes has shed light on the ecological and evolutionary principles at play in natural ecosystems and has been further accelerated through the reconstruction of population genomes to provide genome-centric context. Yet technical challenges with traditional shotgun metagenomics remain for computationally intense short-read assembly, strain heterogeneity within communities, and depth of coverage required for low-abundance microbes. In this Perspective, we highlight three main avenues for promising future developments, including coupling stable isotope probing and genome-resolved metagenomics, applying fluorescence-activated cell sorting approaches to target mini-metagenomes within a larger community, and utilizing single-molecule long-read and synthetic long-read technology to link mobile elements to host microbial cells. These developments on the horizon will undoubtedly advance genome-resolved metagenomic approaches and enable a better understanding of uncultivated microbes in their natural environments.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

ATHENA: Analytical Tool for Heterogeneous Neuromorphic Architectures

The ASC program seeks to use machine learning to improve efficiencies in its stockpile stewardship mission. Moreover, there is a growing market for technologies dedicated to accelerating AI workloads. Many of these emerging architectures promise to provide savings in energy efficiency, area, and latency when compared to traditional CPUs for these types of applications — neuromorphic analog and digital technologies provide both low-power and configurable acceleration of challenging artificial intelligence (AI) algorithms. If designed into a heterogeneous system with other accelerators and conventional compute nodes, these technologies have the potential to augment the capabilities of traditional High Performance Computing (HPC) platforms [5]. This expanded computation space requires not only a new approach to physics simulation, but the ability to evaluate and analyze next-generation architectures specialized for AI/ML workloads in both traditional HPC and embedded ND applications. Developing this capability will enable ASC to understand how this hardware performs in both HPC and ND environments, improve our ability to port our applications, guide the development of computing hardware, and inform vendor interactions, leading them toward solutions that address ASC’s unique requirements.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Understanding Generative AI Content with Embedding Models

The construction of high-quality numerical features is critical to any quantitative data analysis. Feature engineering has been historically addressed by carefully hand-crafting data representations based on domain expertise. This work views the internal representations of modern deep neural networks (DNNs), called embeddings, as an implicit form of traditional feature engineering. For trained DNNs, we show that these embeddings can reveal interpretable, high-level concepts in unstructured sample data. We use these embeddings in natural language and computer vision tasks to uncover both inherent heterogeneity in the underlying data and human-understandable explanations for it. In particular, we find empirical evidence that there is inherent separability between real data and those generated from AI models.

Vargas, Max↗
DOE OSTI2018

HEP Software Foundation Community White Paper Working Group - Data Processing Frameworks

Data processing frameworks are an essential part of HEP experiments' software stacks. Frameworks provide a means by which code developers can undertake the essential tasks of physics data processing, accessing relevant inputs and storing their outputs, in a coherent way without needing to know the details of other domains. Frameworks provide essential core services for developers and help deliver a configurable working application to the experiments' production systems. Modern HEP processing frameworks are in the process of adapting to a new computing landscape dominated by parallel processing and heterogeneity, which pose many questions regarding enhanced functionality and scaling that must be faced without compromising the maintainability of the code. In this paper we identify a program of work that can help further clarify the key concepts of frameworks for HEP and then spawn R&D activities that can focus the community's efforts in the most efficient manner to address the challenges of the upcoming experimental program.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2019

Comparing High Performance Computing Accelerator Programming Models

Accelerator devices are becoming a norm in High Performance Computing (HPC). With more systems opting for heterogeneous architectures, portable programming models like OpenMP and OpenACC are becoming increasingly important. The SPEC ACCEL 1.2 benchmark suite consists of comparable benchmarks in OpenCL, OpenMP 4.5, and OpenACC 2.5 that can be used to evaluate the performance and support for programming models and frameworks on heterogeneous platforms. In this paper we go beneath the normative metric of performance times and look at the individual kernels to study the usage, strengths, and weaknesses of the two prevalent portable heterogeneous programming models, OpenMP and OpenACC. From our analysis we identify that benchmarks like MRI-Q, SP and BT have better performance using OpenACC, while benchmarks like MiniGhost, LBM and LBDC do consistently better with the OpenMP programming model across supercomputers like Titan, and Summit.We deep dive into the kernels of select four benchmarks to answer questions like: Where does the benchmark spend most of its cycles? What is the parallelization strategy used? Why is one programming model more performant than the other? By identifying the similarities and dierences we want to contrast between the benchmark implementation strategies in the SPEC ACCEL 1.2 benchmarks and provide more insights into the OpenMP and OpenACC programming models.

Pophale, Swaroop S.↗
DOE OSTI2022

Impact of Variable Gas Mixtures on Bubble Size Distribution and Mass Transfer in Gas Fermentation Reactors

Gas fermentation has emerged as a promising new technology for the generation of fuels and chemicals from mixtures of greenhouse and energy rich gas streams (CO2/CH4/H2/CO) via microbial bioreaction. Example pathways include biomethanation (CO2/H2 to CH4), biogas upgrading, CO fermentation and wet-waste conversion. Effective Gas-liquid mass-transfer is an important physical phenomenon that determines the design and scale-up of these systems. There is currently a knowledge-gap regarding bubble-size distributions when using a mixture of gases with vastly different properties, which can have a significant impact on overall mass-transfer. For example, hydrogen bubbles are more buoyant compared to other relatively heavier gases (CO2/CH4/CO), resulting in a large distribution of residence times and bubble sizes. This work therefore develops a deeper understanding of bubble dynamics and interphase mass transfer in such heterogenous gas mixtures through well-resolved computational models. We use a detailed multiphase computational-fluid-dynamics (CFD) model to study the impact of gas-mixtures on overall mass-transfer in bubble column and air-lift reactors. The CFD tool previously developed by the authors (1) for simulating aerobic fermentation reactors at scale is used in this study. The Reynolds-averaged mass, momentum, energy, and species transport equations are solved for interpenetrating gas and liquid phase in this model. We use a population balance-based bubble-size-distribution model that is validated against small-scale experiments in our solver. Results pertaining to multiple simulations of gas-fermentation reactors are presented where gas mixtures with varying compositions of CO2/CH4/CO/H2 are imposed at the sparger boundaries. The spatio-temporal variations in bubble-size distribution and mass transfer coefficient is analyzed for varying superficial velocities and gas-compositions for varying sizes of bubble-column and airlift reactors.

BIOMASS FUELS,MATHEMATICS AND COMPUTING↗