Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “accelerated computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

ExaSGD: 2022 Kernel Thrust Activities

The Kernel Thrust milestone ADSE22-407 covers the development of device-capable optimization algorithms and solvers technologies required by the ExaSGD project’s software stack in order to solve security-constrained alternating current optimal power flow (SC-ACOPF) problems on emerging exascale architectures. To this extent, in FY22 the main objective of the Kernel Thrust was (i) provide sparse optimization solver that runs efficiently on hardware accelerator devices (i.e., NVIDIA and AMD GPUs) to perform intra-node computations, (ii) strengthen the reliability and increase the performance of the mixed-dense sparse (MDS) solver of HiOp for deployment on the FY22 target architectures, Summit and Crusher, and (iii) increase performance by improving the mathematical algorithm and refining the parallel MPI-based implementation of the coarse-grain parallel solver HiOp-PriDec for capabilities deployment on the FY22 target architectures, Summit and Crusher. This document presents the developments and contributions done by the Kernels Thrust Team in FY22 toward completion of the above-mentioned objectives. These contributions progressed along four main development (sub)thrusts: (1) Design and implementation of a sparse optimization solver for use on hardware accelerators; (2) Improvement of the mathematical algorithm and of the parallel implementation of HiOp-PriDec to ensure readiness and efficient coarse-grain parallelism for FY23 target exascale machine; and (3) Support Software and Application Development Thrusts of the exaSGD project in their deployment of the project’s software stack on AMD- and NVIDIA-based architectures. The development of the sparse optimization solver (thrust 1 above) was new in FY22 and resulted in a new sparse solver in HiOp (available as of version 0.6). The second development thrust was a continuation of the efforts from FY21 and improved the mathematical algorithm and the communication strategy of the HiOp-PriDec solver. The last developement thrust is a large collaborative effort. Namely, the project’s teams from multiple labs (LLNL, PNNL, ORNL, and NREL) performed large-scale demonstration of the ExaSGD software stack, namely the optimization solvers of HiOp interfaced with the modeling front-end ExaGO and the stochastic sampler PowerScenarios. These demonstration efforts solved large-scale instances of the SC-ACOPF challenge problem of medium network sizes (10, 000-bus system) and large number of contingencies on Summit (NVIDIA accelerators) and Crusher (AMD accelerators) systems at ORNL.

97 MATHEMATICS AND COMPUTING↗

Accelerating transients with NekRS: GPU overlapping domain implementation and multi-rate timestepping

The simulation of nuclear transients using Computational Fluid Dynamics (CFD) presents significant computational challenges due to the inherent complexity and the wide separation in temporal scales between various flow physical phenomena. These disparities lead to high computational costs, often making the simulation of transients impractical without advanced techniques. Consequently, multiple research initiatives are being pursued by the NEAMS thermal-hydraulic area, some driven by academic institutions and some by national laboratories. Overall, they are exploring novel methods to make transient simulations more feasible and efficient. This report delves into recent advancements within the CFD code NekRS, specifically those achieved in Fiscal Year 2024 under the CONNECT effort, aimed at improving the performance and feasibility of transient simulations. The first major advancement involves the porting of NekRS to Aurora, one of the Department of Energy’s (DOE) most powerful supercomputers. Additionally, the report discusses the implementation of an overlapping domain capability within NekRS. This novel GPU-accelerated capability allows different spatial regions of the domain to be solved independently, enhancing the code’s efficiency, particularly when running large-scale simulations in complex domains. The scalability of this approach is demonstrated, highlighting its potential to transform how transients are approached in CFD simulations. Lastly, the report focuses on how this overlapping domain capability specifically accelerates transient simulations through multi-rate timestepping. By decoupling different regions and facilitating faster computations, this method offers a promising pathway to making nuclear transient simulations more computationally feasible, addressing one of the critical bottlenecks in the field. Together, these advancements represent a significant leap forward in transient simulation technology, bringing closer the possibility of handling highly complex nuclear scenarios with greater efficiency and accuracy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Celeritas: Accelerating Geant4 with GPUs

Celeritas [1] is a new Monte Carlo (MC) detector simulation code designed for computationally intensive applications (specifically, High Lumi- nosity Large Hadron Collider (HL-LHC) simulation) on high-performance heterogeneous architectures. In the past two years Celeritas has advanced from prototyping a GPU-based single physics model in infinite medium to implementing a full set of electromagnetic (EM) physics processes in complex geometries. The current release of Celeritas, version 0.3, has incorporated full device-based navigation, an event loop in the presence of magnetic fields, and detector hit scoring. New functionality incorporates a scheduler to offload electromagnetic physics to the GPU within a Geant4-driven simulation, enabling integration of Celeritas into high energy physics (HEP) experimental frameworks such as CMSSW. On the Summit supercomputer, Celeritas performs EM physics between 6 and 32 faster using the machine’s Nvidia GPUs compared to using only CPUs. When running a multithreaded Geant4 ATLAS test beam application with full hadronic physics, using Celeritas to accelerate the EM physics results in an overall simulation speedup of 1.8–2.3× on GPU and 1.2× on CPU.

Johnson, Seth R.↗

Genomic materials design: CALculation of PHAse Dynamics

The CALPHAD system of fundamental phase-level databases, now known as the Materials Genome, has enabled a mature technology of computational materials design and qualification that has already met the acceleration goals of the national Materials Genome Initiative. Here, as first commercialized by QuesTek Innovations, the methodology combines efficient genomic-level parametric design of new material composition and process specifications with multidisciplinary simulation-based forecasting of manufacturing variation, integrating efficient uncertainty management. Recent projects demonstrated under the multi-institutional CHiMaD Design Center notably include novel alloys designed specifically for additive manufacturing. With the proven success of the CALPHAD-based Materials Genome technology, current university research emphasizes new methodologies for affordable accelerated expansion of more accurate CALPHAD databases. Rapid adoption of these new capabilities by US apex corporations has compressed the materials design and development cycle to under 2 years, enabling a new “materials concurrency” integrated into a new level of concurrent engineering supporting an unprecedented level of manufacturing innovation.

36 MATERIALS SCIENCE↗

Parallel sorting algorithm classification: is manual instrumentation necessary?

Understanding parallel algorithms is crucial for accelerating scientific simulations on complex, distributed memory, high-performance computers. Modern algorithm classification approaches learn semantics directly from source code to differentiate between algorithms, however, accessing source code is not always possible. We can learn about parallel algorithms from observing their performance, as programs running the same algorithms and using the same hardware should exhibit similar performance characteristics. We present an approach to learn algorithm classes from parallel performance data directly in order to classify algorithms without access to the source code. We extend previous work to enable classifying parallel sorting algorithms using automatic instrumentation instead of requiring manual region annotations in the source code. In this work, we design and demonstrate a study for classification of parallel sorting algorithms using parallel performance data collected from automatic instrumentation, and evaluate the performance of our new methodology on classification. We leverage Caliper to collect the performance data, Thicket for our exploratory data analysis (EDA), and PyTorch and Scikit-learn to evaluate the effectiveness of random forests, support vector machines (SVMs), decision trees, neural networks, and logistic regressions on parallel performance data. Additionally, we study noise in parallel performance data, whether the removal of noise and pre-processing of the data is necessary to accurately classify parallel sorting algorithms, and determine the effectiveness of features created from performance data. In conclusion, we demonstrate classification accuracy for these five different models of up to 97.7% across four different parallel algorithm classes.

Algorithm Classification↗

Semi-Automated Creation of Density Functional Tight Binding Models through Leveraging Chebyshev Polynomial-Based Force Fields

Density functional tight binding (DFTB) is an attractive method for accelerated quantum simulations of condensed matter due to its enhanced computational efficiency over standard density functional theory (DFT) approaches. However, DFTB models can be challenging to determine for individual systems of interest, especially for metallic and interfacial systems where different bonding arrangements can lead to significant changes in electronic states. In this regard, we have created a rapid-screening approach for determining systematically improvable DFTB interaction potentials that can yield transferable models for a variety of conditions. Our method leverages a recent reactive molecular dynamics force field where many-body interactions are represented by linear combinations of Chebyshev polynomials. This allows for the efficient creation of multi-center representations with relative ease, requiring only a small investment in initial DFT calculations. Here, we have focused our workflow on TiH 2 as a model system and show that a relatively small training set based on unit-cell-sized calculations yields a model accurate for both bulk and surface properties. Our approach is easy to implement and can yield reliable DFTB models over a broad range of thermodynamic conditions, where physical and chemical properties can be difficult to interrogate directly and there is historically a significant reliance on theoretical approaches for interpretation and validation of experimental results.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Boosting Photoelectric Conductivity in Porphyrin-Based MOFs Incorporating C 60

Electronic structure calculations show that guest C60 in the porphyrin-containing metal organic frameworks Zn 2 (TCPB)(DA-ZnP) (DA-MOF; H 4 TCPB = 1,2,4,5-tetrakis(4-carboxyphenyl)benzene, DA-ZnP = [5,15-bis[(4-pyridyl)ethynyl]-10,20-diphenylporphinato]zinc(II)) and Zn 2 (TCPB)(F-ZnP) (F-MOF; F-ZnP = [5,15-di(4-pyridyl)-10,20-bis(pentafluorophenyl)porphinato]zinc(II)) engenders high photoelectrical conductivity due to efficient donor–acceptor charge-transfer (CT) interactions. Structural modifications at the meso position of the porphyrin influence the preferred positions of C 60 within the frameworks, giving rise to host–guest interactions with different anisotropic structural, electronic, and optoelectronic properties. A preferred slipped-parallel π-stacked interaction of C 60 that is predicted for NH 2 -substituted DA-MOF and F-MOF fosters strong CT transitions and lowers band gaps by ~1.0 eV compared to the pristine DA-MOF and F-MOF. Hopping rates computed using Marcus theory are found to be anisotropic and accelerated by multiple orders of magnitude across π-stacked interfaces created by C 60 incorporation, a consequence of strong electronic coupling between initial and final diabatic states. Calculations indicate that photoinduced electron transfer, as well as direct CT from porphyrin to C 60 upon irradiation, triggers a charge separation process that leads to the formation of what should be long-lived electron-trapped states at the heterojunctions. Lastly, design principles revealed here for the control of photophysical and electron-transfer processes will be useful for constructing new MOF-derived visible- and infrared-based optoelectronics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Two–Dimensional Idealized Hadley Circulation Simulation for Global High Resolution Model Development

A new framework for the development of global high resolution models using a vertical- meridional, two-dimensional pole-to-pole domain is proposed. Compared with the three-dimensional global model, the two-dimensional framework can simulate cloud-scale convection at significantly reduced computational cost, data volume, and turn-around time, and accelerate the development phase. Although idealized, it allows for simulation of various clouds and scale interactions under a wide range of environmental conditions, even though zonal waves such as mid latitude storms cannot be simulated. Physics schemes can be tested and assessed over a full array of simultaneously occurring cloud regimes. The framework can serve as an intermediate step between a one-dimensional simulation and a full three-dimensional global model. Using this framework, we analyze the resolution dependencies of simulated clouds and the Hadley circulation in a range of global high resolution models by performing multiple 1000-day simulations; for some resolutions tested, for example, 2 km horizontal resolution, three-dimensional simulation is not feasible at the present time. Analysis shows that both horizontal and vertical resolution determine the properties of the Hadley circulation and clouds, and that the differences among the simulated Hadley circulations are understood as differences in scale interactions influenced by resolution.

54 ENVIRONMENTAL SCIENCES↗

Robust method for broadband efficiency enhancement of electron photocathodes using optical interferences

In this work, we demonstrate the key features of an interference cathode using both simulations and experiments. We deposit Cs 3 Sb photocathodes on Ag to produce an interference enhanced photocathode with 2–5× quantum efficiency (QE) enhancement using a robust procedure that requires only a smooth metal substrate and QE monitoring during growth. We grow both an interference cathode (Ag substrate) and a typical photocathode (Si reference substrate) simultaneously to confirm that the effects are due to optical interactions with the substrate rather than photocathode composition or surface electron affinity differences. Growing the cathodes until the QE converges shows both the characteristic interference peaks during growth and the identical limiting case where the cathode is “infinitely thick,” in agreement with simulations. We also grow a cathode until the QE on Ag peaks and then stop the growth, demonstrating broadband QE enhancement.

36 MATERIALS SCIENCE↗

Tuning microwave losses in superconducting resonators

Abstract The performance of superconducting resonators, particularly cavities for particle accelerators and micro cavities and thin film resonators for quantum computations and photon detectors, has been improved substantially by recent material treatments and technological advances. As a result, the niobium cavities have reached the quality factors Q ∼ 10 11 at 1–2 GHz and 1.5 K and the breakdown radio-frequency (rf) fields H close to the dc superheating field of the Meissner state. These advances raise the questions of whether the state-of-the-art cavities are close to the fundamental limits, what these limits actually are, and to what extent the Q and H limits can be pushed by the materials nano structuring and impurity management. These issues are also relevant for many applications using high-Q thin film resonators, including single-photon detectors and quantum circuits. This topical review outlines basic physical mechanisms of the rf nonlinear surface impedance controlled by quasiparticles, dielectric losses and trapped vortices, as well as the dynamic field limit of the Meissner state. Sections cover methods of engineering an optimum quasiparticle density of states and superfluid density to reduce rf losses and kinetic inductance by pairbreaking mechanisms related to magnetic impurities, rf currents, and proximity-coupled metallic layers at the surface. A section focuses on mechanisms of residual surface resistance, which dominates rf losses at ultra low temperatures. Microwave losses of trapped vortices and their reduction by optimizing the concentration of impurities and pinning potential are also discussed.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Fast explicit solutions for neutrino-electron scattering: Explicit asymptotic methods

Here, we present results of explicit asymptotic approximations applied to neutrino-electron scattering in a representative model of neutrino population evolution under conditions characteristic of core-collapse supernova explosions or binary neutron star mergers. It is shown that this approach provides stable solutions of these stiff systems of equations, with accuracy and time stepping comparable to that for standard implicit treatments such as backward Euler, fixed point iteration, and Anderson-accelerated fixed point iteration. Because each time step can be computed more rapidly with the explicit asymptotic approximation than with implicit methods, this suggests that algebraically stabilized explicit integration methods could be used to compute neutrino evolution coupled to hydrodynamics more efficiently in stellar explosions and mergers than the methods currently in use.

79 ASTRONOMY AND ASTROPHYSICS↗

Pretraining Billion-Scale Geospatial Foundational Models on Frontier

As AI workloads increase in scope, generalization capability becomes challenging for small task-specific models and their demand for large amounts of labeled training samples increases. On the contrary, Foundation Models (FMs) are trained with internet-scale unlabeled data via self-supervised learning and have been shown to adapt to various tasks with minimal fine-tuning. Although large FMs have demonstrated significant impact in natural language processing and computer vision, efforts toward FMs for geospatial applications have been restricted to smaller size models, as pretraining larger models requires very large computing resources equipped with state-of-the-art hardware accelerators. Current satellite constellations collect 100+TBs of data a day, resulting in images that are billions of pixels and multimodal in nature. Such geospatial data poses unique challenges opening up new opportunities to develop FMs. We investigate billion scale FMs and HPC training profiles for geospatial applications by pretraining on publicly available data. We studied from end-to-end the performance and impact in the solution by scaling the model size. Our larger 3B parameter size model achieves up to 30% improvement in top1 scene classification accuracy when comparing a 100M parameter model. Moreover, we detail performance experiments on the Frontier supercomputer, America's first exascale system, where we study different model and data parallel approaches using PyTorch's Fully Sharded Data Parallel library. Specifically, we study variants of the Vision Transformer architecture (ViT), conducting performance analysis for ViT models with size up to 15B parameters. By discussing throughput and performance bottlenecks under different parallelism configurations, we offer insights on how to leverage such leadership-class HPC resources when developing large models for geospatial imagery applications.

Tsaris, Aristeidis (aris)↗

STEPS: A Portable Numerical Simulation Toolkit for Electrical Power System Dynamic Studies

Numerical simulation is the key technique for large scale power system analysis. Redistribution of global renewable power via international interconnections requires new simulation tools to study the interconnected systems with different nominal frequencies as a whole. In this paper we introduce an open source simulation toolkit for electrical power systems (STEPS) which is hosted at Github. Its kernel is coded in C++ with major functions of power flow and electro-mechanical dynamic simulation. Flexible options are provided and configurable to improve power flow solution and dynamic simulation. Common devices and models are supported in STEPS for AC/DC hybrid system studies. Studies of interconnected systems with different nominal frequencies is supported in STEPS for research of international interconnection. Application program interfaces are provided and wrapped with Python to enable high-level interfaces for general applications. STEPS is thread safe and parallel computation is supported in both kernel and script levels to accelerate simulation. It is portable and works on Windows and GNU/Linux platforms. Cases from small to large scale systems are thoroughly tested to validate the toolkit with commercial packages as benchmarks.

42 ENGINEERING↗

Hierarchical Distributed Optimal Power Flow of HV and MV Distribution Networks With Continuous and Discrete Devices

With large-scale distributed photovoltaics (PVs) being integrated into distribution networks (DNs), coordinated optimal power flow (OPF) of high voltage (HV) and medium voltage (MV) DNs should be investigated to optimally dispatch the distributed PVs and other network devices. Here, this paper presents a hierarchical distributed OPF method for HV and MV DNs with on-load tap changers, reactive power compensators, feeder switches and distributed PVs. A hierarchical master-slave control architecture is applied to implement coordinated OPF of two-layer DNs. The HV master problem and MV subproblems are transformed into mixed-integer convex problems respectively with second order cone programming and LinDistFlow approximation. Since there is no efficient distributed algorithm to solve such OPF models with integer subproblems, a novel distributed algorithm is proposed in this paper to efficiently solve the hierarchical coordinated OPF model with integer subproblems in a distributed manner. In the proposed algorithm, the coordinated OPF model is solved in a branch-and-bound framework, where in each branch node generalized Benders decomposition (GBD) algorithm is applied to decompose the coordinated OPF model into a master problem and relaxed subproblems and solves them iteratively to get optimal solution. The GBD optimal and feasible cutting planes generated in a branch node are proved to be valid for its descendants. Moreover, three acceleration techniques are introduced into the proposed algorithm to improve computational efficiency. Finally, the effectiveness and accuracy of the proposed method are verified via simulation tests in Jinzhai DNs of China.

42 ENGINEERING↗

Effect of Engineered Cracks in Catalyst Layers on PEMFC Catalyst Layer Durability

Proton exchange membrane fuel cells (PEMFCs) are expected to play a pivotal role in decarbonizing the transportation sector, and particularly heavy-duty vehicles (HDVs). However, improvements in durability are needed for PEMFCs to compete with state-of-the-art power sources for HDVs. Here, we examine how catalyst layer (CL) cracks that are engineered affect the CL durability by using patterned silicon templates to control the CL crack density at the micrometer scale. Electrochemical analyses show that the initial PEMFC performance is relatively unaffected by crack density, but the performance after durability testing was strongly affected. Specifically, CLs with high crack density showed higher performance relative to CLs without cracks after application of a carbon corrosion accelerated stress test. Electrochemical analyses coupled with X-ray computed tomography and scanning transmission electron microscopy with energy dispersive X-ray spectroscopy showed that the cracks provide shorter oxygen diffusion pathways to reaction sites, leading to decreased oxygen transport resistance. Additionally, we observed that the catalyst durability is unaffected by cracks. Our results provide a mechanistic explanation of the role of cracks in CL durability.

30 DIRECT ENERGY CONVERSION↗

FutureTense

Protective vaccines and reliable diagnostics are essential tools for controlling viral diseases. However, the efficacy of these tools can be diminished by mutations in viral genomes. The delay between the emergence of new viral strains and the redesign of vaccines and diagnostics allows for continued viral transmission. Is it possible to address this challenge by computationally predicting viral genome sequence evolution? Can we “future-proof” vaccines and diagnostics by targeting both current and anticipated future sequence variants? While predicting viral evolution is still an unsolved, “grand challenge” problem in biology, the large, and rapidly growing, number of SARS-CoV-2 genome sequences provide an opportunity to quantify the ability of machine learning to predict viral genome sequence evolution. Towards this end, we have developed a simple computational model for predicting viral evolution at the level of individual nucleotides. The key metric for quantifying the per-base, prediction accuracy for viral evolution is the Mann-Whitney U statistic (or, equivalently, the area under the receiver operator curve). Since the Mann-Whitney U statistic is not a differentiable function, existing deep leaning packages (like Pytorch and Keras/TensorFlow) are not useful, as they require that the accuracy metric/objective function be analytically differentiable with respect to the model parameters. To overcome this challenge, we have implemented custom software, “FutureTense”, that can train a machine learning model by maximizing the non-differentiable Mann-Whitney U statistic. This software trains a machine learning model by exploring along the direction of the discrete gradient of the Mann-Whitney U statistic in the model parameter space. Parallel computing and genome sequence-specific optimizations are used to accelerate model training. The resulting machine learning model learns the observed high C->U mutation rates in the SARS-CoV-2 genome (which are potentially induced by host defenses) and provides prediction accuracies that are significantly better than one would expect from random chance. While predicting viral evolution is still quite far from a solved problem, the surprising performance of this simple model gives hope that the accuracy of predicting viral genome evolution can be further increased by more sophisticated approaches.

Gans, Jason↗

JAXtronomy: A JAX port of lenstronomy

Gravitational lensing is a phenomenon where light bends around massive objects, resulting in distorted images seen by an observer. Studying gravitationally lensed systems provides insights into cosmology and astrophysics, including constraints of the expansion rate of the Universe and the distribution of dark matter. Thus, we introduce JAXtronomy, a re-implementation of the gravitational lensing software package lenstronomy (Birrer, 2021; Birrer & Amara, 2018) using JAX (Bradbury et al., 2018). JAX is a Python library that uses an accelerated linear algebra (XLA) compiler to improve the performance of computing software. Our core design principle of JAXtronomy is to maintain an identical API to that of lenstronomy. The main JAX features utilized in JAXtronomy are just-in-time compilation, which can lead to significant reductions in execution time, and automatic differentiation, which allows for the implementation of gradient-based algorithms that were previously impossible. Additionally, JAX allows code to be run on GPUs or parallelized across CPU cores, further boosting the performance of JAXtronomy.

astronomy↗

FY2019 Energy Efficient Mobility Systems Annual Progress Report

EEMS Program activities during FY 2019 focused on analytical research to understand the impacts that new mobility technologies and services will have at the vehicle, traveler, and overall transportation system-level. This research included the development of vehicle and transportation system simulation models and tools to evaluate the complex interactions among the various actors within the mobility landscape, analysis of empirical data to characterize which solutions may provide the largest benefits, and development of new control systems and algorithms that use vehicle connectivity and automation to improve the performance and efficiency of individual vehicles as well as the overall traffic system. This document presents a brief overview of the EEMS Program and documents progress and results for projects within four of the five EEMS activity areas: (1) the SMART (Systems and Modeling for Accelerated Research in Transportation) Mobility Lab Consortium, (2) High Performance Computing and Big Data Solutions for Mobility Data, (3) Advanced R&D Projects conducted by industry and academia, and (4) Core Modeling, Simulation, and Evaluation, Similarly, the remaining EEMS activity area – (5) Living Labs (managed under VTO’s Technology Integration Program). Each of the individual progress reports provide a project overview and highlights of the technical results.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗