Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “AMD”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Parallelization of a Proxy Transport App Using ComputeCPP and SYCL

This document details the attempts to parallelize a multi-group Monte Carlo proxy app using SYCL and the ComputeCPP Community Edition compiler. SYCL is a standard set by the Khronos Group and is described as a, “cross-platform abstraction layer that builds on the underlying concepts, portability and efficiency of OpenCL that enables code for heterogeneous processors to be written in a “single-source” style using completely standard C++.” ComputeCpp Community Edition (CE) is a heterogeneous parallel programming platform that provides a conformant implementation of the SYCL™ 1.2.1 Khronos specification. ComputeCPP provides a compiler and an SDK containing a build system to improve the usability of the compiler. The supported OpenCL 1.2 platforms for ComputeCpp are AMD® and Intel®, with experimental support for PTX which is used on Nvidia graphics cards as well as experimental support for ARM chips. All testing reported in this document was done on the Darwin computer cluster using an Nvidia GTX Titan X graphics card. Since ComputeCPP does not support using this card with OpenCL, ComputeCPP’s experimental PTX64 bit-code generation was used to generate device code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Recovery of Rare Earth Elements from Coal Mining Waste Materials

The objective of this proposed project was to locate coal overburden material that had rare earth elements (REEs) at concentrations of 300 ppm or higher. After securing the feedstock the next goal was to efficiently extract and purify the feedstocks to a purity of greater than 95%. A techno economic analysis was conducted to determine the economic viability of mining and processing REEs associated with Appalachian coal deposits. All aspects of mining, mineral processing, by-product potential, waste management, permitting and economics were examined. Attention was paid to the separation, degree of purification and marketing of Rare Earth elements. Along with REEs we evaluated the economics of the recovery of other metals of interest aong with the REEs. Our site location chosen was at the Jeddo Coal Site near Hazleton, Pennsylvania. The primary site was at the Upper Leigh High Mine. However, that changed to the North Eckley Mine site. We have analyzed a third site that will now be our second alternative to North Eckley. That site is the Highland mine site. This site is in a similar basin as the North Eckley site. During this project we evaluated various acids and extraction conditions. We have settled on using HCl as the acid of choice. One of the advantages of using HCl is it allows for easy removal of the highest contaminating metal, iron. When iron reacts with HCl in the presence of high chlorides it creates the anion complex FeCl 4 -1 . This FeCl 4 -1 complex will bind with an anion exchange resin. Greater than 99.8% of the iron is removed with this technique. Once the FeCl 4 -1 complex is bound to the anion exchange resin it can be released easily by just passing water over it. This water dilutes the FeCl 4 -1 to form FeCl 3 which is not anionic and therefore not attracted to the anion exchange resin. The FeCl 3 solution is a popular water flocculating agent used all over the world for water purification. We plan on this being one of our products produced. One of our goals was to create a multipurpose facility that was capable of handling multiple feedstocks. The proposed multipurpose facility will be able process all coal biproducts and coal products. These include 1.) clays that can easily be leached with ion exchange or acid 2.) Hard mineral deposits that can be leached with high pressure acid digestion 3.) Fly ash can be leached in the high-pressure acid digestion reactor. Fly ash is not a focus of this proposal but, the beneficial aspect of its utilization in this design cannot be overlooked. 4.) Acid Mine Drainage (AMD) Sludge is a high source of REE’s and can easily be dissolved to form a pregnant leach solution. Not shown on this simplified block flow diagram but crucial to its success is the recycle of acids. Our REE separation system is a continuous ion exchange process. The first stage is the separation of the non-REEs from the REEs. This is accomplished because the REEs are relatively larger than most of the non-REEs and typically have higher oxidation states (+3) than the non-REEs. In this step all the elements stick onto the column. However, as the columns are rinsed with various concentrations of acids different elements come off. For example, monovalent elements such as sodium and potassium elute off the column with a 1M HCl solution. Divalent elements such as calcium and magnesium do not elute until a 2M HCl solution is passed over the columns. The trivalent elements (REEs) are not eluted until a much higher concentrated acid is passed of the columns. Iron is also a trivalent, but it was removed in a prior anion exchange system. Aluminum is trivalent too, but it is much smaller than the REE atoms and elutes near the end of the 2 M HCl with the divalents. At the stage 2 and 3 our volume and masses have become too small to run on the continuous system. Therefore, we used a batch chromatography column or a flash chromatography column. The stage 2 process separates these REEs into 3 different fractions. A light, mid and heavy fraction. We calculated that we recovered greater than 90% of the REEs. This third column was packed with a different stationary phase. Five elements were chosen and purified to higher than 95% purity as shown by our internal testing. These elements were shipped to the DOE.

01 COAL, LIGNITE, AND PEAT↗

An Initial Investigation of the Design Challenges Associated with Reliable 100GigE Packet Capture

Network security researchers often rely on Emulytics TM to provide a way to evaluate the safety and security of real world systems. This work involves running a large number of virtual machines on a distributed platform to observe how software and hardware will respond to different types of attacks. While Emulytics TM software such as minimega provide a scalable system for conducting experiments, the sheer volume of network traffic produced in an experiment can easily exceed the rate at which data can be recorded for offline analysis. As such, researchers must perform live analytics, narrow their monitoring scope or accept that they must run an experiment multiple times to capture all the information they require. In support of Sandia's commitment to Emulytics TM , we are developing new storage components for the Carlin cluster that will enable researchers to capture significantly more network traffic from their experiments. This report provides a summary of Haoda Wang's initial investigation of how new AMD Epyc storage nodes can be adapted to perform packet capture at 100Gbps speeds with minimal loss. This work found that the NVMe storage capabilities of the Epyc architecture are suitable for capturing 100Gbps Ethernet traffic. While capturing traffic with existing libraries was surprisingly challenging, we were able to develop a DPDK-based software tool that recorded network traffic to disk with minimal packet loss.

97 MATHEMATICS AND COMPUTING↗

Milestone 1241

Harden and optimize the ROCm based AMD GPU backend, develop a prototype backend for the Intel ECP Path Forward architecture, and improve the existing prototype Remote Memory Space capabilities.

97 MATHEMATICS AND COMPUTING↗

Milestone 1261

Supporting the latest hardware and compiler versions is important to leverage improvements in the software environment and new HPC platforms. We will provide certified support for the latest releases of vendor compilers from Intel, AMD, IBM, NVIDIA, ARM and Cray as well as of open source compilers GCC and Clang.

97 MATHEMATICS AND COMPUTING↗

Recovery of Rare Earth Elements (REEs) from Coal Mine Drainage, Phase 2

Phase 1 research identified a two-step refining train, acid leaching of AMD precipitate feed followed by solvent extraction (SX), to produce a 2% TREE product. For the Phase 2 bench scale system, the objective was to get the acid leaching step to operate in batch-mode with sufficient storage capacity to feed an aqueous, enriched REE liquor to a pilot SX plant operating in continuous-mode at a feed rate capable of producing 3 g/hr 2% TREE. Important process variables included feed rate, extractant makeup, flowsheet configuration, and stripping conditions. Operating parameters were optimized through a feedback-capable SCADA system configured for the SX bench scale plant. These conditions were met and exceeded. TREE grades approaching 90% were produced while our Techno-Economic Assessment indicated highly favorable economic returns. The project led to the design of a pilot facility for producing roughly 500 kg/TREE/year. That plant is now in the procurement stage with constructed expected to begin in late 2020.

01 COAL, LIGNITE, AND PEAT↗

Recovery of Rare Earth Elements (REEs) from Coal Mine Drainage, Phase 2

Phase 1 research identified a two-step refining train, acid leaching of AMD precipitate feed followed by solvent extraction (SX), to produce a 2% TREE product. For the Phase 2 bench scale system, the objective was to get the acid leaching step to operate in batch-mode with sufficient storage capacity to feed an aqueous, enriched REE liquor to a pilot SX plant operating in continuous-mode at a feed rate capable of producing 3 g/hr 2% TREE. Important process variables included feed rate, extractant makeup, flowsheet configuration, and stripping conditions. Operating parameters were optimized through a feedback-capable SCADA system configured for the SX bench scale plant. These conditions were met and exceeded. TREE grades approaching 90% were produced while our Techno-Economic Assessment indicated highly favorable economic returns. The project led to the design of a pilot facility for producing roughly 500 kg/TREE/year. That plant is now in the procurement stage with constructed expected to begin in late 2020.

01 COAL, LIGNITE, AND PEAT↗

How To Maintain Effective IAEA Safeguards While Reducing Facility Impact

For almost twenty years, inspectors from the International Atomic Energy Agency have been visiting the K-Area Material Storage facility at the Savannah River Site where excess plutonium has been placed under IAEA safeguards as part of the United States Volunatary Offer Agreement. During that time, the mission of K-Area Complex has expanded from storage of nuclear matieral to glovebox operations in support of the National Nuclear Security Administration’s Plutonium Disposition program. With this change in mission, it is becoming increasingly challenging to manage facility staff radiation exposure and operating activities during the IAEA’s annual Physcial Inventory Verifications (PIV). This study has identified both near-term and long-term recommendations for IAEA monitoring protocols that would allow the IAEA to maintain effective safeguards of the material while decreasing the impact to the facility. A statisitical analysis has shown that reducing the number of containers measured during an annual PIV from 12 to 4 still ensures a high level of confidence in the confidence while reducing the inspector time in the facility amd with a corresponding significant reduction in personnel radiation exposure. A modified installation pattern of Remotely Monitored Sealing Arrays (RMSAs) is also proposed utilizing only the outer rows of arrays of stored material containers in the Stack Area (SA). The modified RMSA placement will provide equivalent protection, while significantly reducing personnel radiological exposure, manpower requirements and associated costs. With advances in technology, there are additional potential options in containment/surveillance and continuity of knowledge that would allow the agency to be outside of the facility during PIV measurements and have confidence in the accuracy and authencitity of the results.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Performance Assessment of AFQMC Implementation (ECP Milestone 5.2 Report)

The auxiliary field quantum Monte Carlo algorithm in QMCPACK was ported to run on AMD GPUs using HIP. Initial performance measurements on early access hardware indicate a 4x slowdown compared to NVIDIA V100s. The slowdown was determined to be a result of suboptimal ROCM libraries for small matrix sizes coupled with some poorly performing hipified CUDA kernels. Through a preliminary analysis of HIP kernel performance we determined a strategy for pro ling and tuning kernels. We request that ROCM libraries are optimized for smaller problem sizes particularly for batched operations.

97 MATHEMATICS AND COMPUTING↗

Performance Analysis of Scientific Computing Workloads on Trusted Execution Environments

Scientific computing sometimes involves computation on sensitive data. Depending on the data and the execution environment, the HPC (high-performance computing) user or data provider may require confidentiality and/or integrity guarantees. To study the applicability of hardware-based trusted execution environments (TEEs) to enable secure scientific computing, we deeply analyze the performance impact of AMD SEV and Intel SGX for diverse HPC benchmarks including traditional scientific computing, machine learning, graph analytics, and emerging scientific computing workloads. We observe three main findings: 1) SEV requires careful memory placement on large scale NUMA machines (1x -3.4x slowdown without and 1x -1.15x slowdown with NUMA aware placement), 2) virtualization - a prerequisite for SEV - results in performance degradation for workloads with irregular memory accesses and large working sets (1x -4x slowdown compared to native execution for graph applications) and 3) SGX is inappropriate for HPC given its limited secure memory size and inflexible programming model (1.2x -126x slowdown over unsecure execution). Finally, we discuss forthcoming new TEE designs and their potential impact on scientific computing.

97 MATHEMATICS AND COMPUTING↗

Port and optimize the CEED software stack to Aurora/Frontier EA (ECP Milestone Report)

The goal of this milestone was to port the CEED software stack, including Nek, MFEM and libCEED to the Frontier and Aurora early access hardware, work on optimizing the performance on AMD and Intel GPUs, and demonstrate impact in CEED-enabled ECP applications. As part of this milestone, we also performed a number of other activities, including continued optimizations for CEED applications at scale on Summit, performance evaluation on non-ECP hardware, including the Fugaku’s A64FX chip and the NVIDIA A100 GPU architecture, exploring the use of just-in-time compilations in applications at scale and potential of mixed precision optimizations in the CEED discretization and solver algorithms, and more. During the milestone period, the CEED team released new versions of 6 of its packages, including major releases of MFEM, NekRS and OCCA. We also organized the fifth CEED Annual meeting (CEED5AM) which included nearly 100 researchers from national labs, universities and industry.

97 MATHEMATICS AND COMPUTING↗

Milestone M7 Report: Reducing Excess Data Movement Part 2

This milestone evaluates techniques to measure and, if possible, reduce data movement across all levels of the memory hierarchy, focusing on CPU/GPU page level data movement and on intra-GPU memory hierarchy. We quantitatively evaluate the efficacy of the techniques in reducing data movement and measure how performance tracks data movement reduction. We study a small collection of benchmarks and proxy mini-apps that run on advanced pre-exascale GPUs and on the Accelsim GPU simulator. Our approach has two thrusts: to measure advanced data movement reduction directives and techniques on the newest available GPUs, and to evaluate our benchmark set on simulated GPUs configured with architectural refinements to reduce data movement. We primarily evaluated NVidia-based architectures due to the unavailability of AMD GPU hardware and tools until very recently.

97 MATHEMATICS AND COMPUTING↗

ExaSGD: 2021 Kernel Thrust Activities

The Kernel Thrust milestone ADSE22-214 covers the development of device-capable optimization algorithms and solvers technologies required by the ExaSGD project’s software stack in order to solve security-constrained alternating current optimal power flow (SC-ACOPF) problems on emerging exascale architectures. To this extent, in FY21 the main objective of the Kernel Thrust was (i) provide robust optimization solver(s) that run efficiently on hardware accelerator devices (i.e., NVIDIA and AMD GPUs) to perform intra-node computations and (ii) provide coarse-grain parallel optimization capabilities that exploit the decomposition opportunities present in the SC-ACOPF challenge problems to provide exascale-capable solvers.

97 MATHEMATICS AND COMPUTING↗

Unified Memory: GPGPU-Sim/UVM Smart Integration

CPU/GPU heterogeneous compute platforms are an ubiquitous element in computing and a programming model specified for this heterogeneous computing model is important for both performance and programmability. A programming model that exposes the shared, unified, address space between the heterogeneous units is a necessary step in this direction as it removes the burden of explicit data movement from the programmer while maintaining performance. GPU vendors, such as AMD and NVIDIA, have released software-managed runtimes that can provide programmers the illusion of unified CPU and GPU memory by automatically migrating data in and out of the GPU memory. However, this runtime support is not included in GPGPU-Sim, a commonly used framework that models the features of a modern graphics processor that are relevant to non-graphics applications. UVM Smart was developed, which extended GPGPU-Sim 3.x to in- corporate the modeling of on-demand pageing and data migration through the runtime. This report discusses the integration of UVM Smart and GPGPU-Sim 4.0 and the modifications to improve simulation performance and accuracy.

97 MATHEMATICS AND COMPUTING↗

ECP Milestone Report: Identify initial kernels, bake-off problems (benchmarks) and miniapps (CEED-MS6)

The CEED co-design center is developing a number of kernels, bake-off / benchmark problems (BPs) and mini-applications (miniapps) that capture the unique requirements of high-order finite element algorithms and use them to influence standards, best practices and vendors to generate more portable, better performing code across diverse hardware designs. This is a main activity in CEED’s Hardware, Applications and Finite Element thrusts. CEED’s miniapps, a.k.a. CEEDlings, are small, standalone applications - surrogates for sub-components of interest from the selected first wave of applications (the MARBL/LLNLApp and ExaSMR projects). The BPs are even smaller standalone programs that solve a simple physical problem, including discretization, linear and/or nonlinear solve, and potentially a relatively small number of time steps. A BP may be a proxy/surrogate for part of a miniapp or another problem of general interest. In CEED, both miniapps and BPs will be used extensively in the project to evaluate and compare the performance of algorithms in specific contexts. The parts of the miniapps and BPs that play an important role in their overall performance will be identified and separated as standalone kernels. These kernels and their interaction inside BPs, miniapps and the actual applications, will be the main focus of our optimization efforts. All three standalone pieces of software (miniapps, BPs, and kernels) will serve as a basis for engaging and collaborating with hardware vendors and software technologies (ST) projects. These partners can start at the bottom of the hierarchy, e.g. with the kernels, and easily transition to BPs and miniapps as all three families will be produced in the same CEED environment. In this milestone we identified the initial kernels, bake-off problems and miniapps and delivered software and documentation for them through the new CEED website, http://ceed.exascaleproject.org. We specifically identified the Nekbone miniapp for the ExaSMR application and developed a new miniapp, Laghos, for the MARBL/LLNLApp application. We also formulated four initial benchmark problems (BP1- BP4) with clearly defined performance metrics and performed an initial bake-off comparison between the Nek5000 (spectral element) and MFEM (high-order finite element) technologies. As part of the milestone, we also engaged vendors (AMD) and ST projects (MPICH, STRUMPACK). In this document we are reporting some details and results from these R&D activities, as well as additional project-wide activities performed in Q3 of FY17, including: making CEED software available on GitHub, developing the project website, and the preparation of CEED’s first annual meeting.

97 MATHEMATICS AND COMPUTING↗

Performance tuning of CEED software and 1st and 2nd wave apps

The goal of this milestone was the performance tuning of the CEED software, as well as the use and tuning of CEED to accelerate the first and second wave of targeted ECP applications. In this milestone, the CEED team developed optimization techniques and tuned for performance the CEED software to accelerate the first and second wave target ECP applications. Specifically, the focus was on the following: (1) Efficient use of the memory sub-system for managing data motion and interactions among different physics packages and libraries; this included integration of the new developments in a libCEED 0.5 software release; (2) Enhancing the CEED libraries with GPU and AMD GPU support in close interaction with vendors; (3) Optimal data locality and motion, and enhanced scalability and parallelism; this included vendors interactions for improvements in data motion and making strong scaling easier and more efficient; and (4) Continue boosting performance for the first-wave and second-wave of ECP target applications, including ExaSMR, ExaWind, Urban, MARBL, E3SM, and ExaAM. A main part of this milestone was the performance tuning of the CEED first-wave and second-wave ECP applications. This included the ExaSMR application – Coupled Monte Carlo Neutronics and Fluid Flow Simulation of Small Modular Reactors (ORNL), the MARBL application – Next-Gen Multi-physics Simulation Code (LLNL), and the ExaAM ExaConstit – a miniapp for the Transforming Additive Manufacturing through Exascale Simulation applications project (ExaAM), as well as ExaWind, Urban, and E3SM. The artifacts delivered include performance improvements in CEED’s 1st and 2nd wave of applications, and tuned CEED software for various architectures through a number of backends, freely available in the CEED’s repository on GitHub. See the CEED website, http://ceed.exascaleproject.org and the CEED GitHub organization, http://github.com/ceed for more details. In addition to details and results from the above R&D efforts, in this document we are also reporting on other project-wide activities performed in Q4 of FY19 including: CEED’s third annual meeting, MFEM GPU kernels scaling improvements, libCEED 0.5 and NekRS releases, an overview paper covering latest results on a set of bake-off high-order finite element problems (BPs), and other outreach efforts.

97 MATHEMATICS AND COMPUTING↗

High-order algorithmic developments and optimizations for large-scale GPU-accelerated simulations (Milestone CEED-MS36)

The goal of this milestone was to improve the high-order software ecosystem for CEED-enabled ECP applications by making progress on efficient matrix-free kernels targeting forthcoming ECP architectures. These kernels included matrix-free preconditioning and the development of new set of CEED solver bake-off problems. As part of this milestone, we also released the next version of the CEED software stack, CEED-4.0, reported on results from several application collaborations, and documented the efforts of porting to AMD GPUs for Frontier and other modern architectures, such as Fugaku. The specific tasks addressed in this milestone were: (1) Port and run CEED benchmarks/miniapps on Frontier EA systems; (2) Demonstrate performant libCEED integration in MFEM, Nek and applications; (3) Matrix-free preconditioning of high-order operators; (4) Benchmark problems for fast high-order solvers on GPU platforms; and (5) Public release of CEED-4.0. The artifacts delivered include the next version of the CEED software stack, CEED-4.0, the next libCEED release, libCEED-0.8, and a number of developments integrated within applications to improve their GPU and CPU performance and capabilities. See the CEED website, https://ceed.exascaleproject.org and the CEED GitHub organization, https://github.com/ceed for more details.

97 MATHEMATICS AND COMPUTING↗

FY20 Proxy App Suite Release: Report for ECP Proxy App Project Milestone ADCD-504-10

Version 4.0 of the ECP Proxy App Suite is practically unchanged from the previous release. The current set of proxies has proven useful for many aspects of benchmarking and co-design and we see little reason to alter the suite. Although there have been few changes to the ECP suite, the team has been hard at work in other areas. In the area of Machine Learning (ML) we have now created a separate proxy suite dedicated to this scientific applications of ML. The suite includes: miniGAN (Generative Adversarial Networks), miniRL (Reinforcement Learning), CRADL (inline inference), Cosmoflow-Benchmark (Convolutional Neural Network), and MLPerf-DeepCam (Climate Segmentation Benchmark). Section 3 contains more information about these proxies as well as the principles that are guiding the development of the suite. We have surveyed available proxies for several application domains including Computational Fluid Dynamics, Quantum Chemistry, Quantum Computing Simulation, Molecular Dynamics, Monte Carlo Transport, and Density Functional Theory to identify gaps in proxy coverage. Several new proxy apps are either already available or will be released soon to fill these gaps. Section 4 provides full details. Finally, section 5 reports on our continued collaboration with the ECP Continuous Integration (CI) effort to use proxy apps to help identify problems and roadblocks to cross-lab CI. We have also assisted the El Capitan Center of Excellence (COE) to stand up a CI system that will be used to test releases of HPE and AMD software stacks. We hope that the COE effort can serve as a model for ECP by showing how the Proxy App Team can work with AD and ST teams identify critical features, kernels, patterns, etc. and incorporate them into a CI system that will help ensure that Frontier and Aurora will provide those needed capabilities.

97 MATHEMATICS AND COMPUTING↗