Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “supercomputing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Report on the LLNL Global Full-waveform Inversion Workflow and Progress

LLNL has developed the SPiRaL global seismic tomography model based upon millions of body wave travel times and surface wave dispersion curves in the period range of 25-200 seconds (Simmons et al., 2021). The motivation to construct the SPiRaL model (which stands for S-, P-, Rayleigh, and Love waves) is based upon the guidance provided by a 3-D model workshop held in Berkeley in 2007 and documented in a paper by Zucca et al. (2009). It was concluded in Zucca et al. (2009) that a “practical and obtainable” model is one that predicts body wave travel times for event location while also predicting surface wave velocities for moment tensor estimation. We have largely followed that guidance which has led to the construction of SPiRaL. Looking forward, we now seek to improve the global model through full waveform inversion (FWI). This necessitates the development/customization of an efficient and flexible modeling workflow to automate the process using LLNL’s supercomputing platforms. This report briefly outlines the work that being performed at LLNL to develop the necessary tools and framework to update the SPiRaL global model with full waveform information.

58 GEOSCIENCES↗
DOE OSTI2021

Advances in Mixed Precision Algorithms: 2021 Edition

Over the last year, the ECP xSDK-multiprecision effort has made tremendous progress in developing and deploying new mixed precision technology and customizing the algorithms for the hardware deployed in the ECP flagship supercomputers. The effort also has succeeded in creating a cross-laboratory community of scientists interested in mixed precision technology and now working together in deploying this technology for ECP applications. In this report, we highlight some of the most promising and impactful achievements of the last year. Among the highlights we present are: Mixed precision IR using a dense LU factorization and achieving a 1.8× speedup on Spock; results and strategies for mixed precision IR using a sparse LU factorization; a mixed precision eigenvalue solver; Mixed Precision GMRES-IR being deployed in Trilinos, and achieving a speedup of 1.4× over standard GMRES; compressed Basis (CB) GMRES being deployed in Ginkgo and achieving an average 1.4× speedup over standard GMRES; preparing hypre for mixed precision execution; mixed precision sparse approximate inverse preconditioners achieving an average speedup of 1.2×; and detailed description of the memory accessor separating the arithmetic precision from the memory precision, and enabling memory-bound low precision BLAS 1/2 operations to increase the accuracy by using high precision in the computations without degrading the performance. We emphasize that many of the highlights presented here have also been submitted to peer-reviewed journals or established conferences, and are under peer-review or have already been published.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Advances in Mixed Precision Algorithms: 2021 Edition

Over the last year, the ECP xSDK-multiprecision effort has made tremendous progress in developing and deploying new mixed precision technology and customizing the algorithms for the hardware deployed in the ECP flagship supercomputers. The effort also has succeeded in creating a cross-laboratory community of scientists interested in mixed precision technology and now working together in deploying this technology for ECP applications. In this report, we highlight some of the most promising and impactful achievements of the last year. Among the highlights we present are • Mixed precision IR using a dense LU factorization and achieving a 1.8× speedup on Spock; • Results and strategies for mixed precision IR using a sparse LU factorization; • A mixed precision eigenvalue solver; • Mixed Precision GMRES-IR being deployed in Trilinos, and achieving a speedup of 1.4× over standard GMRES; • Compressed Basis (CB) GMRES being deployed in Ginkgo and achieving an average 1.4× speedup over standard GMRES; • Preparing hypre for mixed precision execution; • Mixed precision sparse approximate inverse preconditioners achieving an average speedup of 1.2×; • Detailed description of the memory accessor separating the arithmetic precision from the memory precision, and enabling memory-bound low precision BLAS 1/2 operations to increase the accuracy by using high precision in the computations without degrading the performance. We emphasize that many of the highlights presented here have also been submitted to peer-reviewed journals or established conferences, and are under peer-review or have already been published.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Using Pilot Jobs and CernVM File System for Simplified Use of Containers and Software Distribution

High Energy Physics (HEP) experiments entail an abundance of computing resources, i.e. sites, to run simulations and analyses by processing data. This requirement is fulfilled by local batch farms, grid sites, private/commercial clouds, and supercomputing centers via High Throughput Computing (HTC). The growing needs of such experiments and resources being prone to trends of heterogeneity make it difficult for physicists to handle these resources directly. Additionally, HEP collaborations heavily rely on data and software releases, typically in the order of tens of gigabytes, while conducting simulations and analyses. Hence, aspects of scalability, reliability, and maintenance become crucial with regards to the distribution of the necessary data and software stack. The GlideinWMS [4] framework helps with the resource management problem by using pilot jobs, aka Glideins, to provision reliable elastic virtual clusters. Glideins are submitted to unreliable heterogeneous resources which are validated and customized by the Glideins to make the worker nodes available for end-user job execution. On the other hand, the CernVM File System (CernVM-FS or CVMFS) [1] helps with data distribution. It is a write-once, read-everywhere filesystem used to deploy scientific software to thousands of nodes on a worldwide distributed computing infrastructure. CVMFS is based on the Hyper Text Transfer Protocol and has been widely used within the particle physics community for (1) distributing experiment software and data such as calibrations, and (2) facilitating containerization by efficiently hosting container images along with providing containerization software, especially Singularity [3] GlideinWMS relies on CVMFS installed locally on the computing resources to satisfy the experiments' software needs. This requires system administrators' effort to install and maintain CVMFS at the sites and limits the use of sites, especially HPC resources, that do not have CVMFS installed. This poster presents a solution, taking advantage of Glideins to provide CVMFS at most sites without the need for a local installation. Doing so expands the pool of resources available for HEP experiments and reduces the effort of system administrators for current resources. Additionally, the proposed solution allows GlideinWMS to also start Singularity [3], a containerization software that can run unprivileged, on sites where neither CVMFS nor Singularity are available, including HPC sites. The benefits provided by this solution are: (1) lower overhead for site administrators in that they have less software to install, (2) an expanded pool of resources that run user jobs with easy access to software and data provided by CVMFS, thus making life easier for the scientists, and (3) improved flexibility to use HPC resources by enabling GlideinWMS pilot jobs to support HPC sites.

Urs, Namratha↗
DOE OSTI2021

Legacy of Metropolis continues through new materials donated to classified library collections

“From the very beginning of the Los Alamos project, it was inevitable that the Laboratory would suffer total immersion in computing,” said Nicholas Constantine Metropolis in 1976, reflecting his characteristic humor. Metropolis had succinctly summarized the prominent place of computing in Los Alamos’s mission and history. Metropolis himself played no small role in that “total immersion,” exemplified by the Lab’s supercomputing center, a postdoctoral fellowship, and the world-famous algorithm that carry his name. So does a collection of legacy materials in the National Security Research Center (NSRC). The NSRC, the Lab’s classified library, which also houses unclassified artifacts, recently received a new addition to the Metropolis Collections. This donation, 22 years after his death on October 17, 1999, provides tangible evidence of Metropolis’s continuing legacy at Los Alamos.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Distributed Training for High Resolution Images: A Domain and Spatial Decomposition Approach

In this work we developed two Pytorch libraries using the PyTorch RPC interface for distributed deep learning approaches on high resolution images. The spatial decomposition library allows for distributedtraining on very large images, which otherwise won’t be possible on a single GPU. The domain parallelism library allows for distributed training across multiple domain unlabeled data, by leveraging the domain separation architecture. Both of those libraries were tested on the Summit supercomputer at a moderate scale, and we are releasing the code for both of them.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Dipolar molecule emulator of lattice gauge theories (Final Report)

The quantum many-body problem is a great unsolved, cross-cutting challenge in physics that is of fundamental importance. Our understanding of phenomena related to dense quark matter, in particular, is challenged by this practical intractability of classical simulations. Because of the sheer cost and challenge of performing experiments that probe the length and energy scales relevant to such physics, there are practical motivations for finding theoretical methods to address the many-body problem. One promising approach is based on the use of a programmable and controllable analog quantum systems to emulate the physics of many-body problems of interest. While there are currently broad efforts to develop mid- to large-scale quantum computers, we are still likely many years away from such devices outperforming classical supercomputers for useful calculations. Even though digital quantum computers are still at a stage too premature for such tasks, approaches based on analog quantum simulators have advanced rapidly over the past two decades and can now treat many-body problems of interest on small- to medium-scale systems. Tackling the challenging many-body problems of relevance to high energy physics represents one of the great new opportunities and challenges for the field of analog quantum simulation. To address this challenge, this award brought together an interdisciplinary team of physicists with expertise in high energy theory (El-Khadra and Draper), computational and condensed matter physics (Clark), and experimental quantum and atomic, molecular, optical (AMO) science (DeMarco and Gadway), with the goal of developing realistic and optimized strategies for the analog quantum simulation of lattice gauge theories using cold atoms and molecules. This track 1 project included both theoretical and experimental goals, stated as follows. The theory goals were to "develop and verify a novel approach to quantum emulation of (1+1)d quantum link models, based on arrays of trapped quantum spins with long-range interactions." This final project report details the progress made under this award, as well as new research directions developed under this award.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

2022 Agnew and Metropolis Postdoc Fellow Showcase Event Book

Agnew National Security Postdoc Fellows pursue cutting-edge experimental, theoretical, computational science, and engineering research aligned with the national security mission. Metropolis Postdoc Fellows pursue cutting-edge research in the areas of computational and computer science, physics, and engineering. Computer simulation capabilities are developed in support of the stockpile stewardship program together with broader national nuclear security needs. Fellows have access to some of the most powerful supercomputers in the world to perform pioneering research.

42 ENGINEERING↗
DOE OSTI2021

ERAS: Enabling the Integration of Real-World Intellectual Properties (IPs) in Architectural Simulators

Sandia National Laboratories is investigating scalable architectural simulation capabilities with a focus on simulating and evaluating highly scalable supercomputers for high performance computing applications. There is a growing demand for RTL model integration to provide the capability to simulate customized node architectures and heterogeneous systems. This report describes the first steps integrating the ESSENTial Signal Simulation Enabled by Netlist Transforms (ESSENT) tool with the Structural Simulation Toolkit (SST). ESSENT can emit C++ models from models written in FIRRTL to automatically generate components. The integration workflow will automatically generate the SST component and necessary interfaces to ’plug’ the ESSENT model into the SST framework.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

High Performance Equilibrium Solvers for Integrated Magnetic Fusion Simulations

With the funding provided by this award, we developed numerical codes for the study of magnetically confined plasmas for fusion applications. Accordingly, our work can be divided into two separate categories: 1) the design and analysis of novel numerical methods providing high accuracy and high efficiency; 2) the study of the equilibrium and stability of magnetically confined plasmas with some of these numerical codes, as well as the study of the nature of the turbulent behavior which may arise in the presence of instabilities. We first developed new numerical schemes based on integral equation methods for the computation of steady-state magnetic configurations in fusion experiments, providing high accuracy for the magnetic field and its derivatives, which are required for stability and turbulence calculations. We employed different integral formulations depending on the application of interest: axisymmetric or non-axisymmetric equilibria, force-free or magnetohydrodynamic equilibria, fixed-boundary equilibria or free-boundary equilibria. While efficient, these methods do not yet apply to plasma boundaries which are not smooth, a situation which is fairly common in magnetic confinement experiments. To address this temporary weakness, we also constructed a new steady-state solver based on the Hybridizable Discontinuous Galerkin (HDG) method, which provides full geometric flexibility. In addition to these numerical tools focused on steady-states, we also contributed to the improvement of the speed and accuracy of codes simulating the plasma dynamics of fusion plasmas, by developing a novel velocity space representation for the efficient solution of kinetic equations, which most accurately describe the time evolution of hot plasmas in fusion experiments. Using the tools discussed above, we studied several questions pertaining to the equilibrium and stability of magnetically confined plasmas. In particular, we derived a new simple model for axisymmetric devices called tokamaks, to predict how elongated a fusion plasma can be before it becomes unstable and collapses. We also looked at the effect of the shape of the outer plasma surface on key properties of the steady-state magnetic configurations, and how these properties impact turbulence in fusion plasmas, and the corresponding transport of momentum. Likewise, we studied the role of large localized flows on the steady-state magnetic configurations, and how they may influence plasma stability and turbulence. Non-axisymmetric steady-state magnetic configurations are inherently more complex than axisymmetric steady-state configurations, and the subject of ongoing controversies regarding the regularity of the equations determining such steady-states, and their solutions. Implementing an existing NYU code in a new geometry, we studied the nature of the singularity of the solutions observed in the code, and methods to eliminate them. Our main conclusion is that by appropriately tailoring the plasma boundary, it is possible to eliminate the singularities otherwise appearing in our simulations, and to obtain steady-states which appear to be smooth. To gain further insights on incompletely understood turbulence phenomena, we proposed a new reduced model capturing most of these phenomena, which is simple enough to not require expensive numerical simulations on massive supercomputers to investigate them. We demonstrated the strong similarity between our simulations and published results obtained from computationally expensive simulations, and plan to rely on our reduced model to identify the key mechanisms determining the evolution and strength turbulent driven transport in fusion plasmas. Finally, we proposed a new framework for tokamak reactor design studies, enabling us to consider the relative merits of steady-state versus pulsed fusion reactors. We found that pulsed fusion reactors may benefit most from recent advances in magnet technology, and the availability of very high field magnets. As such, they may become more desirable than steady-state tokamak reactors for cost efficient electricity generation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Fusion Energy Sciences Network Requirements Review. Final Report, April - October 2021

The Energy Sciences Network (ESnet) is the high-performance network user facility for the US Department of Energy (DOE) Office of Science (SC) and delivers highly reliable data transport capabilities optimized for the requirements of data-intensive science. In essence, ESnet is the circulatory system that enables the DOE science mission by connecting all of its laboratories and facilities in the US and abroad. ESnet is funded and stewarded by the Advanced Scientific Computing Research (ASCR) program and managed and operated by the Scientific Networking Division at Lawrence Berkeley National Laboratory (LBNL). ESnet is widely regarded as a global leader in the research and education networking community. Throughout 2021, ESnet and the Office of Fusion Energy Sciences (FES) of the DOE SC organized an ESnet requirements review of FES-supported activities. Preparation for these events included identification of key stakeholders: program and facility management, research groups, and technology providers. Each stakeholder group was asked to prepare formal case study documents about their relationship to the FES program to build a complete understanding of the current, near-term, and long-term status, expectations, and processes that will support the science going forward.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Tools for Design and Scale-Up of Solar Thermochemical Reactors: Cooperative Research and Development Final Report, CRADA Number CRD-13-00530

NREL will be collaborating with the Participant on a United States - Australia Solar Energy Collaboration (USASEC) Project Number 1-USO034 "Tools for design and scale-up of solar thermochemical reactors." The grant funds for the Participant's 3.5 year project number 1-US034 commencing on 1 February 2013 have been awarded to the Participant by the Australian Renewable Energy Agency and NREL will be collaborating with the Participant during the final 28 months of this project. This project seeks to provide basic knowledge required to design solar thermochemical reactors able to perform the required energy conversions. In several proposed and demonstrated reactors, concentrated sunlight directly irradiates small solid particles suspended in fluid, enabling very high heat transfer rates to the particles which are the sites of chemical reaction. The reactors, therefore, involve the complex and couple dynamics of turbulent, chemically reacting, particle-laden flows and their interaction with concentrating solar radiation. A strong understanding of these coupled interactions will be crucial important in predicting and optimizing the performance of prototype reactors, but this understanding does not yet exist, since they have never been studied in any fundamental way. The project has a assembled an internationally leading team from The University of New South Wales (UNSW) and the University of Adelaide in Australia and the NREL in the United States to address this key gap in available know-how. The project will use U.S. Dept. of Energy (DOE) supercomputers, among the most powerful available worldwide, with cutting-edge software tools to perform first-principles simulations of the relevant interactions. These studies will be combined with detailed laser-based measurements in Australia to provide the first comprehensive databases concerning the governing phenomena in directly irradiated solar-thermochemical reactors. The outcomes will be the basic scientific knowledge, engineering knowhow and modeling tools necessary to design new reactor concepts and then scale up from the laboratory bench to practical size systems.

14 SOLAR ENERGY↗
DOE OSTI2022

The Exploitation of Data Reduction for Visualization

The disparity between the computational speed and storage bandwidth, as demonstrated in Figure 1, is a well known problem that grows with each successive generation. The visualization community is principally responding to this issue by using in situ to reduce which data must be written to storage. However, other communities are taking different, possibly complementary approaches. In particular, data compression is a common general approach to reduce storage demands. Data compression technologies are typically not designed with post processing in mind. The principal metrics measured are compression ratio, the improved bandwidth to storage, and the error introduced. It is assumed that data is inflated to its full size before any post processing can happen. Although when talking about bandwidth disparities, HPC’s dirty little secret is that no part of the memory nor interconnect hardware is increasing at the rate of computation. For example, the Summit supercomputer has a peak computation rate almost 10 times its predecessor, Titan, but only about 4 times the memory, less than twice the aggregate memory bandwidth, and almost no improvement in the interconnect bisection bandwidth. Naively inflating data for post processing does not help with limitations in the memory and interconnect systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

The Importance of Scientific Visualization on Novel Hardware

Innovation in HPC hardware and adoption of heterogeneous systems has led to a variety of unique programming models. This has led to a challenge for scientific visualization software (and indeed all HPC software) to take full advantage of recent generations of supercomputing. Edge computing, where hardware is specialized for the needs of the particular application, exacerbates the problem. VTK-m has had many successes on this front by providing device-agnostic algorithms that compare favorably to implementations written to specific devices as shown in Table 1. However, VTK-m has focused mostly on GPU and traditional CPU multicore technology. There are numerous processor technologies, both existing and potential future, that are not being addressed by current R&D efforts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

MOSCATO Development and Integration in Fiscal Year 2022

During FY21, we conducted ongoing development work for the MOSCATO (Molten Salt Chemistry and Transport) solver. The code development work primarily consisted of transitioning capabilities from the original version of the solver, which was written in OpenFOAM, into Nek5000. In doing so, a fast, highly parallelizable solver was created that is capable of complex chemistry and corrosion simulations for engineering-scale molten salt systems. The Nek5000 version of MOSCATO is now fully featured and capable of higher-fidelity simulations than were previously possible. Demonstration cases including a thermal convection loop have been simulated to test these new capabilities. We built upon the work for FY22 and improved the code from several different perspectives. First, we improved the user interface by adding a new component to the official Nek5000 input file (.par). This new part contains documents parameters like, salt properties (density, viscosity, Cp, thermal conductivity), diffusion coefficients, standard potential, etc. Second, we built a conversion script to extract salt properties from the MSTDB-TP salt database and write to MOSCATO input file. Third, we migrated the code to NekRS, which is the GPU branch of Nek5000 and suitable for next generation supercomputers. Verification and Validation (V&V) work was also continued in FY22. Two tasks were performed. The first V&V task involved the validation of the Poisson-Nernst-Planck equation solver and Butler-Volmer electrode kinetics, by comparing with numerical and experimental data about thermoelectric cells. The second task involved the comparisons to corrosion results from a thermal convection loop run during the MSRE era. Satisfactory agreement was obtained from both tasks.

Yuan, Haomin↗
DOE OSTI2022

Scalable Gaussian Processes, GPyTorch Application Benchmarking, and Targeted Adaptive Design (TAD) on ThetaGPU

We aim at showcasing the scalability of Gaussian Process (GP). The naive GP implementation scales cubically with data size, which can be prohibitive, so GP has not heretofore been considered suitable for very large-scale problem settings. We take advantage of GPyTorch, a library for scalable GPs built on top of PyTorch that incorporates GPU acceleration. With GPyTorch, one can achieve nearly linear scaling with structured kernel interpolation (SKI) and constant-time predictive covariances computation with LanczOs Variance Estimates (LOVE) while preserving accuracy. We also take advantage of the computational power of ThetaGPU, a supercomputer of Argonne Leadership Computing Facility (ALCF). In addition, we implement a scalable, GPU-ready version of Targeted Adaptive Design (TAD), a GP-based data-driven algorithm that efficiently searches the control space of an advanced manufacturing experiment for settings capable of producing a required design within a specified tolerance, despite the poorly known mapping from control settings to design. We finally show our benchmarking for GPyTorch and TAD performance on CPU vs. ThetaGPU and discuss the results and implications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Accurate and Efficient Parametric Model-Order Reduction for Turbulent Thermal Transport

This project produced new algorithms and software for low-cost exploration of turbulent thermal-fluids behavior under parametric variation by using reduced-order models (ROMs). The ROMs numerically solve the governing equations for fluid motion by using a small set of basis functions (typically, N=20-200 modes) to represent the solution. The base modes are computed as optimal combinations of solutions from expensive high-fidelity "anchor-point" solutions involving millions of unknowns, which are typically generated by solving the full Navier-Stokes equations on a supercomputer. The ROM solution is itself a combination of the base modes, where the basis coefficients are determined by evolving an NxN system of nonlinear equations. The overarching idea is to use the inexpensive ROM to predict solutions under conditions where the parameters differ from the anchor-point conditions. Several ingredients are required to make ROMs useful for thermal hydraulics analysis. These include: a stable and accurate ROM that is capable of reproducing the large-scale dynamics of turbulent flow, error indicators than can guide the choice of anchor points, and low-cost mechanisms for evaluating nonlinear terms in the reduced equations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Science & Technology Review: Climate Change Comes into Focus

At Lawrence Livermore National Laboratory, we focus on science and technology research to ensure our nation’s security. We also apply that expertise to solve other important national problems in energy, bioscience, and the environment. Science & Technology Review is published eight times a year to communicate, to a broad audience, the Laboratory’s scientific and technological accomplishments in fulfilling its primary missions. The publication’s goal is to help readers understand these accomplishments and appreciate their value to the individual citizen, the nation, and the world. The cover image shows a simulation run on the Department of Energy’s (DOE’s) state-of-the-science Energy Exascale Earth Systems Model (E3SM), which leverages DOE’s advanced supercomputers for climate and earth science research. As the article beginning on p. 4 describes, the newly released version 2 will be used to simulate aspects of Earth’s variability at weather-scale resolution and investigate decadal changes in climate that will critically impact the United States in coming years.

54 ENVIRONMENTAL SCIENCES↗