Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Computation of stationary 3D halo currents in fusion devices with accuracy control

This paper addresses the calculation of the resistive distribution of halo currents in three-dimensional structures of large magnetic confinement fusion machines. A Neumann electrokinetic problem is solved on a geometry so complicated that complementarity is used to monitor the discretization error. An irrotational electric field is obtained by a geometric formulation based on the electric scalar potential, whereas three geometric formulations are compared to obtain a solenoidal current density: a formulation based on the electric vector potential and two geometric formulations inspired from mixed and mixed-hybrid Finite Elements. The electric vector potential formulation is usually considered impractical since an enormous computing power is wasted by the topological pre-processing it requires. To solve this challenging problem, we present novel algorithms based on lazy cohomology generators that enable to save orders of magnitude computational time with respect to all other state-of-the-art solutions proposed in literature. Believing that our results are useful in other fields of scientific computing, the proposed algorithm is presented as a detailed pseudocode in such a way that it can be easily implemented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

PFLOTRAN User Manual: A Massively Parallel Reactive Flow and Transport Model for Describing Surface and Subsurface Processes

PFLOTRAN solves a system of generally nonlinear partial differential equations describing multi-phase, multicomponent and multiscale reactive flow and transport in porous materials. The code is designed to run on massively parallel computing architectures as well as workstations and laptops (e.g. Hammond et al., 2011). Parallelization is achieved through domain decomposition using the PETSc (Portable Extensible Toolkit for Scientific Computation) libraries for the parallelization framework (Balay et al., 1997). PFLOTRAN has been developed from the ground up for parallel scalability and has been run on up to 218 processor cores with problem sizes up to 2 billion degrees of freedom. Written in object oriented Fortran 90, the code requires the latest compilers compatible with Fortran 2003. At the time of this writing this requires gcc 4.7.x, Intel 12.1.x and PGC compilers. As a requirement of running problems with a large number of degrees of freedom, PFLOTRAN allows reading input data that is too large to fit into memory allotted to a single processor core. The current limitation to the problem size PFLOTRAN can handle is the limitation of the HDF5 file format used for parallel IO to 32 bit integers. Noting that 2 32 = 4; 294; 967; 296, this gives an estimate of the maximum problem size that can be currently run with PFLOTRAN. Hopefully this limitation will be remedied in the near future.

58 GEOSCIENCES↗

2015 HPC Annual Report

Center 9300 is very proud to provide a wide range of computing and networking resources ranging from desktop support to high performance computing that enable Sandia’s national security mission needs. Our goal is to provide these services in the most efficient, secure, user friendly, and agile means necessary. High performance computing is one example of how we are delivering on this goal. Thanks to investments from NNSA’s Advanced Simulation and Computing program, coupled with Sandia’s Institutional Computing program, a wide variety of computing resources are available and used to support national security needs. This year we are expanding our high performance computing infrastructure with the procurement of institutional resources for information computing or analytics. Big data analytics has been the buzzword in the computing industry for over a decade now and industries in finance, food and drug, business, and security organizations have been leading the charge. Much like how scientific computing has changed the way science and engineering are performed, data analytics is changing just about every aspect of our lives and more especially our ability to contribute to the national security mission of Sandia. This third edition of our HPC Annual Report continues our commitment to communicate the details and impact of Sandia’s large-scale computing resources that support missions work across Sandia. The Laboratories’ and NNSA’s strategic investments in high performance computing demonstrate our commitment to keeping mission-related research on the cutting edge of science, at pace with technology advances, and at a scale that meets the toughest demands of the nation we so proudly serve.

97 MATHEMATICS AND COMPUTING↗

2016 High Performance Computing Annual Report

Sandia National Laboratories’ California site is celebrating its 60th anniversary (1956 to 2016), and high performance computing has been a key enabler for its scientists and engineers throughout much of its history. Since its founding, Sandia California has helped pioneer the use of HPC platforms including hosting Sandia’s first Cray-1 supercomputer in the 1970s and supporting development of scalable cluster computing platforms to create a new paradigm for cost-effective supercomputing in the 1990s. Recent decades of investment in creation of scalable application frameworks for scientific computing have also enabled new generations of modeling and simulation codes. These resources have facilitated computational analysis of complex phenomena in diverse applications spanning national defense, energy, and homeland security. Today, Sandia California researchers work with partners in academia, industry, and national labs to evolve the state-of-the-art in HPC, modeling, and data analysis (including foundational capabilities for exascale computing platforms) and apply them in transformational ways. Research efforts include mitigating the effects of silent hardware failures that can jeopardize the results of large-scale computations, developing exascale-capable asynchronous task-parallel programming models and runtime systems, formulating new techniques to better explore and analyze extreme-scale data sets, and increasing our understanding of materials and chemical sciences which has applications spanning nuclear weapons stockpile stewardship to more efficient automobile engines. The following section highlights some of these research and applications projects and further illustrates the breadth of our HPC capabilities.

97 MATHEMATICS AND COMPUTING↗

Hands-on Performance Tuning of 3D Finite Difference Earthquake Simulation on GPU Fermi Chipset

3D simulation of earthquake ground motion is one of the most challenging computational problems in science. The emergence of graphic processing units (GPU) as an effective alternative to traditional general purpose processors has become increasingly capable in terms of accelerating scientific computing research. In this paper, we describe our experiences in porting AWP-ODC, a 3D finite difference seismic wave propagation code, to the latest GPU Fermi chipset. We completely rewrote this Fortran-based 13-point asymmetric stencil computation code in C and MPI-CUDA in order to take advantage of the powerful GPU computing capabilities. Our new CUDA code implemented the asymmetric 3D stencil on Fermi to make the best use of GPU on-chip memory for an aggressive parallel efficiency. Benchmark on NVIDIA Tesla M2090 demonstrated 10x speedup versus the original fully optimized AWP-ODC FORTRAN MPI code running on a single Intel Nehalem 2.4 GHz CPU socket (4 cores/CPU), and 15x speedup versus the same MPI code running on a single AMD Istanbul 2.6 GHz CPU socket (6 cores/CPU). Sustained single-GPU performance of 143.8 GFLOPS in single precision is benchmarked for the testing case of 128x128x960 mesh size.

3D Stencil Computation↗

Bio-Inspired Molecular Catalysts for Hydrogen Oxidation and Hydrogen Production

Recent advances in Ni-based bio-inspired catalysts obtained in the Center for Molecular Electrocatalysis, an Energy Frontier Research Center (EFRC) at the Pacific Northwest National Laboratory, demonstrated the possibility of cleaving H2 or generating H2 heterolytically with turnover frequencies comparable or superior to those of hydrogenase enzymes. In these catalysts the transformation between H2 and protons proceeds via an interplay between proton, hydride and electron transfer steps and involves the interaction of a dihydrogen molecule with both a Ni(II) center and with pendant amine bases incorporated in a six-membered ring, which act as proton relays. These catalytic platforms are well designed in that when protons are correctly positioned (endo) toward the Raugei-ACS-Books.docxPrinted 12/18/12 2 metal center, catalysis proceeds at very high rates. We will show that the proton removal (for H2 oxidation) and proton delivery (for H2 production) are often the rate determining steps. Furthermore, the presence of multiple protonation sites gives rise to reaction intermediates with protons not correctly positioned (exo relative to the metal center). These isomers are easily accessible kinetically and are detrimental to catalysis because of the slow isomerization processes necessary to convert them to the catalytically competent endo isomers. In this chapter we will review the major findings of our computational investigation on the role of proton relays for H2 chemistry and provide guidelines for the design of new catalysts. This research was carried out in the Center for Molecular Electrocatalysis, an Energy Frontier Research Center funded by the U.S. Department of Energy, Office of Science. Pacific Northwest National Laboratory is operated for the U.S. Department of Energy by Battelle. Computational resources were provided at W. R. Wiley Environmental Molecular Science Laboratory (EMSL), a Raugei-Bio-Inspired Molecular-Catalysts-for-Hydrogen- Oxidation-and-Hydrogen-Production.doc Printed 12/18/2012 23 national scientific user facility sponsored by the Department of Energy’s Office of Biological and Environmental Research located at Pacific Northwest National Laboratory, the National Energy Research Scientific Computing Center (NERSC) at Lawrence Berkeley National Laboratory, and the Jaguar supercomputer at Oak Ridge National Laboratory (INCITE 2008-2011 award supported by the Office of Science of the U.S. DOE under Contract No. DE-AC0500OR22725).

Environmental Molecular Sciences Laboratory↗

Edge at the Pier: EPCAPE Software-Defined Sensing Field Campaign Report

The Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE) was aimed to enhance the understanding of cloud and aerosol properties in the region surrounding La Jolla, California. To address challenges in data collection and processing from various instruments, an edge computing device known as Waggle Sage Node (WSN) was deployed at the Ellen Browning Scripps Memorial Pier. WSN is a distributed-sensing platform designed to collect and analyze environmental data at the edge. Sage is a multi-agency-supported project that designs and builds a new kind of national-scale reusable cyberinfrastructure to enable artificial intelligence (AI) at the edge based on the Waggle platform. Sponsors include the U.S. Department of Energy (DOE) Advanced Scientific Computing Research (ASCR), DOE National Nuclear Security Administration (NNSA), DOE Biological and Environmental Research (BER) through DOE Artificial Intelligence for Earth System Predictability (AI4ESP), Argonne Laboratory-Directed Research and Development (LDRD). Sage (https://sagecontinuum.org/) is funded as a National Science Foundation Mid-Scale Research Infrastructure (MSRI) project (https://www.nsf.gov/awardsearch/showAward?AWD_ID=1935984). This robust, multi-architecture edge computing platform facilitated environmental monitoring during the campaign. This report details the scientific objectives, deployment process, and key results of integrating Waggle into the EPCAPE field campaign.

54 ENVIRONMENTAL SCIENCES↗

Snowmass Letter of Interest - Cloud Computing - CompF4

The world currently spends more than $30B per quarter on the consumption of Cloud Computing services. This is 17 times the size of the entire FY20 budget for the Office of Science at the Department of Energy. These resources have been successfully used for scientific computing in HEP and elsewhere under a pay-as-you-go model where users are billed monthly based on the resources they have consumed. There are a wide range of Cloud services, but we categorize them into “capability” and “capacity”. Capability services represent a unique set of features that we have not provisioned on-premises for a variety of reasons (cost-effectiveness, power consumption, proprietary solutions, etc.) Capacity services are services that allow us to scale out commodity services; historically we have focused on high-throughput (batch) computing.

97 MATHEMATICS AND COMPUTING↗

The Water Table Model (WTM) (v2.0.1): coupled groundwater and dynamic lake modelling

Abstract. Ice-free land comprises 26 % of the Earth's surface and holds liquid water that delineates ecosystems, affects global geochemical cycling, and modulates sea levels. However, we currently lack the capacity to simulate and predict these terrestrial water changes across the full range of relevant spatial (watershed to global) and temporal (monthly to millennial) scales. To address this knowledge gap, we present the Water Table Model (WTM), which integrates coupled components to compute dynamic lake and groundwater levels. The groundwater component solves the 2D horizontal groundwater flow equation using non-linear equation solvers from the C++ PETSc (Portable, Extensible Toolkit for Scientific Computation) library. The dynamic lake component makes use of the Fill–Spill–Merge (FSM) algorithm to move surface water into lakes, where it may evaporate or affect groundwater flow. In a proof-of-concept application, we demonstrate the continental-scale capabilities of the WTM by simulating the steady-state climate-driven water table for the present day and the Last Glacial Maximum (LGM; 21 000 calendar years before present) across the North American continent. During the LGM, North America stored an additional 14.98 cm of sea-level equivalent (SLE) in lakes and groundwater compared to the climate-driven present-day scenario. We compare the present-day result to other simulations and real-world data. Open-source code for the WTM is available on GitHub and Zenodo.

Callaghan, Kerry L. (ORCID:0000000226740838)↗

Applying Quantum Computing to Simulate Power System Dynamics

Power system dynamics are generally modeled by high dimensional nonlinear differential-algebraic equations due to a large number of generators, loads, and transmission lines. Thus, its computational complexity grows exponentially with the system size. This paper demonstrates the potential use of quantum computing algorithms to model the power system dynamics. Leveraging a symbolic programming framework, we equivalently convert the power system dynamics’ differential algebraic equations (DAEs) into ordinary differential equations (ODEs), where the data of the state vector can be encoded into quantum computers via amplitude encoding. The system's nonlinearity is captured by Taylor polynomial expansion, the quantum state tensor, and Hamiltonian simulation, whereas state variables can be updated by a quantum linear equation solver. Our results show that quantum computing can simulate the dynamics of the power system with high accuracy, whereas its complexity is polynomial in the logarithm of the system dimension. Our work also illustrates the use of scientific machine learning tools for implementing scientific computing concepts, e.g., Taylor expansion, DAEs/ODEs transform, and quantum computing solver, in the field of power engineering.

Tran, Huynh↗

The TOP500 List and Progress in High-Performance Computing

The TOP500 list has enjoyed incredible success as a metric for supercomputing performance and as a source of data for identifying technological trends, for more than two decades. Here, the project's editors reflect on its usefulness and limitations for guiding large-scale scientific computing into the exascale era.

97 MATHEMATICS AND COMPUTING↗

Relating Gyrokinetic Electron Turbulence to Plasma Confinement in the National Spherical Torus Experiment

Unraveling the relationship between plasma turbulence and transport is an important step in the development of magnetic fusion energy. In a magnetic fusion experiment, naturally occurring gradients in temperature and density profiles drive plasma turbulence. This turbulence can effectively transport heat and particles throughout the machine, thereby modifying the plasma's profiles. The result is a feedback system, with turbulence driving transport and transport altering the turbulent drive. Understanding this system is as important to development of fusion energy as it is challenging. The relationship between gyrokinetic electron temperature gradient (ETG) driven turbulence and thermal confinement is particularly poorly understood. Empirical evidence suggests that ETG turbulence can not only exist in the National Spherical Torus Experiment (NSTX) but that it can also sometimes drive enough thermal transport to limit machine performance. Electron-scale (high-k) density fluctuations increase when the ETG mode is predicted to be active. Reversing the device's magnetic shear not only suppresses these fluctuations, but also triggers high electron confinement modes in NSTX known as electron internal transport barriers (e-ITBs). Controlling ETG turbulence with magnetic shear significantly enhances plasma confinement. This dissertation supplements these experimental observations with numerical simulations. Applying the nonlinear gyrokinetic code GYRO to NSTX confirms the possibility of strong ETG-driven turbulent transport within the experiment. The associated thermal flux can indeed be high, accounting for at least one half of the inferred experimental level; however, the link between highk fluctuations and ETG turbulence is less firm. Additionally, the first nonlinear simulations of an NSTX e-ITB confirm that magnetic shear suppresses ETG turbulence and establishes transport barriers. While ETG turbulence can be strong in NSTX, its detrimental effects can be controlled with magnetic shear. How turbulence governs the performance of fusion experiments cannot be determined without an understanding of plasma transport. To that end, this work develops new algorithms for solving the steady-state plasma transport problem, integrating them into and testing them with the TGYRO code. An application of the new algorithms to a proposed ETG experiment on NSTX shows that adding impurities to radio-frequency heated plasmas can reduce turbulent transport and improve plasma performance. This work is supported by the Princeton Plasma Physics Laboratory, which is operated by Princeton University for the U.S. Department of Energy under Contract No. DE-AC02-09CH11466, and the SciDAC Center for the Study of Plasma Microturbulence, and used the computational resources of both the Oak Ridge Leadership Computing Facility, located in the National Center for Computational Sciences at Oak Ridge National Laboratory, which is supported by the Office of Science of the Department of Energy under Contract No. DE-AC05-00OR22725, and the National Energy Research Scientific Computing Center, which is supported by the Office of Science under Contract No. DE-AC02-05CH11231.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Verification and Validation of Open-Source Computational Fluid Dynamics Capabilities in MOOSE

The Multiphysics Object Oriented Simulation Environment (MOOSE) advances predictive modeling in nuclear research by simplifying the application design process and making modeling more efficient and accessible to researchers and the broader community. Because of MOOSE’s critical role in the scientific computation field, verification and validation are important to evaluate the reliability and credibility of MOOSE’s code, simulations, and models. To assess MOOSE’s Navier Stokes module and turbulence models, the following verification and validation University of Manchester ERCOFTAC cases were simulated in MOOSE, and the results were compared: Case 032 Turbulent Flow in a 2D Channel Case 079 Natural Convection in an Enclosed Cavity

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Enabling Exascale Hardware and Software Design through Scalable System Virtualization (Final Report)

The purpose of this project has been to extend the state of the art of systems software for high-end computing (HEC) platforms, and to use systems software to better enable the evaluation of potential future HEC platforms, for example exascale platforms. Such platforms, and their systems software, have the goal of providing scientific computation at new scales, thus enabling new research in the physical sciences and engineering. Over time, the innovations in systems software for such platforms also become applicable to more widely used computing clusters, data centers, and clouds. This was a five-institution project, centered on the Palacios virtual machine monitor (VMM) systems software, a project begun at Northwestern, and originally developed in a previous collaboration between Northwestern University and the University of New Mexico. In this project, Northwestern (including via our subcontract to the University of Pittsburgh) contributed to the continued development of Palacios, along with other team members. We took the leadership role in (1) continued extension of support for emerging Intel and AMD hardware, (2) integration and performance enhancement of overlay networking, (3) connectivity with architectural simulation, (4) binary translation, and (5) support for modern Non-Uniform Memory Access (NUMA) hosts and guests. We also took a supporting role in support for specialized hardware for I/O virtualization, profiling, configurability, and integration with configuration tools. The efforts we led (1-5) were largely successful and executed as expected, with code and papers resulting from them. The project demonstrated the feasibility of a virtualization layer for HEC computing, similar to such layers for cloud or datacenter computing. For effort (3), although a prototype connecting Palacios with the GEM5 architectural simulator was demonstrated, our conclusion was that such a platform was less useful for design space exploration than anticipated due to inherent complexity of the connection between the instruction set architecture level and the microarchitectural level. For effort (4), we found that a code injection approach proved to be more fruitful. The results of our efforts are publicly available in the open source Palacios codebase and published papers, all of which are available from the project web site, v3vee.org. Palacios is currently one of the two codebases (the other being Sandia’s Kitten lightweight kernel) that underlies the node operating system for the DOE Hobbes Project, one of two projects tasked with building a systems software prototype for the national exascale computing effort.

97 MATHEMATICS AND COMPUTING↗

The HEPCloud Facility: elastic computing for High Energy Physics – The NOvA Use Case

The need for computing in the HEP community follows cycles of peaks and valleys mainly driven by conference dates, accelerator shutdown, holiday schedules, and other factors. Because of this, the classical method of provisioning these resources at providing facilities has drawbacks such as potential overprovisioning. As the appetite for computing increases, however, so does the need to maximize cost efficiency by developing a model for dynamically provisioning resources only when needed. To address this issue, the HEPCloud project was launched by the Fermilab Scientific Computing Division in June 2015. Its goal is to develop a facility that provides a common interface to a variety of resources, including local clusters, grids, high performance computers, and community and commercial Clouds. Initially targeted experiments include CMS and NOvA, as well as other Fermilab stakeholders. In its first phase, the project has demonstrated the use of the “elastic” provisioning model offered by commercial clouds, such as Amazon Web Services. In this model, resources are rented and provisioned automatically over the Internet upon request. In January 2016, the project demonstrated the ability to increase the total amount of global CMS resources by 58,000 cores from 150,000 cores - a 25 percent increase - in preparation for the Recontres de Moriond. In March 2016, the NOvA experiment has also demonstrated resource burst capabilities with an additional 7,300 cores, achieving a scale almost four times as large as the local allocated resources and utilizing the local AWS s3 storage to optimize data handling operations and costs. NOvA was using the same familiar services used for local computations, such as data handling and job submission, in preparation for the Neutrino 2016 conference. In both cases, the cost was contained by the use of the Amazon Spot Instance Market and the Decision Engine, a HEPCloud component that aims at minimizing cost and job interruption. This paper describes the Fermilab HEPCloud Facility and the challenges overcome for the CMS and NOvA communities.

Fuess, S.↗

Kernel fusion in atomistic spin dynamics simulations on Nvidia GPUs using tensor core

In atomistic spin dynamics simulations, the time cost of constructing the space- and time-displaced pair correlation function in real space increases quadratically as the number of spins N, leading to significant computational effort. The GEMM subroutine can be adopted to accelerate the calculation of the dynamical spin-spin correlation function, but the computational cost of simulating large spin systems (>40000 spins) on CPUs remains expensive. In this work, we perform the simulation on the graphics processing unit (GPU), a hardware solution widely used as an accelerator for scientific computing and deep learning. Here we show that GPUs can accelerate the simulation up to 25-fold compared to multi-core CPUs when using the GEMM subroutine on both. To hide memory latency, we fuse the element-wise operation into the GEMM kernel using CUTLASS that can improve the performance by 26% ~ 33% compared to implementation based on cuBLAS. Furthermore, we perform the on-the-fly calculation in the epilogue of the GEMM subroutine to avoid saving intermediate results on global memory, which makes the large-scale atomistic spin dynamics simulation feasible and affordable.

97 MATHEMATICS AND COMPUTING↗

The 70th Anniversary of the MANIAC at Los Alamos

March 2022 is the 70th anniversary of the MANIAC, the first fully electronic computer at Los Alamos. The MANIAC was constructed when electronic computing and its associated industry were still in their infancy. Early computer centers like Los Alamos had to build their own systems and invent the methods for using them. This pioneering effort gave Los Alamos and the few places like it an outsized influence on the emerging electronic computing field, shaping the computing technologies and methods we experience today. This report highlights the history of the MANIAC and "recalls the hard work and ingenuity of the people at Los Alamos who helped to invent the modern field of scientific computing, using vacuum tubes and paper tape to build the Lab’s continuing computing legacy."

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Engineering Computational Practices (Rev. 1)

This manual will attempt to motivate the use of an automated build system for the purposes of computational science and engineering. As part of this motivation, the surrounding computational practices of version control, documen tation, compute environment management, and regression testing will also be addressed as applied to the practice of computational engineering. Specifically, this manual intends to motivate the adoption of these traditional software engineering practices for use in research and production engineering simulation projects. This manual is not the first such effort in the greater scientific computing community. In fact, the authors relied heavily on the lesson plans of the Software Carpentry, established to teach computing skills to researchers in 1998. As the intention for this manual is to lay out fundamental practices of engineering computing, it will not attempt to fully teach the underlying concepts and will instead reference the well designed lesson plans of the Software Carpentry. Where possible, this manual will explain to general computing practices and concepts and limit discussion of specific software implementations to examples or vehicles for practice in concrete application. The specific software taught by the Software Carpentry curriculum is an excellent starting point to learn the core concepts of computational engi neering. However, the authors have found that applications to engineering simulation and analysis require translation of these software development concepts into the language and workflows of computational engineers. Adopting these computational tools may require engineers to re-imagine their workflows in some combination of traditional engineer ing and software concepts. It has also been necessary to extend existing software build systems for engineering practices beyond the simple wrap ping of engineering software execution. Where necessary, examples of specific software and their method of extension to engineering simulations will be given, with reference to the User Manual for recommended practical use. Where this manual relies on specific implementation examples, it should be understood that the practicing engineer may find that different software is more amenable to their specific work. It is always the overall collection of computational practices is more important than any specific software implementation. The ability to recognize which concepts are implemented by a software package will make a practicing engineer agile to changing project needs, computing resources, numeric solvers, programming languages, and even available funding.

42 ENGINEERING↗