Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Supercomputer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72

FAIR principles for AI models with a practical application for accelerated high energy diffraction microscopy

Abstract A concise and measurable set of FAIR (Findable, Accessible, Interoperable and Reusable) principles for scientific data is transforming the state-of-practice for data management and stewardship, supporting and enabling discovery and innovation. Learning from this initiative, and acknowledging the impact of artificial intelligence (AI) in the practice of science and engineering, we introduce a set of practical, concise, and measurable FAIR principles for AI models. We showcase how to create and share FAIR data and AI models within a unified computational framework combining the following elements: the Advanced Photon Source at Argonne National Laboratory, the Materials Data Facility, the Data and Learning Hub for Science, and funcX, and the Argonne Leadership Computing Facility (ALCF), in particular the ThetaGPU supercomputer and the SambaNova DataScale ® system at the ALCF AI Testbed. We describe how this domain-agnostic computational framework may be harnessed to enable autonomous AI-driven discovery.

47 OTHER INSTRUMENTATION↗

SARS-CoV2 billion-compound docking

Abstract This dataset contains ligand conformations and docking scores for 1.4 billion molecules docked against 6 structural targets from SARS-CoV2, representing 5 unique proteins: MPro, NSP15, PLPro, RDRP, and the Spike protein. Docking was carried out using the AutoDock-GPU platform on the Summit supercomputer and Google Cloud. The docking procedure employed the Solis Wets search method to generate 20 independent ligand binding poses per compound. Each compound geometry was scored using the AutoDock free energy estimate, and rescored using RFScore v3 and DUD-E machine-learned rescoring models. Input protein structures are included, suitable for use by AutoDock-GPU and other docking programs. As the result of an exceptionally large docking campaign, this dataset represents a valuable resource for discovering trends across small molecule and protein binding sites, training AI models, and comparing to inhibitor compounds targeting SARS-CoV-2. The work also gives an example of how to organize and process data from ultra-large docking screens.

60 APPLIED LIFE SCIENCES↗

AI-based design of a nuclear reactor core

The authors developed an artificial intelligence (AI)-based algorithm for the design and optimization of a nuclear reactor core based on a flexible geometry and demonstrated a 3× improvement in the selected performance metric: temperature peaking factor. The rapid development of advanced, and specifically, additive manufacturing (3-D printing) and its introduction into advanced nuclear core design through the Transformational Challenge Reactor program have presented the opportunity to explore the arbitrary geometry design of nuclear-heated structures. The primary challenge is that the arbitrary geometry design space is vast and requires the computational evaluation of many candidate designs, and the multiphysics simulation of nuclear systems is very time-intensive. Therefore, the authors developed a machine learning-based multiphysics emulator and evaluated thousands of candidate geometries on Summit, Oak Ridge National Laboratory’s leadership class supercomputer. The results presented in this work demonstrate temperature distribution smoothing in a nuclear reactor core through the manipulation of the geometry, which is traditionally achieved in light water reactors through variable assembly loading in the axial direction and fuel shuffling during refueling in the radial direction. The conclusions discuss the future implications for nuclear systems design with arbitrary geometry and the potential for AI-based autonomous design algorithms.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Machine-learning-based dynamic-importance sampling for adaptive multiscale simulations

Multiscale simulations are a well-accepted way to bridge the length and time scales required for scientific studies with the solution accuracy achievable through available computational resources. Traditional approaches either solve a coarse model with selective refinement or coerce a detailed model into faster sampling, both of which have limitations. Here, we present a paradigm of adaptive, multiscale simulations that couple different scales using a dynamic-importance sampling approach. Our method uses machine learning to dynamically and exhaustively sample the phase space explored by a macro model using microscale simulations and enables an automatic feedback from the micro to the macro scale, leading to a self-healing multiscale simulation. As a result, our approach delivers macro length and time scales, but with the effective precision of the micro scale. Our approach is arbitrarily scalable as well as transferable to many different types of simulations. Overall, our method made possible a multiscale scientific campaign of unprecedented scale to understand the interactions of RAS proteins with a plasma membrane in the context of cancer research running over several days on Sierra, which is currently the second-most-powerful supercomputer in the world.

59 BASIC BIOLOGICAL SCIENCES↗

A general framework for quantifying uncertainty at scale

Abstract In many fields of science, comprehensive and realistic computational models are available nowadays. Often, the respective numerical calculations call for the use of powerful supercomputers, and therefore only a limited number of cases can be investigated explicitly. This prevents straightforward approaches to important tasks like uncertainty quantification and sensitivity analysis. This challenge can be overcome via our recently developed sensitivity-driven dimension-adaptive sparse grid interpolation strategy. The method exploits, via adaptivity, the structure of the underlying model (such as lower intrinsic dimensionality and anisotropic coupling of the uncertain inputs) to enable efficient and accurate uncertainty quantification and sensitivity analysis at scale. Here, we demonstrate the efficiency of this adaptive approach in the context of fusion research, in a realistic, computationally expensive scenario of turbulent transport in a magnetic confinement tokamak device with eight uncertain parameters, reducing the effort by at least two orders of magnitude. In addition, we show that this refinement method intrinsically provides an accurate surrogate model that is nine orders of magnitude cheaper than the high-fidelity model.

Farcaş, Ionuţ-Gabriel (ORCID:0000000238841580)↗

Modelling the local atomic structure of molybdenum in nuclear waste glasses with ab initio molecular dynamics simulations

The nature of chemical bonding of molybdenum in high level nuclear waste glasses has been elucidated by ab initio molecular dynamics simulations. Two compositions, (SiO2)57.5 – (B2O3)10 – (Na2O)15 – (CaO)15 – (MoO3)2.5 and (SiO2)57.3 – (B2O3)20 – (Na2O)6.8 – (Li2O)13.4 – (MoO3)2.5 , were considered in order to investigate the effect of ionic and covalent components on the glass structure and the formation of the crystallisation precursors (Na2MoO4 and CaMoO4). The coordination environments of Mo cations and the corresponding bond lengths calculated from our model are in excellent agreement with experimental observations. The analysis of the first coordination shell reveals two different types of molybdenum host matrix bonds in the lithium sodium borosilicate glass. Based on the structural data and the bond valence model, we demonstrate that the Mo cation can be found in a redox state and the molybdate tetrahedron can be connected with the borosilicate network in a way that inhibits the formation of crystalline molybdates. These results significantly extend our understanding of bonding in Mo-containing nuclear waste glasses and demonstrate that tailoring the glass composition to specific heavy metal constituents can facilitate incorporation of heavy metals at high concentrations. K.K. was supported through the Impact Studentship scheme at UCL co-funded by the IHI Corporation and UCL. P.V.S. thanks the Royal Society, which supported preliminary work on this project, and the Laboratory Directed Research and Development program at PNNL, a multiprogram national laboratory operated by Battelle for the U.S. Department of Energy. Via our membership of the UK's HEC Materials Chemistry Consortium, which is funded by EPSRC (EP/L000202), this work used the ARCHER UK National Supercomputing Service (http://www.archer.ac.uk).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluation of Attractive Interactions in the Second Coordination Sphere of Iron Complexes Containing Pendant Amines

The interactions between pendant amines in the second coordination sphere and ligands in the first coordination sphere are important for understanding the structures and reactivity of complexes containing PR2NR'2 ligands, which have been shown to be highly active H2 oxidation/production catalysts. A series of [Fe(PPh2NBn2)2(X)(Y)]n+ complexes have been prepared and structurally characterized. These complexes have two different ligands with which the pendant amines of the diphosphine ligand can interact. The solid state structure of cis-Fe(PPh2NBn2)2Cl2 reveals that the six-membered rings adjacent to the P atoms are in a boat confirmation, resulting in close N•••P distances that suggests the P atoms have a greater affinity for the lone pair of electrons on the N atom than chloride ligands. Similarly, boat conformations are observed for both rings adjacent to the hydride ligands of trans-[HFe(PPh2NBn2)2(CH3CN)]+ and trans-HFe(PPh2NBn2)2Cl, resulting in short N•••H distances. Spectroscopic and computational studies of trans-[HFe(PPh2NBn2)2(CO)]+, trans-[HFe(PPh2NBn2)(PPh2NBn2H)(CO)]2+, and trans-[HFe(PPh2NBn2)2(H2)]+ indicate the complexes are more stable when the pendant amines in boat conformations are adjacent to the hydride ligand. These data suggest an attractor ordering of H- > CO > H2 > PR3 > Cl- ~ CH3CN. This work was supported by the Center for Molecular Electrocatalysis, an Energy Frontier Research Center funded by the U.S. Department of Energy, Office of Science, Office of Basic Energy Sciences. Pacific Northwest National Laboratory (PNNL) is operated by Battelle for the U.S. DOE. Computations were performed using the Cascade supercomputer at the Environmental Molecular Sciences Laboratory, a National Scientific User Facility sponsored by the DOE’s Office of Biological and Environmental Research and located at PNNL.

Liao, Qian↗

Nuclear Fission: from more phenomenology and adjusted parameters to more fundamental theory and increased predictive power

Two major recent developments in theory and computational resources created the favorable conditions for achieving a microscopic description of fission dynamics in classically allowed regions of the collective potential energy surface, almost eighty years after its discovery in 1939 by Hahn and Strassmann [1]. The first major development was in theory, the extension of the Time-Dependent Density Functional Theory (TDDFT) [2–5] to superfluid fermion systems [6]. The second development was in computing, the emergence of powerful enough supercomputers capable of solving the complex systems of equations describing the time evolution in three dimensions without any restrictions of hundreds of strongly interacting nucleons. Thus the conditions have been created to renounce phenomenological models and incomplete microscopic treatments with uncontrollable approximations and/or assumptions in the description of the complex dynamics of fission. Even though the available nuclear energy density functionals (NEDFs) are phenomenological still, their accuracy is improving steadily and the prospects of being able to perform calculations of the nuclear fission dynamics and to predict many properties of the fission fragments, otherwise not possible to extract from experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Implementation of Feldman-Cousins Corrections and Oscillation Calculations in the HPC Environment for the NOvA Experiment

Analysis of neutrino oscillation data involves a combination of complex fitting procedures and statistical correction techniques that are used to determine the full three-flavor PMNS parameters and constraint contours. These techniques rely on computationally intensive “multi-universe” stochastic modeling. The process of calculating these contours and corrections can dominate final stages of the data analysis and become a bottleneck for examining the ef-fect of systematic variations on the final results. As part of the DOE SciDAC-4 sponsored research program, we present a new implementation of a neutrino oscillation fitting and framework to carry out calculations of Feldman-Cousins corrections. This implementation is specifically designed and optimized to operate on modern High-Performance Computing (HPC) facilities. We present the performance of the system in calculating allowed regions for the NOvA experiment based on 8.9 x 1020 and 6.9 x 1020 protons-on-target (POT) neutrino and antineutrino datasets, and compare the performance of this new implementation run at the NERSC supercomputing facility with that from methods used previously by the NOvA collaboration running on grid computing facilities.

Sousa, Alexandre↗

Bringing heterogeneity to the CMS software framework

The advent of computing resources with co-processors, for example Graphics Processing Units (GPU) or Field-Programmable Gate Arrays (FPGA), for use cases like the CMS High-Level Trigger (HLT) or data processing at leadership-class supercomputers imposes challenges for the current data processing frameworks. These challenges include developing a model for algorithms to offload their computations on the co-processors as well as keeping the traditional CPU busy doing other work. The CMS data processing framework, CMSSW, implements multithreading using the Intel Threading Building Blocks (TBB) library, that utilizes tasks as concurrent units of work. In this paper we will discuss a generic mechanism to interact effectively with non-CPU resources that has been implemented in CMSSW. In addition, configuring such a heterogeneous system is challenging. In CMSSW an application is configured with a configuration file written in the Python language. The algorithm types are part of the configuration. The challenge therefore is to unify the CPU and co-processor settings while allowing their implementations to be separate. We will explain how we solved these challenges while minimizing the necessary changes to the CMSSW framework. We will also discuss on a concrete example how algorithms would offload work to NVIDIA GPUs using directly the CUDA API.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A fully unprivileged CernVM-FS

The CernVM File System provides the software and container distribution backbone for most High Energy and Nuclear Physics experiments. It is implemented as a file system in user-space (Fuse) module, which permits its execution without any elevated privileges. Yet, mounting the file system in the first place is handled by a privileged suid helper program that is installed by the Fuse package on most systems. The privileged nature of the mount system call is a serious hindrance to running CernVM-FS on opportunistic resource and supercomputers. Fortunately, recent developments in the Linux kernel and in the Fuse user-space libraries enabled fully unprivileged mounting for Fuse file systems (as of RHEL 8), or at least outsourcing the privileged mount system call to a custom, external process. This opens the door to several, very appealing new ways to use CernVM-FS, such as a generally usable “super pilot” consisting of the pilot code bundled with Singularity and CernVM-FS, or the on-demand instantiation of unprivileged, ephemeral containers to publish new CernVM-FS content from anywhere. In this contribution, we discuss the integration of these new Linux features with CernVM-FS and show some of its most promising, new applications.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The ATLAS Workflow Management System Evolution in the LHC Run3 and towards the High-Luminosity LHC era

The ATLAS experiment has 18+ years of experience using workload management systems to deploy and develop workflows to process and to simulate data on the distributed computing infrastructure. Simulation, processing and analysis of LHC experiment data require the coordinated work of heterogeneous computing resources. In particular, the ATLAS experiment utilizes the resources of 250 computing centers worldwide, the power of supercomputing centres, and national, academic and commercial cloud computing resources. In this contribution, we present new techniques for cost-effectively improving efficiency introduced in workflow management system software. The evolution from a mesh framework to new types of computing facilities such as cloud and HPCs is described, as well as new types of production and analysis workflows.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

HEPCloud Operations at Fermilab—The First Five Years

The HEPCloud Facility at Fermilab has now been in production operation for five years. This facility is a unified provisioning gateway to US high performance computing centers, including NERSC, OLCF, and ALCF, other large supercomputers run by the NSF, and commercial clouds. HEPCloud delivers hundreds of millions of core-hours yearly for CMS. HEPCloud also serves other Fermilab experiments including DUNE, Mu2e, Muon g-2, and NOvA. In this paper we present the practical considerations of operating a distributed facility such as HEPCloud. We also mention some of the interesting research and development that HEPCloud has been used for including GPU-based machine learning inference servers, and tests of Quantum Computing.

Timm, Steven [Fermilab]↗

Towards district scale flood simulations using conventional and anisotropic porosity shallow water models with high-resolution topographic information

Current topographic survey technology provides high-resolution (HR) datasets for urban environments. Incorporating this HR information in models aiming to provide flood risk assessment is desirable because the flood wave propagation is depending on the urban topographic features, i.e. buildings, bridges and street networks. Conceptual, numerical and practical challenges arise from the application of shallow water models to HR urban flood modeling. For example, numerical challenges are occurrence of wet-dry fronts, geometric discontinuities in the urban environment and discontinuous solutions, i.e. shock waves. These challenges can be overcome by using a Godunov-type scheme. However, the computational cost of this type of schemes is high, such that HR two-dimensional shallow water simulations with practical relevance have to be run on supercomputers. The porous shallow water model is an alternative approach that aims to reduce computational cost by using a coarse resolution and accounting for unresolved processes by means of the porosity terms. Usually, a speedup between two and three orders of magnitude in comparison to HR simulations can be obtained. This study presents preliminary results of a practical test case concerning pluvial flooding in a district of the city of Nice, France, caused by the intense rainfall event on October 3rd, 2015. HR topography data set on a 1 m resolution is available for the district, whereby street features of infra-metric dimensions have been included. A reference solution is calculated by a HR shallow water model on a 1 m by 1 m structured computational grid. The porous shallow water model is run on a 10 m by 10 m grid and the influence of the drag source term is studied. The model calculations show a large deviation, which is caused by the poor meshing strategy of the porous shallow water (AP) model. The study also summarizes practical challenges that arise during the application of the AP and HR models to a large urban catchment. The main difficulty is to obtain a good mesh. In smaller scale investigations, the mesh is currently constructed by hand such that the cell edges align with buildings. This approach is not feasible for large scale urban catchments with a large number of buildings. Future steps that have to be taken, such as a strategy for automatic mesh generation, are reported on.

42 ENGINEERING↗

How large can the electron to proton mass ratio be in particle-in-cell simulations of unstable systems?

Particle-in-cell simulations are widely used as a tool to investigate instabilities that develop between a collisionless plasma and beams of charged particles. However, even on contemporary supercomputers, it is not always possible to resolve the ion dynamics in more than one spatial dimension with such simulations. The ion mass is thus reduced below 1836 electron masses, which can affect the plasma dynamics during the initial exponential growth phase of the instability and during the subsequent nonlinear saturation. The goal of this article is to assess how far the electron to ion mass ratio can be increased, without changing qualitatively the physics. It is first demonstrated that there can be no exact similarity law, which balances a change in the mass ratio with that of another plasma parameter, leaving the physics unchanged. Restricting then the analysis to the linear phase, a criterion allowing to define a maximum ratio is explicated in terms of the hierarchy of the linear unstable modes. The criterion is applied to the case of a relativistic electron beam crossing an unmagnetized electron-ion plasma.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Modeling laser wakefield accelerator experiments with ultrafast particle-in-cell simulations in boosted frames

The development of new laser systems at the 10 Petawatt range will push laser wakefield accelerators to novel regimes, for which theoretical scalings predict the possibility to accelerate electron bunches up to tens of GeVs in meter-scale plasmas. Numerical simulations will play a crucial role in testing, probing, and optimizing the physical parameters and the setup of future experiments. Fully kinetic simulations are computationally very demanding, pushing the limits of today's supercomputers. In this paper, the recent developments in the OSIRIS framework [R. A. Fonseca et al., Lect. Notes Comput. Sci. 2331, 342 (2002)] are described, in particular the boosted frame scheme, which leads to a dramatic change in the computational resources required to model laser wakefield accelerators. Results from one-to-one modeling of the next generation of laser systems are discussed, including the confirmation of electron bunch acceleration to the energy frontier.

43 PARTICLE ACCELERATORS↗

Atomic-Orbital Close-Coupling Calculations Of Electron Capture From Hydrogen Atoms Into Highly Excited Rydberg States Of Multiply Charged Ions

Collisions of neutral hydrogen atoms with multiply charged ions have been studied in the past using the semi-classical atomic-orbital close-coupling method. We present total and state-resolved cross sections for charge exchange as well as ionization. The advent of supercomputers and parallel programming facilities now allow treatment of collision systems that have been out of reach before, because much larger basis sets involving high quantum numbers are now feasible.

74 ATOMIC AND MOLECULAR PHYSICS↗

Spacecraft charging analysis with the implicit particle-in-cell code iPic3D

We present the first results on the analysis of spacecraft charging with the implicit particle-in-cell code iPic3D, designed for running on massively parallel supercomputers. The numerical algorithm is presented, highlighting the implementation of the electrostatic solver and the immersed boundary algorithm; the latter which creates the possibility to handle complex spacecraft geometries. As a first step in the verification process, a comparison is made between the floating potential obtained with iPic3D and with Orbital Motion Limited theory for a spherical particle in a uniform stationary plasma. Second, the numerical model is verified for a CubeSat benchmark by comparing simulation results with those of PTetra for space environment conditions with increasing levels of complexity. In particular, we consider spacecraft charging from plasma particle collection, photoelectron and secondary electron emission. The influence of a background magnetic field on the floating potential profile near the spacecraft is also considered. Although the numerical approaches in iPic3D and PTetra are rather different, good agreement is found between the two models, raising the level of confidence in both codes to predict and evaluate the complex plasma environment around spacecraft.

42 ENGINEERING↗