Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “supercomputers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

AI-based design of a nuclear reactor core

The authors developed an artificial intelligence (AI)-based algorithm for the design and optimization of a nuclear reactor core based on a flexible geometry and demonstrated a 3× improvement in the selected performance metric: temperature peaking factor. The rapid development of advanced, and specifically, additive manufacturing (3-D printing) and its introduction into advanced nuclear core design through the Transformational Challenge Reactor program have presented the opportunity to explore the arbitrary geometry design of nuclear-heated structures. The primary challenge is that the arbitrary geometry design space is vast and requires the computational evaluation of many candidate designs, and the multiphysics simulation of nuclear systems is very time-intensive. Therefore, the authors developed a machine learning-based multiphysics emulator and evaluated thousands of candidate geometries on Summit, Oak Ridge National Laboratory’s leadership class supercomputer. The results presented in this work demonstrate temperature distribution smoothing in a nuclear reactor core through the manipulation of the geometry, which is traditionally achieved in light water reactors through variable assembly loading in the axial direction and fuel shuffling during refueling in the radial direction. The conclusions discuss the future implications for nuclear systems design with arbitrary geometry and the potential for AI-based autonomous design algorithms.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Machine-learning-based dynamic-importance sampling for adaptive multiscale simulations

Multiscale simulations are a well-accepted way to bridge the length and time scales required for scientific studies with the solution accuracy achievable through available computational resources. Traditional approaches either solve a coarse model with selective refinement or coerce a detailed model into faster sampling, both of which have limitations. Here, we present a paradigm of adaptive, multiscale simulations that couple different scales using a dynamic-importance sampling approach. Our method uses machine learning to dynamically and exhaustively sample the phase space explored by a macro model using microscale simulations and enables an automatic feedback from the micro to the macro scale, leading to a self-healing multiscale simulation. As a result, our approach delivers macro length and time scales, but with the effective precision of the micro scale. Our approach is arbitrarily scalable as well as transferable to many different types of simulations. Overall, our method made possible a multiscale scientific campaign of unprecedented scale to understand the interactions of RAS proteins with a plasma membrane in the context of cancer research running over several days on Sierra, which is currently the second-most-powerful supercomputer in the world.

59 BASIC BIOLOGICAL SCIENCES↗

A general framework for quantifying uncertainty at scale

Abstract In many fields of science, comprehensive and realistic computational models are available nowadays. Often, the respective numerical calculations call for the use of powerful supercomputers, and therefore only a limited number of cases can be investigated explicitly. This prevents straightforward approaches to important tasks like uncertainty quantification and sensitivity analysis. This challenge can be overcome via our recently developed sensitivity-driven dimension-adaptive sparse grid interpolation strategy. The method exploits, via adaptivity, the structure of the underlying model (such as lower intrinsic dimensionality and anisotropic coupling of the uncertain inputs) to enable efficient and accurate uncertainty quantification and sensitivity analysis at scale. Here, we demonstrate the efficiency of this adaptive approach in the context of fusion research, in a realistic, computationally expensive scenario of turbulent transport in a magnetic confinement tokamak device with eight uncertain parameters, reducing the effort by at least two orders of magnitude. In addition, we show that this refinement method intrinsically provides an accurate surrogate model that is nine orders of magnitude cheaper than the high-fidelity model.

Farcaş, Ionuţ-Gabriel (ORCID:0000000238841580)↗

Modelling the local atomic structure of molybdenum in nuclear waste glasses with ab initio molecular dynamics simulations

The nature of chemical bonding of molybdenum in high level nuclear waste glasses has been elucidated by ab initio molecular dynamics simulations. Two compositions, (SiO2)57.5 – (B2O3)10 – (Na2O)15 – (CaO)15 – (MoO3)2.5 and (SiO2)57.3 – (B2O3)20 – (Na2O)6.8 – (Li2O)13.4 – (MoO3)2.5 , were considered in order to investigate the effect of ionic and covalent components on the glass structure and the formation of the crystallisation precursors (Na2MoO4 and CaMoO4). The coordination environments of Mo cations and the corresponding bond lengths calculated from our model are in excellent agreement with experimental observations. The analysis of the first coordination shell reveals two different types of molybdenum host matrix bonds in the lithium sodium borosilicate glass. Based on the structural data and the bond valence model, we demonstrate that the Mo cation can be found in a redox state and the molybdate tetrahedron can be connected with the borosilicate network in a way that inhibits the formation of crystalline molybdates. These results significantly extend our understanding of bonding in Mo-containing nuclear waste glasses and demonstrate that tailoring the glass composition to specific heavy metal constituents can facilitate incorporation of heavy metals at high concentrations. K.K. was supported through the Impact Studentship scheme at UCL co-funded by the IHI Corporation and UCL. P.V.S. thanks the Royal Society, which supported preliminary work on this project, and the Laboratory Directed Research and Development program at PNNL, a multiprogram national laboratory operated by Battelle for the U.S. Department of Energy. Via our membership of the UK's HEC Materials Chemistry Consortium, which is funded by EPSRC (EP/L000202), this work used the ARCHER UK National Supercomputing Service (http://www.archer.ac.uk).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluation of Attractive Interactions in the Second Coordination Sphere of Iron Complexes Containing Pendant Amines

The interactions between pendant amines in the second coordination sphere and ligands in the first coordination sphere are important for understanding the structures and reactivity of complexes containing PR2NR'2 ligands, which have been shown to be highly active H2 oxidation/production catalysts. A series of [Fe(PPh2NBn2)2(X)(Y)]n+ complexes have been prepared and structurally characterized. These complexes have two different ligands with which the pendant amines of the diphosphine ligand can interact. The solid state structure of cis-Fe(PPh2NBn2)2Cl2 reveals that the six-membered rings adjacent to the P atoms are in a boat confirmation, resulting in close N•••P distances that suggests the P atoms have a greater affinity for the lone pair of electrons on the N atom than chloride ligands. Similarly, boat conformations are observed for both rings adjacent to the hydride ligands of trans-[HFe(PPh2NBn2)2(CH3CN)]+ and trans-HFe(PPh2NBn2)2Cl, resulting in short N•••H distances. Spectroscopic and computational studies of trans-[HFe(PPh2NBn2)2(CO)]+, trans-[HFe(PPh2NBn2)(PPh2NBn2H)(CO)]2+, and trans-[HFe(PPh2NBn2)2(H2)]+ indicate the complexes are more stable when the pendant amines in boat conformations are adjacent to the hydride ligand. These data suggest an attractor ordering of H- > CO > H2 > PR3 > Cl- ~ CH3CN. This work was supported by the Center for Molecular Electrocatalysis, an Energy Frontier Research Center funded by the U.S. Department of Energy, Office of Science, Office of Basic Energy Sciences. Pacific Northwest National Laboratory (PNNL) is operated by Battelle for the U.S. DOE. Computations were performed using the Cascade supercomputer at the Environmental Molecular Sciences Laboratory, a National Scientific User Facility sponsored by the DOE’s Office of Biological and Environmental Research and located at PNNL.

Liao, Qian↗

Nuclear Fission: from more phenomenology and adjusted parameters to more fundamental theory and increased predictive power

Two major recent developments in theory and computational resources created the favorable conditions for achieving a microscopic description of fission dynamics in classically allowed regions of the collective potential energy surface, almost eighty years after its discovery in 1939 by Hahn and Strassmann [1]. The first major development was in theory, the extension of the Time-Dependent Density Functional Theory (TDDFT) [2–5] to superfluid fermion systems [6]. The second development was in computing, the emergence of powerful enough supercomputers capable of solving the complex systems of equations describing the time evolution in three dimensions without any restrictions of hundreds of strongly interacting nucleons. Thus the conditions have been created to renounce phenomenological models and incomplete microscopic treatments with uncontrollable approximations and/or assumptions in the description of the complex dynamics of fission. Even though the available nuclear energy density functionals (NEDFs) are phenomenological still, their accuracy is improving steadily and the prospects of being able to perform calculations of the nuclear fission dynamics and to predict many properties of the fission fragments, otherwise not possible to extract from experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Implementation of Feldman-Cousins Corrections and Oscillation Calculations in the HPC Environment for the NOvA Experiment

Analysis of neutrino oscillation data involves a combination of complex fitting procedures and statistical correction techniques that are used to determine the full three-flavor PMNS parameters and constraint contours. These techniques rely on computationally intensive “multi-universe” stochastic modeling. The process of calculating these contours and corrections can dominate final stages of the data analysis and become a bottleneck for examining the ef-fect of systematic variations on the final results. As part of the DOE SciDAC-4 sponsored research program, we present a new implementation of a neutrino oscillation fitting and framework to carry out calculations of Feldman-Cousins corrections. This implementation is specifically designed and optimized to operate on modern High-Performance Computing (HPC) facilities. We present the performance of the system in calculating allowed regions for the NOvA experiment based on 8.9 x 1020 and 6.9 x 1020 protons-on-target (POT) neutrino and antineutrino datasets, and compare the performance of this new implementation run at the NERSC supercomputing facility with that from methods used previously by the NOvA collaboration running on grid computing facilities.

Sousa, Alexandre↗

Bringing heterogeneity to the CMS software framework

The advent of computing resources with co-processors, for example Graphics Processing Units (GPU) or Field-Programmable Gate Arrays (FPGA), for use cases like the CMS High-Level Trigger (HLT) or data processing at leadership-class supercomputers imposes challenges for the current data processing frameworks. These challenges include developing a model for algorithms to offload their computations on the co-processors as well as keeping the traditional CPU busy doing other work. The CMS data processing framework, CMSSW, implements multithreading using the Intel Threading Building Blocks (TBB) library, that utilizes tasks as concurrent units of work. In this paper we will discuss a generic mechanism to interact effectively with non-CPU resources that has been implemented in CMSSW. In addition, configuring such a heterogeneous system is challenging. In CMSSW an application is configured with a configuration file written in the Python language. The algorithm types are part of the configuration. The challenge therefore is to unify the CPU and co-processor settings while allowing their implementations to be separate. We will explain how we solved these challenges while minimizing the necessary changes to the CMSSW framework. We will also discuss on a concrete example how algorithms would offload work to NVIDIA GPUs using directly the CUDA API.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A fully unprivileged CernVM-FS

The CernVM File System provides the software and container distribution backbone for most High Energy and Nuclear Physics experiments. It is implemented as a file system in user-space (Fuse) module, which permits its execution without any elevated privileges. Yet, mounting the file system in the first place is handled by a privileged suid helper program that is installed by the Fuse package on most systems. The privileged nature of the mount system call is a serious hindrance to running CernVM-FS on opportunistic resource and supercomputers. Fortunately, recent developments in the Linux kernel and in the Fuse user-space libraries enabled fully unprivileged mounting for Fuse file systems (as of RHEL 8), or at least outsourcing the privileged mount system call to a custom, external process. This opens the door to several, very appealing new ways to use CernVM-FS, such as a generally usable “super pilot” consisting of the pilot code bundled with Singularity and CernVM-FS, or the on-demand instantiation of unprivileged, ephemeral containers to publish new CernVM-FS content from anywhere. In this contribution, we discuss the integration of these new Linux features with CernVM-FS and show some of its most promising, new applications.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The ATLAS Workflow Management System Evolution in the LHC Run3 and towards the High-Luminosity LHC era

The ATLAS experiment has 18+ years of experience using workload management systems to deploy and develop workflows to process and to simulate data on the distributed computing infrastructure. Simulation, processing and analysis of LHC experiment data require the coordinated work of heterogeneous computing resources. In particular, the ATLAS experiment utilizes the resources of 250 computing centers worldwide, the power of supercomputing centres, and national, academic and commercial cloud computing resources. In this contribution, we present new techniques for cost-effectively improving efficiency introduced in workflow management system software. The evolution from a mesh framework to new types of computing facilities such as cloud and HPCs is described, as well as new types of production and analysis workflows.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

HEPCloud Operations at Fermilab—The First Five Years

The HEPCloud Facility at Fermilab has now been in production operation for five years. This facility is a unified provisioning gateway to US high performance computing centers, including NERSC, OLCF, and ALCF, other large supercomputers run by the NSF, and commercial clouds. HEPCloud delivers hundreds of millions of core-hours yearly for CMS. HEPCloud also serves other Fermilab experiments including DUNE, Mu2e, Muon g-2, and NOvA. In this paper we present the practical considerations of operating a distributed facility such as HEPCloud. We also mention some of the interesting research and development that HEPCloud has been used for including GPU-based machine learning inference servers, and tests of Quantum Computing.

Timm, Steven [Fermilab]↗

Towards district scale flood simulations using conventional and anisotropic porosity shallow water models with high-resolution topographic information

Current topographic survey technology provides high-resolution (HR) datasets for urban environments. Incorporating this HR information in models aiming to provide flood risk assessment is desirable because the flood wave propagation is depending on the urban topographic features, i.e. buildings, bridges and street networks. Conceptual, numerical and practical challenges arise from the application of shallow water models to HR urban flood modeling. For example, numerical challenges are occurrence of wet-dry fronts, geometric discontinuities in the urban environment and discontinuous solutions, i.e. shock waves. These challenges can be overcome by using a Godunov-type scheme. However, the computational cost of this type of schemes is high, such that HR two-dimensional shallow water simulations with practical relevance have to be run on supercomputers. The porous shallow water model is an alternative approach that aims to reduce computational cost by using a coarse resolution and accounting for unresolved processes by means of the porosity terms. Usually, a speedup between two and three orders of magnitude in comparison to HR simulations can be obtained. This study presents preliminary results of a practical test case concerning pluvial flooding in a district of the city of Nice, France, caused by the intense rainfall event on October 3rd, 2015. HR topography data set on a 1 m resolution is available for the district, whereby street features of infra-metric dimensions have been included. A reference solution is calculated by a HR shallow water model on a 1 m by 1 m structured computational grid. The porous shallow water model is run on a 10 m by 10 m grid and the influence of the drag source term is studied. The model calculations show a large deviation, which is caused by the poor meshing strategy of the porous shallow water (AP) model. The study also summarizes practical challenges that arise during the application of the AP and HR models to a large urban catchment. The main difficulty is to obtain a good mesh. In smaller scale investigations, the mesh is currently constructed by hand such that the cell edges align with buildings. This approach is not feasible for large scale urban catchments with a large number of buildings. Future steps that have to be taken, such as a strategy for automatic mesh generation, are reported on.

42 ENGINEERING↗

How large can the electron to proton mass ratio be in particle-in-cell simulations of unstable systems?

Particle-in-cell simulations are widely used as a tool to investigate instabilities that develop between a collisionless plasma and beams of charged particles. However, even on contemporary supercomputers, it is not always possible to resolve the ion dynamics in more than one spatial dimension with such simulations. The ion mass is thus reduced below 1836 electron masses, which can affect the plasma dynamics during the initial exponential growth phase of the instability and during the subsequent nonlinear saturation. The goal of this article is to assess how far the electron to ion mass ratio can be increased, without changing qualitatively the physics. It is first demonstrated that there can be no exact similarity law, which balances a change in the mass ratio with that of another plasma parameter, leaving the physics unchanged. Restricting then the analysis to the linear phase, a criterion allowing to define a maximum ratio is explicated in terms of the hierarchy of the linear unstable modes. The criterion is applied to the case of a relativistic electron beam crossing an unmagnetized electron-ion plasma.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Modeling laser wakefield accelerator experiments with ultrafast particle-in-cell simulations in boosted frames

The development of new laser systems at the 10 Petawatt range will push laser wakefield accelerators to novel regimes, for which theoretical scalings predict the possibility to accelerate electron bunches up to tens of GeVs in meter-scale plasmas. Numerical simulations will play a crucial role in testing, probing, and optimizing the physical parameters and the setup of future experiments. Fully kinetic simulations are computationally very demanding, pushing the limits of today's supercomputers. In this paper, the recent developments in the OSIRIS framework [R. A. Fonseca et al., Lect. Notes Comput. Sci. 2331, 342 (2002)] are described, in particular the boosted frame scheme, which leads to a dramatic change in the computational resources required to model laser wakefield accelerators. Results from one-to-one modeling of the next generation of laser systems are discussed, including the confirmation of electron bunch acceleration to the energy frontier.

43 PARTICLE ACCELERATORS↗

Atomic-Orbital Close-Coupling Calculations Of Electron Capture From Hydrogen Atoms Into Highly Excited Rydberg States Of Multiply Charged Ions

Collisions of neutral hydrogen atoms with multiply charged ions have been studied in the past using the semi-classical atomic-orbital close-coupling method. We present total and state-resolved cross sections for charge exchange as well as ionization. The advent of supercomputers and parallel programming facilities now allow treatment of collision systems that have been out of reach before, because much larger basis sets involving high quantum numbers are now feasible.

74 ATOMIC AND MOLECULAR PHYSICS↗

Spacecraft charging analysis with the implicit particle-in-cell code iPic3D

We present the first results on the analysis of spacecraft charging with the implicit particle-in-cell code iPic3D, designed for running on massively parallel supercomputers. The numerical algorithm is presented, highlighting the implementation of the electrostatic solver and the immersed boundary algorithm; the latter which creates the possibility to handle complex spacecraft geometries. As a first step in the verification process, a comparison is made between the floating potential obtained with iPic3D and with Orbital Motion Limited theory for a spherical particle in a uniform stationary plasma. Second, the numerical model is verified for a CubeSat benchmark by comparing simulation results with those of PTetra for space environment conditions with increasing levels of complexity. In particular, we consider spacecraft charging from plasma particle collection, photoelectron and secondary electron emission. The influence of a background magnetic field on the floating potential profile near the spacecraft is also considered. Although the numerical approaches in iPic3D and PTetra are rather different, good agreement is found between the two models, raising the level of confidence in both codes to predict and evaluate the complex plasma environment around spacecraft.

42 ENGINEERING↗

A divide-conquer-recombine algorithmic paradigm for large spatiotemporal quantum molecular dynamics simulations

We introduce an extension of the divide-and-conquer (DC) algorithmic paradigm called divide-conquer-recombine (DCR) to perform large quantum molecular dynamics (QMD) simulations on massively parallel supercomputers, in which interatomic forces are computed quantum mechanically in the framework of density functional theory (DFT). In DCR, the DC phase constructs globally informed, overlapping local-domain solutions, which in the recombine phase are synthesized into a global solution encompassing large spatiotemporal scales. For the DC phase, we design a lean divide-and-conquer (LDC) DFT algorithm, which significantly reduces the prefactor of the O(N) computational cost for N electrons by applying a density-adaptive boundary condition at the peripheries of the DC domains. Our globally scalable and locally efficient solver is based on a hybrid real-reciprocal space approach that combines: (1) a highly scalable real-space multigrid to represent the global charge density; and (2) a numerically efficient plane-wave basis for local electronic wave functions and charge density within each domain. Hybrid space-band decomposition is used to implement the LDC-DFT algorithm on parallel computers. A benchmark test on an IBM Blue Gene/Q computer exhibits an isogranular parallel efficiency of 0.984 on 786 432 cores for a 50.3 × 10{sup 6}-atom SiC system. As a test of production runs, LDC-DFT-based QMD simulation involving 16 661 atoms is performed on the Blue Gene/Q to study on-demand production of hydrogen gas from water using LiAl alloy particles. As an example of the recombine phase, LDC-DFT electronic structures are used as a basis set to describe global photoexcitation dynamics with nonadiabatic QMD (NAQMD) and kinetic Monte Carlo (KMC) methods. The NAQMD simulations are based on the linear response time-dependent density functional theory to describe electronic excited states and a surface-hopping approach to describe transitions between the excited states. A series of techniques are employed for efficiently calculating the long-range exact exchange correction and excited-state forces. The NAQMD trajectories are analyzed to extract the rates of various excitonic processes, which are then used in KMC simulation to study the dynamics of the global exciton flow network. This has allowed the study of large-scale photoexcitation dynamics in 6400-atom amorphous molecular solid, reaching the experimental time scales.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Modeling of the charge-state separation at ITEP experimental facility for material science based on a Bernas ion source

The experiment automation system is supposed to be developed for experimental facility for material science at ITEP, based on a Bernas ion source. The program CAMFT is assumed to be involved into the program of the experiment automation. CAMFT is developed to simulate the intense charged particle bunch motion in the external magnetic fields with arbitrary geometry by means of the accurate solution of the particle motion equation. Program allows the consideration of the bunch intensity up to 10{sup 10} ppb. Preliminary calculations are performed at ITEP supercomputer. The results of the simulation of the beam pre-acceleration and following turn in magnetic field are presented for different initial conditions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗