Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “simulation code”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Cretin Memory Flow on Sierra

The Cretin iCOE project has a goal of enabling the efficient generation of Non-LTE opacities for use in radiation-hydrodynamic simulation codes using the Nvidia boards on LLNL’s upcoming Sierra system. Achieving the desired level of accuracy for some simulations require the use of a vary large number of atomic configurations (a configuration includes the atomic level for all electrons and how they are coupled together). The NLTE rate matrix needs to be solved separately in each zone. Calculating NLTE opacities can consume more time than all other physics packages used in a simulation.

74 ATOMIC AND MOLECULAR PHYSICS↗

The Outer Rim Simulation: A Path to Many-core Supercomputers

Herein we describe the Outer Rim cosmological simulation, one of the largest high-resolution N-body simulations performed to date, aimed at promoting science to be carried out with large-scale structure surveys. The simulation covers a volume of (4.225 Gpc) 3 and evolves more than one trillion particles. It was executed on Mira, a BlueGene/Q system at the Argonne Leadership Computing Facility. We discuss some of the computational challenges posed by a system such as Mira, a many-core supercomputer, and how the simulation code, Hardware/Hybrid Accelerated Cosmology Code, has been designed to overcome these challenges. We have carried out a large range of analyses on the simulation data and we report on the results as well as the data products that have been generated. The full data set generated by the simulation totals more than 5 PB of data, making curation and handling of the data a large challenge in itself. The simulation results have been used to generate synthetic catalogs for large-scale structure surveys, including Dark Energy Spectroscopic Instrument and eBOSS, as well as experiments on the cosmic microwave background. A detailed catalog for the data challenges of the Large Synoptic Survey Telescope Dark Energy Science Collaboration has been created as well. We publicly release some of the Outer Rim halo catalogs, downsampled particle information, and lightcone data.

79 ASTRONOMY AND ASTROPHYSICS↗

Multicode benchmark on simulated Ti K-edge x-ray absorption spectra of Ti-O compounds

X-ray absorption spectroscopy (XAS) is an element-specific materials characterization technique that is sensitive to structural and electronic properties. First-principles simulated XAS has been widely used as a powerful tool to interpret experimental spectra and draw physical insights. Recently, there has also been growing interest in building computational XAS databases to enable data analytics and machine learning applications. However, there are non-trivial differences among commonly used XAS simulation codes, both in underlying theoretical formalism and in technical implementation. Reliable and reproducible computational XAS databases require systematic benchmark studies. In this work, we benchmarked Ti K-edge XAS simulations of ten representative Ti-O binary compounds, which we refer to as the Ti-O-10 dataset, using three state-of-the-art codes: XSPECTRA, OCEAN and exciting. We systematically studied the convergence behavior with respect to the input parameters and developed a workflow to automate and standardize the calculations to ensure converged spectra. Our benchmark comparison considers a 35 eV spectral range starting from the K-edge onset, representative of widely used near-edge spectra. Quantitative comparison over this range is based on Spearman’s rank correlation score (r sp ). Our results show: (1) the two Bethe-Salpeter equation (BSE) codes (OCEAN and exciting) have excellent agreement with an average $r$ $sp$ of 0.998; (2) good agreement is obtained between the core-hole potential code (XSPECTRA) and BSE codes (OCEAN and exciting) with an average $r$ $sp$ of 0.990, and this smaller $r$ $sp$ reflects the noticeable differences in the main edge spectral shape that can be primarily attributed to the difference in the strength of the screened core-hole potential; (3) simulations from both methods overall reproduce well the main experimental spectral features of rutile and anatase, and the different treatments of the screened core-hole potential have visible impact on pre-edge intensities and the peak ratio of the main edge; (4) there exist moderate differences in the relative edge alignment of the three codes with a standard deviation of about 0.2 eV, which arise from multiple contributions including the frozen core approximation, final state effects, and different approximations used for the self-energy correction. In conclusion, our benchmark study provides important standards for first-principles XAS simulations with broad impact in data-driven XAS analysis.

36 MATERIALS SCIENCE↗

Nonlinear dissipation of circularly polarized Alfven waves due to the beam-induced obliquely propagating waves

In the present study, the dissipation processes of circularly polarized Alfven waves in solar wind plasmas including beam components are numerically discussed by using a 2-D hybrid simulation code. Numerical results suggest that the parent Alfven waves are rapidly dissipated due to the presence of the beam-induced obliquely propagating waves, such as kinetic Alfven waves. The nonlinear wave-wave coupling is directly evaluated by using the induction equation for the parent wave. It is also observed both in the 1-D and 2-D simulations that the presence of large amplitude Alfven waves strongly suppresses the beam instabilities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Memory Scaling of Reverse-Mode Differentiation in Particle Accelerator Simulations with Space Charge

The recent development of differentiable simulation codes for particle accelerators has enabled gradient-based workflows that promise finer control and more realistic modeling of accelerator facilities. However, when using reverse-mode automatic differentiation, the memory usage continuously increases during the simulation, and can potentially exceed the available hardware memory - especially when costly space charge computation is included. To study the memory requirements for differentiable simulations, we have implemented space charge in Cheetah, a PyTorch-based beam tracking code that supports reverse-mode differentiation. We find that the memory usage for reverse-mode differentiation grows linearly with the number of macroparticles and cells, and that it is proportional to the number of space charge kicks involved in the simulation. This general scaling can be used to evaluate whether a given differentiable simulation is feasible given hardware memory constraints.

Dhamrait, Arjun↗

Benchmarking Heavy Ion Transport Codes FLUKA, HETC-HEDS MARS15, MCNPX, and PHITS

Powerful accelerators such as spallation neutron sources, muon-collider/neutrino facilities, and rare isotope beam facilities must be designed with the consideration that they handle the beam power reliably and safely, and they must be optimized to yield maximum performance relative to their design requirements. The simulation codes used for design purposes must produce reliable results. If not, component and facility designs can become costly, have limited lifetime and usefulness, and could even be unsafe. The objective of this proposal is to assess the performance of the currently available codes PHITS, FLUKA, MARS15, MCNPX, and HETC-HEDS that could be used for design simulations involving heavy ion transport. We plan to access their performance by performing simulations and comparing results against experimental data of benchmark quality. Quantitative knowledge of the biases and the uncertainties of the simulations is essential as this potentially impacts the safe, reliable and cost effective design of any future radioactive ion beam facility. Further benchmarking of heavy-ion transport codes was one of the actions recommended in the Report of the 2003 RIA R&D Workshop".

43 PARTICLE ACCELERATORS↗

3D modeling of the electron energy distribution function in negative hydrogen ion sources

For optimization and accurate prediction of the amount of H-ion production in negative ion sources, analysis of electron energy distribution function (EEDF) is necessary. We are developing a numerical code which analyzes EEDF in the tandem-type arc-discharge source. It is a three-dimensional Monte Carlo simulation code with realistic geometry and magnetic configuration. Coulomb collision between electrons is treated with the ''binary collision'' model and collisions with hydrogen species are treated with the ''null-collision'' method. We applied this code to the analysis of the JAEA 10 A negative ion source. The numerical result shows that the obtained EEDF is in good agreement with experimental results.

43 PARTICLE ACCELERATORS↗

Scalable Performance Awareness for In Situ Scientific Applications

Part of the promise of exascale computing and the next generation of scientific simulation codes is the ability to bring together time and spatial scales that have traditionally been treated separately. This enables creating complex coupled simulations and in situ analysis pipelines, encompassing such things as "whole device" fusion models or the simulation of cities from sewers to rooftops. Unfortunately, the HPC analysis tools that have been built up over the preceding decades are ill suited to the debugging and performance analysis of such computational ensembles. In this paper, we present a new vision for performance measurement and understanding of HPC codes, MonitoringAnalytics (MONA). MONA is designed to be a flexible, high performance monitoring infrastructure that can perform monitoring analysis in place or in transit by embedding analytics and characterization directly into the data stream, without relying upon delivering all monitoring information to a central database for post-processing. It addresses the trade-offs between the prohibitively expensive capture of all performance characteristics and not capturing enough to detect the features of interest. We demonstrate several uses of MONA; capturing and indexing multi-executable performance profiles to enable later processing, extraction of performance primitives to enable the generation of customizable benchmarks and performance skeletons, and extracting communication and application behaviors to enable better control and placement for the current and future runs of the science ensemble. Relevant performance information based on a system for MONA built from ADIOS and SOSflow technologies is provided for DOE science applications and leadership machines.

Wolf, Matthew D.↗

Reducing Disk Storage of Full-3D Seismic Waveform Tomography (F3DT) Through Lossy Online Compression

Full-3D seismic waveform tomography (F3DT) is the latest seismic tomography technique that can assimilate broadband, multi-component seismic waveform observations into high-resolution 3D subsurface seismic structure models. The main drawback in the current F3DT implementation, in particular the scattering-integral implementation (F3DT-SI), is the high disk storage cost and the associated I/O overhead of archiving the 4D space-time wavefields of the receiver- or source-side strain tensors. The strain tensor fields are needed for computing the data sensitivity kernels, which are used for constructing the Jacobian matrix in the Gauss-Newton optimization algorithm. In this study, we have successfully integrated a lossy compression algorithm into our F3DT SI workflow to significantly reduce the disk space for storing the strain tensor fields. The compressor supports a user-specified tolerance for bounding the error, and can be integrated into our finite-difference wave-propagation simulation code used for computing the strain fields. The decompressor can be integrated into the kernel calculation code that reads the strain fields from the disk and compute the data sensitivity kernels. During the wave-propagation simulations, we compress the strain fields before writing them to the disk. To compute the data sensitivity kernels, we read the compressed strain fields from the disk and decompress them before using them in kernel calculations. Experiments using a realistic dataset in our California statewide F3DT project have shown that we can reduce the strain-field disk storage by at least an order of magnitude with acceptable loss, and also improve the overall I/O performance of the entire F3DT-SI workflow significantly. The integration of the lossy online compressor may potentially open up the possibilities of the wide adoption of F3DT-SI in routine seismic tomography practices in the near future.

97 MATHEMATICS AND COMPUTING↗

Massively parallel phase-field simulations targeting exascale

The interface thickness in the phase-field (PF) method limits its simulation scales. Consequently, large-scale PF simulations become prohibitively expensive for resolving the extremely fine microstructures that typically form during rapid solidification processing. This challenge is significant in predicting microstructure evolution in metal additive manufacturing and has been identified by the United States Department of Energy’s Exascale Computing Project. Here, to address this, we develop a multi-GPU and MPI-based massively parallel simulation code, utilizing state-of-the-art algorithms, software, and libraries, for large-scale three-dimensional (3D) PF simulations. We report the first GPU-parallel PF simulations on Frontier (currently the second TOP500 exascale cluster) and Summit machines, taking dendritic growth as an example problem. We evaluate the parallel performance of our implementation using scaling studies with more than 24 000 GPUs (among the largest known computations to date) and the acceleration performance using large-scale simulations of dendritic growth in 3D. Finally, massively parallel GPUs in these supercomputers enabled the first coupled multiscale simulations of laser melting and subsequent dendritic solidification on the scale of a full melt-pool, demonstrating the feasibility of performing PF simulations with a point total over 2 billion grid points within an acceptable time.

Exascale↗

Verification of the time evolution of cosmological simulations via hypothesis-driven comparative and quantitative visualization

We describe a visualization assisted process for the verification of cosmological simulation codes. The need for code verification stems from the requirement for very accurate predictions in order to interpret observational data confidently. We compare different simulation algorithms in order to reliably predict differences in simulation results and understand their dependence on input parameter settings.

97 MATHEMATICS AND COMPUTING↗

Energetic particle transport in 3D equilibrium. Final report

In this project, we have further developed the state-of-the-art fusion simulation code, gyrokinetic toroidal code (GTC), for studying the energetic particle (EP) transport in the 3D equilibrium. We have applied the new capabilities to simulate the EP transport by the Alfven eigenmodes in stellarators and by 3D magnetic islands in tokamaks. As part of V&V efforts for 3D capability, the 3D capabilities of GTC have been applied to study thermal transport in stellarators and tokamak with 3D magnetic fields by microturbulence, which could cause additional EP loss. Effects magnetic islands on neoclassical bootstrap current have also been studied. The computational capability developed and physics learned in this project are in support of fusion SciDAC Center for Integrated Simulation of Energetic Particles in Burning Plasmas (ISEP). During this project, the PI has supervised 6 postdoctoral researchers and 4 PhD students at the University of California, Irvine. A complete list of 49 publications and 23 invited talks partially supported by this grant since 7/2015 appears at the end of this report. Five key publications closely related to this project are highlighted in this report.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Magnetic Reconnection in Solar Flares [Slides]

Magnetic reconnection is the underlying mechanism in solar flares. Magnetic reconnection is an astrophysical process in an electrically conducting plasma where neighboring magnetic field lines running anti-parallel break and reconnection therefore exchanging the direction of their paths. The result of this process is the magnetic field energy converting to kinetic and thermal energy which is explosively released. The scale of a solar is extremely large compared to Earth so kinetic simulations are unable to portray an accurate model. In this project, we are using an astrophysical magnetohydrodynamic (MHD) simulation code known as Athena++ with the reconnection problem generator file created by Li et al. 2018. To further study this simulation, we began testing a heating/cooling term. The results of the original file will be compared with the modified file with an implemented heating/cooling term to better understand how solar flares function.

79 ASTRONOMY AND ASTROPHYSICS↗

Modelling Beam Loss Within the LANSCE Proton Storage Ring

Several upgrades are being considered for the proton storage ring (PSR) at the Los Alamos Neutron Science Center (LANSCE) to reduce beam loss and thereby reduce the cooldown period of the PSR following a beam run. First, we have considered an increased beam pipe diameter would reduce beam loss due to beam scraping caused by misalignments and tuning errors. However, this would require increased pole-to-pole gap height within the dipoles and quadrupoles, which would change their effective length and alter their fringe fields. The effect of different magnet gaps on the beam optical parameters and on beam loss was studied using the simulation codes MAD-X and PyORBIT. Second, we are developing a detailed particle tracking model within the framework of the simulation package General Particle Tracer (GPT) for the PSR H - stripping system. This model will be used to study the effect of the stripper foil parameters (position, composition, areal density, depth, etc.) on first-turn losses, where most of the observed beam loss and emittance growth occurs due to foil scattering, foil stripping, and Lorentz stripping. The model implements C++ custom elements created to model foil scattering, foil stripping, and Lorentz stripping, as these are not built-in features of GPT. The preliminary results of the MAD-X and PyORBIT simulations, as well as the GPT simulation model, is described in this tech note.

43 PARTICLE ACCELERATORS↗

Conservation equations and calculation of mean flows in gyrokinetics

Conservation equations are derived for the gyrocenter toroidal momentum density and the polarization field. These equations are derived from the gyrokinetic model as it is implemented in simulation codes. In view of predicting the toroidal rotation in future fusion devices such as ITER, where external momentum input will be small, accurate simulations of momentum transport are crucial. The evolution equation for gyrocenter toroidal momentum density involves the divergence of the off-diagonal components of the Reynolds and generalized Maxwell stress, while the source term is the radial current of gyrocenters. The time evolution of the polarization field is the opposite of the gyrocenter current. Hence, an evolution equation for the total momentum density, i.e., the sum of gyrocenter and polarization field toroidal momentum density can be written. The force balance equation and the toroidal momentum conservation equations have been numerically tested with the gysela code. They are satisfied with a high level of accuracy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An OpenMP GPU-offload implementation of a non-equilibrium solidification cellular automata model for additive manufacturing

Here, in this paper, performance strategies on GPU-based HPC platforms of a cellular automata (CA) simulation code for non-equilibrium solidification, including nucleation, grain growth, solute partitioning and transport for the metal additive manufacturing (AM) process are investigated using OpenMP 4.5. To accurately report the speed-up for multicore CPUs and GPUs, a rigorous performance analysis employed optimizations appropriate for both CPU-only code (baseline) and GPU offload codes for an isothermal test problem. The performance results on Summit at the Oak Ridge Leadership Computing Facility indicate that using a precomputed list of interface cells significantly decreased the wall-clock time on GPUs. The speedup due to GPU acceleration was evaluated for a full Summit node and measured to be 1.8X when comparing a 6 MPI tasks run with 6 GPUs versus 36 MPI tasks on the CPU only. That speed-up was found to be 7.9X when comparing 6 MPI tasks with 6 GPUs versus the 6 MPI tasks running on the CPU only. Performance measurements showed that system total time is almost constant for runs with more than 96 MPI tasks (or GPUs), indicating that the GPU-accelerated code showed an excellent weak scaling performance. Finally, a rapid directional solidification problem was considered to demonstrate the CA code capability on Summit. It was found that a mesh size of at least 0.05 μm is recommended for the AM-like simulations in order to obtain accurate elongated grain microstructure and elongated subgrain features, which are in qualitative good agreement with experimental data. The results presented in this study indicate that the performance strategies on GPU-based HPC platforms for the CA code are appropriate for novel HPC exascale platforms.

36 MATERIALS SCIENCE↗

Fast-ion physics in SPARC

Potential loss of energetic ions including alphas and radio-frequency tail ions due to classical orbit effects and magnetohydrodynamic instabilities (MHD) are central physics issues in the design and experimental physics programme of the SPARC tokamak. The expected loss of fusion alpha power due to ripple-induced transport is computed for the SPARC tokamak design by the ASCOT and SPIRAL orbit-simulation codes, to assess the expected surface heating of plasma-facing components. We find good agreement between the ASCOT and SPIRAL simulation results not only in integrated quantities (fraction of alpha power loss) but also in the spatial, temporal and pitch-angle dependence of the losses. If the toroidal field (TF) coils are well-aligned, the SPARC edge ripple is small (0.15–0.30 %), the computed ripple-induced alpha power loss is small ( ~0.25% ) and the corresponding peak surface power density is acceptable ( 244 kW m -2 ). However, the ripple and ripple-induced losses increase strongly if the TF coils are assumed to suffer increasing magnitudes of misalignment. Surface heat loads may become problematic if the TF coil misalignment approaches the centimetre level. Ripple-induced losses of the energetic ion tail driven by ion cyclotron range of frequency (ICRF) heating are not expected to generate significant wall or limiter heating in the nominal SPARC plasma scenario. Because the expected classical fast-ion losses are small, SPARC will be able to observe and study fast-ion redistribution due to MHD including sawteeth and Alfvén eigenmodes (AEs). SPARC's parameter space for AE physics even at moderate Q is shown to reasonably overlap that of the demonstration power plant ARC (Sorbom et al., Fusion Engng Des., vol. 100, 2015, p. 378), and thus measurements of AE mode amplitude, spectrum and associated fast-ion transport in SPARC would provide relevant guidance about AE behaviour expected in ARC.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Gauss Sum Strong Simulation v.0.1

Universal quantum circuits can be formulated in the Pauli measurement-based formalism as input T gate magic states, Clifford gates, and then multi-Pauli measurements. This code simulates single-Pauli measurements to show some theoretical bounds on the cost of full multi-Pauli measurements. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2020-14080 O

SciDAC↗