Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Coded computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

Initial Development of Fusion Magnet Simulation Capabilities for Performance and Safety Evaluation Using the MOOSE Framework

Fusion energy holds the promise of being a transformative technology as a carbon-neutral, sustainable source of energy. Whole device modeling and the development of fusion digital twins will be increasingly important for emerging fusion device concepts at both national laboratories and within the commercial fusion industry. However, meeting the challenge of whole device modeling of fusion energy devices requires robust, multiphysics, multiscale modeling and simulation technologies capable of running on large-scale supercomputers. Detailed analysis of individual systems at-scale is also required to ensure safe and efficient operation as well as provide the safety basis for future device designs and licensing activities. In a tokamak, toroidal and poloidal magnets confine and shape the fusion plasma to promote the fusion reaction. High plasma temperatures and high magnetic field requirements in modern design concepts (leading to high amounts of energy stored within each magnet) impose electrical, thermal, and mechanical loads on the magnet components, which in turn impacts the safety considerations of the magnet and their supporting systems. Idaho National Laboratory (INL) has a history of working in this space, including development and benchmarking of the Magnetic System Circuitry Analysis Program (MSCAP) and Magnet Arcing (MAGARC) codes to study magnet quench events; notably, MAGARC was used to study quenching during the ITER Engineering Design Activity. However, these legacy codes and capabilities are not parallel and scalable, and new tools are required for future advances in this area, which leads to the INL-developed Multiphysics Object-Oriented Simulation Environment (MOOSE) framework. Developed originally for fission reactor systems under United States Department of Energy, Office of Nuclear Energy modeling and simulation programs, the MOOSE framework has been well-suited to multiscale, multiphysics modeling and simulation needs for nuclear systems. The framework is open-source, well-tested, under continuous development and deployment, and developed to a Nuclear Quality Assurance, Level 1 software quality standard. MOOSE has also been used in the fusion space previously in several projects: INL’s Tritium Migration Analysis Program, Version 8 (TMAP8) for tritium migration, UK Atomic Energy Authority’s A Unified Resource for OpenMC (fusion) Reactor Applications (AURORA) code for fusion thermo-mechanical and neutronics analysis, and Argonne National Laboratory’s Cardinal for high-fidelity computational fluid dynamics and neutronics. However, to model superconducting magnets, several MOOSE enhancements are required: additions to the current MOOSE electromagnetic capabilities, new material libraries for superconductors of interest (such as YBCO), as well as fusion-specific models for thermo-mechanics. This talk will discuss initial development activities to build these capabilities in MOOSE, focusing on initial validation and benchmarking activities. Proposed coupling workflows and future work to support the simulation of fusion magnets and magnet structural assemblies for performance and safety evaluation in MOOSE will also be discussed.

70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Fast and Accurate Predictions of Total Energy for Solid Solution Alloys with Graph Convolutional Neural Networks

We use graph convolutional neural networks (GCNNs) to produce fast and accurate predictions of the total energy of solid solution binary alloys. GCNNs allow us to abstract the lattice structure of a solid material as a graph, whereby atoms are modeled as nodes and metallic bonds as edges. This representation naturally incorporates information about the structure of the material, thereby eliminating the need for computationally expensive data pre-processing which would be required with standard neural network (NN) approaches. We train GCNNs on ab-initio density functional theory (DFT) for copper-gold (CuAu) and iron-platinum (FePt) data that has been generated by running the LSMS-3 code, which implements a locally self-consistent multiple scattering method, on OLCF supercomputers Titan and Summit. GCNN outperforms the ab-initio DFT simulation by orders of magnitude in terms of computational time to produce the estimate of the total energy for a given atomic configuration of the lattice structure. We compare the predictive performance of GCNN models against a standard NN such as dense feedforward multi-layer perceptron (MLP) by using the root-mean-squared errors to quantify the predictive quality of the deep learning (DL) models. We find that the attainable accuracy of GCNNs is at least an order of magnitude better than that of the MLP.

Lupo Pasini, Massimiliano↗

Hi-COLA: fast, approximate simulations of structure formation in Horndeski gravity

We introduce Hi-COLA, a code designed to run fast, approximate N-body simulations of non-linear structure formation in reduced Horndeski gravity. Given an input Lagrangian, Hi-COLA dynamically constructs the appropriate field equations and consistently solves for the cosmological background, linear growth, and screened fifth force of that theory. Hence Hi-COLA is a general, adaptable, and useful tool that allows the mildly non-linear regime of many Horndeski theories to be investigated for the first time, at low computational cost. In this work, we first describe the screening approximations and simulation setup of Hi-COLA for theories with Vainshtein screening. We validate the code against traditional N-body simulations for cubic Galileon gravity, finding 2.5% agreement up to k max = 1.2 h/Mpc. To demonstrate the flexibility of Hi-COLA, we additionally run the first simulations of an extended shift-symmetric gravity theory. We use the consistency and modularity of Hi-COLA to dissect how the modified background, linear growth, and screened fifth force all contribute to departures from ΛCDM in the non-linear matter power spectrum. Hi-COLA can be found at https://github.com/Hi-COLACode/Hi-COLA.

97 MATHEMATICS AND COMPUTING↗

Combining different 3-D global and regional seismic wave propagation solvers towards box tomography in the deep Earth

SUMMARY In previous publications, we presented a general framework, which we called ‘box tomography’, that allows the coupling of any two different numerical seismic wave propagation solvers, respectively outside and inside a target region, or ‘box’. The goal of such hybrid wavefield computations is to reduce the cost of computations in the context of full-waveform inversion for structure within the target region, when sources and/or receivers are located at large distances from the box. Previously, we had demonstrated this approach with sources and receivers outside the target region in a 2-D acoustic spherical earth model, and demonstrated and applied this methodology in the 3-D spherical elastic Earth in a continental scale inversion in which all stations were inside the target region. Here we extend the implementation of the approach to the case of a 3-D global elastic earth model in the case where both sources and stations are outside the box. We couple a global 3-D solver, SPECFEM3D_GLOBE, for the computation of the wavefield and Green’s functions in a reference 3-D model, with a regional 3-D solver, RegSEM, for the computation of the wavefield within the box, by means of time-reversal mirrors. We briefly review key theoretical aspects, showing in particular how only the displacement is needed to be stored at the boundary of the box. We provide details of the practical implementation, including the geometrical design of the mirrors, how we deal with different sizes of meshes in the two solvers, and how we address memory-saving through the use of B-spline compression of the recorded wavefield on the mirror. The proposed approach is numerically efficient but also versatile, since adapting it to other solvers is straightforward and does not require any changes in the solver codes themselves, as long as the displacement can be recovered at any point in time and space. We present benchmarks of the hybrid computations against direct computations of the wavefield between a source and an array of stations in a realistic geometry centred in the Yellowstone region, with and without a hypothetical plume within the ‘box’, and with a 1-D or a 3-D background model, down to a period of 20 s. The ultimate goal of this development is for applications in the context of imaging of remote target regions in the deep mantle, such as, for example, Ultra Low Velocity Zones.

Geochemistry & Geophysics↗

MOSCATO Development and Integration in Fiscal Year 2024

MOSCATO (Molten Salt Chemistry and Transport) is a multiphysics code that provides high-fidelity, coupled simulations of fluid flow, heat transfer, mass transfer, chemistry, electrochemical phenomena, and alloy evolution for molten salt equipment. In FY24, significant developments were made to the code package, enhancing its capabilities in many aspects. The improvements and advancements can be summarized as follows: 1. Implementation of tritium transport capabilities and validation with experimental data: To enable modeling of tritium and other fission gases within MSRs, we implemented gas transport within MOSCATO via inclusion of couple mass transport equations within the salt and structural alloys. Comparisons to experimental data from literature showed good agreement with respect to tritium release rates. 2. Preliminary implementation of two-phase flow models in MOSCATO: To model tritium and other gases above their solubility limits, we implemented preliminary two-phase flow models within MOSCATO to account for bubble transport. The first model adopted was the Level-Set approach, which can handle the high void fraction regime, but with a requirement for high mesh resolution thus high computational expense. In this report, we present a verification of the Level-Set method using a simple benchmark case. We also performed a demonstration of the code as applied to an experimental case involving cover gas flow through salt in an experimental vessel. The second model adopted was the Eulerian-Eulerian dispersed flow model, which is computationally cheaper but limited to low void fraction regimes, such as bubbly flow. Validation and verification have not yet been performed for the Eulerian-Eulerian approach, but a preliminary implementation was completed. 3. Validation with static corrosion experiments: Static corrosion experimental data for stainless steel coupons within molten salts was used to further validate the corrosion model in MOSCATO. To do so, we leveraged the existing models in MOSCATO and simulated the sample mass loss and mass gain phenomena. Several ion species, including Cr 2+ , Fe 2+ and H + , were simulated in salt using the PNP solver, while Cr 0 and Fe 0 were simulated with a diffusion solver in stainless steel. The mass loss of the samples was compared with experimental data, and good agreement was achieved. These combined activities served to further expand the capabilities of MOSCATO and make it more generally applicable to the full range of phenomena that can control chemistry and corrosion in molten salt reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A GPU accelerated mixed-precision Smoothed Particle Hydrodynamics framework with cell-based relative coordinates

Smoothed Particle Hydrodynamics (SPH) is essential for modeling complex large-deformation problems across various applications, requiring significant computational power. A major portion of SPH computation time is dedicated to the Nearest Neighboring Particle Search (NNPS) process. While advanced NNPS algorithms have been developed to enhance SPH efficiency, the potential efficiency gains from modern computation hardware remain underexplored. Here, this study investigates the impact of GPU parallel architecture, low-precision computing on GPUs, and GPU memory management on NNPS efficiency. Our approach employs a GPU-accelerated mixed-precision SPH framework, utilizing low precision float-point 16 (FP16) for NNPS while maintaining high precision for other components. To ensure FP16 accuracy in NNPS, we introduce a Relative Coordinated-based Link List (RCLL) algorithm, storing FP16 relative coordinates of particles within background cells. Our testing results show three significant speedup rounds for CPU-based NNPS algorithms. The first comes from parallel GPU computations, with up to a 1000x efficiency gain. The second is achieved through low-precision GPU computing, where the proposed FP16-based RCLL algorithm offers a 1.5x efficiency improvement over the FP64-based approach on GPUs. By optimizing GPU memory bandwidth utilization, the efficiency of the FP16 RCLL algorithm can be further boosted by 2.7x, as demonstrated in an example with 1 million particles. Our code is released at https://github.com/pnnl/lpNNPS4SPH.

97 MATHEMATICS AND COMPUTING↗

Performance Analysis of the Expected Track Length Estimator

This work investigates whether performance of the MCNP code is improved by the implementation of the expected track length estimator. The expected track length estimator is known to decrease variance when compared to the track length estimator in many classes of Monte Carlo particle transport simulations. However, the computational cost of computing an exponent for every particle collision within a tallied cell has previously been considered prohibitively expensive. Therefore, the goal of this work is to determine whether the variance improvements seen by the expected track length estimator in most cases makes up for the increase in transport time when implemented in the MCNP code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Trilinos: Enabling Scientific Computing across Diverse Hardware Architectures at Scale

Trilinos is a community-developed, open-source software framework that facilitates building large-scale, complex, multiscale, multiphysics simulation code bases for scientific and engineering problems. Since the Trilinos framework has undergone substantial changes to support new applications and new hardware architectures, this document is an update to “An Overview of the Trilinos project” by Heroux et al. (ACM Transactions on Mathematical Software, 31(3):397–423, 2005). It describes the design of Trilinos, introduces its new organization in product areas, and highlights established and new features available in Trilinos. Particular focus is put on the modernized software stack based on the Kokkos ecosystem to deliver performance portability across heterogeneous hardware architectures. This article also outlines the organization of the Trilinos community and the contribution model to help onboard interested users and contributors.

Heterogeneous Hardware Architectures↗

A New 1D Model for Thermal Mixing and Stratification in Advanced Reactor Transients

Thermal mixing and stratification in large pools and enclosures play a critical role in the safety and performance of pool-type nuclear reactors, particularly during transient scenarios involving significant temperature differences between incoming and bulk coolant. Accurate modeling of these phenomena is essential for predicting system behavior and supporting passive safety features such as natural circulation. Here, this paper presents a new 1D model for thermal mixing and stratification, developed and implemented in the SAM code. The model represents a large pool as 1D coolant jet channels and zero-dimensional bulk pool volumes, enabling the simulation of a wide range of flow configurations, including hot and cold jet interactions, stratified layers, and the influence of complex geometries such as ceilings, free surfaces, and internal obstacles. Heat exchange between jet and pool regions is governed by closure relations calibrated against 3D computational fluid dynamics (CFD) simulations. The model improves upon earlier approaches by incorporating time-dependent jet characteristics and capturing the associated delay effects more accurately. Code-to-code comparisons and validation against experimental data from the Thermal Stratification Test Facility demonstrate the model’s accuracy and flexibility. This work offers two key contributions: (1) an efficient and robust method for simulating thermal mixing and stratification at the system level, eliminating the need for external coupling between system analysis codes and CFD, and (2) a significant enhancement of SAM’s capabilities to analyze thermal stratification phenomena in advanced reactor systems.

SAM↗

SEAS Communication Engine: An Extensible, Flexible Wrapper for Co-Simulation Agents

When modeling and analyzing the power grid and other large scale systems, researchers often express scenarios as optimization problems and feed them into advanced software solvers. In order to allow multiple solvers to communicate with each other and share data from different domains, the National Renewable Energy Laboratory (NREL) and associated Department of Energy (DOE) labs have developed a software framework called the Hierarchical Engine for Large-scale Infrastructure Co-Simulation (HELICS). HELICS allows cosimulation via a collection of client libraries for different languages that can be called from the appropriate optimization software. However, these client libraries do not provide a higher level of abstraction beyond reading and writing data off of the shared HELICS bus. In this paper, we describe a new software library called the SEAS Communication Engine that exposes a higher-level API for running cosimulation problems. The SEAS Engine provides a class-based abstraction on top of the Python HELICS client, in order to allow users to implement their domain-specific cosimulations without needing to interact with core HELICS primitives. This will make adoption of HELICS and cosimulation in general easier, by exposing a simpler API. In the second part of the paper, we validate our library on a collection of different simulation examples, including the canonical IEEE 13 Bus Feeder. Lastly, we demonstrate using the SEAS Engine to directly call domain-specific code written in the Julia programming language. Our hope is that this will serve as a template for easily calling software in different programming languages via the SEAS Engine, thereby avoiding code duplication and complexity.

co-simulation↗

Benchmark of the KGMf with a coupled Boltzmann equation solver

The Kinetic Global Model framework (KGMf) is an open-source general-purpose global model (spatially averaged) simulation code developed to explore the reaction kinetics and pathways in plasma discharge systems. It contains species continuity and electron energy balance equations, with a time-dependent evaluated electron energy distribution function (EEDF) for electron impact reactions. The EEDF is utilized to determine the rate coefficients for electron impact reactions, which can have profound impact on the temporal evolutions of plasma parameters. Previously, the EEDF was commonly assumed as Maxwellian or an analytical function of the effective electron temperature. In this work, the KGMf is coupled with a Boltzmann equation (BE) solver to self-consistently compute the EEDF. The EEDF evolution frequency is determined based on relative changes of the reduced electric field. The KGMf is benchmarked with the ZDPlasKin code based on high-pressure low-temperature argon plasma discharge cases. Additionally, the temporal evolutions of reduced electric field, electron temperature, EEDF, reaction rates, and species densities, are obtained and compared under different discharge conditions, showing good agreement between the KGMf and the ZDPlasKin simulations. The application of the KGMf for predicting breakdown times in high power microwave discharges is also presented, which shows qualitative agreement with particle-in-cell simulations. The KGMf can be further applied for more complicated plasma discharge systems, where the reaction kinetics are more intricate (e.g., plasma-assisted combustion systems).

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Accelerating x-ray tracing for exascale systems using Kokkos

The upcoming exascale computing systems Frontier and Aurora will draw much of their computing power from GPU accelerators. The hardware for these systems will be provided by AMD and Intel, respectively, each supporting their own GPU programming model. The challenge for applications that harness one of these exascale systems will be to avoid lock-in and to preserve performance portability. We report here on our results of using Kokkos to accelerate a real-world application on NERSC's Perlmutter Phase 1 (using NVIDIA A100 accelerators) and Crusher, the testbed system for OLCF's Frontier (using AMD MI250X). By porting to Kokkos, we successfully ran the same X-ray tracing code on both systems and achieved speed-ups between 13 % and 66 % compared to the original CUDA code. Finally, these results are a highly encouraging demonstration of using Kokkos to accelerate production science code.

97 MATHEMATICS AND COMPUTING↗

An Overview of UME: Unstructured Mesh Explorations [Slides]

What is UME? UME extracts an important computational kernel from a large computational physics application, which is based on an unstructured mesh representation. The memory layout, indexing, data management, and communication patterns are as close to the original application as possible. The original application is a long-lived Fortran program, with ~750K source lines of code (sloc). UME is a C++17 implementation of a zone gradient operator, with about ~3K sloc.

97 MATHEMATICS AND COMPUTING↗

Toucan: A performance portable, scalable implementation of the DECA algorithm

In the field of additive manufacturing (AM), cellular automata (CA) is extensively used to simulate microstructural evolution during solidification. However, while traditional CA approaches are relatively fast, they still require a substantial number of time steps, are limited to moderate volumes, and are relatively difficult to improve through parallelism due to the highly localized nature of the solidification front. Here, to address these issues of time to solution and load balancing, we introduce Toucan, a parallel, performance-portable, and scalable code written in C++ with the Kokkos library that leverages the discrete event inspired cellular automata (DECA) algorithm to perform parallel-in-time (PinT) grain growth simulations. Toucan effectively mitigates load balancing issues by distributing the computational workload more evenly across processors, enhancing scalability and efficiency. We conduct both strong and weak scaling studies on up to 64 GPUs on the Frontier supercomputer, demonstrating that Toucan significantly outperforms the current state-of-the-art, time-stepped CA code, ExaCA, on both single and multi-GPU simulations. Even in AM-specific weak scaling scenarios, Toucan maintains near-ideal scaling, in contrast to the linear increase observed with ExaCA due to the moving laser raster pattern. This study highlights Toucan’s potential to transform microstructural simulations in AM by radically improving both efficiency and scalability over existing methods.

36 MATERIALS SCIENCE↗

Extension of OpenMC for Fixed Source Transmutation Calculations

This report documents work performed under a Strategic Partnership Project between Argonne National Laboratory (ANL) and the United Kingdom Atomic Energy Authority (UKAEA). The overall goal of this project is to extend OpenMC [1], a community-developed Monte Carlo particle transport code, to be able to perform fixed-source transmutation calculations. In fission and fusion reactors, the high flux of energetic neutrons causes materials within the reactor to “transmute,” or undergo a nuclear reaction that results in the addition/removal of neutrons and protons from the nucleus of an atom. If subjected to these reactions for long enough, the overall composition and physical properties of the material itself begin to change as a result of transmutation. Such a feature is vital for predicting the decrease in tritium production rate within a breeder blanket during the lifetime of a fusion reactor. OpenMC is capable of simulating neutron transport in fission/fusion systems, thereby allowing it to estimate the flux that causes transmutation. It is also capable of solving the transmutation equations, which determine how the composition of a material changes over time due to neutron irradiation and radioactive decay. However, solving the transmutation equations was previously only possible when the source of neutrons came from a fission system. In a fusion system, the source of neutrons is typically determined by a separate code and then given as an input to the particle transport simulation. This is known as a fixed source calculation. Through this project, we have extended OpenMC to solve the transmutation equations for a fixed source calculation. Evaluating the change in material compositions due to transmutation and its effect on physical properties is of key importance to a range of engineering analyses for fission and fusion systems. For example, in a fusion reactor, estimating the dose rate at different physical locations resulting from irradiated materials in the reactor allows designers to ensure that workers are not exposed to doses beyond applicable regulations. In order to properly dispose of irradiated materials, designers also need to estimate the radiotoxicity, which again relies on knowledge of the material composition at some future time. The specific tasks for this project that were agreed to between ANL and UKAEA were as follows: 1. Make changes and additions in the openmc.deplete and related modules in OpenMC to support transmutation calculations following a fixed source transport simulation. 2. Make necessary changes to OpenMC to model transmutation due to an arbitrary set of reactions needed for fusion applications. Use this new capability to generate a depletion chain file based on the TENDL nuclear data library. 3. Improve the openmc.deplete module in OpenMC to keep track of gases produced as a by-product of nuclear reactions during transmutation calculations. 4. Validate the new capabilities by carrying out fixed-source transmutation calculations on a suitable benchmark problem using OpenMC and a comparable Monte Carlo neutron transport code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

VTK-m User's Guide (V.1.8)

Extreme scale systems require a new programming model and a fundamental change in how we design algorithms. To address these issues we created VTK-m: the visualization toolkit for multi-/many-core architectures. VTK-m supports a number of algorithms and the ability to design further algorithms through a top-down design with an emphasis on extreme parallelism. VTK-m also provides support for finding and building links across topologies, making it possible to perform operations that determine manifold surfaces, interpolate generated values, and find adjacencies. Although VTK-m provides a simplified high-level interface for programming, its template-based code removes the overhead of abstraction. VTK-m simplifies the development of parallel scientific visualization algorithms by providing a framework of supporting functionality that allows developers to focus on visualization operations. Additionally, VTK-m provides data abstractions not provided by other libraries that make code written in VTK-m more versatile.

97 MATHEMATICS AND COMPUTING↗

Reassessing the MCNP Random Number Generator

Random number generators are integral components to Monte Carlo codes. They provide the pseudorandom number sequence used to actually sample the distributions of interest. As a result, they are one of the most important components to the software. The current recommended MCNP random number generator is a 63-bit linear congruential generator (LCG). This generator is quite fast, but it has some drawbacks. First, it only has a period of 2 63 . Due to the necessarily non-optimal usage of random numbers to ensure parallel reproducibility, this amount is too few to guarantee random number sequences are not reused in all configurations the code runs under. As simulation size increases, users will need to be aware of the limitations of the generator and tune configuration variables to best suit their simulations, or they will need to assume that reuse is not negatively affecting their answers. Neither of these are optimal. Second, small LCGs are fairly weak in bit generation quality, and this can have an unknown impact on the quality of the simulation. This paper is an investigation into whether or not more modern random number generators can supersede the current ones. The goal is to find a generator that is similar or superior in speed to the LCGs, has a state space large enough to make strong guarantees about random number reuse, and passes all modern random number test suites. If such a generator is found, it would eliminate the need for the user to even be aware of the limitations of the random number generator and would simplify the use of the code. This paper will be broken into several parts. Sec. 2 will discuss the evolution of the random number generator within the MCNP code. Sec. 3 will go over what a Monte Carlo code needs from a generator to be reproducible and portable and how the current generator behaves in that light. Sec. 4 goes through how each generator was tested. Finally, Sec. 5 will discuss improvements that could be made to the code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Heat Pipe Modeling Capabilities in Sockeye

Presentation to be given in a meeting with stakeholders of the Nuclear Energy Advanced Modeling and Simulation program for modeling related to microreactors. This presentation gives an overview of the capabilities and status of the heat pipe code Sockeye.

97 MATHEMATICS AND COMPUTING↗