Final Report: Multiphysics Modeling of Accelerators Through Code Integration
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Scientific foundation models hold great promise for advancing nuclear and particle physics by improving analysis precision and accelerating discovery. Yet, progress in this field is often limited by the lack of openly available large scale datasets, as well as standardized evaluation tasks and metrics. Furthermore, the specialized knowledge and software typically required to process particle physics data pose significant barriers to interdisciplinary collaboration with the broader machine learning community. This work introduces a large, openly accessible dataset of 10 million simulated proton-proton collisions, designed to support self-supervised training of foundation models. To facilitate ease of use, the dataset is provided in a common NumPy format. In addition, it includes 70,000 labeled examples spanning three well defined downstream tasks: track finding, particle identification, and noise tagging, to enable systematic evaluation of the foundation model's adaptability. The simulated data are generated using the Pythia Monte Carlo event generator at a center of mass energy of $\sqrt{s}$ = 200 GeV and processed with Geant4 to include realistic detector conditions and signal emulation in the sPHENIX Time Projection Chamber at the Relativistic Heavy Ion Collider, located at Brookhaven National Laboratory. This dataset resource establishes a common ground for interdisciplinary research, enabling machine learning scientists and physicists alike to explore scaling behaviors, assess transferability, and accelerate progress toward foundation models in nuclear and high energy physics. The complete simulation and reconstruction chain is reproducible with the sPHENIX software stack. All data and code locations are provided under Data Accessibility.
Many problems of interest in engineering, medicine, and the fundamental sciences rely on high-fidelity flow simulation, making performant computational fluid dynamics solvers a mainstay of the open-source software community. Previous work MFC 3.0 was made a published, documented, and open-source solver via Bryngelson et al. Comp. Phys. Comm. (2021) with numerous physical features, numerical methods, and scalable infrastructure. MFC 5.0 is a significant update to MFC 3.0, featuring a broad set of well-established and novel physical models and numerical methods, as well as the introduction of GPU and APU (or superchip) acceleration. Here, we exhibit state-of-the-art performance and ideal scaling on the first two exascale supercomputers, OLCF Frontier and LLNL El Capitan. Combined with MFC’s single-accelerator performance, MFC achieves exascale computation in practice, and achieved the largest-to-date public CFD simulation at 200 trillion grid points as a 2025 ACM Gordon Bell Prize finalist. New physical features include the immersed boundary method, N-fluid phase change, Euler–Euler and Euler–Lagrange sub-grid bubble models, fluid-structure interaction, hypo- and hyper-elastic materials, chemically reacting flow, two-material surface tension, magnetohydrodynamics (MHD), and more. Numerical techniques now represent the current state-of-the-art, including general relaxation characteristic boundary conditions, WENO variants, Strang splitting for stiff sub-grid flow features, and low Mach number treatments. Weak scaling to tens of thousands of GPUs on OLCF Summit and Frontier and LLNL El Capitan achieves efficiencies within 5% of ideal to over 90% of their respective system sizes. Strong scaling results for a 16-times increase in device count show parallel efficiencies over 90% on OLCF Frontier. MFC’s software stack has undergone further improvements, including continuous integration, which ensures code resilience and correctness through over 300 regression tests; metaprogramming, which reduces code length while maintaining performance portability; and code generation for computing chemical reactions
Cardinal is an open-source application that couples OpenMC Monte Carlo transport and NekRS computational fluid dynamics (CFD) to the Multiphysics Object-Oriented Simulation Environment (MOOSE), closing neutronics and thermal-fluid gaps in conducting high-resolution multiscale and multiphysics analyses of nuclear systems. We first provide a brief introduction to Cardinal's software design, data mapping, and coupling strategy to highlight our approach to overcoming common challenges in high-fidelity multiphysics simulations. Here we then present two Cardinal simulations for hexagonal pin bundles. The first is a validation of Cardinal's conjugate heat transfer coupling of NekRS's Reynolds-Averaged Navier Stokes model with MOOSE's heat conduction physics for a bare seven-pin Freon-12 bundle flow experiment. Predictions for pin surface temperatures under three different heating modes agree reasonably well with experimental data and similar CFD modeling from the literature. The second simulation is a multiphysics coupling of OpenMC, NekRS, and BISON for a reduced-scale, seven-pin wire-wrapped version of an Advanced Burner Reactor bundle. Wire wraps are approximated using a momentum source model, and coupled predictions are provided for velocity, temperature, and power distribution.
Modeling and simulation of fuel burnup plays important roles in reactor design, operation, safety, and security as well as nuclear material control and accounting (MC&A) [1]. This task is uniquely challenging for pebble bed reactors (PBR) because the pebbles are continuously added and recycled into the reactor core, and their paths through the core are random. To address this problem, we present two simulation models in this paper. Brookhaven National Laboratory (BNL) developed a simple lattice model of a PBR in Serpent software to generate used pebble isotopic concentrations. The benefit of using Serpent software in this specific application is that it helps streamline the data generation process without having to use too many independent software codes in combination to achieve a simple task. For example, transport, burnup and zero power decay can be implemented in a single pass. Three-dimensional core models were developed using Serpent to simulate the burnup process of 5 subject pebbles starting from fresh till they reach nearly target burnup, with each pebble placed in one of the five artificially designated radial channels to capture the changing neutron spectra along the core radius. Equilibrium isotopic concentrations were assumed in all other pebbles in the core. To provide a verification for the Serpent isotope transmutation and decay results, Oak Ridge National Laboratory (ORNL) performed simple SCALE/ORIGEN calculations using the average neutron spectra calculated by Serpent for each of the 5 pebbles. The 252-group neutron spectra from Serpent were then used by ORIGEN to produce the one-group library for depletion and decay calculations. The isotopic concentrations of a few nuclides of interest and neutron and gamma source terms produced from the ORIGEN calculations were compared with the ones from the Serpent calculations. The model simulated in this work was based on the Pebble Bed Modular Reactor (PBMR)-400 design because many data needed for the simulation such as core power profiles, fuel and reflector temperatures, and equilibrium core composition are publicly available. In this paper, we will compare the results between these two approaches and benchmark the results against a set of well-established simulation results for PBMR-400.
Modeling and simulation of fuel burnup plays important roles in reactor design, operation, safety, and security as well as nuclear material control and accounting (MC&A) [1]. This task is uniquely challenging for pebble bed reactors (PBR) because the pebbles are continuously added and recycled into the reactor core, and their paths through the core are random. To address this problem, we present two simulation models in this paper. Brookhaven National Laboratory (BNL) developed a simple lattice model of a PBR in Serpent software to generate used pebble isotopic concentrations. The benefit of using Serpent software in this specific application is that it helps streamline the data generation process without having to use too many independent software codes in combination to achieve a simple task. For example, transport, burnup and zero power decay can be implemented in a single pass. Three-dimensional core models were developed using Serpent to simulate the burnup process of five subject pebbles starting from fresh till they reach nearly target burnup, with each pebble placed in one of the five artificially designated radial channels to capture the changing neutron spectra along the core radius. Equilibrium isotopic concentrations were assumed in all other pebbles in the core. To provide a verification for the Serpent isotope transmutation and decay results, Oak Ridge National Laboratory (ORNL) performed simple SCALE/ORIGEN calculations using the average neutron spectra calculated by Serpent for each of the five pebbles. The 252-group neutron spectra from Serpent were then used by ORIGEN to produce the one-group library for depletion and decay calculations. The isotopic concentrations of a few nuclides of interest and neutron and gamma source terms produced from the ORIGEN calculations were compared with the ones from the Serpent calculations. The model simulated in this work was based on the Pebble Bed Modular Reactor (PBMR)-400 design because many data needed for the simulation such as core power profiles, fuel and reflector temperatures, and equilibrium core composition are publicly available. In this paper, we will compare the results between these two approaches and benchmark the results against a set of well-established simulation results for PBMR-400.
Informed decision-making using computational fluid dynamics (CFD) results requires quantifying the errors and uncertainties of a simulation. Verification, validation, and uncertainty quantification (VVUQ) methods were developed to address this need and have matured. However, these VVUQ analyses are often non-trivial and require CFD analysts and practitioners to have specific skill sets. This has led to the uneven adoption of VVUQ analyses, in part, based on the availability of software tools to aid CFD analysts and practitioners. Solution verification, a procedure to evaluate the accuracy of a simulation by estimating potential errors arising from the computational model and computing the uncertainties without comparing to results from a physical system, is one of the lagging VVUQ analyses as the absence of software has forced CFD analysts and practitioners to develop their own codes or piece together incomplete software from across the internet. This work presents an opensource Python package, CFDverify, to lower the barrier of entry and fill in the technological gap in solution verification. CFDverify also provides a streamlined framework to remove some potential errors in post-processing CFD results. The hope is that CFDverify can improve the quality and quantity of CFD solution verification in scientific and research studies and attract interest in developing a communal tool. This paper describes the design, features, and an example use of CFDverify.
Computational tools have a crucial role to play in accelerating the deployment of fusion as a clean, reliable, abundant, and sustainable energy source. Multiphysics, high-fidelity simulation capabilities can help model, study, and predict intricate interactions between materials performance, plasma exposure, neutron irradiation, and engineering processes. As such, they can assist in the resolution of scientific and engineering challenges underpinning design, construction, and commission of fusion power plants. To address these needs, ongoing efforts are leveraging the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework and delivering new computational tools for the fusion community. These tools inherit crucial attributes from MOOSE. They are open-source, modular, integrated with nuclear industry-standard software quality assurance processes, and enable multiphysics, multi-fidelity, fully integrated, zero- to three-dimensional, and massively parallel simulations. After a short overview of these capabilities, we will present the development of Fusion ENergy Integrated multiphys-X (FENIX), a MOOSE-based application designed to enable plasma facing component design and performance evaluation. Throughout their lifetime, plasma facing components are exposed to extreme thermal loads, repeated thermal shocks, and irradiation by plasma ions, neutral particles, and high-energy neutrons. Consequently, designing a plasma facing component with acceptable lifetime degradation is extremely challenging. FENIX aims to model the multiphysics environment in which plasma facing components evolve to accelerate their design studies. To that end, FENIX couples existing MOOSE capabilities such as heat transfer, thermomechanics, and thermal hydraulics, with tritium transport via the MOOSE-based Tritium Migration Analysis Program, Version 8 (TMAP8), with neutronics via the MOOSE-based high-fidelity neutron-photon transport and fluid dynamics code Cardinal, and finally with Particle-in-Cell plasma simulation capabilities being developed in this project. In this study, we present the current FENIX capabilities and preliminary results of its application to model the Tritium Plasma Experiment set up at Idaho National Laboratory.
Oil fields characterized by significant proportions of hot water in the reservoir offer a unique opportunity for geothermal energy co-production and utilization. Development of an accurate geological model is essential in understanding the subsurface. However, this is a challenge at the preliminary stages of resource assessment when data on the subsurface parameters and subterranean fault network is scarce. Our focus in this paper is to explore a methodology for developing an accurate conceptual geological model of the complexly faulted reservoir at the Blackburn Field, Nevada, to create a numerical simulation that will eventually be used to assess the potential of co-producing electricity. There are four steps to the evolution of this model: (1) collection of public data and research on the geological setting of the system; (2) digitization of seismic time-interpretation and cross-sections to create the most representative model of the subsurface; and (3) creation of a natural-state numerical model to simulate the thermal gradient through the subsurface. Utilizing publicly available data of the geological system and Leapfrog conceptual modeling software, we refined a preliminary model to be more representative of the subsurface geology of an active geothermal exploration stage project. The conceptual geological model developed has been imported into VOLSUNG reservoir modeling software to create a natural-state model, further characterizing the Blackburn Field reservoir's thermal gradient. In the future, new seismic data will be utilized to further evolve the conceptual geological model for numerical simulations.
Wind energy plays a crucial role in sustainable power generation, yet its full potential in the southeast United States (SEUS) remains underexplored. This study advances wind resource assessment in the SEUS using existing regional modeling and multisource observations. We find that terrain complexity, influenced by orography and forest canopy, significantly impacts the accuracy of modeled wind speed. While the High-Resolution Rapid Refresh (HRRR) model effectively simulates wind profiles over flat, nonforested terrain, larger errors are produced above forest canopies, and particularly for those stands in hilly and mountainous terrain where there are no observations aloft that could be used by HRRR’s data assimilation software. Seasonal variations, e.g., changes in the leaf area index, further complicate the relationship between terrain complexity and simulation errors. Here, our findings emphasize the critical need for comprehensive wind profile measurements, extending from below the canopy to height above the canopy and through the lower planetary boundary layer, to fully quantify model performance over and near forests, and for improving wind resource assessment, planning, and management. This study provides valuable insights not only for further model development but also for future field campaign deployment with the goal of further improving our understanding of wind resources in the region.
TOUGH is a widely used general purpose numerical simulator designed for fluid and heat flows of multiphase, multicomponent fluid mixtures in porous and fractured media, which has been applied to many real-world problems such as underground geological storage, geothermal reservoir engineering or nuclear waste disposal, to name a few. `toughio` is a lightweight, object-oriented and vectorized Python library that aims to provide user-friendly routines to facilitate pre- and post-processing of a TOUGH simulation. Although its primary target is the latest version TOUGH3, `toughio` can also be used to read/write TOUGH2 input/output files. Currently, to the best of our knowledge, only PyTOUGH offers an exhaustive number of features to carry out a complete TOUGH simulation using a scripting language. `toughio` and PyTOUGH share the same objectives, yet with different approaches and philosophies. On the one hand, a PyTOUGH mesh is represented as a MULGRAPH geometry where elements can be unstructured horizontally but only layered vertically. It also checks that the model parameters are valid to ensure that a TOUGH simulation runs smoothly. On the other hand, although it provides basic meshing features, `toughio` mostly relies on common third-party softwares (e.g. Abaqus, FLAC3D, Gmsh, LaGriT) to generate the mesh by importing and converting it to a TOUGH mesh, which also conveniently facilitates the coupling of TOUGH with any other simulator that also supports the same mesh formats. Besides, `toughio` is designed to be just a TOUGH input and output file reader/writer. It assumes that the user knows what he is doing and does not verify the validity of the model parameters (`toughio` does verify the functional arguments).
This paper reviews the progress in computing radio frequency (RF) wave fields in fusion plasmas, specifically focusing on simulations utilizing the finite element method (FEM) over the past few decades. Computing RF wave fields in fusion plasmas presents unique challenges due to large simulation domains, complex antenna structures, non-local dielectric properties, and wide ranges of spatial scales. It highlights key developments and outlines future directions, primarily addressing waves in the ion cyclotron (IC) to lower hybrid (LH) frequency range. We begin with briefly revisiting earlier developments before the widespread availability of modern computer-aided engineering (CAE) software based on FEM. This historical perspective illuminates early progress and the physics difficulties that motivated ongoing work within the community. Modern wave simulations for RF antennas based on FEM are characterized by the use of detailed 3D antenna model geometry generated from engineering CAD software and localized wave dielectric model. Significant advancements have also been made in improving physics models to include phenomena such as RF sheath rectification and wave scattering. FEM-based RF simulations have also been applied to compute wave propagation in the core region, where the inclusion of non-local dielectric response is crucial. This is a challenging goal, and several promising approaches have been proposed in this area. Additionally, RF simulation development initiatives based on open-source libraries have gained popularity, demonstrating scalability and flexibility in extending physics models. This paper will discuss the advantages and disadvantages of using such a publicly available FEM library.
Superconducting transmons can be configured as qubits and can also be used for weak signal axion searches. During a prior LDRD (17-ERD-006), a robust capability for system simulation and analysis, algorithm development, algorithm to FPGA workflow and experimental measurements was developed. During that project it was determined that a new software-defined radio FPGA would be a significant improvement in cost, simplicity, and software maintainability over the X6-1000M FPGA plus RF front-end system that had been used. In this Feasibility Study, we successfully developed the interface to the new NI USRP-2954R SDR platform, generated and optimized the VHDL of the existing algorithms, and experimentally tested the new FPGA system on real qubit in the laboratory. These tests showed it had the same SNR on weak measurements as the prior FPGA.
Quantum networks are considered the future of secure communication in the coming quantum era. Yet there lack significant efforts on developing practical quantum networks for power grids. Here, in this paper, we establish a quantum network-based power grid (QNetGrid) framework and develops a real-time, reliable, flexible, programmable, and cost-effective QNetGrid software testbed containing repeater-based quantum communication, quantum routing, real software-defined networking (SDN) switches, and real-time networked microgrids (NMs) operations. It makes the following contributions: 1) a repeater and routing based quantum network simulator (QNSim) is developed, 2) repeaters with and without quantum memories are respectively simulated in QNSim, 3) different routing scenarios in QNetGrid are investigated, 4) a real-time QNetGrid software testbed is built in RTDS incorporating QNSim and real SDN switches, and 5) various test cases are designed, and experimental results produced with the QNetGrid testbed provide valuable insights for building quantum networks in power grids.
A tool was developed to rapidly generate synthetic gamma-ray spectra to evaluate safeguards material control and accounting methods for liquid-fueled molten salt reactors. Molten salt reactor operations pose unique challenges to nuclear safeguards methods and protocols compared to deployed reactors designs (e.g., light water reactors). This research evaluates the use of gamma-ray spectroscopy to monitor fission product isotopic flow through a reactor model to understand expected operations and investigate changes to the spectra with material diversion scenarios. The large design space of molten salt reactors (e.g., liquid-fueled, liquid-cooled, online separations) could potentially lead to many measurement points within the reactor system. The developed analytical tool generates and evaluates synthetic gamma-ray spectra from dynamic reactor simulations by extracting isotopic inventory to generate source terms. An implementation in the Gamma Detector Response and Analysis Software (GADRAS) Application Program Interface (API) uses the source terms, a model of the reactor component, a detector response function, and measurement plan to quickly generate and analyze spectra. Prospective measurements are then evaluated in the more accurate but slower Geant4 simulations. Utilization of the developed modeling tool and analysis of the subsequent spectra enables optimization of collimation, shielding requirements, and expected count rates that are used to determine key measurement points in the modeled reactor design.
Distributed energy resources (DERs) are continuing to grow due to regulatory, policy, and market shifts, and it needs to be ensured that small DERs are given a level playing field with traditional resources. Legacy market processes such as unit-commitment problems were designed for a power grid consisting largely of centralized power plants. In contrast, DERs consist of many small devices with distinct operating characteristics that may or may not be connected at the transmission interconnection points, limiting their visibility to the independent system operators (ISOs) who operate wholesale electricity markets. This report details the development and initial results from a simulation platform that integrates state-of-the-art security-constrained unit commitment software, detailed feeder models, and a DER aggregator model to quantify potential DER integration issues. Quantitative results to date illustrate potential infeasible scheduling solutions from SCUC when the DERA includes aggregations of energy-limited energy storage resources. Likewise, if aggregations are not penalized for dispatch deviations, they may have incentives to deviate from the SCUC-determined resource schedules. Assumptions about the amount of aggregated demand response resources (DRRs) and the ability of DERAs to follow profit incentives have an important impact – DRRs have significant flexibility and can typically feasibly meet their SCUC schedule, but on the other hand, their profit incentives can cause unscheduled increases in load before and after DRR dispatch. Computation time results on the SCUC solver and simulation platform only show a modest increase in SCUC solution time as the number of DERAs is increased, but results to date only reflect the RTS-GMLC test system; results may show more significant solver slowdown in larger transmission systems. The largest contribution to simulation time is attributed to the DERA offer generation method, which is suggested for future improvements.
Modifications to the Computational Fluid Dynamic (CFD) software ANSYS Fluent were done to quantify and characterize tritium transport in Gas-Liquid Contactors (GLCs). A double-slit, Ergun-like equation was employed for the porous media model, with Ergun coefficients validated with Sulzer’s Sulcol software. Tritium transport from PbLi within the GLC was verified against analytical models. The geometry of the CFD model was based on the MELODIE GLC experiment. The hydrodynamic CFD pressure drop results align well with SulCol estimations and fall between the predictions of the analytical Delft-Olujic and Billet & Schultes models. In terms of mass transfer efficiency, traditional mass transfer models showed a significant deviation from experimental results when using varying values of H solubility in PbLi. A saturation phenomenon occurred when utilizing high solubility values for hydrogen in PbLi. In conclusion, a modified film theory mass transfer coefficient, incorporating either the Delft-Olujic or Billet & Schultes wettability model, yielded CFD-predicted extraction efficiencies that closely matched experimental measurements.
The last 2 years have been a period of unprecedented growth for the MOOSE community and the software itself. The number of monthly visitors to the website has grown from just over 3,000 to now averaging 5,000. In addition, over 1,800 pull requests have been merged since the beginning of 2020, and the new discussions forum has averaged 600 unique visitors per month. The previous publication has been cited over 200 times since it was published 2 years ago. This paper serves as an update on some of the key additions and changes to the code and ecosystem over the last 2 years, as well as recognizing contributions from the community.