Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Simulation software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Developing And Scaling an OpenFOAM Model to Study Turbulent Flow in a HFIR Coolant Channel

Improving the understanding of how computational fluid dynamics (CFD) direct numerical simulations (DNS) of flows in the High Flux Isotope Reactor (HFIR) perform when run in parallel using the high performance computing (HPC) platform Summit at the Oak Ridge Leadership Computing Facility (OLCF) is of particular importance to boost the computational tools used to support HFIR conversion to low enriched fuel (LEU). Evaluation of scaling performance was driven by the increasing importance of graphics processing unit (GPU) usage in HPC, which is becoming the standard for modern supercomputers such as Summit. The desired results are to obtain a strong positive correlation between the computational resources dedicated to a problem and the relative speed-up of the simulation in comparison to a benchmark. This capability will allow substantially improvement in HFIR flow analytical capabilities, specifically when predicting turbulence properties at high Reynolds numbers. The study leverages previous simulation results performed with code PHASTA (finite element) on HPC platforms Cori (NERSC) and Theta (ALCF) [1] with computing options provided in the computing platform OpenFOAM (finite volume) at OLCF. Transitioning from PHASTA to OpenFOAM will (1) eliminate dependence on third-party software for mesh generation and manipulation, (2) reduce resource needs by employing modern architectures, and (3) build expertise for future modeling of HFIR-specific problems like heat transfer in involute geometry, entrance effects, flow structure in channel corners, and so on—all important issues when defining the available thermal margins in the transition to LEU. CPUs and GPUs differ significantly in their architecture and utilization, as discussed in the literature [2]. The most important differences are in the approach to computations and their memory. A single GPU contains a large quantity of cores, enabling it to perform with a much higher throughput than a CPU, but execution requires a different approach. GPU codes execute instructions using the Single-Instruction Multiple-Thread (SIMT) approach in which a single instruction is used for groups of threads called warps. A warp typically consists of 32 threads which must execute the same set of instructions, although on separate threads. Alternately, a CPU has far fewer cores that are much more flexible in their operation, excelling at quickly performing more complex serial computations. This is why GPUs have greater throughput when properly utilized. The second important difference is seen when comparing their memory spaces. Limited memory allocations and CPU–GPU communications cause a significant bottleneck in GPU-accelerated programs. Further study was required to properly take advantage of GPU resources. A comprehensive analysis of code performance and the model-specific features of turbulence constitutes the core of this work. In this study, a DNS simulation of HFIR channel turbulence was performed with the finite volume CFD code OpenFOAM v2112 and CUDA v11.0 on Red Hat Enterprise Linux v8.2. The OpenFOAM installation had AMGx integrated to enable GPU acceleration and utilizes the PETSc4FOAM library. The computational resources and the problem size were scaled on CPU and CPU + GPU architectures to gain a better understanding of the performance of a DNS problem on modern computing hardware. The study aimed to analyze the scaling of the code exclusively on CPUs and then to examine the scaling of the codes with GPU acceleration enabled. Scaling studies included CPU and GPU acceleration on a mesh of varying resolution to analyze the impact of problem size relative to computational resources. In the course of preparing the GPU configuration on Summit, mainly using the AMGX solvers, difficulties were encountered stemming from constant changes resulting from extensive ongoing development activities and the changing environment. This resulted in the inability to complete the GPU portion of the work. The code was compiled and tested, but production runs to assess acceleration were not performed because the used discretional compute time allocation expired as year-end approached. The Summit HPC platform is scheduled for decommissioning in 2024, making it unattractive for future use with Nvidia-based GPUs. Therefore, the work will be moved onto NERSC machines in FY24. An application was prepared and submitted, and sufficient node-hours were awarded to continue the research in the next calendar year. This report summarizes work performed thus far, which mostly focused on CPU OpenFOAM computing.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A methodology for generating reduced-order models for large-scale buildings using the Krylov subspace method

Developing a computationally efficient but accurate building energy simulation (BES) model is important for many purposes. Model order reduction (MOR) methods are attractive and much more reliable than identification approaches, since it directly extract a lower-dimensional model from a detailed physics-based model without any pre-simulations. However, because of computational and data storage requirements, there are challenges of applying these methods to a large-scale building. To overcome the problem, this work introduces the Krylov subspace method to the building science field. Technical issues of applying the method to building applications are addressed and a suitable algorithm that overcomes those challenges is presented. Furthermore, to demonstrate the reliability of the algorithm, comparisons between the resulted reduced-order model (ROM) and a high-fidelity model from a commercial BES software for a 60-zone case study building are provided. The ROM was a factor of 100 faster than the high fidelity model but with high accuracy.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Method for Rapid Modeling of Distortion in Laser Powder Bed Fusion Metal Additive Manufacturing Parts

The simulation and modeling of part-level distortion and residual stress in diverse metal additive manufacturing (AM) geometries has great potential to enable the rapid adoption of this technology in engineering design. Moreover, the use of additive manufacturing component libraries (CLs) offer a computationally efficient means of quantifying these part-level defects resultant from AM processing. We report on how the individual simulations of simple shapes, potential entries in a CL, can be superimposed to provide an indication of distortion and residual stresses in complex geometries. Laser powder bed fusion AM was used to construct test geometries of varied shapes and their combinations in the form of CLs in an effort to characterize location-dependent and feature-dependent distortion distributions. Blue light scanning was used to experimentally measure 3D distortions in order to investigate the interaction between the component shapes and local boundary conditions. Overall, part-level distortions were highly dependent on test component geometry, local boundary conditions, and shape combination. Commercial finite element software was used to verify experimental trends and to make predictions of distortion. The use of CLs resulted in over 20 times savings in computational cost while reproducing overall trends in distortion for test geometry assemblies. Therefore, it is anticipated that the use of CLs for L-PBF AM geometries has demonstrated potential to facilitate efficient simulations of full component AM assemblies, thereby reducing the need for costly trial-and-error-type experimental analysis.

36 MATERIALS SCIENCE↗

Universal Workflow Language and Software Enable Geometric Learning and FAIR Scientific Protocol Reporting

Written language and conventional data structures for representing scientific procedures suffer from low process detail, often fail to accurately represent protocols, and lack universality. New strategies for the handling of experimental data are needed to provide viable process information for both humans and machines. In this work, we present the universal workflow language (UWL) and interface (UWLi). UWL is a findable, accessible, interoperable, and reusable (FAIR)-compatible, graph-based data architecture that can capture arbitrary scientific procedures through workflow representation, and UWLi is an accompanying software package for building, manipulating, and interpreting UWL entries. The UWL format was found to be highly effective in identifying deficiencies in the reported process details of high-impact, peer-reviewed scientific journals, and in simulated scenarios, the graph format was shown to be more effective than conventional methods in predictively modeling the outcome of diverse scientific protocols. Implementation of UWL could enable more accurate scientific communication and more impactful process datasets.

14 SOLAR ENERGY↗

Towards Interactive, Reproducible Analytics at Scale on HPC Systems

The growth in scientific data volumes has resulted in a need to scale up processing and analysis pipelines using High Performance Computing (HPC) systems. These workflows need interactive, reproducible analytics at scale. The Jupyter platform provides core capabilities for interactivity but was not designed for HPC systems. In this paper, we outline our efforts that bring together core technologies based on the Jupyter Platform to create interactive, reproducible analytics at scale on HPC systems. Our work is grounded in a real world science use case-applying geophysical simulations and inversions for imaging the subsurface. Our core platform addresses three key areas of the scientific analysis workflow-reproducibility, scalability, and interactivity. We describe our implemention of a system, using Binder, Science Capsule, and Dask software. We demonstrate the use of this software to run our use case and interactively visualize real-Time streams of HDF5 data.

containers↗

kynema-fmb [SWR-23-07]

Kynema-FMB (FKA: Kynema) is an open-source performance portable flexible multibody (FMB) dynamics solver designed for time-domain simulations. While originally tailored for wind turbine structural dynamics, the formulation and implementation are those of a general flexible-multidbody dynamics solver that can readily be applied to a wide range of systems. Kynema was designed with a narrow focus, namely to provide a lightweight, fast, accurate FMD solver for coupling to computational-fluid-dynamics (CFD) codes, especially the CFD codes in the Kynema suite, for fluid-structure-interaction (FSI) simulations. Kynema-FMB is equipped to model systems that can be represented as a collection of beams and rigid bodies that are connected through constraints. Degrees of freedom are defined in the inertial/global frame of reference and include displacements and rotations (formally as rotation matrices, but stored as quaternions). The underlying formulation is built on a Lie-group time integrator designed for index-3 differential-algebraic equations, which is second-order accurate in time (Bruls et al., 2012). Beam models are based on geometrically exact beam theory and are discretized as high-order spectral finite elements similar to those in BeamDyn (Wang et al., 2017). The governing equations for a FMD system like a wind turbine constitute a highly nonlinear system of constrained partial-differential equations. Kynema-FMB uses analytical Jacobians in the nonlinear-system solves in each time step. Linear systems use sparse storage and several third-party sparse-linear-system solvers are enabled. Ill conditioning of linear systems is mitigated with preconditioning described in Bottasso et al, 2008. Kynema-FMB is integrated with a simple open-source controller (ROSCO). There is an application programming interface (API) for coupling to geometry-resolved CFD (like that in Sharma et al., 2023) and actuator-force CFD (like that in Kuhn et al., 2025). In the latter, for actuator-line models, Kynema-FMB includes an internal blade-element solver that depends on user-provided lookup tables for coefficients of lift and drag, i.e., aerodynamic polars. Kynema-FMB is written in C++ and leverages Kokkos and Kokkos-Kernels (KokkosEcosystem) as its performance portability layer enabling simulations on both CPU and GPU systems. The repository is equipped with extensive automated testing at the unit and regression/system levels. The following describes the high-level development objectives conceived for Kynema: *Kynema will follow modern software development best practices, including test-driven development (TDD), version control, hierarchical automated testing, and continuous integration (CI) for a robust development environment. *The core data structures are memory efficient and enable vectorization and parallelization at multiple levels. *Data structures are data-oriented to exploit methods for accelerated computing including high utilization of chip resources (e.g., single instruction multiple data (SIMD) instruction sets) and parallelization using GP-GPUs. *The computational algorithms incorporate robust open-source libraries for mathematical operations, resource allocation, and data management. *The API design considers multiple stakeholder needs and ensure integration with existing and future ecosystems for data science, machine learning, and AI. *Kynema-FMB is written in modern C++ and leverages Kokkos as its performance-portability library with inspiration from the kynema stack.

Sprague, MichaelA.↗

Ginkgo - A math library designed to accelerate Exascale Computing Project science applications

Large-scale simulations require efficient computation across the entire computing hierarchy. A challenge of the Exascale Computing Project (ECP) was to reconcile highly heterogeneous hardware with the myriad of applications that were required to run on these supercomputers. Mathematical software forms the backbone of almost all scientific applications, providing efficient abstractions and operations that are crucial to harness the performance of computing systems. Ginkgo is one such mathematical software library, nurtured by ECP, providing high-performance, user-friendly, and performance portable interfaces for applications in ECP and beyond. In this paper, we elaborate on Ginkgo’s philosophy of high-performance software that is sustainable, reproducible, and easy to use. We showcase the wide feature set of solvers and preconditioners available in Ginkgo and the central concepts involved in their design. We elaborate on four different ECP software integrations: MFEM, PeleLM + SUNDIALS, XGC, and ExaSGD that use Ginkgo to accelerate their science runs. Performance studies of different problems from these applications highlight the effectiveness of Ginkgo and the benefits incurred by these ECP applications.

Cojean, Terry↗

Unified differentiable digital twin for the IOTA/FAST facility

As the design complexity of modern accelerators grows, there is more interest in using advanced simulations that have fast execution time or produce insights about accelerator state. One notable example of additional information are gradients of physical observables with respect to design parameters produced by differentiable simulations. The IOTA/FAST facility has recently begun a program to implement and experimentally validate a unified start-to-end differentiable digital twin to serve as a virtual accelerator test stand, allowing for rapid prototyping of new software and experiments with minimal beam time costs. In this contribution we will discuss our plans and progress. Specifically, we will cover the selection and benchmarking of both physics and ML codes, the development of generic interfaces between device models and surrogate or physics-based sections, and the export of the parameters through either a deterministic event loop or a fully asynchronous EPICS soft input/output controller. We will also discuss challenges in model calibration and uncertainty quantification, as well as future plans to support larger proton accelerators like PIPII and Booster.

Kuklev, Nikita [Fermilab]↗

An Empirical Model For Intrinsic Alignments: Insights From Cosmological Simulations

We extend current models of the halo occupation distribution (HOD) to include a flexible, empirical framework for the forward modeling of the intrinsic alignment (IA) of galaxies. A primary goal of this work is to produce mock galaxy catalogs for the purpose of validating existing models and methods for the mitigation of IA in weak lensing measurements. This technique can also be used to produce new, simulation-based predictions for IA and galaxy clustering. Our model is probabilistically formulated, and rests upon the assumption that the orientations of galaxies exhibit a correlation with their host dark matter (sub)halo orientation or with their position within the halo. We examine the necessary components and phenomenology of such a model by considering the alignments between (sub)halos in a cosmological dark matter only simulation. We then validate this model for a realistic galaxy population in a set of simulations in the Illustris-TNG suite. We create an HOD mock with Illustris-like correlations using our method, constraining the associated IA model parameters, with the $\mathcal{X}$$^{2}_{dof}$ between our model’s correlations and those of Illustris matching as closely as 1.4 and 1.1 for orientation–position and orientation–orientation correlation functions, respectively. By modeling the misalignment between galaxies and their host halo, we show that the 3-dimensional two-point position and orientation correlation functions of simulated (sub)halos and galaxies can be accurately reproduced from quasi-linear scales down to 0.1 $\mathcal{h}$ –1 Mpc. We also find evidence for environmental influence on IA within a halo. Our publicly-available software provides a key component enabling efficient determination of Bayesian posteriors on IA model parameters using observational measurements of galaxy-orientation correlation functions in the highly nonlinear regime.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Optimal Operation of Residential High Performance Water Heater for Reduction of Electricity Cost and Peak Demand Through Field Validation

Water heating accounts for about 18% of a typical US home’s energy use. Modern water heaters have enabled control options through APIs, offering customers the opportunity to reduce their energy cost and peak demand by dynamically adjusting settings. A water heater’s capacity to store energy using its storage tank makes it an asset for peak demand reduction and energy cost savings. For this reason, a mixed-integer linear programming model is proposed to minimize the energy cost of a high-performance water heater while also reducing the peak demand of the residential household under a time-of-use utility rate by dynamically changing the water heater’s running mode. Specifically, a multi-objective optimization model is formulated to determine the mode settings of the water heater considering hot water use, time-of-use rate, and peak demand limit of the residential household. The mode settings are associated with different dead bands of water temperature for triggering on/off action of the heat pump and heating element. A 66-gal hybrid electric high performance water heater was used for numerical simulation and practical experiments. The simulation results were well aligned with measurements of practical experiments, validating the soundness of the thermodynamic model. In addition, reductions of energy cost, enabling affordability, and reducing peak demand are demonstrated. The research team also developed a software framework with dashboards to automatically and continuously monitor and manage devices.

Liu, Guodong [ORNL] (ORCID:0000000213498608)↗

Modeling receiver flux of commercial power tower concentrating solar power plants using ray tracing: a round-robin comparison of SolTrace, Solstice, and TieSOL

This study presents a multi-stage, cross-validation comparison of three software packages for Monte Carlo ray tracing (MCRT) applied to central tower concentrating solar power (CSP) systems. The three packages evaluated are: (1) SolTrace, an open-source tool developed by the National Renewable Energy Laboratory (NREL); (2) Solstice, an open-source program created by CNRS-PROMES and Meso-Star, with enhancements for CSP applications (called solsticepy) from the Australian National University; and (3) TieSOL, a commercial software developed by Tietronix. This investigation extends previous ray tracing comparisons by incorporating models of multi-facet heliostats within a commercial-scale solar field, taking into account zoned focal lengths and canting configurations. Receiver flux distributions were compared across the tools using a series of case studies, including single-heliostat scenarios, isolated blocking situations, and comprehensive full-field simulations. The case studies were designed to diagnose differences across the models at varying levels of complexity, and to identify and resolve discrepancies as additional parameters were introduced. Key factors examined in the analysis include sun positions, heliostat location, facet and canting focus, and aimpoint strategies. The comparison aims to improve the accuracy and reliability of these tools while providing benchmark cases for validating future optical modeling tools.

14 SOLAR ENERGY↗

2021 NIRT Mini Drill (After Action Report)

During the summer and fall of 2021, several functional area drills were held that focused on exercising Consequence Management’s (CM) ability to extract and use data from RadResponder for the purpose of answering intermediate-phase questions presented as technical inject requests for information (RFI) in Sandia National Laboratories (SNL) Consequence Management Operational System (COSMOS) software. The scenario chosen was that of Northern Lights 2016 (NL16) which was a large-scale nuclear power plant (NPP) release exercise in the state of Minnesota. The NL16 data was extracted from the Radiological Assessment and Monitoring System (RAMS) event where it was created and was reformatted for implanting to a new RadResponder event. Next, the beta-version of a laboratory sample data simulator was used to generate more sample data that was injected to the event. Five “mini-drills” were devised with each prompt defined by a data-based need. For each drill, a team of assessment and NARAC scientists worked the problem using the drill prompt and the available data in RadResponder. The teams held a kickoff meeting, had several days to work the problem, and then reported their results as well as observations in a hotwash. Several areas for improvement in both the software and process were identified during the course of these drills. This report will document the process of addressing each RFI and the discovered gaps in both software capability and methodology so that they can be considered for future development and investment by the CM and NIRT programs.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

New Physics in the Hot Electron Furnace (Final Report)

The primary purpose of this award was experiments and simulations related to the idea of a ‘Hot Electron Furnace’ where nonlocal heat transport would allow unique new experimental opportunities at x-ray free electron lasers. The period of this award included beamtime at the MEC endstation of the LCLS, and the execution of those experiments was a primary goal. Unfortunately, the beamtime had limited success due to (1) inability of the LCLS to deliver the expected two-color operations mode, and (2) failure of the MEC endstation’s own software to save the cavity timing data that would have allowed inference of time delays for the few hours when two-color mode briefly operated. The beamtime was then switched to operate in single-color (one pulse) mode, and studies were performed of x-ray heating and probe, simultaneously. Two interesting manuscripts are finally near submission, having been delayed by student graduations, need for collaborator simulations of x-ray heating processes, and then COVID. I am hopeful that they will soon be submitted (especially the paper on x-ray heating of MgO) because one of the principal students involved has returned from industry to take a postdoc position at SLAC. Below, we first list all publications and other work products (including the two that are nearing submission) and then summarize several outcomes from this effort. During the term of this award three UW physics graduate students were at least partially supported, and all three received their Ph.D.’s with significant components of their supported work in the dissertation.

47 OTHER INSTRUMENTATION↗

Comparing Early Evolution of Flames in X-Ray Bursts in Two and Three Dimensions

We explore the early evolution of flame ignition and spreading on the surface of a neutron star in three dimensions, in the context of X-ray bursts. We look at the nucleosynthesis and morphology of the burning front and compare to two-dimensional axisymmetric simulations to gauge how important a full three-dimensional treatment of the flame is for the early dynamics. Finally, we discuss the progress toward full-star resolved flame simulations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Caldera_Grid

Caldera Grid is part of Caldera software platform, a suite of collective, open-source tools that was developed to improve the state of the art in modeling the impacts of Electric Vehicle (EV) charging on the grid. Caldera Grid is a co-simulation framework implemented using Hierarchical Engine for Large scale Infrastructure Co-Simulation (HELICS). The framework facilitates the co-simulation of EV charging and Smart Charge Management (SCM) strategies in Caldera Infrastructure Charge Model (ICM) with distribution level grid models in OpenDSS. Vehicle energy needs and charge session requirements generated using Caldera Charge Decision Module (CDM) are fed in as input to Caldera Grid. The EV charging models in Caldera ICM simulates both the uncontrolled charging loads as well as loads modified by the SCM strategies to develop distributed load profiles for each grid node hosting an Electric Vehicle Supply Equipment (EVSE) – also known as chargers. These loads were simulated in OpenDSS alongside existing distribution feeder loads. Each of these models are co-simulated in a HELICS federate. The HELICS co-simulation framework facilitates communication and synchronization between the federates. By co-simulating EV loads and distribution feeder loads, Caldera Grid can assess the potential grid impacts of EV charging on distribution feeders under various grid conditions. A control strategy federate is implemented with an interface where control strategies based on feedback from EV charging status and grid conditions can be developed and implemented. The platform can also support multiple control strategies in a single co-simulation.

Sundarrajan, ManojKumar Cebol↗

BASS: An R Package for Fitting and Performing Sensitivity Analysis of Bayesian Adaptive Spline Surfaces

In this work, we present the R package BASS as a tool for nonparametric regression. The primary focus of the package is fitting fully Bayesian adaptive spline surface (BASS) models and performing global sensitivity analyses of these models. The BASS framework is similar to that of Bayesian multivariate adaptive regression splines (BMARS) from Denison, Mallick, and Smith (1998), but with many added features. The software is built to efficiently handle significant amounts of data with many continuous or categorical predictors and with functional response. Under our Bayesian framework, most priors are automatic but these can be modified by the user to focus on parsimony and the avoidance of overfitting. If directed to do so, the software uses parallel tempering to improve the reversible jump Markov chain Monte Carlo (RJMCMC) methods used to perform inference. We discuss the implementation of these features and present the performance of BASS in a number of analyses of simulated and real data.

97 MATHEMATICS AND COMPUTING↗

Virtual Engineering: Python framework for engineering process design

Virtual Engineering (VE) is a Python software framework designed to accelerate the research and development of engineering processes that are fundamentally defined by multiple unit operations executed in series. VE supports a wide variety of different multi-physics models and integrates them to simulate a complete end-to-end process. To automate the execution of this model sequence, VE provides (i) a robust method to communicate between models, (ii) a high-level, user-friendly interface to set model parameters and enable optimization, and (iii) an overall model-agnostic approach that allows new computational units to be swapped in and out of workflows. Although the VE framework was developed to support the biochemical conversion of biomass to fuel, we have designed each component to easily accommodate new domains and unit models.

09 BIOMASS FUELS↗

Status of EM Pump Modeling Capability for VTR

SAS4A/SASSYS-1 is a simulation tool used to perform deterministic analyses of anticipated events as well as design basis and beyond design basis accidents for advanced liquid-metal-cooled nuclear reactors. Most recently, SAS4A/SASSYS-1 has been selected as the safety analysis software for the Versatile Test Reactor (VTR), a new materials testing Sodium Fast Reactor (SFR) to be built by the Department of Energy. In order to support analysis of the VTR, which will utilize ElectroMagnetic (EM) pumps as the primary coolant pumps, the development of new EM pump modeling capabilities has been initiated for SAS4/SASSYS-1. The new physics-based EM pump model captures systems-level transient performance based on equivalent circuit theory and is highly flexible to model a wide range of electromagnetic pumps of the three-phase linear induction type subject to changes in power supply and plant conditions. Within the equivalent circuit framework, two sub-models are developed to provide options for analysts both with and without a detailed geometric characterization of their pump such that minimal information is required to achieve a realistic working model, but specific details of a particular pump design may be captured if sufficient information is provided. In addition, heat generated from pump operation and its transport through the plant system can be modeled to better capture the behavior of certain transients. This paper will outline the model and derive the governing equations of the new EM pump model. An initial comparison between the simple EM pump model and experimental data is made. This comparison shows that the equivalent circuit model can capture pump performance, with greater accuracy near the rated conditions. In order to demonstrate the transient behavior of the new model, a simple transient with an EM pump replacing the centrifugal pumps in the Advanced Burner Test Reactor is included.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗