Rocstar Multiphysics Modernization, Enhancement and Cloud Interface Development
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Direct Numerical Simulations of realistic combustion devices are extremely challenging due to the wide separation of scales in the simulation, for example an internal combustion (IC) engine chamber, and the flame thickness of a high-pressure flame. The PeleLMeX solver uses adaptive mesh refinement (AMR) to evolve multi-species reacting flows in the low Mach number limit at the Exascale and relies on an embedded boundary (EB) approach to represent complex geometries. In that framework, the EB geometries often give rise to very small cut-cells along the boundary, which translate into extreme ill-conditioning of the pressure-projection, with eigenvalues that span 15-16 orders of magnitude. In this talk, we focus on the case of a typical IC piston bowl geometry for which we present on a novel approach towards solving these nearly singular linear systems with ILU-based, C-AMG smoothers on massively parallel architectures. In particular, we use scaling and equilibration algorithms to handle the non-normality of the upper triangular factors. This enables us to approximate the highly sequential triangular solve algorithm, embedded in the AMG smoothing-solve phase, with Jacobi iterations. This approximation can be written as a convergent Neumann series whose terms are composed of highly parallel sparse matrix vector multiplications. The result is an algorithm that substantially decreases setup and solve time, compared to state-of-the-art, for these challenging linear systems.
Rotating detonation engines (RDEs) hold great promise as a technology for powering aviation engines. The pressure gain that results from continuously traversing detonation waves enables high theoretical performance compared to deflagration-based combustion. However, the harsh operating conditions inside an RDE restrict the availability of suitable experimental diagnostics to study these systems in detail and the range of spatial and temporal scales render numerical simulations of these systems difficult. In this study, we have combined adaptive mesh refinement and a robust shock-capturing approach to study RDE systems computationally using the compressible, reactive solver PeleC. Multi-species transport along with compressible Navier-Stokes equations are solved in the model along with finite-rate chemistry. Complex geometries are represented using an embedded boundary method with second-order spatial accuracy and the system is evolved in time using a second-order Runge-Kutta method. We present studies of a methane-air RDE system that is doped with varying levels of hydrogen. Our analysis focusses on how fuel mixture and doping levels effect the detonation flame structure and the generation of multiple wave modes.
High fidelity simulations of realistic combustion devices are extremely demanding computationally because of the requirements to capture complex fuel chemical decomposition, its intricate interactions with turbulent, often multiphase, flows, and the wide separation of space and time scales between the thin flame and the device boundaries. Software required to carry out such computations tends to be extremely complex, particularly when designed to exploit hardware accelerators, and can be difficult to port and maintain. We present Pele, a performance portable suite of tools for the simulation of combustion systems, including codes to evolve reactive multiphase configurations in the low Mach number and compressible flow regimes, along with a set of inter-compatible post processing and in situ analysis tools. The Pele suite of tools is built on top of the AMReX framework for block-structured adaptive mesh refinement, which provides efficient data structures and algorithms that enable the development of a wide variety of efficient mesh and particle based PDE integration schemes. A hierarchical MPI+X parallelism scheme supports CPU-only and accelerated architectures, where X can be OpenMP, CUDA, and HIP based approaches for intra-node computational work distribution. The algorithms and data structures underlying the Pele simulation and analysis tools are highly scalable and performant across a wide variety of high-performance computing platforms, including DOEs newest exascale-class machines, Frontier and Aurora. The simulation and analysis tools are fully documented and freely distributed as open source via GitHub. We present key algorithmic and software challenges, solution strategies, performance and resulting set of capabilities.
Applying electric fields to flames can provide an effective, non-invasive control of the combustion process. In this work, an algorithm recently introduced to handle the interactions between reactive flows and an electric field is extended to handle multiple dimensions and adaptive mesh refinement (AMR), and applied to a series of laminar flames. Experimental data allows to validate the ability of the algorithm to capture the mechanisms driving the flame response to electric fields.
Applying electric fields to flames can provide an effective, non-invasive control of the combustion process. In this work, an algorithm recently introduced to handle the interactions between reactive flows and an electric field is extended to handle multiple dimensions and adaptive mesh refinement (AMR), and applied to a series of laminar flames. Experimental data allows to validate the ability of the algorithm to capture the mechanisms driving the flame response to electric fields.
The atypical combustion properties of hydrogen have long provided an interest for hydrogen-enriched combustion, emphasized in recent years by increasingly stringent emission regulations. Significant work has been focused on the small hydrocarbon(C1-C3)/hydrogen blends, but much less is known about the effect of hydrogen on heavier hydrocarbon combustion, of interest for the aviation and automotive industry. In this work, we perform direct numerical simulations (DNS) of spherically expanding laminar n-dodecane/H2 flames in a constant-volume vessel at elevated pressure and a range of hydrogen seeding levels. A low Mach number model is used to represent the gas and flame dynamics allowing for a temporally varying, spatially homogeneous pressure field, while also enabling numerical evolution of the system numerically at time step sizes governed by the advective CFL limit rather than acoustic processes. We use an adaptive mesh refinement (AMR) approach to tackle the large separation of scales associated with high pressure premixed flame surfaces propagating in a laboratory-scale closed domain. We incorporate detailed chemistry and transport models for the reacting flow and focus the analysis on the effects of the pressure rise on the flame propagation characteristics and morphology as the hydrogen content is increased. The presence of fast diffusive H2 and the pressure rise results in dramatic thinning of the flame and the potential onset of hydrodyanmic and theromdiffusive instabilities. We assess the potential role of these instabilities on the ability to accurately measure laminar burning speed experimentally based on the mean flame surface propagation speed.
Rotating detonation engines (RDEs) have gained attention as a promising technology for future aviation engines. However, the numerical studies of these systems pose severe challenges due to the broad range of spatial and temporal scales. In this study, we use an adaptive mesh refinement based compressible, reactive solver PeleC to resolve the broad range of scales and accurately capture shock and detonation waves using high-resolution numerical schemes. Multi- species transport along with compressible Navier-Stokes equations are solved in the model along with a finite-rate based chemistry model. Embedded boundary method is used to model the complex geometry consisting of discrete fuel nozzles and the combustion chamber. The fuel consisting predominantly of hydrogen is doped with varying levels of methane while air is used as the oxidizer. For a specified total pressure and temperature, the number of stable detonation waves is found to decrease with increasing methane concentration in the fuel mixture. Additionally, no stable detonation solutions are observed for methane composition higher than 20% by volume for the range of operating conditions studied (300-900K, 10 Atm). The increased presence of high temperature zones is also indicative of higher thermal NOx emissions at low methane concentrations. The effect of fuel-air mixture composition and temperature on the detonability, detonation wave structure, mode transitions and their stability are analyzed in this study in addition to their implication on NOx emission.
Due to downsizing trends, flame-wall interaction (FWI) is increasingly prominent in gas turbines (GTs). FWI has direct consequences on flame stabilization and pollutant emissions, but it is not well understood in turbulent flows representative of GTs. We present results from a direct numerical simulation (DNS) of a turbulent CH4/H2 model GT low-swirl laboratory-scale flame interacting with an inclined wall. The results from the laboratory flame include simultaneous measurements of velocity using stereo particle imaging velocimetry and OHxCH2O planar laser induced fluorescence. The adaptive-mesh refinement solver PeleLMeX is used, with 24-species, 105-reaction reduced Aramco chemical kinetics mechanism. The premixed fuel-air mixture consists of hydrogen-enriched methane with 70% hydrogen volume fraction and 0.4 equivalence ratio. The inflow is prescribed to match experimental measurements at the burner exit. Karlovitz and turbulent Reynolds numbers are 300 and 400, respectively. The simulation and experimental results show excellent agreement. The flame features a bowl-shape stabilization, with a corrugated, continuous flame front at the leading edge, followed by fragmented reaction zones downstream. A large diffuse cloud of CH2O is formed downstream of the quenching point. The simulation results indicate that the cloud of CH2O is the result of incomplete methane combustion, with CH2O "leaking" from the locally quenched reaction zones.The DNS provides fine-grain resolution of turbulence-flame-wall interaction that cannot be captured with experimental measurements. With access to the entire solution vector at each cell of the computational domain, the local quenching.
Multi-fuel, advanced injection strategies have become increasingly promising as a strategy to mitigate the emissions generated from internal combustion engines. By carefully controlling the combustion phasing in-cylinder, these new multi-pulse, multi-fuel injection strategies are able to burn in the low-temperature combustion regime where both NOx and soot are not readily produced, reducing the need for extensive exhaust gas recirculation systems. In this study, we examine a reactivity-controlled compression ignition (RCCI) strategy that uses an early pre-filled methane-air mixture with low turbulence background as the low-reactivity fuel and a direct injection of four discrete dodecane jets as a surrogate for the high-reactivity diesel fuel. We use the Pele software suite, a highly optimized, exascale-ready, adaptive mesh refinement codebase to perform high-resolution numerical simulations of a scaled down, single cylinder from the RCCI engine. Here, we resolve the ignition kernels down to micrometer scales and present several statistical quantities evaluating the development of the flow and detailing the onset of ignition and subsequent flame development. Particular attention is paid to the conditions surrounding the onset of the first ignition kernels and discussing what led to the development of those conditions.
We present a case study of catalytic propane dehydrogenation with our open-source multiphysics solver, Mesoflow. The solver was developed to simulate reactive flow coupled to heterogeneous catalytic reactions and deactivation in the context of complex, mesoscale geometry. The method leverages cartesian block-structured adaptive mesh refinement to capture realistic catalyst microstructural features acquired directly from X-ray computed tomography data. A kinetic model for propane dehydrogenation and catalyst deactivation was developed based on temporal analysis of products (TAP) reactor experiments. The TAP reactor experiments allow for precise characterization of intrinsic kinetic reaction steps which are implemented into Mesoflow simulations to model the spatial and temporal evolution of reactants, products, and catalyst active sites. The short-term and long-term deactivation behavior is studied by using XCT data collected from fresh and aged catalyst pellets, which exhibit different microstructural features. This study employs time-splitting algorithms to connect disparate reaction and flow timescales, enabling the simulations to achieve realistic deactivation timescales on the order of minutes while the flow time-scales for small particles (100 microns) are several milliseconds. We also introduce a flexible automated python script that writes the necessary files to construct a Mesoflow simulation from user-created chemical mechanisms. We will also introduce a few new features that are added to Mesoflow such as higher order schemes, implicit chemistry integrators and the ability to run on AMD and NVIDIA graphics-processing-units.
The reference solution for the management of low and intermediate level short-lived waste (LILW) in France consists in their emplacement in concrete vaults built at the near-surface. The corresponding disposal facility under operation by the French waste management organization (Andra), is located in North-eastern France and planned to be closed in 2060. The safety case developed by Andra has to show the evidence that, amongst other aspects, the radionuclide transfer through the confinement barriers will occur in such a way that the human and environmental exposure will be as low as reasonably achievable (ALARA) and in accordance with the dose constraints. For this purpose, modelling is used to integrate uncertainties about the characteristics of concrete components, waste and water table and their evolution in time and space. At last, modelling is finally used to investigate the radiological impact of specific scenarios in which the failure of safety barriers occurs. In the frame of its technical review of the safety assessment, the French Institute for Radiological Protection and Nuclear Safety (IRSN) also performs such kind of numerical modelling of radionuclide fate from the waste to the hydrogeological outlets, in order to check whether the assessment performed by Andra takes into account sufficiently conservative assumptions. The present work aims to evaluate the role of components of the vaults on radionuclide transport during the post-closure period over a few thousand years. For this purpose, IRSN carries out numerical calculations with MELODIE software, which simulates water flow and transport of species, in order to simulate radionuclide migration from waste packages emplaced in a concrete vault to the surrounding groundwater. The developed transport model focuses on 3-H radionuclide and integrates Andra's main assumptions (release model from the waste packages, chemical and hydraulic properties of the vault components, shrinkage and cracks in concrete components). An adaptive mesh method, based on an a posteriori error estimator, was used to model the cracks and the consideration of a strong heterogeneity in the hydraulic and transport parameters values in the different components of the model. This method shows an improvement of results of about 40 times, whereas the mesh size was increased by only 2%. (authors)
Thermal hydraulic predictions of flow regimes within nuclear reactor cores require significant computational resources and accuracy to ensure that the core design does not violate the thermal limits of materials. Multiphase computational fluid dynamics (CFD) has become a valuable computational capability for predicting flow characteristics as they relate to applications such as nuclear reactor safety and mixing phenomena around spacer grids within fuel assemblies. Multiphase CFD requires closure relationships for both the effects of turbulence as well as the transfer of mass, momentum, and energy between phases. Understanding the sensitivity of the parameters used in closure relationships is important for improving accuracy, but performing rigorous sensitivity analysis is computationally expensive. Adjoint mathematics have been utilized for reactor physics and fluid dynamics applications with respect to verification, sensitivity analysis, adaptive mesh refinement, and optimization. The usage of adjoint methods to predict the sensitivities of a variety of closure relationship parameters within a given problem has been shown to return sensitivity responses with significantly fewer computations than normal 'large-scale' methods. As the complexity of multiphase CFD methods increases, the demand for accurate verification tools and improvements in computational efficiency also increases, making the development of adjoint capabilities an attractive option. Closure relationships that describe interphase momentum physics in multiphase CFD modelling rely heavily on prescribed constants determined from experimental data. Due to the computational efficiency of an adjoint approach, the time to derive these closure relationships could be dramatically reduced, and data assimilation techniques could be used to return probability density functions of closure models derived using experimental data. This work develops a multiphase adjoint capability for the Eulerian-Eulerian two field, two phase equations. Specifically, the adjoint capability has been developed for the sub-cooled nucleate boiling solver boilEulerFoam developed by Dr. Nam Dinh of NC State University within the open-source CFD library OpenFOAM.
Oxycombustion in supercritical carbon dioxide is an integral part of the Allam Cycle, a technology that enables carbon-neutral use of fossil-fuels and carbon-negative use of biofuels. We simulate oxycombustion in a realistic combustor geometry for two sets of fuel conditions: pure methane, and a 40 percent methane/60 percent carbon dioxide blend, both at 343.15 K. The fuel jet mixes with a preheated swirler of 20 percent oxygen and 80 percent carbon dioxide at 1005.35 K, with a 100 percent carbon dioxide coflow at 783.15 K. The entire system operates at a pressure of 300 bar, putting the entire system above the critical temperature and pressure of carbon dioxide. Simulations are performed using PeleC, a compressible block-structured adaptive-mesh refinement (AMR) reacting flow code. Direct comparison of results using thermodynamically self-consistent implementations of the ideal gas equation of state and the Soave-Redlich-Kwong (SRK) equation of state allow quantification of the real gas impacts on combustion kinetics, flow temperatures, and pollutant formation.
Electrification and use of renewable hydrogen is currently a necessity for decarbonizing the iron-and-steel industry. In this regard, hydrogen plasma smelting reduction (HPSR) is a novel pathway that is being explored for reduction of iron ore. HPSR provides several decarbonization merits compared to conventional blast furnaces. Firstly, the use of renewable hydrogen drastically reduces the CO2 emissions compared to the use of coke. Secondly, renewable electricity in the form of a thermal plasma for making reactive hydrogen species (radicals, ions) are more efficient at reducing iron ore compared to neutral H2. Thirdly, a molten product compatible with downstream processes is obtained from the intense heat transfer from the plasma. However, the scale-up of this technology requires fundamental exploration of hydrogen plasma dynamics and its interaction with complex solid material that include phase changing iron-ore and slag. In this work, we present a first principles continuum scale model for thermal plasmas in Ar/H2 gas mixtures typically used for HPSR. The thermal plasma governing equations for mass, momentum and energy with Lorentz force and Joule heating source terms are solved along with electromagnetic equations for electrostatic and magnetic vector potential. Our solver will be based on Pele, a suite of reacting flow solvers designed for advanced scientific computing architectures (Henry De Frahan et al., Proceedings of SIAM Parallel Processing, 13-25, 2024), and will utilize adaptive mesh generation for enhanced resolutions at locations of intense physicochemical interactions. This study will present the impact of Ar to H2 ratios on excited/dissociated hydrogen species concentrations, plasma temperature and conductivity along with the impact of outgassed species (water, metal vapor, O, OH radicals) from ore surface on gas phase chemistry. Furthermore, the heat and species flux to the surface will be quantified as a function of applied voltages in a transferred arc configuration.
Iron and steel production accounts for approximately 8% of global carbon dioxide (CO) emissions. Pathways to decarbonize include replacing fossil fuels in iron ore reduction and electrifying other steelmaking processes. Iron pellets produced by hydrogen, called Hydrogen Direct Reduced Iron (HDRI), have property differences from those produced using conventional DRI processes. These differences may impact melting in electric arc furnaces (EAF) and other downstream processes. The physical properties of iron pellets vary significantly with temperature during heating, complicating predictions of their behavior. In this project, we seek to develop an integrated simulation, including the fluid flow and convective thermal transport around the pellet particle. We also examine conduction and phase changes within the particle as they impact the melting process. We use adaptive mesh refinement (AMR) to resolve both the changing size of the particle and the complex physics of the interaction between the pellet and the surrounding fluid. We base our simulations on the AMReX-incflo module, which allows large-scale Navier-Stokes simulation while resolving the changing particle size during melting. As we advance our numerical tools, we anticipate an improved understanding of the dynamics of HDRI melting, which will, in turn, accelerate the adoption of low-carbon technologies in the steelmaking industry.
We propose a new strategy for boundary conforming meshing that decouples the problem of building tetrahedra of proper size and shape from the problem of conforming to complex, nonmanifold boundaries. This approach is motivated by the observation that while several methods exist for adaptive tetrahedral meshing, they typically have difficulty at geometric boundaries. The proposed strategy avoids this conflict by extracting the boundary conforming constraint into a secondary step. We first build a background mesh having a desired set of tetrahedral properties, and then use a generalized stenciling method to divide, or “cleave”, these elements to get a set of conforming tetrahedra, while limiting the impacts cleaving has on element quality. In developing this new framework, we make several technical contributions including a new method for building graded tetrahedral meshes as well as a generalization of the isosurface stuffing and lattice cleaving algorithms to unstructured background meshes.
In this paper, we present a multi-threaded approach for the automatic load balancing of adaptive finite element (FE) meshes. The platform of our choice is the EARTH multi-threaded system which offers sufficient capabilities to tackle this problem. We implement the question phase of FE applications on triangular meshes, and exploit the EARTH token mechanism to automatically balance the resulting irregular and highly nonuniform workload. We discuss the results of our experiments on EARTH-SP2, an implementation of EARTH on the IBM SP2, with different load balancing strategies that are built into the runtime system.