Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “adaptive meshing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Collaborative Research: A Model of Partially Ionized Plasma Flows with Kinetic Treatment of Neutral Atoms and Nonthermal Ions

Interactions of flows of partially ionized, magnetized plasma are frequently accompanied by the presence of both thermal and non-thermal (pickup) ion components. Such interactions cannot be modeled using traditional MHD equations and require more advanced approaches to treat them. If a nonthermal component of ions is formed due to charge exchange and collisions between the thermal (core) ions and neutrals, it experiences the action of magnetic field, its distribution function is isotropized, and it soon acquires the velocity of the ambient plasma without being thermodynamically equilibrated. This situation, e. g., takes place in the outer heliosphere –- the part of interstellar space beyond the solar system whose properties are determined by the solar wind interaction with the local interstellar medium. This is also possible in laboratory, at million degrees and above, when plasma is conducting electricity far too well, which makes Ohmic heating ineffective. To attain the target temperatures one needs additional heating eventually playing a dominant role. Among such sources is a so-called neutral particle beam heating. This is a wide-spread technique (Joint European Torus and International Thermonuclear Experimental Reactor experiments) based on the injection of powerful beams of neutral atoms into ohmically preheated plasma. In this project we have investigated the energy and density separation between the thermal and nonthermal components in the solar wind and interstellar plasmas. A new model has been developed in which we solve the ideal MHD equations for mixture of all ions and the kinetic Boltzmann equation to describe the transport of neutral atoms. As a separate capability, we can treat the flow of neutral atoms in a multi-component fashion, where neutral atoms born in each thermodynamically distinct region are governed by the Euler gas dynamic equations. We also describe the behavior of pickup ions either kinetically, using the Fokker--Planck equation, or as a separate fluid. Our numerical simulations have demonstrated that pickup ions play a major role in the interaction of the solar wind and (partially ionized) interstellar medium plasmas. Our teams have investigated the stability of the surface (the heliopause) that separates the solar wind from the local interstellar medium, the transport of galactic cosmic rays, the properties of the heliotail flow, and modifications to the bow wave in front of the heliopause due to charge exchange between the neutral H atoms born in the solar wind and interstellar ions. Modeling results have been validated against observational data, such as obtained by the Interstellar Boundary Explorer (IBEX), and made it possible to shed light on the structure of energetic neutral atom maps created by this spacecraft.. We have also demonstrated that charge-exchange modulated heliosphere is a source of anisotropy of the multi-TeV cosmic ray flux observed in a number of Earth-bound air shower experiments. Newly developed codes are implemented within a Multi-Scale Fluid-Kinetic Simulation Suite (MS-FLUKSS), a publicly available code being developed by our team for over 12 years. MS-FLUKSS scales well up to 160,000 computing cores and has been ported on major supercomputers in the country. Efficient parallelization and data choreography in the continuum simulation modules are provided by Chombo, an adaptive mesh refinement framework managed by Phillip Colella's team at LBNL. We have implemented in-house, hybrid (MPI+OpenMP) parallelization of the kinetic modules that solve the Boltzmann equation with a Monte Carlo method. Currently, the kinetic modules are being rewritten to take advantage of the modern CPU-GPU supercomputer architecture. The scope of the project allowed us to enhance plasma research and education in such broad, multidisciplinary field as physics of partially ionized plasma and its application to space physics and fusion science. Besides the impact on the modeling of complex physical systems, our approach to computational resource management for complex codes utilizing multiple algorithm technologies appears to be a major advance on current approaches. The development of sophisticated resource management will be essential for all future modeling efforts that incorporate a diversity of scales and physical processes. Our effort provided leadership in promoting computational science and plasma physics within the UAH and FIT campuses and, through the training of a broad spectrum of scientists and engineers, fostering new technologies across the country.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Collaborative Research: A Model of Partially Ionized Plasma Flows with Kinetic Treatment of Neutral Atoms and Nonthermal Ions

Interactions of flows of partially ionized, magnetized plasma are frequently accompanied by the presence of both thermal and non-thermal (pickup) ion components. Such interactions cannot be modeled using traditional MHD equations and require more advanced approaches to treat them. If a nonthermal component of ions is formed due to charge exchange and collisions between the thermal (core) ions and neutrals, it experiences the action of magnetic field, its distribution function is isotropized, and it soon acquires the velocity of the ambient plasma without being thermodynamically equilibrated. This situation, e. g., takes place in the outer heliosphere - the part of interstellar space beyond the solar system whose properties are determined by the solar wind interaction with the local interstellar medium. This is also possible in laboratory, at million degrees and above, when plasma is conducting electricity far too well, which makes Ohmic heating ineffective. To attain the target temperatures one needs additional heating eventually playing a dominant role. Among such sources is a so-called neutral particle beam heating. This is a wide-spread technique (Joint European Torus and International Thermonuclear Experimental Reactor experiments) based on the injection of powerful beams of neutral atoms into ohmically preheated plasma. In this project we have investigated the energy and density separation between the thermal and nonthermal components in the solar wind and interstellar plasmas. A new model has been developed in which we solve the ideal MHD equations for mixture of all ions and the kinetic Boltzmann equation to describe the transport of neutral atoms. As a separate capability, we can treat the flow of neutral atoms in a multi-component fashion, where neutral atoms born in each thermodynamically distinct regions are governed by the Euler gas dynamic equations. We also describe the behavior of pickup ions either kinetically, using the Fokker–Planck equation, or as a separate fluid. Our numerical simulations have demonstrated that pickup ions play a major role in the interaction of the solar wind and (partially ionized) interstellar medium plasmas. Our teams have investigated the stability of the surface (the heliopause) that separates the solar wind from the local interstellar medium, the transport of galactic cosmic rays, the properties of the heliotail flow, and modifications to the bow wave in front of the heliopause due to charge exchange between the neutral H atoms born in the solar wind and interstellar ions. Modeling results have been validated against observational data, such as obtained by the Interstellar Boundary Explorer (IBEX), and made it possible to shed light on the structure of energetic neutral atom maps created by this spacecraft.. We have also demonstrated that charge-exchange modulated heliosphere is a source of anisotropy of the multi-TeV cosmic ray flux observed in a number of Earth-bound air shower experiments. Newly developed codes are implemented within a Multi-Scale Fluid-Kinetic Simulation Suite (MS-FLUKSS), a publicly available code being developed by our team for over 12 years. MS-FLUKSS scales well up to 160,000 computing cores and has been ported on major supercomputers in the country. Efficient parallelization and data choreography in the continuum simulation modules are provided by Chombo, an adaptive mesh refinement framework managed by Phillip Colella’s team at LBNL. We have implemented in-house, hybrid (MPI+OpenMP) parallelization of the kinetic modules that solve the Boltzmann equation with a Monte Carlo method. Currently, the kinetic modules are being rewritten to take advantage of the modern CPU-GPU supercomputer architecture. The scope of the project allowed us to enhance plasma research and education in such broad, multidis- ciplinary field as physics of partially ionized plasma and its application to space physics and fusion science. Besides the impact on the modeling of complex physical systems, our approach to computational resource management for complex codes utilizing multiple algorithm technologies appears to be a major advance on current approaches. The development of sophisticated resource management will be essential for all future modeling efforts that incorporate a diversity of scales and physical processes. Our effort provided leadership in promoting computational science and plasma physics within the UAH and FIT campuses and, through the training of a broad spectrum of scientists and engineers, foster new technologies across the country.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Experimental and numerical investigation of reactive shock-accelerated flows

The main goal of this program was to establish a qualitative and quantitative connection, based on the appropriate dimensionless parameters and scaling laws, between shock-induced distortion of astrophysical plasma density clumps and their earthbound analog in a shock tube. These objectives were pursued by carrying out laboratory experiments and numerical simulations to study the evolution of two gas bubbles accelerated by planar shock waves and compare the results to available astrophysical observations. The experiments were carried out in an vertical, downward-firing shock tube, 9.2 m long, with square internal cross section (25×25 cm 2 ). Specific goals were to quantify the effect of the shock strength (Mach number, M) and the density contrast between the bubble gas and its surroundings (usually quantified by the Atwood number, i.e. the dimensionless density difference between the two gases) upon some of the most important flow features (e.g. macroscopic properties; turbulence and mixing rates). The computational component of the work performed through this program was aimed at (a) studying the physics of multi-phase compressible flows in the context of astrophysics plasmas and (b) providing a computational connection between laboratory experiments and the astrophysical application of shock-bubble interactions. Throughout the study, we used the FLASH4.2 code to run hydrodynamical and magnetohydrodynamical simulations of shock bubble interactions on an adaptive mesh.

79 ASTRONOMY AND ASTROPHYSICS↗

Simulation of Internal Combustion Engines with High-Performance Computing Tools

Traditional Lagrangian spray modeling approaches for internal combustion engines are highly griddependent due to insufficient resolution in the near nozzle region. This is primarily because of inherent restrictions of volume fraction with the Lagrangian assumption together with high computational costs associated with small grid sizes. A state-of-the-art grid-convergent spray modeling approach was developed and implemented by Senecal et al. (ASME-ICEF2012-92043) in the CONVERGE software. The key features of the methodology include Adaptive Mesh Refinement (AMR), advanced liquid-gas momentum coupling, and improved distribution of the liquid phase, which enables use of cell sizes smaller than the nozzle diameter. This modeling approach was rigorously validated against nonevaporating, evaporating, and reacting data from the literature. The current numerical study focusses on further demonstration of the grid-convergent modeling approach for simulating a single-cylinder Cat® compression ignition engine. The simulated injector is characterized with a nominal nozzle exit diameter of 259 μm. Simulations using various minimum grid sizes (ranging from 125 μm to 1000 μm) are compared for engine performance and emissions parameters of interest such as pressure, heat release rate, ignition delay, NOx, HC, and soot emissions. The peak cell-count for the highest resolution simulation was on the order of 34 million. These computationally expensive simulations were facilitated at a high-performance computing facility at Argonne National Laboratory. METIS load-balancing algorithm was developed and implemented in Converge code for the simulations. Scaling studies were also performed. The validity of previously recommended grid settings (ASME-ICEF2012-92043) for accuracy/runtime trade-off is further assessed. Efficacy of a simplified combustion model is also compared against a detailed chemical kinetics based combustion model.

33 ADVANCED PROPULSION SYSTEMS↗

Trinity Phase 2 Open Science: CTH

CTH is an Eulerian hydrocode developed by Sandia National Laboratories (SNL) to solve a wide range of shock wave propagation and material deformation problems. Adaptive mesh refinement is also used to improve efficiency for problems with a wide range of spatial scales. The code has a history of running on a variety of computing platforms ranging from desktops to massively parallel distributed-data systems. For the Trinity Phase 2 Open Science campaign, CTH was used to study mesoscale simulations of the hypervelocity penetration of granular SiC powders. The simulations were compared to experimental data. A scaling study of CTH up to 8192 KNL nodes was also performed, and several improvements were made to the code to improve the scalability.

97 MATHEMATICS AND COMPUTING↗

Resistive MHD calculations with ROXANE

We discuss the efficacy of the adaptive mesh refinement (AMR) code ROXANE in performing resistive Magnetohydrodynamic (MHD) simulations. Two-dimensional simulations with ROXANE for a generic Z-pinch setup for imploding a cylindrical liner shows that random hotspots known to occur in other codes in the insulator region are absent here. Furthermore, artificial instabilities present in other codes due to mesh imprinting are not present in ROXANE. The fundamental reasons for the better performance of ROXANE in resistive MHD simulations is the interface treatment in a cell containing two conductors (materials), avoiding the artificial mixing of disparate resistivities.

36 MATERIALS SCIENCE↗

Predictive Modeling of Aging and Degradation of Materials in Extreme Environments.

In order to accurately describe defect accumulation in heterogeneous microstructures and under complex irradiation conditions, simulation methods are needed that can explicitly account for the effect of nonhomogeneous microstructures on damage accumulation. In this project, an advanced simulation tool called spatially resolved stochastic cluster dynamics (SRSCD) is developed for this purpose. The proposed approach relies on solving spatially resolved coupled rate equations of standard cluster dynamics methods in a kinetic Monte Carlo scheme. Large-scale simulations of radiation damage in polycrystalline materials are enabled through several improvements made to this method, including a pseudo-adaptive meshing scheme for cascade implantation and implementation of this method in a synchronous parallel kinetic Monte Carlo framework.

36 MATERIALS SCIENCE↗

Preliminary Design Studies for a Hydro-Growth Radiography Platform to Study the Double Shell Ablator Joint

Double shell target assembly requires mating two hemispheres of aluminum to form the ablator, and the design of the mating joint governs the dimensions of the gap that remains following ablator assembly. Radiographic data from double shell implosions with two different joint designs demonstrate the importance of having a smaller outer gap to minimize perturbation growth, but higher quality data is desirable for validating simulations of such localized engineering features. A double shell hydrogrowth radiography platform is proposed to enable detailed measurements of the joint feature evolution for comparison to simulation predictions. The conservative design is based on a successfully fielded double shell keyhole target, but the tungsten inner shell is replaced with molybdenum to allow imaging with X-rays from a zirconium backlighter (16.3 keV). Eulerian radiation-hydrodynamics simulations with adaptive mesh refinement are used to predict joint feature evolution for several different joint designs. Synthetic radiographs produced from ablator-only calculations demonstrate that the evolution of different joint morphologies can be radiographed and distinguished. Feedthrough of the joint perturbation to a molybdenum inner shell is predicted to be measurable at a convergence ratio of 2.

36 MATERIALS SCIENCE↗

SURF Model Resolution in xRage Code

A key issue for detonation wave simulations with a reactive burn model is the resolution needed for the reaction zone. The reaction-zone width is a physical length scale. For plastic-bonded explosives, it is small (on the order of 100 microns) but affects important detonation properties such as the detonation speed. Even with adaptive mesh refinement, a well resolved reaction zone is computationally expensive. Here we consider the trade-off between computational expense and accuracy when the resolution of the reaction zone is varied for simulations with the xRage code of PBX 9501 with the SURF burn model and of PBX 9502 with the SURFplus burn model. For assessing shock initiation, the numerical Pop plot is simulated, and for assessing propagating detonation waves, the cylinder test is used as a test problem. The reaction-zone resolution is varied from a cell size of 6.25 to 200 microns, and key properties of the solutions are compared. With 6 micron resolution, the numerical solution is near mesh converged and can be used to judge the accuracy of the coarser resolution simulations. For the propagating detonation wave in the cylinder test, at 200 microns the detonation speed is low by a couple of per cent. In terms of cpu-hours, the finest resolution is about a factor of 100 more expensive than the coarsest resolution.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Parallelization and Performance Portability in Hydrodynamics Codes

With the eve of Exascale computing, performance and portability are at the forefront of all scientific codes. Adding more cores and more energy to a system is no longer a sustainable way to achieve performance, and extra effort must now be made to improve performance in all areas of code and code development. Using hydrodynamic codes as a basis, this work explores numerous techniques to achieve performance in different ways. Adaptive mesh refinement (AMR) is a necessary technique to improve memory optimization in mesh-based simulations. However it is invasive and conventionally difficult to integrate into existing applications, so we present a new branch of AMR to create a smooth transition to these optimizations, which not only improves performance, but also greatly reduces developer effort. We introduce the concept of this improvement as Phantom-Cell AMR, and assess theoretically the improvements, as well as present an application of its use. Other work included involves and investigation into an efficient data structure that ensures optimal memory layout for cache performance, with a target of making codes performant and portable across all architectures. All of the work targets both performance and portability, not just on CPU hardware, but specifically across GPU architectures. Parallel performance is key to all of the methods presented, but the research makes a great effort to improve the portability of all applications to prepare for current high performance computing systems and those on the horizon.

97 MATHEMATICS AND COMPUTING↗

Numerical Diffusion (Mixing) of Material in Numerical Simulations of Hydrodynamics [Slides]

It is often assumed that a material interface between two materials is spread over a few numerical cells in numerical simulations for hydrodynamics. Also, we have the impression that higher order methods introduce less numerical diffusion (mixing) of material. As we know one of the purposes of adaptive mesh refinement (AMR) is to resolve interfaces between materials, but we would like to know how effective AMR is to reduce numerical diffusion of material. We will present our investigation about numerical diffusion (mixing) of material in xRage. The result of the investigation indicates that the assumptions mentioned above are not always valid. In this talk, we will also demonstrate the effectiveness of numerical techniques to reduce numerical diffusion of material, including contact discontinuity steepening, isotropic interface steepening, max interface steepening, material interface reconstruct.

36 MATERIALS SCIENCE↗

2D Magnetohydrodynamic Simulations of the Electrothermal Instability in Metallic Liners

The Virginia Tech (VT) Plasma Dynamics Laboratory Computational (PDCL) and Lawrence Livermore National Laboratory (LLNL) are performing two dimensional (2D) simulations of the electrothermal instability (ETI) using the LLNL multi-physics code Ares. Ares is a multi-physics arbitrary–Lagrangian-Eulerian (ALE) code developed by LLNL and is of particular use in studying magnetohydrodynamic (MHD) instabilities like the ETI due to its resistive MHD, magnetic diffusion, and radiative-hydrodynamics packages. Among its capabilities, it has the ability to model material strength, perform adaptive mesh refinement (AMR), and incorporate a wide variety of equations of state models and conductivity models. The 2D Ares simulation model created by VT-LLNL for studying the development and growth of the electrothermal instability has been configured with initial conditions based on the Mykonos Electrothermal Instability II (METI-II) experiments described by this grant and conducted by team members at the University of Nevada (UNR), the University of New Mexico (UNM), and Sandia National Laboratories. Previously, preliminary 2D Ares simulations of the ETI had been run to approximately 80ns. The rods in these simulations were initiated with sinusoidal perturbations at a similar order of magnitude to those measured on the aluminum rods used for the Mykonos experiment. This model has been improved by increasing the spatial resolution of the simulations and running the simulations further in time. In addition to the simulation run-times extending, the preliminary sinusoidal perturbation has been replaced with a perturbation derived from amplitude measurements by the experimental team, thereby correlating the simulation inputs better to the experimental runs. These new runs are capable of reaching 120ns of simulated time for the uncoated cases and to 200ns the 41 μm coated cases.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

CEED-MS8:Initial Integration of CEED Software in ECP Applications

Key components of CEED software development involve fast finite element operator storage and evaluation, architecture optimizations, performant algorithms for all orders, global kernels for finite element operators, efficient use of the memory sub-system, optimal data locality and motion, enhanced scalability and parallelism, and fast tensor contractions. As ultimate goals of the project, CEED is exploring and identifying the best algorithms for the full range of discretizations and applying algorithmic and software development to support ECP applications’ needs. In this milestone we report on the initial integration of CEED software in the selected first-wave ECP/CEED apps and the continued exploration of other ECP applications as second-wave (milestone CEED-MS23) and third-wave (milestone CEED-MS35) ECP/CEED application candidates. An extensive evaluation of various approaches for GPU acceleration of the CEED computational motives is also a major focus of the report, both in the settings of CEED’s Nekbone and Laghos miniapps, as well as versions of CEED’s bake-off problems (introduced in milestone CEED-MS6). The first-wave ECP applications targeted for coupling with CEED software include the ExaSMR and MARBL applications. We also report on near-term collaboration with the seed-funded Urban Systems project, as well as engagements with ACME, ExaAM, GEOS and the Application Assessment and Proxy App projects. The ExaSMR project involves coupled thermal-hydraulics/neutronics, with the latter based on Monte Carlo methods and the former based on high-order discretizations of the Navier-Stokes and energy equations for accurate simulation of turbulent transport. The project requires fast and efficient turbulence simulation capabilities that will scale to exascale platforms. Work within CEED will ensure that all aspects of the Nek5000 workflow scale to the target problem space, which involves > 10 10 degrees of freedom in typical production runs. CEED’s goal is to provide implementations that perform with maximum attainable efficiency and deliver low turn-around times. A deliverable for this milestone is beta-release of the GPU-based variant of Nek5000. MARBL is targeting high-energy-density physics problems, including single fluid multi-material hydrodynamics and radiation/magnetic diffusion simulation, with applications in inertial confined fusion, pulsed power experiments, and equation of state/material strength analysis. The code uses high-order methods based arbitrary Lagrangian-Eulerian, direct Eulerian, and unstructured adaptive mesh refinement. A deliverable for this milestone is collaboration with MARBL for improved performance based on partially-assembled operators. The Urban exascale project is planning to couple real-time data with high performance simulations to study particulate transport in cities. Nek5000 will be used for large eddy and RANS (Reynolds-averaged Navier-Stokes) simulations of turbulent transport in these domains. Areas where the CEED team is aiding the Urban Canyon group include creating high-order meshes for urban geometries and developing boundary conditions appropriate for simulations close to real-life urban conditions. The software artifacts delivered as part of this milestone include GPU-enabled versions of the Nekbone and Laghos miniapps, which are provided through the CEED website, http://ceed.exascaleproject.org and the CEED GitHub organization, http://github.com/ceed. In addition to details and results from the above R&D efforts, in this document we are also reporting on other project-wide activities performed in Q4 of FY17, including: the CEED first annual meeting and participation of CEED researchers in a variety of outreach activities.

97 MATHEMATICS AND COMPUTING↗

Quantitative Performance Assessment of Proxy Apps and Parents (Report for ECP Proxy App Project Milestone ADCD-504-11)

The ECP Proxy Application Project has an annual milestone to assess the state of ECP proxy applications. Our FY21 milestone (ADCD-504-11) proposed to: "Assess the performance and fidelity of proxy applications, including those in the ECP Proxy App Suite, relative to the ECP Application workload on heterogeneous platforms. Use proxy applications and selected ECP applications to assess the utility of critical elements of the Exascale toolchain, especially tools used to collect performance data. Identify gaps in coverage and/or common situations in which proxies may fail to adequately represent ECP applications." To satisfy this milestone, the following specific tasks were completed: Study ability of MACSio to represent I/O workloads of adaptive mesh codes; Prepare report on assessed performance and debugging tools; Perform cosine similarity study on Intel and P9 and submit paper; Complete LDMS/GPU subcontract, complete and receive report; Complete validation of LDMS data collection for GPUs and submit paper; and Perform cosine similarity study on GPUs.

97 MATHEMATICS AND COMPUTING↗

Fuel Injection Dynamics and Composition Effects on RDE Performance

Rotating detonation engines (RDEs) provide a promising route to substantially increasing cycle efficiency in stationary gas turbines. Much of this increase relies on the ability to achieve consistent pressure gain within the combustor. In particular, the design of injectors that feed fuel and air into the detonation channel plays a crucial role. Such injectors have to ensure proper mixing of fuel and oxidizer, while minimizing backflow of detonation products into the feed plenums, and reduce susceptibility to the complex wave structures that exist within the combustor. From a practical perspective, such RDEs also need to operate with variable fuel composition. When fuel mixtures with components that possess vastly different oxidation pathways and time-scales are used, there could be additional losses through deflagrative burning instead of detonation-driven heat release. Such sensitivity to the complete flow path is akin to the physics of thermoacoustic instabilities in conventional gas turbines. In this sense, RDEs pose a unique research challenge: the performance of the device relies on the small-scale heat release process, which is highly dependent on the flow interactions within the full-scale system. As a result, canonical flow configurations, instrumented with detailed diagnostics or modeled using high-fidelity tools, but only focus on the small-scale processes will not contain the key system-level interactions. At the same time, macroscopic measurements and models that only capture system-level performance will not provide insight into the key sources of pressure losses. These couplings and sensitivities provide a formidable challenge to both experimental and simulation studies of the effects Thus, a joint experimental/computational program designed specifically to address these challenges was undertaken in this program. The focus of this program was on two key topics: a) the interaction between injector flow and the overall wave dynamics within the combustor, and b) the deflagration/detonation structure in multi-component fuels that are of practical interest. Both topics involve interaction of small-scale heat release processes with the geometry-dependent wave structure. Studies focused on the study of full-scale RDE systems, based on a 6-inch conventional annular geometry. Experimentally RDEs were studied using a combination of diagnostics. A combination of optical diagnostics and aero-thermo-acoustic analysis based on a combination of spectral and mode decomposition analysis was used to identify the dynamics of the detonation wave and other secondary waves that exist in the system. These studies have helped the identification and investigation of injector and detonation dynamics arising from coupling, and how they affect RDE mixing, detonation structure, operability and performance. Performance of RDEs was investigated through thrust stand measurements, which was used to evaluate the effective pressure gain generated by the system through the concept of equivalent available pressure. Optical diagnostics were developed and implemented to investigate the distribution of heat release, across the detonation wave. Novel optical diagnostics of NIR imaging was also developed and applied to investigate the high temperature / high pressure distribution across the detonation wave. In order to complement the experiments, the computational tools were geared to simulate the full experimental setup. GPU-based acceleration of the models and computations were developed to enable rapid simulation of the full system. In addition, the use of adaptive mesh refinement, and unstructured grid formulation, enabled the investigation of realistic geometries studied in the laboratory. The simulations produced a wealth of detail on the structure of the detonation wave under different operating conditions. Emphasis was placed on quantifying mixture pre-burning and the impact on wave propagation and structure.

03 NATURAL GAS↗

Quantitative Performance Assessment of Proxy Apps and Parents (Report for ECP Proxy App Project Milestone ADCD-504-28)

The ECP Proxy Application Project has an annual milestone to assess the state of ECP proxy applications and their role in the overall ECP ecosystem. Our FY22 March/April milestone (ADCD- 504-28) proposed to: Assess the fidelity of proxy applications compared to their respective parents in terms of kernel and I/O behavior, and predictability. Similarity techniques will be applied for quantitative comparison of proxy/parent kernel behavior. MACSio evaluation will continue and support for OpenPMD backends will be explored. The execution time predictability of proxy apps with respect to their parents will be explored through a carefully designed scaling study and code comparisons. Note that in this FY, we also have quantitative assessment milestones that are due in September and are, therefore, not included in the description above or in this report. Another report on these deliverables will be generated and submitted upon completion of these milestones. To satisfy this milestone, the following specific tasks were completed: Study the ability of MACSio to represent I/O workloads of adaptive mesh codes. Re-define the performance counter groups for contemporary Intel and IBM platforms to better match specific hardware components and to better align across platforms (make cross-platform comparison more accurate). Perform cosine similarity study based on the new performance counter groups on the Intel and IBM P9 platforms. Perform detailed analysis of performance counter data to accurately average and align the data to maintain phases across all executions and develop methods to reduce the set of collected performance counters used in cosine similarity analysis. Apply a quantitative similarity comparison between proxy and parent CPU kernels. Perform scaling studies to understand the accuracy of predictability of the parent performance using its respective proxy application. This report presents highlights of these efforts.

97 MATHEMATICS AND COMPUTING↗

Simulating Atmospheric Boundary Layer Turbulence with Nek5000/RS

We present large-eddy-simulation (LES) modeling approaches for the simulation of atmospheric boundary layer turbulence that are of direct relevance to wind energy production. In this report, we study a GABLS benchmark problem using high-order spectral element code Nek5000/RS, which is supported under the DOE’s Exascale Computing Project (ECP) Center for Efficient Exascale Discretizations (CEED) project, targeting application simulations on various acceleration-device based exascale computing platforms [1, 2]. We demonstrate our newly developed subgrid-scale (SGS) models based on high-pass filter (HPF), mean-field eddy viscosity (MFEV), and Smagorinsky (SMG) with no-slip and traction boundary conditions, provided with low-order statistics, convergence and turbulent structure analysis. The model fidelity and scaling performance of Nek5000/RS on DOE’s leadership computing platforms in comparison to those of AMR-Wind, a block-structured second-order finite-volume code with adaptive-mesh-refinement capabilities, are discussed in [3].

17 WIND ENERGY↗

Modeling the Interaction of Laser-Produced Proton Beams with Matter

A major goal of this project is to significantly increase our understanding of isochoric heating of matter using laser produced proton beams, and the associated high energy density (HED) and warm dense matter (WDM) regimes generated. This will benefit research fields such as planetary science, fusion energy, plasma physics, and material science. For example, it will enhance our understanding of WDM properties of iron and silica under conditions encountered in planetary interiors and diagnostic components in fusion devices exposed to high fluxes of energetic plasma ions. The project is motivated by recent experiments that irradiated Si targets with proton beams generated by the 20 TW-laser at the SLAC MEC end-station. The HED/WDM states are probed using the 50 fs hard X-rays available in the 3rd harmonic of the LCLS. As part of this project, results from the phase contrast X-ray imaging, which shows the generation of compression waves that produces rear surface spallation, are compared with results from the 3D multi-physics multi- material code, PISALE, that combines Arbitrary Lagrangian-Eulerian (ALE) hydrodynamics with Adaptive Mesh Refinement (AMR). This comparison required modifications to several physics models in the PISALE (Pacific Island Structured-AMR with ALE) code. An important aspect of this project is the continued training of graduate students in HED physics and in conducting complex multiphysics simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗