Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Adaptive Mesh Refinement”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Adaptive Mesh Refinement for Parallel in Time Methods

The project applied the multigrid-reduction-in-time (MGRIT) algorithm to an existing sub-cycled adaptive mesh refinement (AMR) code to investigate the performance of flows dominated by inertial physics. Previous work demonstrated good performance from MGRIT+AMR applied to flows dominated by diffusive physics. Consistent with previous experience, inertial physics negatively affected convergence rates and performance. Efforts to circumvent this issue by appealing to the physics of turbulence were investigated. It has been demonstrated that scales can be effectively transferred between multigrid levels for a turbulent flow resulting in a) partial convergence observed and b) nearly identical results to sequential time-stepping. Performance improvements have not yet been demonstrated - attempts at coarsening the grid on coarser MG levels compromises the solution quality and leads to divergence. This report summarize the accomplishments for the time-frame from 10/5/2020 to 12/31/2020 with an informal no-cost-extension to 05/20/2021

97 MATHEMATICS AND COMPUTING↗

AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement Applications

As supercomputers advance towards exascale capabilities, computational intensity increases significantly, and the volume of data requiring storage and transmission experiences exponential growth. Adaptive Mesh Refinement (AMR) has emerged as an effective solution to address these two challenges. Concurrently, error-bounded lossy compression is recognized as one of the most efficient approaches to tackle the latter issue. Despite their respective advantages, few attempts have been made to investigate how AMR and error-bounded lossy compression can function together. To this end, this study presents a novel in-situ lossy compression framework that employs the HDF5 filter to improve both I/O costs and boost compression quality for AMR applications. We implement our solution into the AMReX framework and evaluate on two real-world AMR applications, Nyx and WarpX, on the Summit supercomputer. Experiments with 512 cores demonstrate that AMRIC improves the compression ratio by 81X and the I/O performance by 39X over AMReX's original compression solution.

Wang, Daoce↗

Parthenon—a performance portable block-structured adaptive mesh refinement framework

On the path to exascale the landscape of computer device architectures and corresponding programming models has become much more diverse. While various low-level performance portable programming models are available, support at the application level lacks behind. To address this issue, we present the performance portable block-structured adaptive mesh refinement (AMR) framework Parthenon, derived from the well-tested and widely used Athena++ astrophysical magnetohydrodynamics code, but generalized to serve as the foundation for a variety of downstream multi-physics codes. Parthenon adopts the Kokkos programming model, and provides various levels of abstractions from multidimensional variables, to packages defining and separating components, to launching of parallel compute kernels. Parthenon allocates all data in device memory to reduce data movement, supports the logical packing of variables and mesh blocks to reduce kernel launch overhead, and employs one-sided, asynchronous MPI calls to reduce communication overhead in multi-node simulations. Using a hydrodynamics miniapp, we demonstrate weak and strong scaling on various architectures including AMD and NVIDIA GPUs, Intel and AMD x86 CPUs, IBM Power9 CPUs, as well as Fujitsu A64FX CPUs. At the largest scale on Frontier (the first TOP500 exascale machine), the miniapp reaches a total of 1.7 × 10 13 zone-cycles/s on 9216 nodes (73,728 logical GPUs) at [Formula: see text] weak scaling parallel efficiency (starting from a single node). In combination with being an open, collaborative project, this makes Parthenon an ideal framework to target exascale simulations in which the downstream developers can focus on their specific application rather than on the complexity of handling massively-parallel, device-accelerated AMR.

97 MATHEMATICS AND COMPUTING↗

Assessing Adaptive Mesh Refinement (AMR) in a Forced Shallow-Water Model with Moisture

Two forced shallow-water flow scenarios are explored in a 2D fourth-order finite-volume dynamical core with adaptive mesh refinement (AMR) to investigate AMR’s ability to track and resolve complex evolving features. Traditional shallow-water test cases are mainly characterized by large-scale smooth flows that do not effectively test the multiscale abilities of variable-resolution and AMR models to resolve sharp gradients and small-scale flow filaments. Therefore, adding forcing mechanisms to the shallow-water system to model key atmospheric processes adds complexity and creates small-scale phenomena. These can serve as foci for dynamic grid refinement while remaining simple enough to study the numerical design of a model’s dynamical core. The first shallow-water flow scenario represents a strengthening, tropical cyclone–like, vortex that is driven by a Betts–Miller-like convection scheme. The second shallow-water test is built upon a barotropically unstable jet with an added Kessler-like warm rain scheme that leads to precipitating frontal zones. The key feature of both tests is that there is significant sensitivity to the model grid while converging (structurally) at high resolution. Both test cases are investigated for a series of uniform resolutions and a variety of AMR tagging criteria. The AMR simulations demonstrate that grid refinement can resolve local features without requiring global high-resolution meshes. However, the results are sensitive to the refinement criteria. Criteria that trigger refinement early in a simulation reproduce the uniform-resolution reference solutions most reliably. Finally, in contrast, AMR criteria that delay refinement for several days require careful tuning of the AMR thresholds to improve results compared with uniform-resolution simulations.

54 ENVIRONMENTAL SCIENCES↗

An Adaptive-Mesh-Refinement Based Computational Tool for Simulating Catalysis at Mesoscale

In this work, we present a computational tool for mesoscale applications using open-source exascale- computing compatible adaptive-mesh-refinement (AMR) library, AMReX [2]. AMReX is software library that enables development of application solvers with block-structured Cartesian AMR. Our tool has capabilities to include realistic geometry representation, chemical species transport, reactions and thermodynamics that are critical for capturing mesoscale physics. A significant achievement is the ability of our solver to automatically import electron microscopy data in the form of a stereolithography (STL) or pixelated file format (mrc, tiff) without undergoing the tedious task of unstructured mesh generation. This feature allows for rapid simulation of catalyst particles with complex morphologies using an immersed-boundary formulation. The use of AMR allows for higher resolutions at catalyst surface interfaces, which in turn provides an accurate description of surface reactions and transport. Our solver uses a hybrid distributed and shared memory parallelism (OpenMP/GPU-based) with which strong scaling up to 10,000 processors for realistic catalyst particle simulations have been demonstrated.

BIOMASS FUELS,MATHEMATICS AND COMPUTING↗

Adaptive Mesh Refinement Large Eddy Simulation of the Supercritical Carbon Dioxide Round Turbulent Jet

Supercritical carbon dioxide (sCO2) is of interest to a range of engineering problems, including carbon capture, utilization, and storage (CCUS) as well as advanced cycles for power generation. Non-ideal variations in physical properties of sCO2 impact the physics of these systems. In this study, we simulate turbulent sCO2 jets to gain a better understanding of these physics.We use a second order finite volume method with adaptive mesh refinement as implemented in the first-principles simulation code PeleC to perform a Large Eddy Simulation (LES) of three turbulent jets of sCO2. Additionally, we use the Soave-Redlich-Kwong equation of state to close the system and examine the impact of a cubic equation of state on the turbulent flow physics. We look at velocity and Reynolds stress profiles at different downstream locations for three cases in which the temperature of the jet andthat of the ambient fluid differ in order to capture the effects of widely varying thermal properties in the pseudocritical region. These results are then contrasted with established theory for ideal gas jets.

adaptive mesh refinement↗

High resolution numerical simulations of methane pool fires using adaptive mesh refinement

The ability to accurately predict the structure and dynamics of pool fires using computational simulations is of great interest in a wide variety of applications, including accidental and wildland fires. However, the presence of physical processes spanning a broad range of spatial and temporal scales poses a significant challenge for simulations of such fires, particularly at conditions near the transition between laminar and turbulent flow. Here, in this study, we examine the transition to turbulence in methane pool fires using high-resolution simulations with multi-step finite rate chemistry, where adaptive mesh refinement (AMR) is used to directly resolve small-scale flow phenomena. We perform three simulations of methane pool fires, each with increasing diameter, corresponding to increasing inlet Reynolds and Richardson numbers. As the diameter increases, the flow transitions from organized vortex roll-up via the puffing instability to much more chaotic mixing associated with finger formation along the shear layer and core collapse near the inlet. These effects combine to create additional mixing close to the inlet, thereby enhancing fuel consumption and causing more rapid acceleration of the fluid above the pool. We also make comparisons between the transition to turbulence and core collapse in the present pool fires and in inert helium plumes, which are often used as surrogates for the study of buoyant reacting flows.

42 ENGINEERING↗

Multi-Objective Adaptive Mesh Refinement Using Reinforcement Learning

Finite element methods approximate the solution to a partial differential equation (PDE) on a mesh consisting of many elements. In general, using more, smaller elements results in a lower error in the approximation. However, it is often possible to lower the error substantially by only refining, or decreasing the size of, the few elements in the mesh that have the highest error. Adaptive mesh refinement (AMR) is a process that selectively refines regions of a mesh with high error to achieve a desired accuracy in as few degrees of freedom (DOFs) as possible. AMR is favorable compared to uniform refinement, which refines all elements of the mesh equally, because it can often achieve the same accuracy without wasting extra computation time on refinement of elements that already have low error. However, it is difficult to know which elements to refine. In this report we explore ways to choose which elements to refine such that we minimize both the resulting error and the cumulative DOFs used in computation. In particular, we introduce a Pareto-front learning algorithm that trains a policy to give the optimal refinement actions to minimize the cumulative DOFs used to achieve a given target error. Such a policy is useful because it can be deployed on many different problem types where different accuracy levels are desired. Furthermore, training a single policy for a range of target errors allows us to use transfer learning to reduce the required training time.

97 MATHEMATICS AND COMPUTING↗

SUHMO: an adaptive mesh refinement SUbglacial Hydrology MOdel v1.0

Abstract. Water flowing under ice sheets and glaciers can have a strong influence on ice dynamics, particularly through pressure changes, suggesting that a comprehensive ice sheet model should include the effect of basal hydrology. Modeling subglacial hydrology remains a challenge, however, mainly due to the range of spatial and temporal scales involved – from subglacial channels to vast subglacial lakes. Additionally, networks of subglacial drainage channels dynamically evolve over time. To address some of these challenges, we have developed an adaptive mesh refinement (AMR) model based on the Chombo software framework. We extend the model proposed by Sommers et al. (2018) with a small but significant change to accommodate the transition from unresolved to resolved flow features. We handle the strong nonlinearities present in the equations by resorting to an efficient nonlinear full approximation scheme multigrid (FAS-MG) algorithm. We outline the details of the algorithm and present convergence analysis results demonstrating its good performance. Additionally, we present results validating our approach, using test cases from the Subglacial Hydrology Model Intercomparison Project (SHMIP) (de Fleurian et al., 2018). We finish by presenting a more complex, 100 km-by-100 km synthetic test case with peaks and valleys that we use to investigate the effective pressure distribution as the number of AMR levels increases. These preliminary results suggest that a minimum spatial resolution is needed to properly capture channel features, but additional work is required to precisely quantify this and its impact on accurately modeling the coupled ice sheet–hydrology system. The efficiency of our approach, relying on localized refinement, is also demonstrated. Future work will include coupling the SUbglacial Hydrology MOdel (SUHMO) with the BISICLES AMR ice sheet model (Cornford et al., 2013), both built on the same numerical framework.

58 GEOSCIENCES↗

Adaptive Mesh Refinement Simulations for Turbulent Reacting Flow

With the increased availability of exascale computing hardware, detailed simulations of realistic devices can be performed at practically relevant time and length scales. Insights into the multiscale driving mechanisms in compressible reacting flow systems with complex geometry, such as combustors, can be used for design optimization and technology improvements. However, to effectively perform these simulations, advanced numerical algorithms must be used to maintain solution accuracy without incurring undue computational costs. PeleC, part of the Pele suite of codes, leverages block-structured adaptive mesh refinement (AMR) through the AMReX library to capture fine-scale flow features in compressible reacting flows. In this talk, we discuss recent improvements to the numerical algorithms, particularly in regard to describing flows at complex boundary structures, and PeleC's performance on exascale computing hardware. We will demonstrate that PeleC is well-suited for modern, extreme-scale, heterogenous compute platforms.

combustion↗

Gravitational Self-force Errors of Poisson Solvers on Adaptively Refined Meshes

An error in the gravitational force that the source of gravity induces on itself (a self-force error) violates both the conservation of linear momentum and the conservation of energy. If such errors are present in a self-gravitating system and are not sufficiently random to average out, the obtained numerical solution will become progressively more unphysical with time: the system will acquire or lose momentum and energy due to numerical effects. In this paper, we demonstrate how self-force errors can arise in the case where self-gravity is solved on an adaptively refined mesh when the refinement is nonuniform. Here, we provide the analytical expression for the self-force error and numerical examples that demonstrate such self-force errors in idealized settings. We also show how these errors can be corrected to an arbitrary order by straightforward addition of correction terms at the refinement boundaries.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Historical review and proof-of-concept future method demonstration of adaptive mesh refinement in nuclear engineering for increased fidelity and computational efficiency

As the nuclear industry's use of computational tool increases, the need for increased fidelity and computational efficiency is well known. While most approaches to increased fidelity rely on applying a fine mesh over the problem domain, a more efficient method is to apply an adaptive mesh refinement (AMR) algorithm to the mesh definition. In the field of nuclear engineering, AMR has previously been used in conjunction with deterministic methods, including: S{sub N} transport methods, Lattice Boltzmann Methods, and COMSOL. The future of AMR in nuclear engineering is to couple it to a Monte Carlo code with the goal of reducing calculation time. A proof-of-concept example yielded positive results for using the gradient of the flux as a refinement criteria. The refinement criteria was varied from 0.01 to 0.10, which yielded a recommended range of 0.01 to 0.04, and the number of refinement iterations was varied from 0 to 7, with diminishing returns seen after 5 iterations. After the success of the proof-of-concept exercise, work began on creating a full program coupling MCNP6.2 and the AMR algorithm in the deal.II library. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Axion Mass Prediction from Adaptive Mesh Refinement Cosmological Lattice Simulations

The quantum chromodynamics (QCD) axion arises as the pseudo-Goldstone mode of a spontaneously broken Abelian Peccei-Quinn (PQ) symmetry. If the scale of PQ symmetry breaking occurs below the inflationary reheat temperature and the domain wall number is unity, then there is a unique axion mass that gives the observed dark matter (DM) abundance. Computing this mass has been the subject of intensive numerical simulations for decades since the mass prediction informs laboratory experiments. Axion strings develop below the PQ symmetry-breaking temperature, and as the string network evolves, it emits axions that go on to become the DM. A key ingredient in the axion mass prediction is the spectral index of axion radiation emitted by the axion strings. We compute this index in this Letter using the most precise and accurate large-scale simulations to date of the axion-string network leveraging adaptive mesh refinement to achieve the precision that would, otherwise, require a static lattice with 262,144 3 lattice sites. We find a scale-invariant axion radiation spectrum to within 1% precision and find no evidence that the spectral index of radiation evolves with time. Accounting for axion production from strings prior to the QCD phase transition leads us to predict that the axion mass should be approximately 𝑚 𝑎 ∈ (45, 65) μ ⁢eV. However, we provide preliminary evidence that axions are produced in greater quantities from the string-domain-wall network collapse during the QCD phase transition, potentially increasing the mass prediction to as much as 300 μ ⁢eV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

PeleC: An adaptive mesh refinement solver for compressible reacting flows

Reacting flow simulations for combustion applications require extensive computing capabilities. Leveraging the AMReX library, the Pele suite of combustion simulation tools targets the largest supercomputers available and future exascale machines. We introduce PeleC, the compressible solver in the Pele suite, and detail its capabilities, including complex geometry representation, chemistry integration, and discretization. We present a comparison of development efforts using both OpenACC and AMReX’s C++ performance portability framework for execution on multiple GPU architectures. We discuss relevant details that have allowed PeleC to achieve high performance and scalability. PeleC’s performance characteristics are measured through relevant simulations on multiple supercomputers. The success of PeleC’s design for exascale is exhibited through demonstration of a 160 billion cell simulation and weak scaling onto 100% of Summit, an NVIDIA-based GPU supercomputer at Oak Ridge National Laboratory. Our results provide confidence that PeleC will enable future combustion science simulations with unprecedented fidelity.

97 MATHEMATICS AND COMPUTING↗