Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “domain decomposition method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

495 records · Page 28

Flow Partitioning in Fully Saturated Soil Aggregates

Microbes play an important role in facilitating organic matter decomposition in soils, which is a major component of the global carbon cycle. Microbial dynamics are intimately coupled to environmental transport processes, which control access to labile organic matter and other nutrients that are needed for the growth and maintenance of microorganisms. Transport of soluble nutrients in the soil system is arguably most strongly impacted by preferential flow pathways in the soil. Since the physical structure of soils can be characterized as being formed from constituent micro aggregates which contain internal porosity, one pressing question is the partitioning of the flow among the “inter-aggregate” and “intra-aggregate” pores and how this may impact overall solute transport within heterogeneous soil structures. The answer to this question is particularly important in evaluating assumptions to be used in developing upscaled simulations based on highly-resolved mechanistic models. We constructed a number of diverse multi-aggregate structures with different packing ratios by stacking micro-aggregates containing internal pores and varying the size and shape of inter-aggregate pore spacing between them. We then performed pore-scale flow simulations using computational fluid dynamics methods to determine the flow patterns in these aggregate-of-aggregates structures and computed the partitioning of the flow through intra- and inter-aggregate pores as a function of the spacing between the aggregates. The results of these numerical experiments demonstrate that soluble nutrients are largely transported via flows through inter-aggregate pores. Although this result is consistent with intuition, we have also been able to quantify the relative flow capacity of the two domains under various conditions. For example, in our simulations, the flow capacity through the aggregates (intra-aggregate flow) was less than 2% of the total flow when the spacing between the aggregates was larger than 18 micron. Inter-aggregate pores continued to be the dominant flow pathways even at much smaller spacing; intra-aggregate flow was less than 10% of the total flow when the inter- and intra-aggregate pore sizes were comparable. Such studies are making it possible to identify which model upscaling assumptions are realistic and what computational methods are required for detailed numerical investigation of microbial carbon cycling dynamics in soil systems.

computational fluid dynamics↗

GPU-enabled extreme-scale turbulence simulations: Fourier pseudo-spectral algorithms at the exascale using OpenMP offloading

Fourier pseudo-spectral methods for nonlinear partial differential equations are of wide interest in many areas of advanced computational science, including direct numerical simulation of three-dimensional (3-D) turbulence governed by the Navier-Stokes equations in fluid dynamics. This paper presents a new capability for simulating turbulence at a new record resolution up to 35 trillion grid points, on the world's first exascale computer, Frontier, comprising AMD MI250x GPUs with HPE's Slingshot interconnect and operated by the US Department of Energy's Oak Ridge Leadership Computing Facility (OLCF). Key programming strategies designed to take maximum advantage of the machine architecture involve performing almost all computations on the GPU which has the same memory capacity as the CPU, performing all-to-all communication among sets of parallel processes directly on the GPU, and targeting GPUs efficiently using OpenMP offloading for intensive number-crunching including 1-D Fast Fourier Transforms (FFT) performed using AMD ROCm library calls. With 99% of computing power on Frontier being on the GPU, leaving the CPU idle leads to a net performance gain via avoiding the overhead of data movement between host and device except when needed for some I/O purposes. Memory footprint including the size of communication buffers for MPI_ALLTOALL is managed carefully to maximize the largest problem size possible for a given node count. Detailed performance data including separate contributions from different categories of operations to the elapsed wall time per step are reported for five grid resolutions, from 2048 3 on a single node to 32768 3 on 4096 or 8192 nodes out of 9408 on the system. Both 1D and 2D domain decompositions which divide a 3D periodic domain into slabs and pencils respectively are implemented. The present code suite (labeled by the acronym GESTS, GPUs for Extreme Scale Turbulence Simulations) achieves a figure of merit (in grid points per second) exceeding goals set in the Center for Accelerated Application Readiness (CAAR) program for Frontier. The performance attained is highly favorable in both weak scaling and strong scaling, with notable departures only for 2048 3 where communication is entirely intra-node, and for 32768 3 , where a challenge due to small message sizes does arise. Communication performance is addressed further using a lightweight test code that performs all-to-all communication in a manner matching the full turbulence simulation code. Performance at large problem sizes is affected by both small message size due to high node counts as well as dragonfly network topology features on the machine, but is consistent with official expectations of sustained performance on Frontier. Overall, although not perfect, the scalability achieved at the extreme problem size of 32768 3 (and up to 8192 nodes — which corresponds to hardware rated at just under 1 exaflop/sec of theoretical peak computational performance) is arguably better than the scalability observed using prior state-of-the-art algorithms on Frontier's predecessor machine (Summit) at OLCF. New science results for the study of intermittency in turbulence enabled by this code and its extensions are to be reported separately in the near future.

3D fast Fourier transform↗

Stochastic Optimization for Grid Resilience. FY18 Final Technical Report

The optimal restoration problem lies at the foundation of the evaluation and improvement of resilience in power systems. In this report we present a scalable decomposition algorithm for solving this problem for realistic power systems. The algorithm has been developed in three major research threads, corresponding to the chapters in the present report. Chapter 1 studies mixed-integer programming (MIP) formulations for the requirement that each electrical island that appears after a recon guration must have at least one energized generator. We provide three alternative MIP formulations for this restriction, show their equivalence, and prove that two of them are stronger in terms of their linear programming relaxation than the formulation most commonly used in the power systems literature. Since the time to solve MIPs can vary signi cantly between equivalent formulations, we also present computational experiments on IEEE test systems for the Intentional Controlled Islanding (ICI) and the Black Start Allocation (BSA) problems. We observe that a polynomially separable, exponential in size, strong formulation yields the best performance for the BSA problem and exhibits a comparable performance to a linear in size, weak formulation for the ICI problem. Chapter 2 presents a methodology to generate mixed-integer linear approximations of the AC power ow equations governing lines, transformers (including tap regulators and phase shifters), shunt and series compensators, and consumption responsive to voltage. Our approximations are capable of capturing limitations for power grids under abnormal or uncommon operating conditions where common assumptions used in power ow relaxations may not hold. Particularly, the approximation captures overvoltages under almost no load, which is a major concern when energizing lines after a blackout. The method constructs piecewise linear approximations of the non-linear power ow equations by minimizing the squared approximation error over a subset of the feasible domain. We test the method using a realistic database for the Chilean system (1548 buses, 1114 lines, 564 transformers). The resulting approximations yield root mean square errors in the order of 0.05pu and are successfully applied to solve a transmission switching instance for the Chilean system. Chapter 3 presents our algorithm for optimal restoration. The algorithm works by partitioning the problem into a master problem and a slave problem. The master problem optimizes over energization sequences of generators, buses and branches, for the entire restoration horizon, while respecting the energization requiments studied in Chapter 1. The slave problem veri es that there exist power ow solutions supporting the energization sequences proposed by the master problem, adding cuts to the master if an infeasible sequence is detected.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Implementation of a High-Fidelity Interface Resolving Method in Nek5000

The development and utilization of computational fluid dynamics (CFD) models for large, high-temperature electric melters in the Waste Treatment and Immobilization Plant (WTP) in eastern Washington State have proven to be valuable for various purposes. These models allow for a better understanding of the physio-chemical processes occurring within the melter vessels and can contribute to improving operational efficiency, throughput, and addressing operational issues related to vitrification. The CFD models employed for these melter vessels incorporate multiphase fluid flow and heat transfer simulations in different regions, including the plenum, cold cap, and molten glass regions. As the tank waste and glass formers are introduced into the melter, a reacting batch layer known as the cold cap forms on top of the molten glass. To enhance the melt rate, forced convection bubblers located at the bottom of the melters generate convection currents that help homogenize the molten glass and provide heat to the cold cap. As the bubbles rise through the highly viscous glass, they adopt a spherical-cap shape [1]. Meanwhile, the conversion of the batch to glass generates significant amounts of gases (such as water vapor, carbon dioxide, sulfur dioxide, and NOx) due to thermal decomposition [2]. These gases become trapped between the cold cap and molten glass, forming a foam layer [3]. For modeling multiphase flow in CFD and heat transfer simulations of waste glass melters at different scales, efforts are underway to augment the capabilities of the Nek5000 [4] and NekRS [5] open-source codes [6]. Nek5000/NekRS is a scalable and efficient spectral element code that has been successfully applied to a wide range of fluid dynamics problems. By leveraging the Nek5000/NekRS software, it becomes possible to model the melter systems more affordably and with lower computational requirements compared to currently utilized commercial CFD software. The specific objectives of this ongoing effort include: 1. Implementation of a level set method in Nek5000/NekRS: The level set method is a numerical technique commonly employed in CFD simulations to track and represent the interface between different phases or materials accurately. By incorporating this method into Nek5000/NekRS, the ability to simulate multiphase flows in waste glass melters at a high level of fidelity can be achieved. 2. Demonstration of capability for air bubbling through molten glass: As part of the development process, a specific case of air bubbling through molten glass will be simulated using the augmented Nek5000/NekRS code. This demonstration aims to showcase the ability of the software to accurately capture and analyze the complex phenomena involved in the multiphase flow within waste glass melters. By achieving these objectives, the improved Nek5000/NekRS code will offer a powerful computational tool for simulating and analyzing waste glass melter systems, enabling better understanding, optimization, and troubleshooting of these vitrification processes. The ability to accurately model and simulate multiphase flows has broad relevance across many industries and scientific domains, and the improved functionality can contribute to advancements in various fields beyond waste glass melter simulations.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Dynamics of multicomponent vesicles in a viscous fluid

We develop and investigate numerically a thermodynamically consistent model of two-dimensional multicomponent vesicles in an incompressible viscous fluid. The model is derived using an energy variation approach that accounts for different lipid surface phases, the excess energy (line energy) associated with surface phase domain boundaries, bending energy, spontaneous curvature, local inextensibility and fluid flow via the Stokes equations. The equations are high-order (fourth order) nonlinear and nonlocal due to incompressibility of the fluid and the local inextensibility of the vesicle membrane. To solve the equations numerically, we develop a nonstiff, pseudo-spectral boundary integral method that relies on an analysis of the equations at small scales. The algorithm is closely related to that developed very recently by Veerapaneni et al. [81] for homogeneous vesicles although we use a different and more efficient time stepping algorithm and a reformulation of the inextensibility equation. We present simulations of multicomponent vesicles in an initially quiescent fluid and investigate the effect of varying the average surface concentration of an initially unstable mixture of lipid phases. The phases then redistribute and alter the morphology of the vesicle and its dynamics. When an applied shear is introduced, an initially elliptical vesicle tank-treads and attains a steady shape and surface phase distribution. A sufficiently elongated vesicle tumbles and the presence of different surface phases with different bending stiffnesses and spontaneous curvatures yields a complex evolution of the vesicle morphology as the vesicle bends in regions where the bending stiffness and spontaneous curvature are small.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Extending ALE3D, an Arbitrarily Connected hexahedral 3D Code, to Very Large Problem Size (U)

As the number of compute units increases on the ASC computers, the prospect of running previously unimaginably large problems is becoming a reality. In an arbitrarily connected 3D finite element code, like ALE3D, one must provide a unique identification number for every node, element, face, and edge. This is required for a number of reasons, including defining the global connectivity array required for domain decomposition, identifying appropriate communication patterns after domain decomposition, and determining the appropriate load locations for implicit solvers, for example. In most codes, the unique identification number is defined as a 32-bit integer. Thus the maximum value available is 231, or roughly 2.1 billion. For a 3D geometry consisting of arbitrarily connected hexahedral elements, there are approximately 3 faces for every element, and 3 edges for every node. Since the nodes and faces need id numbers, using 32-bit integers puts a hard limit on the number of elements in a problem at roughly 700 million. The first solution to this problem would be to replace 32-bit signed integers with 32-bit unsigned integers. This would increase the maximum size of a problem by a factor of 2. This provides some head room, but almost certainly not one that will last long. Another solution would be to replace all 32-bit int declarations with 64-bit long long declarations. (long is either a 32-bit or a 64-bit integer, depending on the OS). The problem with this approach is that there are only a few arrays that actually need to extended size, and thus this would increase the size of the problem unnecessarily. In a future computing environment where CPUs are abundant but memory relatively scarce, this is probably the wrong approach. Based on these considerations, we have chosen to replace only the global identifiers with the appropriate 64-bit integer. The problem with this approach is finding all the places where data that is specified as a 32-bit integer needs to be replaced with the 64-bit integer. that need to be replaced. In the rest of this paper we describe the techniques used to facilitate this transformation, issues raised, and issues still to be addressed. This poster will describe the reasons, methods, issues associated with extending the ALE3D code to run problems larger than 700 million elements.

97 MATHEMATICS AND COMPUTING↗

Physics-guided dual implicit neural representations for source separation

Significant challenges exist in efficient data analysis of most advanced experimental and observational techniques because the collected signals often include unwanted contributions, such as background and signal distortions, that can obscure the physically relevant information of interest. To address this, we have developed a self-supervised machine-learning approach for source separation using a dual implicit neural representation framework that jointly trains two neural networks: one for approximating distortions of the physical signal of interest and the other for learning the effective background contribution. Our method learns directly from the raw data by minimizing a reconstruction-based loss function without requiring labeled data or pre-defined dictionaries. We demonstrate the effectiveness of our framework by considering a challenging case study involving large-scale simulated, as well as experimental, momentum-energy-dependent inelastic neutron scattering data in a four-dimensional parameter space, characterized by heterogeneous background contributions and unknown distortions to the target signal. The method is found to successfully separate physically meaningful signals from a complex or structured background even when the signal characteristics vary across all four dimensions of the parameter space. An analytical approach that informs the choice of the regularization parameter is presented. Our method offers a versatile framework for addressing source separation problems across diverse domains, ranging from superimposed signals in astronomical measurements to structural features in biomedical image reconstructions.

47 OTHER INSTRUMENTATION↗

A novel coupling of noise reduction algorithms for particle flow simulations

Proper orthogonal decomposition (POD) and its extension based on time-windows have been shown to greatly improve the effectiveness of recovering smooth ensemble solutions from noisy particle data. However, to successfully de-noise any molecular system, a large number of measurements still need to be provided. In order to achieve a better efficiency in processing time-dependent fields, we have combined POD with a well-established signal processing technique, wavelet-based thresholding. In this novel hybrid procedure, the wavelet filtering is applied within the POD domain and referred to as WAVinPOD. The algorithm exhibits promising results when applied to both synthetically generated signals and particle data. In this work, the simulations compare the performance of our new approach with standard POD or wavelet analysis in extracting smooth profiles from noisy velocity and density fields. Numerical examples include molecular dynamics and dissipative particle dynamics simulations of unsteady force- and shear-driven liquid flows, as well as phase separation phenomenon. Simulation results confirm that WAVinPOD preserves the dimensionality reduction obtained using POD, while improving its filtering properties through the sparse representation of data in wavelet basis. This paper shows that WAVinPOD outperforms the other estimators for both synthetically generated signals and particle-based measurements, achieving a higher signal-to-noise ratio from a smaller number of samples. The new filtering methodology offers significant computational savings, particularly for multi-scale applications seeking to couple continuum informations with atomistic models. It is the first time that a rigorous analysis has compared de-noising techniques for particle-based fluid simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

EVOLUTION OF THE SOLAR ACTIVITY OVER TIME AND EFFECTS ON PLANETARY ATMOSPHERES. II. {kappa}{sup 1} Ceti, AN ANALOG OF THE SUN WHEN LIFE AROSE ON EARTH

The early evolution of Earth's atmosphere and the origin of life took place at a time when physical conditions at the Earth were radically different from its present state. The radiative input from the Sun was much enhanced in the high-energy spectral domain, and in order to model early planetary atmospheres in detail, a knowledge of the solar radiative input is needed. We present an investigation of the atmospheric parameters, state of evolution, and high-energy fluxes of the nearby star {kappa}{sup 1} Cet, previously thought to have properties resembling those of the early Sun. Atmospheric parameters were derived from the excitation/ionization equilibrium of Fe I and Fe II, profile fitting of H{alpha}, and the spectral energy distribution. The UV irradiance was derived from Far-Ultraviolet Spectroscopic Explorer and Hubble Space Telescope data, and the absolute chromospheric flux from the H{alpha} line core. From careful spectral analysis and the comparison of different methods, we propose for {kappa}{sup 1} Cet the following atmospheric parameters: T{sub eff} = 5665 {+-} 30 K (H{alpha} profile and energy distribution), log g = 4.49 {+-} 0.05 dex (evolutionary and spectroscopic), and [Fe/H] = +0.10 {+-} 0.05 (Fe II lines). The UV radiative properties of {kappa}{sup 1} Cet indicate that its flux is some 35% lower than the current Sun's between 210 and 300 nm, it matches the Sun's at 170 nm, and increases to at least 2-7 times higher than the Sun's between 110 and 140 nm. The use of several indicators ascribes an age to {kappa}{sup 1} Cet in the interval {approx}0.4-0.8 Gyr and the analysis of the theoretical Hertzsprung-Russell diagram (H-R) suggests a mass {approx}1.04 M{sub sun}. This star is thus a very close analog of the Sun when life arose on Earth and Mars is thought to have lost its surface bodies of liquid water. Photochemical models indicate that the enhanced UV emission leads to a significant increase in photodissociation rates compared with those commonly assumed of the early Earth. Our results show that reliable calculations of the chemical composition of early planetary atmospheres need to account for the stronger solar photodissociating UV irradiation.

79 ASTRONOMY AND ASTROPHYSICS↗