Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Nonlinear programming.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Automated property optimization via ab initio O(N) elongation method: Application to (hyper-)polarizability in DNA

An automated property optimization method was developed based on the ab initio O(N) elongation (ELG) method and applied to the optimization of nonlinear optical (NLO) properties in DNA as a first test. The ELG method mimics a polymerization reaction on a computer, and the reaction terminal of a starting cluster is attacked by monomers sequentially to elongate the electronic structure of the system by solving in each step a limited space including the terminal (localized molecular orbitals at the terminal) and monomer. The ELG-finite field (ELG-FF) method for calculating (hyper-)polarizabilities was used as the engine program of the optimization method, and it was found to show linear scaling efficiency while maintaining high computational accuracy for a random sequenced DNA model. Furthermore, the self-consistent field convergence was significantly improved by using the ELG-FF method compared with a conventional method, and it can lead to more feasible NLO property values in the FF treatment. The automated optimization method successfully chose an appropriate base pair from four base pairs (A, T, G, and C) for each elongation step according to an evaluation function. From test optimizations for the first order hyper-polarizability (β) in DNA, a substantial difference was observed depending on optimization conditions between “choose-maximum” (choose a base pair giving the maximum β for each step) and “choose-minimum” (choose a base pair giving the minimum β). In contrast, there was an ambiguous difference between these conditions for optimizing the second order hyper-polarizability (γ) because of the small absolute value of γ and the limitation of numerical differential calculations in the FF method. It can be concluded that the ab initio level property optimization method introduced here can be an effective step towards an advanced computer aided material design method as long as the numerical limitation of the FF method is taken into account.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2016

NEW NEUTRON-CAPTURE MEASUREMENTS IN 23 OPEN CLUSTERS. I. THE r -PROCESS

Neutron-capture elements, those with Z > 35, are the least well understood in terms of nucleosynthesis and formation environments. The rapid neutron-capture, or r -process, elements are formed in the environments and/or remnants of massive stars, while the slow neutron-capture, or s -process, elements are primarily formed in low-mass AGB stars. These elements can provide much information about Galactic star formation and enrichment, but observational data are limited. We have assembled a sample of 68 stars in 23 open clusters that we use to probe abundance trends for six neutron-capture elements (Eu, Gd, Dy, Mo, Pr, and Nd) with cluster age and location in the disk of the Galaxy. In order to keep our analysis as homogeneous as possible, we use an automated synthesis fitting program, which also enables us to measure multiple (3–10) lines for each element. We find that the pure r -process elements (Eu, Gd, and Dy) have positive trends with increasing cluster age, while the mixed r - and s -process elements (Mo, Pr, and Nd) have insignificant trends consistent with zero. Pr, Nd, Eu, Gd, and Dy have similar, slight (although mostly statistically significant) gradients of ∼0.04 dex kpc{sup −1}. The mixed elements also appear to have nonlinear relationships with R {sub GC}.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2011

NID Copper Sample Analysis

The current focal point of the nuclear physics program at PNNL is the MAJORANA DEMONSTRATOR, and the follow-on Tonne-Scale experiment, a large array of ultra-low background high-purity germanium detectors, enriched in 76Ge, designed to search for zero-neutrino double-beta decay (0νββ). This experiment requires the use of germanium isotopically enriched in 76Ge. The DEMONSTRATOR will utilize 76Ge from Russia, but for the Tonne-Scale experiment it is hoped that an alternate technology under development at Nonlinear Ion Dynamics (NID) will be a viable, US-based, lower-cost source of separated material. Samples of separated material from NID require analysis to determine the isotopic distribution and impurities. The MAJORANA DEMONSTRATOR is a DOE and NSF funded project with a major science impact. DOE is funding NID through an SBIR grant for development of their separation technology for application to the Tonne-Scale experiment. The Environmental Molecular Sciences facility (EMSL), a DOE user facility at PNNL, has the required mass spectroscopy instruments for making these isotopic measurements that are essential to the quality assurance for the MAJORANA DEMONSTRATOR and for the development of the future separation technology required for the Tonne-Scale experiment. A sample of isotopically separated copper was provided by NID to PNNL for isotopic analysis as a test of the NID technology. The results of that analysis are reported here.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Final Seismic Shake Table Test Plan

The Spent Fuel Waste Disposition (SFWD) program is planning to conduct a full-scale seismic shake table test on the dry storage systems of spent nuclear fuel (SNF) to close the gap related to seismic loads on fuel assemblies in dry storage systems. This test will allow for quantifying the strains and accelerations on surrogate fuel assembly hardware and cladding during earthquakes of different magnitudes and frequency content. Full-scale testing is needed because a dry storage system is a complex and highly nonlinear system making it hard to predict (model) the responses to seismic excitations. The non-linearity arises from the multiple spatial gaps in the system – between fuel rods and the basket, between the basket and dry storage canister, between the dry storage canister and the storage cask (overpack), and ventilation gaps. The non-linearities pose significant limitations on the value of tests with scaled systems.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Nonlinear Multiobjective MPC-Based Optimal Operation of a High Consistency Refining System in Papermaking

As one of the most important unit in the papermaking industry, the high consistency (HC) refining system is confronted with challenges such as improving pulp quality, energy saving, and emissions reduction in its operation processes. Here in this correspondence, an optimal operation of HC refining system is presented using nonlinear multiobjective model predictive control strategies that aim at set-point tracking objective of pulp quality, economic objective, and specific energy (SE) consumption objective, respectively. First, a set of input and output data at different times are employed to construct the subprocess model of the state process model for the HC refining system, and then the Wiener-type model can be obtained through combining the mechanism model of Canadian Standard Freeness and the state process model that determines their structures based on Akaike information criterion. Second, the multiobjective optimization strategy that optimizes both the set-point tracking objective of pulp quality and SE consumption is proposed simultaneously, which uses NSGA-II approach to obtain the Pareto optimal set. Furthermore, targeting at the set-point tracking objective of pulp quality, economic objective, and SE consumption objective, the sequential quadratic programming method is utilized to produce the optimal predictive controllers. In conclusion, the simulation results demonstrate that the proposed methods can make the HC refining system provide a better performance of set-point tracking of pulp quality when these predictive controllers are employed. In addition, while the optimal predictive controllers orienting with comprehensive economic objective and SE consumption objective, it has been shown that they have significantly reduced the energy consumption.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

AN ESTIMATE OF SPENT NUCLEAR FUEL MECHANICAL LOADS IN THE GENERAL 30 CM PACKAGE DROP SCENARIO

The US Department of Energy Spent Fuel and Waste Science and Technology (SFWST) program is performing research to determine the mechanical loading conditions applied to spent nuclear fuel (SNF) during normal conditions of transport to inform mechanical tests of SNF and close an important knowledge gap related to the practical disposition of SNF in the US. Researchers at Pacific Northwest National Laboratory (PNNL) have completed an extensive finite element study to characterize and estimate the potential mechanical loads on SNF during a hypothetical 30 cm drop of an SNF transportation package. This modeling study is validated with test data collected by the SFWST program during a physical test campaign that included one-third scale package drop tests and full-scale single fuel assembly drop tests. The test campaign was led by Sandia National Laboratories (SNL) and included international collaboration with Equipos Nucleares S.A, S.M.E (ENSA) and Bundesanstalt für Materialforschung und -prüfung (BAM). The key contribution of the modeling study is to go beyond the limitations of the limited number of physical tests to estimate the impact response to variations in impact angle, initial gap conditions, fuel assembly design, burnup and other parameters that affect the mechanical loads. The methodology of this study included a classic parametric study to calculate the impact response of highly detailed fuel assemblies over many combinations of parameters. Models of a 17x17 pressurized water reactor fuel assembly and a generic 10x10 boiling water reactor fuel assembly were both used in this study to cover the major fuel assembly types in the US inventory. Over 2,000 impact responses were calculated. The results of the parametric study were evaluated using traditional methods and basic statistics. The results were also used to construct a damage model using multiple nonlinear regression techniques to predict the mechanical loads over the full range of all input parameters. The damage model was found to work very well for all impact angle cases where the cask came to rest on its side. It was concluded that end drop cases where the cask remained vertical (instead of tipping over onto its side) were not sufficiently characterized by the current set of parametric study cases to include in the damage model, but it was not a priority to fully investigate that range because the highest mechanical loads were observed in the broader range of side impact cases. This modeling work provides sufficient insight into the mechanical loads on SNF during a hypothetical 30 cm package drop that, when considered along with the physical test data collected by the SNL-led team, the SFSWT program can consider the knowledge gap closed.

Klymyshyn, Nicholas A.↗
DOE OSTI2022

Efficient Region of Attraction Characterization for Control and Stabilization of Load Tap Changer Dynamics

In this article, we study the monitoring and control of long-term voltage stability considering load tap changer (LTC) dynamics. We show that under generic conditions, the LTC dynamics admit a unique stable equilibrium. For the stable equilibrium, we characterize an explicit inner approximation of its largest region of attraction (ROA). Compared to existing results, the computational complexity of the ROA characterization is drastically reduced. We propose a quadratically constrained linear program formulation for the ROA characterization problem. In addition, we formulate a second-order cone program for online voltage stability monitoring and control exploiting the proposed ROA characterization. Finally, we demonstrate the efficacy of the proposed formulations on the ROA characterization and stability monitoring and control using a standard IEEE test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

A Performance Portable, Fully Implicit Landau Collision Operator with Batched Linear Solvers

Modern accelerators use hierarchical parallel programming models that enable massive multithreading within a processing element (PE), with multiple PEs per device driven by traditional processes. Batching is a technique for exposing PE-level parallelism in algorithms that have traditionally run on MPI processes or multiple threads within a single process. Opportunities for batching arise in, for example, kinetic discretizations of magnetized plasmas where collisions are advanced in velocity space at each spatial point independently. This paper builds on previous work on a high-performance, fully nonlinear, Landau collision operator by batching the linear solver, as well as batching the spatial point problems and adding new support for multiple grids for multiscale, multispecies problems. An anisotropic relaxation verification test that agrees well with previously published results and analytical models is presented. The performance results from NVIDIA A100 and AMD MI250X nodes are presented with hardware utilization analysis for each architecture. Finally, the entire implicit Landau operator time advance is implemented in Kokkos for performance portability, running entirely on the device and is available in the PETSc numerical library.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Spatial and Spin Symmetry Breaking in Semidefinite-Programming-Based Hartree–Fock Theory

The Hartree–Fock problem was recently recast as a semidefinite optimization over the space of rank-constrained two-body reduced-density matrices (RDMs) [ Phys. Rev. A 2014, 89, 010502(R)]. This formulation of the problem transfers the nonconvexity of the Hartree–Fock energy functional to the rank constraint on the two-body RDM. We consider an equivalent optimization over the space of positive semidefinite one-electron RDMs (1-RDMs) that retains the nonconvexity of the Hartree–Fock energy expression. The optimized 1-RDM satisfies ensemble N-representability conditions, and ensemble spin-state conditions may be imposed as well. The spin-state conditions place additional linear and nonlinear constraints on the 1-RDM. We apply this RDM-based approach to several molecular systems and explore its spatial (point group) and spin (Ŝ 2 and Ŝ 3 ) symmetry breaking properties. When imposing Ŝ 2 and Ŝ 3 symmetry but relaxing point group symmetry, the procedure often locates spatial-symmetry-broken solutions that are difficult to identify using standard algorithms. For example, the RDM-based approach yields a smooth, spatial-symmetry-broken potential energy curve for the well-known Be–H 2 insertion pathway. We also demonstrate numerically that, upon relaxation of Ŝ 2 and Ŝ 3 symmetry constraints, the RDM-based approach is equivalent to real-valued generalized Hartree–Fock theory.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

A Mixed integer linear programming‐based distributed energy management for networked microgrids considering network operational objectives and constraints

Abstract Mixed integer linear programming (MILP)–based distributed energy management for networked microgrids embedded modern distribution systems is proposed. Considering the diverse ownership of microgrids, distributed energy resources (DERs) that interface directly with utilities and responsive loads, an alternating direction method of multipliers–based distributed framework was formulated for the scheduling of networked microgrids embedded modern distribution systems by adjusting nodal price signals iteratively. In addition, to make the formulated optimization problems resolvable through more accessible and popular MILP solvers, different linearisation techniques were employed to transform the nonlinear terms into linear or mixed integer linear formats. The proposed MILP‐based distributed method preserves all participants' autonomy (e.g., microgrids, DERs that interface directly with utilities and responsive loads), while incentivising them to actively participate in the distribution system operation with price signals. The proposed method is validated with results of numerical simulation using a modern distribution system consisting of multiple networked microgrids, DERs that interface directly with utilities, as well as responsive loads.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2018

Verification of GENE and GYRO with L-mode and I-mode plasmas in Alcator C-Mod

Here, verification comparisons are carried out for L-mode and I-mode plasma conditions in Alcator C-Mod. We compare linear and nonlinear ion-scale calculations by the gyrokinetic codes GENE and GYRO to each other and to the experimental power balance analysis. The two gyrokinetic codes' linear growth rates and real frequencies are in good agreement throughout all the ion temperature gradient mode branches and most of the trapped electron mode branches of the kyρs spectra at r/a = 0.65, 0.7, and 0.8. The shapes of the toroidal mode spectra of heat fluxes in nonlinear simulations are very similar for k y ρ s ≤ 0.5, but in most cases GENE has a relatively higher heat flux than GYRO at higher mode numbers.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

New systems in MOOSE

The Multiphysics Object-Oriented Simulation Environment (MOOSE) serves as a common library of classes between applications developed for advanced reactor analysis, fusion device engineering, spent fuel cask analysis, geochemistry studies, among other fields. These applications drive the development of the framework to meet their needs. Systems in MOOSE group capabilities that share a common purpose and generally common code. They can be leveraged by all downstream applications, providing extensive code re-use and shared maintenance. They facilitate the discovery by new users of the classes meeting at least partially their needs, and offer the same opportunities for customization as other systems. The addition of a new system to MOOSE opens new ways of solving or discretizing nonlinear problems, of performing distributed postprocessing, and a plethora of other needs. While new systems can be introduced in downstream applications rather than at the framework level, the framework team monitors common needs across the community and often triggers their addition. Documentation, training material, development needs can be centralized, limiting duplicated work across the community. The last three years have seen a large expansion in the capabilities of MOOSE. The supporting role of the framework in the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program has created numerous feature requests to support neutronics, thermal hydraulics, computational fluid dynamics and thermo-mechanics simulations in the Griffin, SAM, Pronghorn and Bison applications respectively. Similarly, laboratory-directed research and development (LDRD) projects in additive manufacturing, high-Reynolds flow simulations, structure optimization also necessitate an expansion of the framework capabilities. This summary reports on the new systems created in MOOSE, their design, their capabilities and some of the relevant interfaces.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2018

Identifying key factors of the seawater intrusion model of Dagu river basin, Jiaozhou Bay

Highlights: • The key factors of seawater intrusion model is identified by mutual entropy analysis. • Precipitation rate and groundwater pumping are the key factors for seawater intrusion. • The hydraulic conductivity of zone 1 has significant influence on seawater intrusion. Seawater intrusion is a complex groundwater - seawater interaction process, and it is influenced by many factors from ground surface to underground, from groundwater to seawater. Generally, for seawater intrusion model, some model parameters and boundary conditions are always specified by model users’ personal experiences or literature's reference value. The defective model would damage the groundwater management for controlling and preventing seawater intrusion when making decisions are based on this model. In order to improve the reliability of seawater intrusion model, the influences of model inputs on output should be identified prior at optimizing model inputs. Dagu river basin, Jiaozhou Bay is one of the most serious areas of seawater intrusion in China, and it is chosen as the study area in this study. The seawater intrusion model of Dagu river basin is built based on a general program SEAWAT4. The key influence factors of model output are analyzed by two sensitivity analysis methods, i.e., stepwise regression and mutual entropy. The results demonstrated that the most important influence factors which have largest sensitivities to groundwater Cl{sup -} concentration are the precipitation rate and groundwater pumping in agriculture area. In addition, the hydraulic conductivity of zone 1 has a non-negligible influence on seawater intrusion process. Stepwise regression analysis is capable of identifying most important influence factor, and it can’t handle complicated nonlinear input-output relationship. Mutual entropy analysis is reliable for identifying the influence factors for complex seawater intrusion model.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Optimization of Superconducting Linac for Proton Improvement Plan-II (PIP-II)

PIP-II is an essential upgrade of the Fermilab complex that will enable the worlds most intense high-energy beam of neutrinos for the international Deep Underground Neutrino Experiment at LBNF and support a broad physics program at Fermilab. Ultimately, the PIP-II superconducting linac will be capable of accelerating the $H-$ CW beam to 800 MeV with an average power of 1.6 MW. To operate the linac with such high power, beam losses and beam emittance growth must be tightly controlled. In this paper, we present the results of global optimization of the Linac options towards a robust and efficient physics design for the superconducting section of the PIP-II linac. We also investigate the impact of the nonlinear field of the dipole correctors on the beam quality and derive the requirement on the field quality using statistical analysis. Finally, we assess the need to correct the quadrupole focusing produced by Half Wave, and Single Spoke accelerating cavities. We assess the feasibility of controlling the beam coupling in the machine by changing the polarity of the field of linac focusing solenoids

43 PARTICLE ACCELERATORS↗
DOE OSTI2021

The 2020 Nonlinear Mechanics and Dynamics Research Institute

The 2020 Nonlinear Mechanics and Dynamics (NOMAD) Research Institute was successfully held from June 15 to July 30, 2020. NOMAD brings together participants with diverse technical backgrounds to work in small teams to cultivate new ideas and approaches in engineering mechanics and dynamics research. NOMAD provides an opportunity for researchers – especially early career researchers - to develop lasting collaborations that go beyond what can be established from the limited interactions at their institutions or at annual conferences. A total of 11 students participated in the seven-week long program held virtually due to the COVID-19 health pandemic. The students collaborated on one of four research projects that were developed by various mentors from Sandia National Laboratories, the University of New Mexico, and other academic and research institutions. In addition to the research activities, the students attended weekly technical seminars, various virtual tours, and socialized at virtual gatherings. At the end of the summer, the students gave a final technical presentation on their research findings. Many of the research discoveries made at NOMAD 2020 are published as proceedings at technical conferences and have direct alignment with the critical mission work performed at Sandia.

42 ENGINEERING↗
DOE OSTI2011

Scientific and Computational Challenges of the Fusion Simulation Program (FSP)

This paper highlights the scientific and computational challenges facing the Fusion Simulation Program (FSP) a major national initiative in the United States with the primary objective being to enable scientific discovery of important new plasma phenomena with associated understanding that emerges only upon integration. This requires developing a predictive integrated simulation capability for magnetically-confined fusion plasmas that are properly validated against experiments in regimes relevant for producing practical fusion energy. It is expected to provide a suite of advanced modeling tools for reliably predicting fusion device behavior with comprehensive and targeted science-based simulations of nonlinearly-coupled phenomena in the core plasma, edge plasma, and wall region on time and space scales required for fusion energy production. As such, it will strive to embody the most current theoretical and experimental understanding of magnetic fusion plasmas and to provide a living framework for the simulation of such plasmas as the associated physics understanding continues to advance over the next several decades. Substantive progress on answering the outstanding scientific questions in the field will drive the FSP toward its ultimate goal of developing the ability to predict the behavior of plasma discharges in toroidal magnetic fusion devices with high physics fidelity on all relevant time and space scales. From a computational perspective, this will demand computing resources in the petascale range and beyond together with the associated multi-core algorithmic formulation needed to address burning plasma issues relevant to ITER - a multibillion dollar collaborative experiment involving seven international partners representing over half the world's population. Even more powerful exascale platforms will be needed to meet the future challenges of designing a demonstration fusion reactor (DEMO). Analogous to other major applied physics modeling projects (e.g., Climate Modeling), the FSP will need to develop software in close collaboration with computers scientists and applied mathematicians and validated against experimental data from tokamaks around the world. Specific examples of expected advances needed to enable such a comprehensive integrated modeling capability and possible "co-design" approaches will be discussed. __________________________________________________

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2011

Integrated Sensing and Controls for Coal Gasification - Development of Model-Based Controls for GE's Gasifier and Syngas Cooler (Final Technical Report)

This report summarizes the achievements and final results of this program. The objective of this program is to develop a comprehensive systems approach to integrated design of sensing and control systems for an Integrated Gasification Combined Cycle (IGCC) plant, using advanced model-based techniques. In particular, this program is focused on the model-based sensing and control system design for the core gasification section of an IGCC plant. The overall approach consists of (i) developing a first-principles physics-based dynamic model of the gasification section, (ii) performing model-reduction where needed to derive low-order models suitable for controls analysis and design, (iii) developing a sensing system solution combining online sensors with model-based estimation for important process variables not measured directly, and (iv) optimizing the steady-state and transient operation of the plant for normal operation as well as for startup using model predictive controls (MPC). Initially, available process unit models were implemented in a common platform using Matlab/Simulink{reg_sign}, and appropriate model reduction and model updates were performed to obtain the overall gasification section dynamic model. Also, a set of sensor packages were developed through extensive lab testing and implemented in the Tampa Electric Company IGCC plant at Polk power station in 2009, to measure temperature and strain in the radiant syngas cooler (RSC). Plant operation data was also used to validate the overall gasification section model. The overall dynamic model was then used to develop a sensing solution including a set of online sensors coupled with model-based estimation using nonlinear extended Kalman filter (EKF). Its performance in terms of estimating key unmeasured variables like gasifier temperature, carbon conversion, etc., was studied through extensive simulations in the presence sensing errors (noise and bias) and modeling errors (e.g. unknown gasifier kinetics, RSC fouling). In parallel, an MPC solution was initially developed using ideal sensing to optimize the plant operation during startup pre-heating as well as steady state and transient operation under normal high-pressure conditions, e.g. part-load, base-load, load transition and fuel changes. The MPC simulation studies showed significant improvements both for startup pre-heating and for normal operation. Finally, the EKF and MPC solutions were coupled to achieve the integrated sensing and control solution and its performance was studied through extensive steady state and transient simulations in the presence of sensor and modeling errors. The results of each task in the program and overall conclusions are summarized in this final report.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2024

GPU-enabled extreme-scale turbulence simulations: Fourier pseudo-spectral algorithms at the exascale using OpenMP offloading

Fourier pseudo-spectral methods for nonlinear partial differential equations are of wide interest in many areas of advanced computational science, including direct numerical simulation of three-dimensional (3-D) turbulence governed by the Navier-Stokes equations in fluid dynamics. This paper presents a new capability for simulating turbulence at a new record resolution up to 35 trillion grid points, on the world's first exascale computer, Frontier, comprising AMD MI250x GPUs with HPE's Slingshot interconnect and operated by the US Department of Energy's Oak Ridge Leadership Computing Facility (OLCF). Key programming strategies designed to take maximum advantage of the machine architecture involve performing almost all computations on the GPU which has the same memory capacity as the CPU, performing all-to-all communication among sets of parallel processes directly on the GPU, and targeting GPUs efficiently using OpenMP offloading for intensive number-crunching including 1-D Fast Fourier Transforms (FFT) performed using AMD ROCm library calls. With 99% of computing power on Frontier being on the GPU, leaving the CPU idle leads to a net performance gain via avoiding the overhead of data movement between host and device except when needed for some I/O purposes. Memory footprint including the size of communication buffers for MPI_ALLTOALL is managed carefully to maximize the largest problem size possible for a given node count. Detailed performance data including separate contributions from different categories of operations to the elapsed wall time per step are reported for five grid resolutions, from 2048 3 on a single node to 32768 3 on 4096 or 8192 nodes out of 9408 on the system. Both 1D and 2D domain decompositions which divide a 3D periodic domain into slabs and pencils respectively are implemented. The present code suite (labeled by the acronym GESTS, GPUs for Extreme Scale Turbulence Simulations) achieves a figure of merit (in grid points per second) exceeding goals set in the Center for Accelerated Application Readiness (CAAR) program for Frontier. The performance attained is highly favorable in both weak scaling and strong scaling, with notable departures only for 2048 3 where communication is entirely intra-node, and for 32768 3 , where a challenge due to small message sizes does arise. Communication performance is addressed further using a lightweight test code that performs all-to-all communication in a manner matching the full turbulence simulation code. Performance at large problem sizes is affected by both small message size due to high node counts as well as dragonfly network topology features on the machine, but is consistent with official expectations of sustained performance on Frontier. Overall, although not perfect, the scalability achieved at the extreme problem size of 32768 3 (and up to 8192 nodes — which corresponds to hardware rated at just under 1 exaflop/sec of theoretical peak computational performance) is arguably better than the scalability observed using prior state-of-the-art algorithms on Frontier's predecessor machine (Summit) at OLCF. New science results for the study of intermittency in turbulence enabled by this code and its extensions are to be reported separately in the near future.

3D fast Fourier transform↗