Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “preconditioning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Modeling Dynamic Regulatory Processes in Stroke.

The ability to examine in silico the behavior of biological systems can greatly accelerate the pace of discovery in disease pathologies, such as stroke, where in vivo experimentation is lengthy and costly. In this paper we describe an approach to in silico examination of blood genomic responses to neuroprotective agents and subsequent stroke through the development of dynamic models of the regulatory processes observed in the experimental gene expression data. First, we identified functional gene clusters from these data. Next, we derived ordinary differential equations (ODEs) relating regulators and functional clusters from the data. These ODEs were used to develop dynamic models that simulate the expression of regulated functional clusters using system dynamics as the modeling paradigm. The dynamic model has the considerable advantage of only requiring an initial starting state, and does not require measurement of regulatory influences at each time point in order to make accurate predictions. The manipulation of input model parameters, such as changing the magnitude of gene expression, made it possible to assess the behavior of the networks through time under varying conditions. We report that an optimized dynamic model can provide accurate predictions of overall system behavior under several different preconditioning paradigms.

dynamic modeling↗

Defect-engineered GaN high electron mobility transistors for enhanced radiation tolerance

This study explores the radiation resilience of GaN high-electron-mobility transistors (HEMTs) under various preconditioning treatments—pristine, electro-pulsed, electrically overstressed, and 60 Co gamma-irradiated—with a focus on enhancing survivability in high-radiation environments. Key findings emphasize the gate region’s central role in radiation sensitivity, with increased defect concentrations leading to reduced sensitivity—as determined from reduced single-event transient intensities during pulsed-laser studies—and impacting charge-transport dynamics. Notably, the most sensitive region shifted as a function of bias state, with the drain side of the gate being most sensitive under negative gate bias and the source side under unbiased conditions due to two-dimensional electron gas disruptions. These insights clarify the mechanisms influencing radiation sensitivity in microelectronics and highlight the potential of defect and strain engineering to enhance the radiation hardness of GaN HEMTs across various operational states, providing valuable guidance for applications in space, defense, and other radiation-rich environments.

36 MATERIALS SCIENCE↗

A balancing domain decomposition method by constraints for advection-diffusion problems

The balancing domain decomposition methods by constraints are extended to solving nonsymmetric, positive definite linear systems resulting from the finite element discretization of advection-diffusion equations. A pre-conditioned GMRES iteration is used to solve a Schur complement system of equations for the subdomain interface variables. In the preconditioning step of each iteration, a partially sub-assembled finite element problem is solved. A convergence rate estimate for the GMRES iteration is established, under the condition that the diameters of subdomains are small enough. It is independent of the number of subdomains and grows only slowly with the subdomain problem size. Numerical experiments for several two-dimensional advection-diffusion problems illustrate the fast convergence of the proposed algorithm.

97 MATHEMATICS AND COMPUTING↗

Solution methods for very highly integrated circuits.

While advances in manufacturing enable the fabrication of integrated circuits containing tens-to-hundreds of millions of devices, the time-sensitive modeling and simulation necessary to design these circuits poses a significant computational challenge. This is especially true for mixed-signal integrated circuits where detailed performance analyses are necessary for the individual analog/digital circuit components as well as the full system. When the integrated circuit has millions of devices, performing a full system simulation is practically infeasible using currently available Electrical Design Automation (EDA) tools. The principal reason for this is the time required for the nonlinear solver to compute the solutions of large linearized systems during the simulation of these circuits. The research presented in this report aims to address the computational difficulties introduced by these large linearized systems by using Model Order Reduction (MOR) to (i) generate specialized preconditioners that accelerate the computation of the linear system solution and (ii) reduce the overall dynamical system size. MOR techniques attempt to produce macromodels that capture the desired input-output behavior of larger dynamical systems and enable substantial speedups in simulation time. Several MOR techniques that have been developed under the LDRD on 'Solution Methods for Very Highly Integrated Circuits' will be presented in this report. Among those presented are techniques for linear time-invariant dynamical systems that either extend current approaches or improve the time-domain performance of the reduced model using novel error bounds and a new approach for linear time-varying dynamical systems that guarantees dimension reduction, which has not been proven before. Progress on preconditioning power grid systems using multi-grid techniques will be presented as well as a framework for delivering MOR techniques to the user community using Trilinos and the Xyce circuit simulator, both prominent world-class software tools.

99 GENERAL AND MISCELLANEOUS↗

Technical Advice and Support for the Joint Integrated Non-Intrusive Inspection (JINII) Program Task 2.2 Transmission Digital Radiography (DR)

The Cargo Advanced Automated Radiography System (CAARS) program aims to utilize advanced radiographic systems to detect radiological and nuclear threats. Validation of initial design and testing concepts is a precondition for prototype system development and large-scale deployment. As expected, Depleted Uranium (DU) is a valid surrogate for Special Nuclear Materials (SNM) in CAARS Advanced Technology Demonstration (ATD) performance field-tests of transmission radiography systems. Dual-energy transmission measurements of DU are nearly identical to SNM, and are distinct from lower Z materials, provided the samples are matched to equal areal density. Results from an alternative method, using samples of equal thickness, showed sample discrimination by material density, rather than by atomic number (Z). The transmission measurements of DU and SNM were made with equipment that is nearly identical to current field systems. X-ray source beams at endpoint energies of 5.4 MeV and 9.6 MeV were used to measure transmission through the selected sample materials. The ratio of the x-ray linear attenuation coefficient times length ({micro}L) at 5.4 MeV, to {micro}L at 9.6 MeV is a metric for atomic number based discrimination of materials. The measured ratios were compared with computed values based on LLNL photon cross section data and LLNL developed models of x-ray detector characteristics. Measured ratios for DU differed from HEU by an average of 0.25%, and from WGPu by 0.08%, which is within the noise level of 0.4 to 0.5%. For comparison, measured ratios for Sn differed from HEU by 3.2%, and from WGPu by 3.6%, well beyond the measurement noise. Measured ratios for W differed from HEU by 0.01%, and from WGPu by 0.32%. The measured ratio values presented in Table 1 demonstrate the feasibility of using a threshold ratio to discriminate low-Z (Z < 72) from high-Z (Z {ge} 72) materials (as defined by CAARS specification). In the case of our test system, a threshold ratio of 1.08 would be suitable based on the measured results.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Final Report - Summer Visit 2010

During my visit to LLNL during the summer of 2010, I worked on algebraic multilevel solvers for large sparse systems of linear equations arising from discretizations of partial differential equations. The particular solver of interest is based on ILU decomposition. The setup phase for this AMG solve is just the single ILU decomposition, and its corresponding error matrix. Because the ILU uses a minimum degree or similar sparse matrix ordering, most of the fill-in, and hence most of the error, is concentrated in the lower right corner of the factored matrix. All of the major multigrid components - the smoother, the coarse level correction matrices, and the fine-to-coarse and coarse-to-fine rectangular transfer matrices, are defined in terms of various blocks of the ILU factorization. Although such a strategy is not likely to be optimal in terms of convergence properties, it has a relatively low setup cost, and therefore is useful in situations where setup costs for more traditional AMG approaches cannot be amortized over the solution of many linear systems using the same matrix. Such a situation arises in adaptive methods, where often just one linear system is solved at each step of an adaptive feedback loop, or in solving nonlinear equations by approximate Newton methods, where the approximate Jacobian might change substantially from iteration to iteration. In general terms, coarse levels are defined in terms of successively smaller lower right blocks of the matrix, typically decreasing geometrically in order. The most difficult issue was the coarse grid correction matrix. The preconditioner/smoother for a given level is just the corresponding lower right blocks of the ILU factorization. The coarse level matrix itself is just the Schur complement; this matrix is not known exactly using just the ILU decomposition in the setup phase. Thus we approximate this matrix using various combinations of the preconditioning matrix and the error matrix. During my visit, several approximations of this type were implemented and tested. While some improved the convergence rate of the overall method, these gains had to be balanced against the additional costs involved in creating and applying these matrices. By this more stringent criterion, none of the improved approximations could be characterized as an unqualified success.

97 MATHEMATICS AND COMPUTING↗

Numerical Methods for Large-Scale Data Factorization (Final Report (Milestone Date 9/30/11) for Subcontract No. B594099)

The following work has been performed by PI Hans De Sterck and graduate student Manda Winlaw for the required tasks 1-5 (as listed in the Statement of Work). Graduate student Manda Winlaw has visited LLNL January 31-March 11, 2011 and May 23-August 19, 2010, working with Van Henson and Mike O'Hara on non-negative matrix factorizations (NMF). She has investigated the dense subgraph clustering algorithm from 'Finding Dense Subgraphs for Sparse Undirected, Directed, and Bipartite Graphs' by Chen and Saad, testing this method on several term-document matrices and adapting it to cluster based on the rank of the subgraphs instead of the density. Manda Winlaw was awarded a first prize in the annual LLNL summer student poster competition for a poster on her NMF research. PI Hans De Sterck has developed a new adaptive algebraic multigrid algorithm for computing a few dominant or minimal singular triplets of sparse rectangular matrices. This work builds on adaptive algebraic multigrid methods that were further developed by the PI and collaborators (including Sanders and Henson) for Markov chains. The method also combines and extends existing multigrid algorithms for the symmetric eigenproblem. The PI has visited LLNL February 22-25, 2011, and has given a CASC seminar 'Algebraic Multigrid for the Singular Value Problem' on this work on February 23, 2011. During his visit, he has discussed this work and related topics with Van Henson, Geoffrey Sanders, Panayot Vassilevski, and others. He has tested the algorithm on PDE matrices and on a term-document matrix, with promising initial results. Manda Winlaw has also started to work, with O'Hara, on estimating probability distributions over undirected graph edges. The goal is to estimate probabilistic models from sets of undirected graph edges for the purpose of prediction, anomaly detection and support to supervised learning. Graduate student Manda Winlaw is writing a paper on the results obtained with O'Hara which will be submitted some time later in 2011 to a data mining conference. PI Hans De Sterck has developed a new optimization algorithm for canonical tensor approximation, formulating an extension of the nonlinear GMRES method to optimization problems. Numerical results for tensors with up to 8 modes show that this new method is efficient for sparse and dense tensors. He has written a paper on this which has been submitted to the SIAM Journal on Scientific Computing. PI Hans De Sterck has further developed his new optimization algorithm for canonical tensor approximation, formulating an extension in terms of steepest-descent preconditioning, which makes the approach generally applicable for nonlinear optimization. He has written a paper on this extension which has been submitted to Numerical Linear Algebra with Applications.

97 MATHEMATICS AND COMPUTING↗

Shape-Selective Catalysts for Fischer-Tropsch Chemistry: January 1, 2001 - December 31, 2008 (Final Report)

Argonne National Laboratory carried out a research program to create, prepare, and evaluate catalysts to promote Fischer-Tropsch (FT) chemistry-specifically, the reaction of hydrogen with carbon monoxide to form long-chain hydrocarbons. In addition to needing high activity, it was desirable that the catalysts have high selectivity and stability with respect to both mechanical strength and aging properties. It was desired that selectivity be directed toward producing diesel fraction components and avoiding excess yields of both light hydrocarbons and heavy waxes. The original goal was to produce shape-selective catalysts that had the potential to limit the formation of long-chain products and yet retain the active metal sites in a protected 'cage.' This cage would also restrict their loss by attrition during use in slurry-bed reactors. The first stage of this program was to prepare and evaluate iron-containing particulate catalysts. Such catalysts were prepared with silica-containing fractal cages. The activity and strength was essentially the same as that of catalysts without the cages. Since there was no improvement, the program plan was modified as discussed below. A second experimental stage was undertaken to prepare and evaluate active FT catalysts formed by atomic-layer deposition [ALD] of active components on supported membranes and particulate supports. The concept was that of depositing active metals (i.e. ruthenium, iron or cobalt) upon membranes with well defined flow channels of small diameter and length such that the catalytic activity and product molecular weight distribution could be controlled. In order to rapidly evaluate the catalytic membranes, the ALD coating processes were performed in an 'exploratory mode' in which ALD procedures from the literature appropriate for coating flat surfaces were applied to the high surface area membranes. Consequently, the Fe and Ru loadings in the membranes were likely to be smaller than those expected for complete monolayer coverage. In addition, there was likely to be significant variation in the Fe and Ru loading among the membranes due to difficulties in nucleating these materials on the aluminum oxide surfaces. The first series of experiments using coated membranes demonstrated that the technology needed further improvement. Specifically, observed catalytic FT activity was low. This low activity appeared to be due to: (1) low available surface area, (2) atomic deposition techniques that needed improvements, and (3) insufficient preconditioning of the catalyst surface prior to FT testing. Therefore, experimentation was expanded to the use of particulate silica supports having defined channels and reasonably high surface area. An effective FT catalyst consisting of ALD-deposited Co and Pt on a silica support has been prepared and demonstrated. This catalyst was more effective than a similar catalyst deposited upon a support of ALD-deposited Al 2 O 3 on silica. This result implies that the deposition of Al 2 O 3 to form a support is not as effective as desired. The addition of Pt as a Co-containing catalyst promoter has been demonstrated; it appears to primarily affect the catalyst pre-conditioning step. Co on Al 2 O 3 catalyst prepared by the Center for Applied Energy Research (CAER) is more effective than Argonne-prepared ALD-deposited Co on ALD-deposited Al 2 O 3 catalyst. The FT activity of ALD-coated Co catalyst on Al 2 O 3 is about linear with Co level from about 9 to 25%. A cooperative research effort was undertaken to test the deposition of platinum on Co FT catalysts; this Pt influences the effectiveness of catalyst conditioning and its continuing activity. In summary, the ALD Pt at a low concentration (0.1 wt %) was as effective as that of the wet chemical deposition technique of CAER (specifically incipient deposition on a Co catalyst that had been prepared and calcined before the Pt deposition.) The ALD technique appeared to be nominally better than the incipient wetness technique that involved co-deposition of Pt and Co prior to calcination. The activation energy of the rate of CO conversion was tightly grouped about an average of 29.2 Kcal/mol when all of the Co-containing catalysts other than those with high Pt promoter levels were taken into account; this implies a uniform reaction mechanism. Catalysts containing Pt and Ru that were ALD-deposited on an ALD-Al 2 O 3 coated catalyst support were found to be relatively inactive. Additional tests were made with a low concentration (0.1 wt %) of Ru or Ir deposited on the reference Co catalyst. The Ir coated catalysts were particularly effective. In support of the above, there was an opportunity to undertake a study of cobalt/promoter/support interaction using the Advanced Photon Source (APS) of Argonne. A number of catalysts (including reference cobalt oxide and iron oxides) were tested using temperature programmed EXAFS/XANES experiments.

08 HYDROGEN↗

Navier-Stokes Solvers and Generalizations for Reacting Flow Problems

This is an overview of our accomplishments during the final term of this grant (1 September 2008 -- 30 June 2012). These fall mainly into three categories: fast algorithms for linear eigenvalue problems; solution algorithms and modeling methods for partial differential equations with uncertain coefficients; and preconditioning methods and solvers for models of computational fluid dynamics (CFD).

97 MATHEMATICS AND COMPUTING↗

Adaptive AMG with Coarsening Based on Compatible Weighted Matching

We introduce a new composite adaptive Algebraic Multigrid (composite αAMG) method to solve systems of linear equations without a-priori knowledge or assumption on characteristics of near-null components of the AMG preconditioned problem referred to as algebraic smoothness. Our version of αAMG is a composite solver built through a bootstrap strategy aimed to obtain a desired convergence rate. The coarsening process employed to build each new solver component relies on a pairwise aggregation scheme based on maximum weighted matching in a graph and on principles of compatible relaxation. The latter replaces the commonly used characterization of strength of connection in both the coarse space selection and in the interpolation scheme. The goal is to design a method leading to scalable AMG for a wide class of problems that go beyond the standard elliptic Partial Differential Equations (PDEs). In the present work, we introduce the method and demonstrate its potential when applied to symmetric positive definite linear systems arising from finite element discretization of highly anisotropic elliptic PDEs on structured and unstructured meshes.

97 MATHEMATICS AND COMPUTING↗

Fully implicit particle-in-cell algorithms for kinetic simulation of plasmas [Slides]

We have demonstrated, for the first time, a fully implicit, fully nonlinear electrostatic PIC formulation that features: (1) Exact charge conservation (via a novel particle mover strategy). (2) Exact energy conservation (no particle self-heating or self-cooling). (3) Adaptive particle orbit integrator to control errors in momentum conservation. The approach has been shown to be free of CFL and finite-grid numerical instabilities. As a result, the method is able to take time steps many times larger than explicit, and resolutions many times coarser. Central to our implementation is the concept of particle enslavement. We have generalized formulation to use spatial adaptivity via mapped coordinates. he method has much potential for efficiency gains vs. explicit in long-time-scale applications, with the CPU speedup scaling as $(kΛ_D)-^{(d+1)}/N_{FE}$. Minimize the number of nonlinear function evaluations $N_{FE}$ for given $Δt$, $Δx \Rightarrow$ preconditioning! We have formulated and implemented a very efficient moment-based preconditioner. We have ported the algorithm to GPU architectures. We have generalized the algorithm to non-radiative electromagnetic regimes (Darwin model), where, in addition to charge and energy, we also conserve canonical momenta.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

HPCG Benchmark Technical Specification

The High Performance Conjugate Gradient (HPCG) benchmark [cite SNL, UTK reports] is a tool for ranking computer systems based on a simple additive Schwarz, symmetric Gauss-Seidel preconditioned conjugate gradient solver. HPCG is similar to the High Performance Linpack (HPL), or Top 500, benchmark [1] in its purpose, but HPCG is intended to better represent how today’s applications perform. In this paper we describe the technical details of HPCG: how it is designed and implemented, what code transformations are permitted and how to interpret and report results.

97 MATHEMATICS AND COMPUTING↗

Scalable Nonlinear Solvers for Fully Implicit Coupled Nuclear Fuel Modeling. Final Report

The focus of the project is on the development and customization of some highly scalable domain decomposition based preconditioning techniques for the numerical solution of nonlinear, coupled systems of partial differential equations (PDEs) arising from nuclear fuel simulations. These high-order PDEs represent multiple interacting physical fields (for example, heat conduction, oxygen transport, solid deformation), each is modeled by a certain type of Cahn-Hilliard and/or Allen-Cahn equations. Most existing approaches involve a careful splitting of the fields and the use of field-by-field iterations to obtain a solution of the coupled problem. Such approaches have many advantages such as ease of implementation since only single field solvers are needed, but also exhibit disadvantages. For example, certain nonlinear interactions between the fields may not be fully captured, and for unsteady problems, stable time integration schemes are difficult to design. In addition, when implemented on large scale parallel computers, the sequential nature of the field-by-field iterations substantially reduces the parallel efficiency. To overcome the disadvantages, fully coupled approaches have been investigated in order to obtain full physics simulations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

CO 2 Saline Storage Demonstration in Colorado Sedimentary Basins. Applied Studies in Reservoir Assessment and Dynamic Processes Affecting Industrial Operations

This multitask research project was conducted in anticipation of a possible future increase in industrial efforts at CO 2 storage in Colorado sedimentary basins. Colorado is already the home to the oldest Rocky Mountain CO 2 storage site, the Rangely Oil Field, where CO 2 -EOR has been underway since the 1980s. The Colorado Geological Survey has evaluated storage options statewide, and as part of the SW Carbon Sequestration Partnership the Survey, is deeply engaged in and committed to suitable underground CO 2 storage. As a more sustainable energy industry is becoming a global priority, it is imperative to explore the range of technical options available to reduce emissions from fossil fuels. One such option is to store at least some emitted CO 2 underground. In this NETL-sponsored CO 2 sequestration project, the Colorado School of Mines and our partners at the University of Colorado have focused on a set of the major fundamental science and engineering issues surrounding geomechanics, mineralogy, geochemistry and reservoir architecture of possible CO 2 storage sites (not limited to Colorado). Those are the central themes of this final report and reported below in Tasks 2, 3, 4, and 6. Closely related to these reservoir geoscience issues are also legal, environmental and public acceptance concerns about pore space accessibility—as a precondition for CO 2 storage. These are addressed in Tasks 1, 5 and 7. Some debates about the future course of the energy industry can become acrimonius. It is true that the physics of combustion of hydrocarbons makes it impossible for fossil energy to attain a carbon footprint anywhere nearly as low as that of renewables. However, there are many offsetting benefits, not the least that fossil energy is still plentiful, it has a global and highly advanced distribution system in place, and the footprint that the fossil energy infrastructure occupies is orders of magnitude smaller than renewable energy facilities with equivalent energy capacity. Finally, inexpensive natural gas here in North America is pushing coal for electricity generation off the market, thus reducing US CO 2 emissions faster than any other large industrialized nation. These two big factors argue for renewed efforts to find technology solutions to reduce the carbon footprint (carbon dioxide as well as methane and trace gases) of conventional and unconventional oil and gas. One major such technology component is likely to be carbon capture, utilization and storage.

54 ENVIRONMENTAL SCIENCES↗

Plasma Science and Innovation Center at Washington, Wisconsin, and Utah State: Final Scientific Report for the University of Wisconsin-Madison

The University of Wisconsin-Madison component of the Plasma Science and Innovation Center (PSI Center) contributed to modeling capabilities and algorithmic efficiency of the Non-Ideal Magnetohydrodynamics with Rotation (NIMROD) Code, which is widely used to model macroscopic dynamics of magnetically confined plasma. It also contributed to the understanding of direct-current (DC) injection of electrical current for initiating and sustaining plasma in three spherical torus experiments: the Helicity Injected Torus-II (HIT-II), the Pegasus Toroidal Experiment, and the National Spherical Torus Experiment (NSTX). The effort was funded through the PSI Center's cooperative agreement with the University of Washington and Utah State University over the period of March 1, 2005 - August 31, 2016. In addition to the computational and physics accomplishments, the Wisconsin effort contributed to the professional education of four graduate students and two postdoctoral research associates. The modeling for HIT-II and Pegasus was directly supported by the cooperative agreement, and contributions to the NSTX modeling were in support of work by Dr. Bickford Hooper, who was funded through a separate grant. Our primary contribution to model development is the implementation of detailed closure relations for collisional plasma. Postdoctoral associate Adam Bayliss implemented the temperature-dependent effects of Braginskii's parallel collisional ion viscosity. As a graduate student, John O'Bryan added runtime options for Braginskii's models and Ji's K2 models of thermal conduction with magnetization effects and thermal equilibration. As a postdoctoral associate, O'Bryan added the magnetization effects for ion viscosity. Another area of model development completed through the PSI-Center is the implementation of Chodura's phenomenological resistivity model. Finally, we investigated and tested linear electron parallel viscosity, leveraged by support from the Center for Extended Magnetohydrodynamic Modeling (CEMM). Work on algorithmic efficiency improved NIMROD's element-based computations. We reordered arrays and eliminated a level of looping for computations over the data points that are used for numerical integration over elements. Moreover, the reordering allows fewer and larger communication calls when using distributed-memory parallel computation, thereby avoiding a data starvation problem that limited parallel scaling over NIMROD's Fourier components for the periodic coordinate. Together with improved parallel preconditioning, work that was supported by CEMM, these developments allowed NIMROD's first scaling to over 10,000 processor cores. Another algorithm improvement supported by the PSI Center is nonlinear numerical diffusivities for implicit advection. We also developed the Stitch code to enhance the flexibility of NIMROD's preprocessing. Our simulations of HIT-II considered conditions with and without fluctuation-induced amplification of poloidal flux, but our validation efforts focused on conditions without amplification. A significant finding is that NIMROD reproduces the dependence of net plasma current as the imposed poloidal flux is varied. The modeling of Pegasus startup from localized DC injectors predicted that development of a tokamak-like configuration occurs through a sequence of current-filament merger events. Comparison of experimentally measured and numerically computed cross-power spectra enhance confidence in NIMROD's simulation of magnetic fluctuations; however, energy confinement remains an open area for further research. Our contributions to the NSTX study include adaptation of the helicity-injection boundary conditions from the HIT-II simulations and support for linear analysis and computation of 3D current-driven instabilities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Deploy Nalu/Kokkos algorithmic infrastructure with performance benchmarking.

The former Nalu interior heterogeneous algorithm design, which was originally designed to manage matrix assembly operations over all elemental topology types, has been modified to operate over homogeneous collections of mesh entities. This newly templated kernel design allows for removal of workset variable resize operations that were formerly required at each loop over a Sierra ToolKit (STK) bucket (nominally, 512 entities in size). Extensive usage of the Standard Template Library (STL) std::vector has been removed in favor of intrinsic Kokkos memory views. In this milestone effort, the transition to Kokkos as the underlying infrastructure to support performance and portability on many-core architectures has been deployed for key matrix algorithmic kernels. A unit-test driven design effort has developed a homogeneous entity algorithm that employs a team-based thread parallelism construct. The STK Single Instruction Multiple Data (SIMD) infrastructure is used to interleave data for improved vectorization. The collective algorithm design, which allows for concurrent threading and SIMD management, has been deployed for the core low-Mach element- based algorithm. Several tests to ascertain SIMD performance on Intel KNL and Haswell architectures have been carried out. The performance test matrix includes evaluation of both low- and higher-order methods. The higher-order low-Mach methodology builds on polynomial promotion of the core low-order control volume nite element method (CVFEM). Performance testing of the Kokkos-view/SIMD design indicates low-order matrix assembly kernel speed-up ranging between two and four times depending on mesh loading and node count. Better speedups are observed for higher-order meshes (currently only P=2 has been tested) especially on KNL. The increased workload per element on higher-order meshes bene ts from the wide SIMD width on KNL machines. Combining multiple threads with SIMD on KNL achieves a 4.6x speedup over the baseline, with assembly timings faster than that observed on Haswell architecture. The computational workload of higher-order meshes, therefore, seems ideally suited for the many-core architecture and justi es further exploration of higher-order on NGP platforms. A Trilinos/Tpetra-based multi-threaded GMRES preconditioned by symmetric Gauss Seidel (SGS) represents the core solver infrastructure for the low-Mach advection/diffusion implicit solves. The threaded solver stack has been tested on small problems on NREL's Peregrine system using the newly developed and deployed Kokkos-view/SIMD kernels. fforts are underway to deploy the Tpetra-based solver stack on NERSC Cori system to benchmark its performance at scale on KNL machines.

97 MATHEMATICS AND COMPUTING↗

Final Report: Subcontract B623868 Algebraic Multigrid solvers for coupled PDE systems

The Pennsylvania State University (“Subcontractor”) continued to work on the design of algebraic multigrid solvers for coupled systems of partial differential equations (PDEs) arising in numerical modeling of various applications, with a main focus on solving the Dirac equation arising in Quantum Chromodynamics (QCD). The goal of the proposed work was to develop combined geometric and algebraic multilevel solvers that are robust and lend themselves to efficient implementation on massively parallel heterogeneous computers for these QCD systems. The research in these areas built on previous works, focusing on the following three topics: (1) the development of parallel full-multigrid (PFMG) and non-Galerkin coarsening techniques in this frame work for solving the Wilson Dirac system; (2) the use of these same Wilson MG solvers for preconditioning the Overlap and Domain Wall formulations of the Dirac equation; and (3) the design and analysis of algebraic coarsening algorithms for coupled PDE systems including Stokes equation, Maxwell equation and linear elasticity.

97 MATHEMATICS AND COMPUTING↗

ForTrilinos Design Document

With the development of a Fortran Interface to Trilinos, ForTrilinos, modelers using modern Fortran will be able to provide their codes the capability to use solvers and other capabilities on exascale machines via a straightforward infrastructure that accesses Trilinos. This document outlines what ForTrilinos does and explains briefly how it works. We show it provides a general access to packages via an entry point and uses an xml file from fortran code. With the first release, ForTrilinos will enable Teuchos to take xml parameter lists from Fortran code and set up data structures. It will provide access to linear solvers and eigen solvers. Several examples are provided to illustrate the capabilities in practice. We explain what the user should have already with their code and what Trilinos provides and returns to the Fortran code. We provide information about the build process for ForTrilinos, with a practical example. In future releases, nonlinear solvers, time iteration, advanced preconditioning techniques, and inversion of control (IoC), to enable callbacks to Fortran routines, will be available.

97 MATHEMATICS AND COMPUTING↗