Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “symmetric tensor decomposition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Estimating Higher-Order Moments Using Symmetric Tensor Decomposition

In this paper, we consider the problem of decomposing higher-order moment tensors, i.e., the sum of symmetric outer products of data vectors. Such a decomposition can be used to estimate the means in a Gaussian mixture model and for other applications in machine learning. The dth-order empirical moment tensor of a set of p observations of n variables is a symmetric d-way tensor. Our goal is to nd a low-rank tensor approximation comprising r $\ll$ p symmetric outer products. The challenge is that forming the empirical moment tensor costs O(pn d ) operations and O(n d ) storage, which may be prohibitively expensive; additionally, the algorithm to compute the low-rank approximation costs O(n d ) per iteration. Our contribution is avoiding formation of the moment tensor, computing the low-rank tensor approximation of the moment tensor implicitly using O(pnr) operations per iteration and no extra memory. This advance opens the door to more applications of higher-order moments since they can now be efficiently computed. We present numerical evidence of the computational savings and show an example of estimating the means for higher-order moments.

97 MATHEMATICS AND COMPUTING↗

Efficient Parallel Sparse Symmetric Tucker Decomposition for High-Order Tensors

Tensor based methods are receiving renewed attention in recent years due to their prevalence in diverse real-world applications. There is considerable literature on tensor representations and algorithms for tensor decompositions, both for dense and sparse tensors. Many applications in hypergraph analytics, machine learning, psychometry, and signal processing result in tensors that are both sparse and symmetric, making it an important class for further study. Similar to the critical Tensor Times Matrix chain operation (TTMc) in general sparse tensors, the Sparse Symmetric Tensor Times Same Matrix chain (S3TTMc) operation is compute and memory intensive due to high tensor order and the associated factorial explosion in the number of non-zeros. In this work, we present a novel compressed storage format CSS for sparse symmetric tensors, along with an efficient parallel algorithm for the S3TTMc operation. We theoretically establish that S3TTMc on CSS achieves a better memory versus run-time trade-off compared to state-of-the-art implementations. We demonstrate experimental findings that confirm these results and achieve up to 2.9× speedup on synthetic and real datasets.

Shivakumar, Shruti↗

SymProp: Scaling Sparse Symmetric Tucker Decomposition via Symmetry Propagation

Sparse symmetric tensors are an important class of tensors, and their decompositions serve as powerful tools for revealing low-rank structures. This paper introduces SymProp, a novel approach for scaling sparse symmetric Tucker decomposition by propagating symmetry through intermediate computations. SymProp optimizes two key computational kernels: Sparse Symmetric Tensor Times Same Matrix chain (S3 TTMc) for Higher-Order Orthogonal Iteration (HOOI) and Sparse Symmetric Tensor Times Same Matrix chain Times Core (S3 TTMcTC) for Higher-Order QR Iteration (HOQRI). Our method employs a metaprogramming-based index iteration approach to efficiently handle the upper triangular parts of intermediate dense symmetric tensors. SymProp achieves up to 50.9× speedup over SPLATT and up to 360.8× over Compressed Sparse Symmetric (CSS) format on the S3 TTMc operation. Moreover, our S3 TTMc and S3 TTMcTC implementations support tensor orders four levels higher than state-of-the-art methods. Our HOQRI demonstrates superior scalability and up to a 33.6× speedup over optimized HOOI. By enabling more scalable Tucker decompositions for higher orders, decomposition ranks, and dimension sizes, SymProp opens new possibilities for analyzing complex hypergraph structures in fields such as network science, data mining, and machine learning.

Li, Zecheng [North Carolina State University]↗

Sparse Symmetric Format for Tucker Decomposition

Tensor-based methods are receiving renewed attention in recent years due to their prevalence in diverse real-world applications. There is considerable literature on tensor representations and algorithms for tensor decompositions, both for dense and sparse tensors. Many applications in hypergraph analytics, machine learning, psychometry, and signal processing result in tensors that are both sparse and symmetric, making them an important class for further study. Similar to the critical Tensor Times Matrix chain operation (TTM c ) in general sparse tensors, the $\underline{S}$ parse $\underline{S}$ ymmetric $\underline{T}$ ensor $\underline{T}$ imes $\underline{S}$ ame $\underline{M}$ atrix $\underline{c}$ hain (S 3 TTM c ) operation is compute and memory intensive due to high tensor order and the associated factorial explosion in the number of non-zeros. We present the novel Compressed Sparse Symmetric (CSS) format for sparse symmetric tensors, along with an efficient parallel algorithm for the S 3 TTM c operation. We theoretically establish that S 3 TTM c on CSS achieves a better memory versus run-time trade-off compared to state-of-the-art implementations, and visualize the variation of the performance gap over the parameter space. We demonstrate experimental findings that confirm these results and achieve up to 2.72× speedup on synthetic and real datasets. The scaling of the algorithm on different test architectures is also showcased to highlight the effect of machine characteristics on algorithm performance.

42 ENGINEERING↗

A finite element tensor approach to plate buckling and postbuckling.

A practical finite element method is presented for geometrically nonlinear (von Karman) plate problems. Symmetric strain energy tensors provide an efficient formulation and solution, and allow the effects of initial imperfections to be considered. An unbalanced force iteration is employed, with the advantage that the time consuming Gauss decomposition needs to be performed only once. The convergence is controlled by an automatically computed relaxation factor, and this makes the method applicable in advanced stages of non-linearity. Several different triangular elements are used in explicitly deriving the required tensors.

Vos, R. G.↗

Flavor diagonal nucleon charges using clover fermions on MILC HISQ ensembles

We present lattice results for the flavor diagonal charges of the proton from the analysis of eight ensembles generated using 2+1+1-flavors of highly improved staggered quarks by the MILC Collaboration. The calculation includes all the needed connected and disconnected contributions to nucleon three-point function. For extracting matrix elements using fits to the spectral decomposition of these correlation functions, two strategies to remove excited state contributions are employed and compared. To renormalize these charges, the 2+1-flavor mixing matrix is calculated in the regularization independent symmetric momentum subtraction intermediate scheme on the lattice. The final results are presented in the $\overline{MS}$ scheme at scale 2 GeV. The axial charges for the proton are $𝑔$$^{𝑢}_{𝐴}$ = 0.781⁢(25), $𝑔$$^{𝑑}_{𝐴}$ =−0.440⁢(39), and $𝑔$$^{𝑠}_{𝐴}$ = −0.055⁢(9); the tensor charges are $𝑔$$^{𝑢}_{𝑇}$ = 0.782⁢(28), $𝑔$$^{𝑑}_{𝑇}$ = −0.195⁢(16), and $𝑔$$^{𝑠}_{𝑇}$ = −0.0016⁢(12); and the scalar charges are $𝑔$$^{𝑢}_{𝑆}$ = 9.39⁢(88), $𝑔$$^{𝑑}_{𝑆}$ = 8.84⁢(93), and $𝑔$$^{𝑠}_{𝑆}$ = 0.37⁢(14). Results for the neutron are given by the 𝑢 ↔ 𝑑 interchange. Results for the sigma terms are 𝜎 𝜋⁢𝑁 | standard = 42⁢(6) MeV from a “standard” analysis and 𝜎 𝜋⁢𝑁 | 𝑁⁢𝜋 = 61⁢(6) MeV from an “𝑁⁢𝜋” analysis that includes the contributions of multihadron 𝑁⁢𝜋 excited states as motivated by chiral perturbation theory. Our preferred value 𝜎 𝜋⁢𝑁 | 𝑁⁢𝜋 is consistent with the phenomenological extraction from 𝜋 −𝑁 scattering data. The strangeness content of the proton, for which the standard analysis is appropriate, is 𝜎 𝑠 | standard = 35⁢(13) MeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Velocity-space Origins of the Pressure–Strain Interaction in Multipopulation Distributions and Its Application to Magnetic Reconnection

A forefront research question is how energy evolves in weakly collisional plasmas for which departures from local thermodynamic equilibrium (LTE) are significant. The standard approach is studying the terms in the non-LTE energy evolution equation derived by taking the second moment of the Boltzmann equation, but the resultant fluid metrics do not retain information about which particles at which velocities drive energy evolution. A widely studied channel for internal energy density evolution is the pressure–strain interaction. Here, we employ the kinetic pressure–strain, a phase-space diagnostic whose velocity-space integral recovers the pressure–strain interaction to disambiguate the contributions to the pressure–strain interaction from disparate particle populations in composite phase-space densities. We develop phase-space analogs of the pressure–strain interaction decompositions to provide the phase-space origins of normal versus sheared flow. We introduce the “kinetic strain-rate” tensor, the phase-space analog of the strain-rate tensor, which we argue is needed to interpret the phase-space origins of the pressure–strain interaction. To demonstrate the utility of these quantities, we investigate them for composite electron distributions near the electron diffusion region in two-dimensional particle-in-cell simulations of antiparallel symmetric magnetic reconnection. We find that the phase-space-based diagnostics isolate the roles of distinct populations. These results contribute to a growing body of work providing new methods for quantifying phase-space energy evolution for a broad array of processes, from magnetic reconnection to collisionless shocks and turbulence, opening new pathways for answering longstanding problems of particle energization in weakly collisional plasmas.

79 ASTRONOMY AND ASTROPHYSICS↗

A Flexible Power Method for Solving Infinite Dimensional Tensor Eigenvalue Problems

We propose a flexible power method for computing the leftmost, i.e., algebraically smallest, eigenvalue of an infinite dimensional tensor eigenvalue problem, $H x = \lambda x$, where the infinite dimensional symmetric matrix $H$ exhibits a translational invariant structure. We assume the smallest eigenvalue of $H$ is simple and apply a power iteration of $e^{-H}$ with the eigenvector represented in a compact way as a translational invariant infinite Tensor Ring (iTR). Hence, the infinite dimensional eigenvector can be represented by a finite number of iTR cores of finite rank. In order to implement this power iteration, we use a small parameter $t$ so that the infinite matrix-vector operation $e^{-Ht}x$ can efficiently be approximated by the Lie product formula, also known as Suzuki--Trotter splitting, and we employ a low rank approximation through a truncated singular value decomposition on the iTR cores in order to keep the cost of subsequent power iterations bounded. We also use an efficient way for computing the iTR Rayleigh quotient and introduce a finite size iTR residual which is used to monitor the convergence of the Rayleigh quotient and to modify the timestep $t$. In this paper, we discuss 2 different implementations of the flexible power algorithm and illustrate the automatic timestep adaption approach for several numerical examples.

Beeumen, Roel Van↗