Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “tensor network simulations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Regional Moment Tensor Inversion Using Rotational Observations

There are benefits from the addition of rotational motions to translational displacements for moment tensor (MT) inversions. The rotational radiation pattern is orthogonal to the shear radiation pattern, thus incorporating rotations is equivalent to gaining another observation point on the focal sphere. We demonstrated this by simulating curl and displacement wavefields for a regional distance station. Thus, one 6-C station (3-Component translational + 3-Component rotational) gathers the same information on radiation pattern as two 3-C stations at 90° azimuth from one another along the focal plane axis, which is sometimes difficult to obtain when restricted to surface sensors. We added rotational Green's functions to a regional MT inversion scheme (long-period, time-domain, and linear inversion) by computing spatial gradients from f-κ reflectivity synthetics. For rotational data, we used Array Derived Rotations (ADR) from Piñon Flats Observatory Array and Golay array deployed during IRIS Community Wavefield Demonstration Experiment. The hope is to ultimately use compact and field deployable broadband rotational seismometers instead of ADRs. Rotational motions were predicted from well-constrained deviatoric MT solutions of nine earthquakes recorded by the arrays and other seismic networks. Additionally, we formed three station sparse datasets with (3-C and 6-C) and without rotational ground motions (3-C only) for eight earthquakes testing the benefits of including rotational waveforms in MT inversions when they are equally weighted with translational waveforms. Adding rotational motions improved the double-couple components and reduced compensated-linear-vector-dipole and isotropic components in full-MT solutions using sparse datasets with poor coverage.

58 GEOSCIENCES↗

Data-driven closure modeling for hypersonic turbulent flows

The Reynolds-averaged Navier–Stokes (RANS) equations remain a workhorse technology for simulating compressible fluid flows of practical interest. Due to model-form errors, however, RANS models can yield erroneous predictions that preclude their use on mission-critical problems. This report summarizes work performed from FY22-FY24 focused on improving RANS models for hypersonic flows using data-driven modeling and scientific machine learning. In this work we: 1. Investigate the current capabilities of RANS models in Sandia’s parallel aerodynamics and re-entry code (SPARC) for hypersonic flows with a focus on shock boundary layer interactions (SBLIs), 2. Assess several established corrections that exist in the literature aimed at improving predictions for SBLIs, 3. Develop improved models for the Reynolds stress tensor using tensor-basis neural networks, 4. Develop a neural-network-based variable turbulent Prandtl number model to reduce errors in wall heating in SBLIs. 5. Begin future investigations including employing the LIFE framework to improve wall heating predictions in SBLIs as well as the ensemble Kalman filter. We find that current RANS models in SPARC are deficient for complex SBLI flows. In particular, no current model jointly predicts wall heat flux, wall shear stress, and wall pressure with reasonable accuracy. Existing corrections help, but do not alleviate this issue altogether. The development of improved models for the Reynolds stress tensor via tensor-basis neural networks results in more predictive RANS models across a suite of low-speed and high-speed cases. For hypersonic boundary layers, the inclusion of the wall-normal Reynolds stress via TBNNs has an appreciable impact on the wall-normal momentum balance and wall quantities. However, we find that improvements to the Reynolds stress tensor do not address the over-prediction in wall heat flux in SBLIs. We find that a neural-network-based variable turbulent Prandtl number model systematically and substantially improves wall heating predictions for a range of SBLI cases.

97 MATHEMATICS AND COMPUTING↗

Simulating spin dynamics of supersolid states in a quantum Ising magnet

Motivated by a recent experimental study on the quantum Ising magnet K 2 Co(SeO 3 ) 2 that presented spectroscopic evidence of zero-field supersolidity (Chen et al., arXiv:2402.15869), we simulate the excitation spectrum of the corresponding microscopic XXZ model for the compound, using the recently developed excitation ansatz for infinite projected entangled-pair states. Here, we map out the ground state phase diagram and compute the dynamical spin structure factors across a range of magnetic field strengths, focusing especially on the two supersolid phases found near zero and saturation fields. Our simulated excitation spectra for the zero-field supersolid “Y” phase are in excellent agreement with the experimental data.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Ab initio ground states of strongly-correlated materials on quantum computers

The accurate first-principles description of strongly-correlated materials is an important and challenging problem in condensed matter physics. Ab initio downfolding has emerged as a way of deriving accurate many-body Hamiltonians including strong correlations, representing a subspace of interest of a material, using density functional theory calculations as a starting point. However, the solution of these material-specific models can scale exponentially on classical computers, constituting a challenge. Here we propose that utilizing quantum computers for obtaining the properties of downfolded Hamiltonians yields an accurate description of the ground state properties of strongly-correlated systems, while circumventing the exponential scaling problem. We benchmark the solution of Hubbard-like models obtained through downfolding by utilizing a classical tensor network implementation of variational quantum eigensolvers (VQE), and we reveal a strategy for driving the optimization through a hybrid minimization of the energy and maximization of the overlap with an approximate solution obtained through low-cost computational methods. This results in a reduction of the energy error by orders of magnitude compared to conventional VQE approaches, and allows us to reproduce long-range correlations for the first time. We demonstrate our first-principles approach for diverse strongly-correlated materials, correctly predicting the antiferromagnetic state of one-dimensional cuprate Ca 2 CuO 3 , the excitonic ground state of monolayer WTe2, and the charge-ordered state of correlated metal SrVO 3 . Our efficient computational implementation allows us to simulate large systems with up to 54 qubits and encompassing up to four correlated bands, which is indicative of the complexity that our framework can address.

Antonios M Alvertis↗

Entanglement transitions from restricted Boltzmann machines

The search for novel entangled phases of matter has lead to the recent discovery of a new class of “en- tanglement transitions,” exemplified by random tensor networks and monitored quantum circuits. Most known examples can be understood as some classical ordering transitions in an underlying statistical mechanics model, where entanglement maps onto the free-energy cost of inserting a domain wall. In this paper we study the possibility of entanglement transitions driven by physics beyond such statistical mechanics mappings. Motivated by recent applications of neural-network-inspired variational Ansätze, we investigate under what conditions on the variational parameters these Ansätze can capture an entanglement transition. We study the entanglement scaling of short-range restricted Boltzmann machine (RBM) quantum states with random phases. For uncorrelated random phases, we analytically demonstrate the absence of an entanglement transition and reveal subtle finite-size effects in finite-size numerical simulations. Introducing phases with correlations decaying as 1/r α in real space, we observe three regions with a different scaling of entanglement entropy depending on the exponent α. We study the nature of the transition between these regions, finding numerical evidence for critical behavior. Furthermore, our work establishes the presence of long-range correlated phases in RBM-based wave functions as a required ingredient for entanglement transitions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A General Spatiotemporal Imputation Framework for Missing Sensor Data

Many applications from precision agriculture, environmental monitoring and transportation networks rely on data collected across space and time over a large geographic area. Missing data poses a significant challenge for any data-driven inference and control tasks. Data imputation or the estimation of missing data can help fill these gaps by utilizing inherent spatial relationships and temporal patterns. A variety of spatiotemporal imputation models have been developed to address missing data in spatiotemporal datasets. However, these classical methods rely on the assumption that the underlying data follows a smooth trend and fail to provide accurate estimates when there is a large number of missing points in the data. Even though there are machine learning driven tensor completion approaches such as convolutional neural network based tensor completion (CoSTCo) that capture the non-linear relationships in the dataset, the transductive nature makes the algorithm less scalable. Thus, existing approaches for estimating the missing information do not effectively capture all dimensions of the spatiotemporal data structure, resulting in erroneous predictions and poor performance. The main contributions of this paper are: (1) We propose a novel inductive framework (G-LSTM) for missing data imputation that integrates a graph neural network with LSTMs to effectively capture both spatial and temporal dependencies. (2) Experimental results on a traffic dataset demonstrate that the proposed GNN integrated with an LSTM framework achieves improved imputation and maintains steady performance even when there are extreme missing conditions in comparison with the state-of-the-art imputation framework (i.e, CoSTCo). (3) The simulation results on a traffic network show up to 69% reduction in mean absolute error and 61% reduction in root mean square error when compared to CoSTCo.

Tharzeen, Aabila↗

A physics-informed multi-agents model to predict thermo-oxidative/hydrolytic aging of elastomers

This paper introduces a novel physics-informed multi-agents constitutive model to propose prediction in quasi-static constitutive behavior of cross-linked elastomer and the loss of mechanical performance during environmental aging. The presented model is used to simulate the effect of single-mechanism chemical aging (i.e. thermal-inducedor hydrolytic aging) on the behavior of the material in this hybrid framework. Those environmental single-mechanism damages change the polymer matrix over time due to massive chain scission, chain formations, and changing the arrangement of molecules in the polymer matrix. Here we propose a data-driven super-constrained machine-learned engine to represent damage in the polymer matrix and capture the changes in material behavior, including its inelastic features such as Mullins effect and permanent set in the course of aging. We have simplified the 3D stress–strain tensor mapping problem into a small number of super-constrained 1D mapping problems by means of a sequential order reduction. An assembly of multiple replicated conditional neural-network learning-agents (L-agents) is trained to systematically simplify the high-dimensional mapping problem into multiple 1D problems, each represented by a different type of agent. Our hybrid framework is designed to capture the effect of deformation history, aging time, and aging temperature. The model is validated with respect to a comprehensive set of experiments specifically designed to benchmark model capabilities and also against available data in the literature. Thermodynamic consistency and frame independency have been verified. Besides acceptable predictive abilities, a significant reduction of computational cost to predict behavior at multiple states of deformation is the most significant feature of this model.

42 ENGINEERING↗

Direct interpolative construction of the discrete Fourier transform as a matrix product operator

The quantum Fourier transform (QFT), which can be viewed as a reindexing of the discrete Fourier transform (DFT), has been shown to be compressible as a low-rank matrix product operator (MPO) or quantized tensor train (QTT) operator. However, the original proof of this fact does not furnish a construction of the MPO with a guaranteed error bound. Meanwhile, the existing practical construction of this MPO, based on the compression of a quantum circuit, is not as efficient as possible. We present a simple closed-form construction of the QFT MPO using the interpolative decomposition, with guaranteed near-optimal compression error for a given rank. This construction can speed up the application of the QFT and the DFT, respectively, in quantum circuit simulations and QTT applications. We also connect our interpolative construction to the approximate quantum Fourier transform (AQFT) by demonstrating that the AQFT can be viewed as an MPO constructed using a different interpolation scheme.

97 MATHEMATICS AND COMPUTING↗

Cartesian message passing neural networks for directional properties: Fast and transferable atomic multipoles

The message passing neural network (MPNN) framework is a promising tool for modeling atomic properties but is, until recently, incompatible with directional properties, such as Cartesian tensors. We propose a modified Cartesian MPNN (CMPNN) suitable for predicting atom-centered multipoles, an essential component of ab initio force fields. The efficacy of this model is demonstrated on a newly developed dataset consisting of 46 623 chemical structures and corresponding high-quality atomic multipoles, which was deposited into the publicly available Molecular Sciences Software Institute QCArchive server. We show that the CMPNN accurately predicts atom-centered charges, dipoles, and quadrupoles and that errors in the predicted atomic multipoles have a negligible effect on multipole–multipole electrostatic energies. The CMPNN is accurate enough to model conformational dependencies of a molecule’s electronic structure. This opens up the possibility of recomputing atomic multipoles on the fly throughout a simulation in which they might exhibit strong conformational dependence.

Glick, Zachary L. (ORCID:0000000309002849)↗

Efficient Mixed-Precision Matrix Factorization of the Inverse Overlap Matrix in Electronic Structure Calculations with AI-Hardware and GPUs

In recent years, a new kind of accelerated hardware has gained popularity in the artificial intelligence (AI) community which enables extremely high-performance tensor contractions in reduced precision for deep neural network calculations. In this article, we exploit Nvidia Tensor cores, a prototypical example of such AI-hardware, to develop a mixed precision approach for computing a dense matrix factorization of the inverse overlap matrix in electronic structure theory, S –1 . This factorization of S –1 , written as ZZT = S –1 , is used to transform the general matrix eigenvalue problem into a standard matrix eigenvalue problem. Here we present a mixed precision iterative refinement algorithm where Z is given recursively using matrix–matrix multiplications and can be computed with high performance on Tensor cores. To understand the performance and accuracy of Tensor cores, comparisons are made to GPU-only implementations in single and double precision. Additionally, we propose a nonparametric stopping criteria which is robust in the face of lower precision floating point operations. The algorithm is particularly useful when we have a good initial guess to Z, for example, from previous time steps in quantum-mechanical molecular dynamics simulations or from a previous iteration in a geometry optimization.

36 MATERIALS SCIENCE↗

The use of digital thread for reconstruction of local fiber orientation in a compression molded pin bracket via deep learning

A deep convolutional neural network (DCNN) was used for microstructure reconstruction using artificial intelligence (MR-AI) by predicting local average fiber orientation distributions (FOD) in a 3D prepreg platelet molded composite (PPMC) pin bracket. To train the MR-AI model, surface strain fields from residual stresses simulated in PPMC plates were used as the input to the DCNN. A training dataset included PPMC plates with various degrees of global fiber alignment, based on the information obtained from high-fidelity flow simulation of a pin bracket. Further, the MR-AI model was then deployed to analyze FOD in the 3D pin bracket by conducting thermo-elastic residual stress analysis. Initially, the MR-AI model was established entirely on the synthetic simulation data. Then, a μCT scan of a physically molded pin bracket was used to create a finite element model that provided data for additional validation of the DCNN model. For the μCT scan finite element pin bracket the MR-AI model predicted the distribution of fiber orientation tensor components with MAE of 0.10 indicating a global prediction error of 10%. For the flow simulated pin bracket, the MR-AI model predicted the distribution of fiber orientation tensor components with a global prediction error of 11%. The MR-AI model showed the ability to predict regions of varying alignment in the base and flange of the pin bracket. The proposed MR-AI methodology allows for rapid prediction of FOD in geometrically complex parts and offers a promising path to detecting unique fiber orientation states in molded components.

42 ENGINEERING↗

The design space of E(3)-equivariant atom-centred interatomic potentials

Abstract Molecular dynamics simulation is an important tool in computational materials science and chemistry, and in the past decade it has been revolutionized by machine learning. This rapid progress in machine learning interatomic potentials has produced a number of new architectures in just the past few years. Particularly notable among these are the atomic cluster expansion, which unified many of the earlier ideas around atom-density-based descriptors, and Neural Equivariant Interatomic Potentials (NequIP), a message-passing neural network with equivariant features that exhibited state-of-the-art accuracy at the time. Here we construct a mathematical framework that unifies these models: atomic cluster expansion is extended and recast as one layer of a multi-layer architecture, while the linearized version of NequIP is understood as a particular sparsification of a much larger polynomial model. Our framework also provides a practical tool for systematically probing different choices in this unified design space. An ablation study of NequIP, via a set of experiments looking at in- and out-of-domain accuracy and smooth extrapolation very far from the training data, sheds some light on which design choices are critical to achieving high accuracy. A much-simplified version of NequIP, which we call BOTnet (for body-ordered tensor network), has an interpretable architecture and maintains its accuracy on benchmark datasets.

Computer Science↗

Spatiotemporal Crossover between Low- and High-Temperature Dynamical Regimes in the Quantum Heisenberg Magnet

The stranglehold of low temperatures on fascinating quantum phenomena in one-dimensional quantum magnets has been challenged recently by the discovery of anomalous spin transport at high temperatures. Whereas both regimes have been investigated separately, no study has attempted to reconcile them. For instance, the paradigmatic quantum Heisenberg spin-$1/2$ chain falls at low-temperature within the Tomonaga-Luttinger liquid framework, while its high-temperature dynamics is superdiffusive and relates to the Kardar-Parisi-Zhang universality class in $1+1$ dimensions. This work aims at reconciling the two regimes. Building on large-scale matrix product state simulations, we find that they are connected by a temperature-dependent spatiotemporal crossover. In this work, as the temperature $T$ is reduced, we show that the onset of superdiffusion takes place at longer length and time scales $\propto 1/T$. This prediction has direct consequences for experiments including nuclear magnetic resonance: it is consistent with earlier measurements on the nearly ideal Heisenberg $S=1/2$ chain compound Sr$_2$CuO$_3$ yet calls for new and dedicated experiments.

1-dimensional spin chains↗

Spontaneous magnon decays from nonrelativistic time-reversal symmetry breaking in altermagnets

Quasiparticles are central to condensed matter physics, but their stability can be undermined by quantum many-body interactions. Magnons, i.e., quasiparticles in quantum magnets, are particularly intriguing because their properties are governed by both real and spin space. While crystal symmetries may be low, spin interactions often remain approximately isotropic, limiting spontaneous magnon decay. Textbook wisdom holds that collinear Heisenberg magnets follow a dichotomy: ferromagnets host stable magnons, while antiferromagnetic magnons may decay depending on dispersion curvature. Up to now, relativistic spin-orbit coupling and noncollinear order that connect spin space to real space were shown to introduce more complex magnon instability mechanisms. Here, we show that even in nonrelativistic isotropic collinear systems, this conventional dichotomy is disrupted in altermagnets. Altermagnets, a newly identified class of collinear magnets, exhibit compensated spin order with nonrelativistic time-reversal symmetry breaking and even-parity band splitting. Using kinematic analysis, nonlinear spin-wave theory, and quantum simulations, we reveal that even weak band splitting opens a decay phase space, driving quasiparticle breakdown. Additionally, 𝑑-wave altermagnets form a rare “island of stability” at the Brillouin-zone center. Furthermore, our findings establish a quasiparticle stability trichotomy in collinear Heisenberg magnets and position altermagnets as a promising platform for unconventional spin dynamics.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Dimerization and spin decoupling in a two-leg Heisenberg ladder with frustrated trimer rungs

We study the antiferromagnetic spin-half Heisenberg ladder in the presence of an additional frustrating rung spin which is motivated and relevant also for the description of real two-dimensional materials such as the two-dimensional trimer magnet Ba 4 Ir 3 O 10 . We study the zero-temperature phase diagram, where we combine numerical and analytical methods into an overall consistent description. All numerical simulations are also accompanied by studies of the dynamical spin structure factor obtained via the density matrix renormalization group. Overall, we find in the regime of strong rung coupling a gapped dimerized phase related to competing symmetry sectors in Hilbert space that ultimately results in frustration-driven spin-Peierls transition. In the weak rung-coupling regime, the system is uniform, yet shows a gapped spinon continuum together with a sharp coherent low-energy branch which renders the system critical overall. In either case, the additional rung spin quickly get sidelined and nearly decouple in the regime when their bare coupling to the ladder is weakened

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Efficient simulation of low-temperature physics in one-dimensional gapless systems

Here, we discuss the computational efficiency of the finite-temperature simulation with minimally entangled typical thermal states (METTS). To argue that METTS can be efficiently represented as matrix product states, we present an analytic upper bound for the average entanglement Rényi entropy of METTS for a Rényi index 0 < q ≤ 1. In particular, for one-dimensional (1D) gapless systems described by conformal field theories, the upper bound scales as O⁡(cN 0 ⁢log⁡β) where c is the central charge and N is the system size. Furthermore, we numerically find that the average Rényi entropy exhibits a universal behavior characterized by the central charge and is roughly given by half of the analytic upper bound. Based on these results, we show that METTS can provide a speedup compared to employing the purification method to analyze thermal equilibrium states at low temperatures in 1D gapless systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Finite-size subthermal regime in disordered SU ( N ) -symmetric Heisenberg chains

SU⁡(N) symmetry is incompatible with the many-body localized (MBL) phase, even when strong disorder is present. However, recent studies have shown that finite-size SU⁡(2) systems exhibit nonergodic, subthermal behavior, characterized by the breakdown of the eigenstate thermalization hypothesis, and by the excited eigenstates entanglement entropy that is intermediate between area and volume law. In this paper, we extend previous studies of the SU⁡(2)-symmetric disordered Heisenberg model to larger systems, using the time-dependent density matrix renormalization group (tDMRG) method. We simulate quench dynamics from weakly entangled initial states up to long times, finding robust subthermal behavior at stronger disorder. Although we find an increased tendency towards thermalization at larger system sizes, the subthermal regime persists at intermediate time scales, nevertheless, and therefore should be accessible experimentally. At weaker disorder, we observe signatures of thermalization; however, entanglement entropy exhibits slow sublinear growth, in contrast to conventional thermalizing systems. Furthermore, we study dynamics of the SU⁡(3)-symmetric disordered Heisenberg model. Similarly, strong disorder drives the system into subthermal regime, albeit thermalizing phase is broader compared to the SU⁡(2) case. Finally, our findings demonstrate the robustness of the subthermal regime in spin chains with non-Abelian continuous symmetry, and are consistent with eventual thermalization at large system sizes and long time scales, suggested by previous studies.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Ocelot: An Interactive, Efficient Distributed Compression-As-a-Service Platform With Optimized Data Compression Techniques

Large volumes of data generated by scientific simulations, genome sequencing, and other applications need to be moved among clusters for data collection/analysis. Data compression techniques have effectively reduced data storage and transfer costs. However, users' requirements on interactively controlling both data quality and compression ratios are non-trivial to fulfill. Here, we propose a novel Compression-as-a-Service (CaaS) platform called Ocelot with four important contributions: (1) It offers real-time visualization, interactive compression, and transfer of scientific datasets. (2) It incorporates new strategies for compressing diverse types of datasets more effectively than traditional methods. (3) It provides an effective method for estimating the compression ratio and execution time of compression tasks. (4) Experiments on multiple real-world datasets on geographically distributed computers show that Ocelot can significantly improve data transfer efficiency with a performance gain of more than 10x in computing clusters with relatively slow networks.

compression as a service (CaaS)↗