Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “tensor network simulations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

AnisONet: A deep neural operator-based anisotropic permeability upscaler from pore to Darcy scale

Directional permeability variations, which govern directional fluid flow in porous media with anisotropy, are important to accurately predict flow behavior, reactive transport, and fluid–solid interactions for various processes such as enhanced geothermal systems, energy storage devices, and biological systems. However, the intricate architecture of porous media makes it difficult to predict directional permeabilities. In this work, we present a novel machine learning (ML) framework, AnisONet, built upon an integration of a convolutional neural network, Swin transformer, and the deep operator network architecture, designed to predict anisotropic permeability and upscale predictions to larger spatial domains. First, AnisONet was evaluated with three classes of two-dimensional (2D) porous media, including synthetic circular and elliptical grains and natural sandstone grains from micro-computed tomography images. A lattice Boltzmann model (LBM) was used to calculate directional permeabilities at every 10° angle, producing 19 data points per image of porous media. AnisONet is then trained to predict permeability as a function of rotation angle. AnisONet showed strong predictive capability of directional permeability. Second, we tested our model for five upscaling cases with a large image size in the finite-element method (FEM) for 2D Darcy flow with various permeability tensor construction methods. Overall, upscaled permeability tensors in FEM simulations produce a reasonably good match with LBM results, highlighting the importance of selecting appropriate tensor formation strategies for accurate permeability upscaling. AnisONet, as a directional permeability estimator, could be further developed for more complex geometries, with the potential to develop a foundational ML model for various applications in porous media.

42 ENGINEERING↗

Machine-Learning-Based Multiscale Methods for 3D Modelling of Granular Materials by Incorporating History-Dependent State Variables

Over the past decades, the prevalence of machine learning (ML) methods has made the development of ML-based constitutive models for granular materials undoubtedly a popular subject. Numerous studies have been made to feature the loading path or history-dependent stress-strain response of granular media using neural networks. In this work, a novel finite element method (FEM)–ML multiscale approach was developed by incorporating internal variables to improve the simulation accuracy of 3D history-dependent granular materials for the first time. To this end, a surrogate constitutive model based on the single-step-based multi-layer perceptron (MLP) neural network was used to replace representative volume element (RVE) simulations conducted by the discrete element method (DEM) in the multiscale FEM–DEM approach. Although the prediction principle of the MLP aligns with the FEM algorithm, artificially added internal variables are required to differentiate the loading history. To address this issue, history variables associated with the Frobenius norm are proposed to be fed into the MLP coupled with the strain tensor to extract the history-dependent behaviour of granular assemblies. The developed FEM–ML approach was demonstrated in 3D conventional triaxial compression (CTC) simulations. Compared to the multiscale FEM–DEM approach, the proposed FEM–ML method exhibits a significantly improved computational efficiency.

granular materials↗

Deep learning of structural morphology imaged by scanning X-ray diffraction microscopy

Scanning X-ray nanodiffraction microscopy is a powerful technique for spatially resolving nanoscale structural morphologies by diffraction contrast. One of the critical challenges in experimental nanodiffraction data analysis is posed by the convergence angle of nanoscale focusing optics which creates simultaneous dependency of the far-field scattering data on three independent components of the local strain tensor-corresponding to dilation and two potential rigid body rotations of the unit cell. All three components are in principle resolvable through a spatially mapped sample tilt series; however, traditional data analysis is computationally expensive and prone to artifacts. In this study, we implement NanobeamNN, a convolutional neural network specifically tailored to the analysis of scanning probe X-ray microscopy data. NanobeamNN learns lattice strain and rotation angles from simulated diffraction of a focused X-ray nanobeam by an epitaxial thin film and can directly make reasonable predictions on experimental data without the need for additional fine-tuning. We demonstrate that this approach represents a significant advancement in computational speed over conventional methods, as well as a potential improvement in accuracy over the current standard.

Luo, Aileen [Cornell Univ., Ithaca, NY (United Sta↗

Evidence for the utility of quantum computing before fault tolerance

Quantum computing promises to offer substantial speed-ups over its classical counterpart for certain problems. However, the greatest impediment to realizing its full potential is noise that is inherent to these systems. The widely accepted solution to this challenge is the implementation of fault-tolerant quantum circuits, which is out of reach for current processors. Here we report experiments on a noisy 127-qubit processor and demonstrate the measurement of accurate expectation values for circuit volumes at a scale beyond brute-force classical computation. We argue that this represents evidence for the utility of quantum computing in a pre-fault-tolerant era. These experimental results are enabled by advances in the coherence and calibration of a superconducting processor at this scale and the ability to characterize and controllably manipulate noise across such a large device. We establish the accuracy of the measured expectation values by comparing them with the output of exactly verifiable circuits. In the regime of strong entanglement, the quantum computer provides correct results for which leading classical approximations such as pure-state-based 1D (matrix product states, MPS) and 2D (isometric tensor network states, isoTNS) tensor network methods break down. These experiments demonstrate a foundational tool for the realization of near-term quantum applications.

97 MATHEMATICS AND COMPUTING↗

Tree tensor network hierarchical equations of motion based on time-dependent variational principle for efficient open quantum dynamics in structured thermal environments

In this work, we introduce an efficient method, TTN-HEOM, for exactly calculating the open quantum dynamics for driven quantum systems interacting with highly structured bosonic baths by combining the tree tensor network (TTN) decomposition scheme with the bexcitonic generalization of the numerically exact hierarchical equations of motion (HEOM). The method yields a series of quantum master equations for all core tensors in the TTN that efficiently and accurately capture the open quantum dynamics for non-Markovian environments to all orders in the system–bath interaction. These master equations are constructed based on the time-dependent Dirac–Frenkel variational principle, which isolates the optimal dynamics for the core tensors given the TTN ansatz. The dynamics converges to the HEOM when increasing the rank of the core tensors, a limit in which the TTN ansatz becomes exact. We introduce TENSO, tensor equations for non-Markovian structured open systems, as a general-purpose Python code to propagate the TTN-HEOM dynamics. We implement three general propagators for the coupled master equations: two fixed-rank methods that require a constant memory footprint during the dynamics and one adaptive-rank method with a variable memory footprint controlled by the target level of computational error. We exemplify the utility of these methods by simulating a two-level system coupled to a structured bath containing one Drude–Lorentz component and eight Brownian oscillators, which is beyond what can presently be computed using the standard HEOM. Our results show that the TTN-HEOM is capable of simulating both dephasing and relaxation dynamics of driven quantum systems interacting with structured baths, even those of chemical complexity, with an affordable computational cost.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Exploring the Use of Novel Spatial Accelerators in Scientific Applications

Driven by the need to find alternative accelerators which can viably replace GPUs in next-generation Supercomputing systems, this paper proposes a methodology to enable agile application/hardware co-design. The application-first methodology provides the ability to come up with design of accelerators while working with real-world workloads, available accelerators, and system software. The iterative design process targets a set of kernels in a workload for performance estimates that can prune the design space for later phases of detailed architectural evaluations. To this effect, in this paper, a novel data-parallel device model is introduced that simulates the latency of performance-sensitive operations in an accelerator including data transfers and kernel computation using multi-core CPUs. The use of off-the-shelf simulators, such as pre-RTL simulator Aladdin or multiple tools available for exploring the design of deep neural network accelerators (e.g., Timeloop) is demonstrated for evaluation of various accelerator designs using applications with realistic inputs. Examples of multiple device configurations that are instantiable in a system are explored to evaluate the performance benefit of deploying novel accelerators. The proposed device is integrated with a programming model and system software to potentially explore the impacts of high-level programming languages/compilers and low-level effects such as task scheduling on multiple accelerators. We analyze our methodology for a set of applications that represent high-performance computing (HPC) and graph analytics. The applications include a computational chemistry kernel realized using tensor contractions, triangle counting, GraphSAGE and Breadth-first Search. These applications include kernels such as dense matrix-dense matrix multiplication, sparse matrix-spare matrix multiplication, and sparse matrix-dense vector multiplication. Our results indicate potential performance benefits and insights for system design by including accelerators that realize these kernels along-side general purpose accelerators.

AI, codesign, Accelerated Computing, Modeling and ↗

Beyond-classical computation in quantum simulation

Quantum computers hold the promise of solving certain problems that lie beyond the reach of conventional computers. However, establishing this capability, especially for impactful and meaningful problems, remains a central challenge. Here, we show that superconducting quantum annealing processors can rapidly generate samples in close agreement with solutions of the Schrödinger equation. We demonstrate area-law scaling of entanglement in the model quench dynamics of two-, three-, and infinite-dimensional spin glasses, supporting the observed stretched-exponential scaling of effort for matrix-product-state approaches. We show that several leading approximate methods based on tensor networks and neural networks cannot achieve the same accuracy as the quantum annealer within a reasonable time frame. Thus, quantum annealers can answer questions of practical importance that may remain out of reach for classical computation.

King, Andrew D. [D-Wave Quantum Inc., Burnaby, BC ↗

Plasma production and ion heating systems for the Material Plasma Exposure eXperiment

Plasma production and ion heating in the Material Plasma Exposure eXperiment (MPEX), whose design is nearing completion, is accomplished using continuous wave RF power with average power density up to 1.6 MW/m2 at the plasma interface. Plasma is produced using helicon waves coupled through a single helical antenna at 13.56 MHz with power supplied by three 100 kW fixed-frequency RF generators feeding a power combiner network followed by the matching network and launcher. The helicon source can utilize various gasses including hydrogen, deuterium, and helium, with a magnetic field strength in the source region up to 0.2 T, and maximum device |B| of 2.5 T. Power is coupled to ions via ion cyclotron heating at the fundamental resonance using a pair of phased helical antennas operating in the frequency range 4-9 MHz, that launch waves towards the resonance from the antenna region where ω > ωci. ICH power is supplied by a single 500 kW tunable RF transmitter through a 90° power splitter and matching/decoupling network. In the case of both the helicon and ICH systems the antennas are located external to the vacuum, with power transferred through novel water-cooled coaxial vacuum windows consisting of fused quartz outer cylinders and silicon nitride inner cylinders with forced convection water cooling between them. The antenna enclosures are pressurized with dry air to 3 bar absolute for voltage standoff.Several 3-D COMSOL models have been created to simulate the two systems. A model of the helicon region utilizing a cold plasma dielectric tensor with accurate magnetic field and realistic plasma density profiles has been used to calculate the plasma loading/complex antenna input impedance at the launcher feed for various ne and |B| values, for the purpose of estimating power handling. It also incorporates the geometry of all launcher structures relevant to this determination. A still more detailed model of the launcher together with a lossy dielectric plasma surrogate has been used to determine RF electric field values and power losses in the device components.Similar models have been produced to predict the performance and power handling of the ICH launcher. For this device the impedance matrix of the two-element antenna array is calculated using a warm plasma model, necessary to properly determine the wave propagation and absorption.

Goulding, Richard↗

Accurate numerical simulations of open quantum systems using spectral tensor trains

Decoherence between qubits is a major bottleneck in quantum computations. Decoherence results from intrinsic quantum and thermal fluctuations as well as noise in the external fields that perform the measurement and preparation processes. With prescribed colored noise spectra for intrinsic and extrinsic noise, we present a numerical method, Quantum Accelerated Stochastic Propagator Evaluation (Q-ASPEN), to solve the time-dependent noise-averaged reduced density matrix in the presence of intrinsic and extrinsic noise. Q-ASPEN is arbitrarily accurate and can be applied to provide estimates for the resources needed to error-correct quantum computations. We employ spectral tensor trains, which combine the advantages of tensor networks and pseudospectral methods, as a variational ansatz to the quantum relaxation problem and optimize the ansatz using methods typically used to train neural networks. Here, the spectral tensor trains in Q-ASPEN make accurate calculations with tens of quantum levels feasible. We present benchmarks for Q-ASPEN on the spin-boson model in the presence of intrinsic noise and on a quantum chain of up to 32 sites in the presence of extrinsic noise. In our benchmark, the memory cost of Q-ASPEN scales as a low-order polynomial in the size of the system once the number of system states surpasses the number of basis functions used in the spectral expansion.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Atomic Structure, Dynamics, Changes in Chemical Bonding and Semiconductor-Metal Transition in Sb 2 Se 3 : A Remarkable Material for Quantum Networks and Energy Applications

Antimony sesquiselenide has become an outstanding functional material for photovoltaics, energy storage and transformation, memory and photonic applications. Sb 2 Se 3 is one of the most successful emerging solar light absorbers and has also been identified as a highly promising ultralow-loss phase-change material (PCM) for next-generation coherent nanophotonic processors, photonic tensor cores, quantum and neuromorphic networks. Unlike benchmark telluride PCMs, Sb 2 Se 3 features a quasi-one-dimensional (1D) crystalline structure consisting of (Sb 4 Se 6 ) ∞ ribbons, lacks the typical PCM chemical bonding, and undergoes an extended semiconductor-metal transition above the melting point. Consequently, the origin of high optical contrast between crystalline (SET) and amorphous (RESET) logic states remains elusive and presents a significant challenge. Using high-energy X-ray diffraction and Raman spectroscopy over a wide temperature range, supported by first-principles simulations and complemented by thermal, optical and electrical measurements, as well as by 121 Sb-Mossbauer spectroscopy, the quasi-1D network of orthorhombic antimony sesquiselenide was found to undergo significant evolution in amorphous and supercooled Sb 2 Se 3 , leading to lower coordination, shorter interatomic distances and a higher p-electron density on antimony, indicating changes in chemical bonding. The observed novel Sb 2 Se 3 nanocrystalline polymorph, characterized by trigonal antimony coordination and more isolated Sb-Se ribbons, could help reduce multiple trapping defect states in the bandgap, which are typical of orthorhombic Sb 2 Se 3 , thereby enhancing the power-conversion efficiency of photovoltaic devices. Semimetallic and metallic liquid Sb 2 Se 3 exhibit a gradual transformation into a denser 2D and/or 3D network with higher antimony coordination. Localized electron states in the pseudogap are becoming extended, leading to an increase in electronic conductivity σ following the relationship σ ∝ N(E F ) 2 . Liquid Sb 2 Se 3 also appears to be strongly fragile, with a nonmonotonic change in viscosity and higher atomic mobility in the metallic liquid. Furthermore, these results explain extraordinary functionalities of Sb 2 Se 3 for photonic and energy applications.

antimony↗

Efficient simulation of moiré materials using the density matrix renormalization group

Here we present an infinite density-matrix renormalization group (DMRG) study of an interacting continuum model of twisted bilayer graphene (tBLG) near the magic angle. Because of the long-range Coulomb interaction and the large number of orbital degrees of freedom, tBLG is difficult to study with standard DMRG techniques - even constructing and storing the Hamiltonian already poses a major challenge. To overcome these difficulties, we use a recently developed compression procedure to obtain a matrix product operator representation of the interacting tBLG Hamiltonian which we show is both efficient and accurate even when including the spin, valley, and orbital degrees of freedom. To benchmark our approach, we focus mainly on the spinless, single-valley version of the problem where, at half filling, we find that the ground state is a nematic semimetal. Remarkably, we find that the ground state is essentially a k-space Slater determinant, so that Hartree-Fock and DMRG give virtually identical results for this problem. Our results show that the effects of long-range interactions in magic angle graphene can be efficiently simulated with DMRG and open up a new route for numerically studying strong correlation physics in spinful, two-valley tBLG, and other moiré materials in future work.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Transversity PDFs of the proton from lattice QCD with physical quark masses

We present a lattice QCD calculation of the transversity isovector- and isoscalar-quark parton distribution functions (PDFs) of the proton utilizing a perturbative matching at next-to-leading-order (NLO) accuracy. Additionally, we determine the isovector and isoscalar tensor charges for the proton. In both calculations, the disconnected contributions to the isoscalar matrix elements have been ignored. The calculations are performed using a single ensemble of N f = 2 + 1 highly improved staggered quarks simulated with physical-mass quarks and a lattice spacing of a = 0.076 fm . The Wilson-clover action, with physical quark masses and smeared gauge links obtained from one iteration of hypercubic smearing, is used in the valence sector. Using the NLO operator product expansion, we extract the lowest four to six Mellin moments and the PDFs via a neural network from the matrix elements in the pseudo-PDF approach. In addition, we calculate the PDFs in the quasi-PDF approach with hybrid-scheme renormalization and the recently developed leading-renormalon resummation technique, at NLO with the resummation of leading small- x logarithms. Published by the American Physical Society 2024

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Study of spin symmetry in the doped t-J model using infinite projected entangled pair states

We study the two-dimensional t-J model on a square lattice using infinite projected entangled pair states (iPEPS). At small doping, multiple orders, such as antiferromagnetic order, stripe order and superconducting order, are intertwined or compete with each other. We demonstrate the role of spin symmetry at small doping by either imposing SU(2) spin symmetry or its U(1) subgroup in the iPEPS ansatz, thereby excluding or allowing spontaneous spin-symmetry breaking, respectively, in the thermodynamic limit. From a detailed comparison of our simulations, we provide evidence that stripe order is pinned by long-range antiferromagnetic order. We also find SU(2) iPEPS, enforcing a spin-singlet state, yields a uniform charge distribution and favors d-wave singlet pairing.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Quantum-Inspired Bayesian Sampling for Uncertainty Quantification and Machine Learning (Final Technical Report)

With increasing simulation and measurement data, machine learning and artificial intelligence have been widely used in computational decision-making of complex engineering systems. The resulting tools, such as uncertainty quantification solvers, reinforcement learning, and physics-informed machine learning, have achieved great success in critical DOE tasks such as material discovery and design, energy system modeling and control, and numerical weather and climate prediction. A core topic in scientific machine learning and artificial intelligence is Bayesian inference: given an observed data set, people want to estimate the posterior distribution of a (possibly large) number of hidden parameters. Due to the flexibility and weak assumptions, Bayesian sampling has been the mainstream Bayesian inference solvers despite the rapid progress of approximate Bayesian inference. Classical Bayesian sampling methods such as Markov-chain Monte Carlo suffer from a low-acceptance rate due to the random walk nature, therefore state-of-the-art techniques use Hamiltonian Monte Carlo and its variants to efficiently draw posterior samples in a high dimension. The key idea of Hamiltonian Monte Carlo and its variants is to simulate the Hamiltonian dynamics of a classical particle with a fixed mass, and their performance significantly degrades when the posterior distribution is highly spiky or has multiple modes. Leveraging the idea of quantum physics, this project has investigated new theory, algorithms and applications of Bayesian inference (especially Bayesian sampling). The main results include: (1) novel quantum-inspired Bayesian sampling methods that can lead to better accuracy for challenging multi-modal or spiky distributions, (2) more scalable machine learning framework leveraging tensor-compressed Bayesian inference, and (3) Bayesian and sampling approaches for verifying the robustness of continuous and binary neural networks.

97 MATHEMATICS AND COMPUTING↗

SO(3)-invariance of informed-graph-based deep neural network for anisotropic elastoplastic materials

This work examines the frame-invariance (and the lack thereof) exhibited in simulated anisotropic elasto-plastic responses generated from supervised machine learning of classical multi-layer and informed-graph-based neural networks, and proposes different remedies to fix this drawback. The inherent hierarchical relations among physical quantities and state variables in an elasto-plasticity model are first represented as informed, directed graphs, where three variations of the graph are tested. While feed-forward neural networks are used to train path-independent constitutive relations (e.g., elasticity), recurrent neural networks are used to replicate responses that depends on the deformation history, i.e. or path dependent. In dealing with the objectivity deficiency, we use the spectral form to represent tensors and, subsequently, three metrics, the Euclidean distance between the Euler Angles, the distance from the identity matrix, and geodesic on the unit sphere in Lie algebra, can be employed to constitute objective functions for the supervised machine learning. In this, the aim is to minimize the measured distance between the true and the predicted 3D rotation entities. Following this, we conduct numerical experiments on how these metrics, which are theoretically equivalent, may lead to differences in the efficiency of the supervised machine learning as well as the accuracy and robustness of the resultant models. Neural network models trained with tensors represented in component form for a given Cartesian coordinate system are used as a benchmark. Our numerical tests show that, even given the same amount of information and data, the quality of the anisotropic elasto-plasticity model is highly sensitive to the way tensors are represented and measured. The results reveal that using a loss function based on geodesic on the unit sphere in Lie algebra together with an informed, directed graph yield significantly more accurate rotation prediction than the other tested approaches.

42 ENGINEERING↗

Geometrical approach to neural net control of movements and posture

In one approach to modeling brain function, sensorimotor integration is described as geometrical mapping among coordinates of non-orthogonal frames that are intrinsic to the system; in such a case sensors represent (covariant) afferents and motor effectors represent (contravariant) motor efferents. The neuronal networks that perform such a function are viewed as general tensor transformations among different expressions and metric tensors determining the geometry of neural functional spaces. Although the non-orthogonality of a coordinate system does not impose a specific geometry on the space, this "Tensor Network Theory of brain function" allows for the possibility that the geometry is non-Euclidean. It is suggested that investigation of the non-Euclidean nature of the geometry is the key to understanding brain function and to interpreting neuronal network function. This paper outlines three contemporary applications of such a theoretical modeling approach. The first is the analysis and interpretation of multi-electrode recordings. The internal geometries of neural networks controlling external behavior of the skeletomuscle system is experimentally determinable using such multi-unit recordings. The second application of this geometrical approach to brain theory is modeling the control of posture and movement. A preliminary simulation study has been conducted with the aim of understanding the control of balance in a standing human. The model appears to unify postural control strategies that have previously been considered to be independent of each other. Third, this paper emphasizes the importance of the geometrical approach for the design and fabrication of neurocomputers that could be used in functional neuromuscular stimulation (FNS) for replacing lost motor control.

Review↗

Direct numerical simulation of open-channel flow over a heterogeneous particle bed at low relative submergence

In this article, this study investigates turbulent open-channel flows over beds of irregularly arranged particles, using direct numerical simulations at a friction Reynolds number of Re T = 300⁠. Two distinct cases are examined: a polydisperse bed (P800) composed of multiple layers of randomly distributed spheres of varying sizes, and a monodisperse bed (M1015) formed by a random distribution of uniform sized spheres, with a bottommost single layer of varied-sized particles to introduce realistic randomness. Our investigation unveils a rich network of low- and high-speed streaks within the flow field, exhibiting distinctive behaviors in different bed configurations. The P800 case presents a poorly organized flow pattern induced by the varied particle sizes and arrangements, while the M1015 case shows a more regular flow pattern, marked by larger streaks. We also observe that total wall shear stress is substantially influenced by surface roughness-induced drag, extending beyond the effects documented in existing studies of open-channel flows. The present study reveals intricate secondary flow patterns over irregular particle beds. Large-scale circulations are discerned around particle crests in the P800 case and localized circulations with increased turbulence in the M1015 case. Furthermore, analysis of Reynolds stress tensor components indicates that roughness disrupts coherent turbulent eddies, consequently mitigating peak stress. We quantify correlations between drag force and local fluid velocity fluctuations. Notably, a larger deviation in drag is observed in the P800 case compared to M1015, accentuating the influence of particle size and distribution on fluid–particle interactions.

42 ENGINEERING↗

Tensor network representation of non-abelian gauge theory coupled to reduced staggered fermions

We show how to construct a tensor network representation of the path integral for reduced staggered fermions coupled to a non-abelian gauge field in two dimensions. The resulting formulation is both memory and computation efficient because reduced staggered fermions can be represented in terms of a minimal number of tensor indices while the gauge sector can be approximated using Gaussian quadrature with a truncation. Numerical results obtained using the Grassmann TRG algorithm are shown for the case of SU(2) lattice gauge theory and compared to Monte Carlo results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗