Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “tensor networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Fracton-elasticity duality in twisted moiré superlattices

We formulate a fracton-elasticity duality for twisted moiré superlattices, taking into account that they are incommensurate crystals with dissipative phason dynamics. From a dual tensor-gauge formulation, as compared to standard crystals, we identify twice the number of conserved charges that describe topological lattice defects, namely, disclinations and another type of defects that we dub discompressions. Furthermore, the key implication of these conservation laws is that both glide and climb motions of lattice dislocations are suppressed, indicating that dislocation networks may become exceptionally stable. We also generalize our results to other planar incommensurate crystals and quasicrystals.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Low-frequency Raman active modes of twisted bilayer MoS 2

Abstract We study the low-frequency Raman active modes of twisted bilayer MoS 2 for several twist angles using a force-field approach and a parametrized bond polarizability model. We show that twist angles near high-symmetry stacking configurations exhibit stacking frustration that leads to significant buckling of the moiré superlattice. We find that atomic relaxation due to the twist is of prime importance. The periodic displacement of the Mo atoms shows the realization of a soliton network, and in turn, leads to the emergence of a number of frequency modes not seen in the high-symmetry stacking systems. Some of the modes are only seen in the XZ Raman polarization setup while others are seen in the XY setup. The symmetry of the normal modes, and how this affects the Raman tensors is examined in detail.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

AnisONet: A deep neural operator-based anisotropic permeability upscaler from pore to Darcy scale

Directional permeability variations, which govern directional fluid flow in porous media with anisotropy, are important to accurately predict flow behavior, reactive transport, and fluid–solid interactions for various processes such as enhanced geothermal systems, energy storage devices, and biological systems. However, the intricate architecture of porous media makes it difficult to predict directional permeabilities. In this work, we present a novel machine learning (ML) framework, AnisONet, built upon an integration of a convolutional neural network, Swin transformer, and the deep operator network architecture, designed to predict anisotropic permeability and upscale predictions to larger spatial domains. First, AnisONet was evaluated with three classes of two-dimensional (2D) porous media, including synthetic circular and elliptical grains and natural sandstone grains from micro-computed tomography images. A lattice Boltzmann model (LBM) was used to calculate directional permeabilities at every 10° angle, producing 19 data points per image of porous media. AnisONet is then trained to predict permeability as a function of rotation angle. AnisONet showed strong predictive capability of directional permeability. Second, we tested our model for five upscaling cases with a large image size in the finite-element method (FEM) for 2D Darcy flow with various permeability tensor construction methods. Overall, upscaled permeability tensors in FEM simulations produce a reasonably good match with LBM results, highlighting the importance of selecting appropriate tensor formation strategies for accurate permeability upscaling. AnisONet, as a directional permeability estimator, could be further developed for more complex geometries, with the potential to develop a foundational ML model for various applications in porous media.

42 ENGINEERING↗

Determination of the chemical shift tensor anisotropy and asymmetry of strongly dipolar coupled protons under fast MAS

Orientationally-dependent interactions such as dipolar coupling, quadrupolar coupling, and chemical shift anisotropy (CSA) contain a wealth of spatial information that can be used to elucidate molecular conformations and dynamics. To determine the sign of the chemical shift tensor anisotropy parameter (δ aniso ), both the |m| = 1 and |m| = 2 components of the CSA need to be symmetry allowed, while the recoupling of the |m| = 1 term is accompanied with the reintroduction of homonuclear dipolar coupling components. Therefore, previously suggested sequences which solely recouple the |m| = 2 term cannot determine the sign a 1 H's δ aniso in a densely-coupled network. Here, we demonstrate the CSA recoupling of strongly dipolar coupled 1 H spins using the $Cn^1_n (90_{0}360_{180}540_{0}360_{180}90_{0})$ sequence. This pulse scheme recouples both the |m| = 1 and |m| = 2 CSA terms but the scaling factors for the homonuclear dipolar coupling terms are zeroed. Consequently, the sequence is sensitive to the sign of δ aniso but is not influenced by homonuclear dipolar interactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine-Learning-Based Multiscale Methods for 3D Modelling of Granular Materials by Incorporating History-Dependent State Variables

Over the past decades, the prevalence of machine learning (ML) methods has made the development of ML-based constitutive models for granular materials undoubtedly a popular subject. Numerous studies have been made to feature the loading path or history-dependent stress-strain response of granular media using neural networks. In this work, a novel finite element method (FEM)–ML multiscale approach was developed by incorporating internal variables to improve the simulation accuracy of 3D history-dependent granular materials for the first time. To this end, a surrogate constitutive model based on the single-step-based multi-layer perceptron (MLP) neural network was used to replace representative volume element (RVE) simulations conducted by the discrete element method (DEM) in the multiscale FEM–DEM approach. Although the prediction principle of the MLP aligns with the FEM algorithm, artificially added internal variables are required to differentiate the loading history. To address this issue, history variables associated with the Frobenius norm are proposed to be fed into the MLP coupled with the strain tensor to extract the history-dependent behaviour of granular assemblies. The developed FEM–ML approach was demonstrated in 3D conventional triaxial compression (CTC) simulations. Compared to the multiscale FEM–DEM approach, the proposed FEM–ML method exhibits a significantly improved computational efficiency.

granular materials↗

Regional Moment Tensor Inversion Using Rotational Observations

There are benefits from the addition of rotational motions to translational displacements for moment tensor (MT) inversions. The rotational radiation pattern is orthogonal to the shear radiation pattern, thus incorporating rotations is equivalent to gaining another observation point on the focal sphere. We demonstrated this by simulating curl and displacement wavefields for a regional distance station. Thus, one 6-C station (3-Component translational + 3-Component rotational) gathers the same information on radiation pattern as two 3-C stations at 90° azimuth from one another along the focal plane axis, which is sometimes difficult to obtain when restricted to surface sensors. We added rotational Green's functions to a regional MT inversion scheme (long-period, time-domain, and linear inversion) by computing spatial gradients from f-κ reflectivity synthetics. For rotational data, we used Array Derived Rotations (ADR) from Piñon Flats Observatory Array and Golay array deployed during IRIS Community Wavefield Demonstration Experiment. The hope is to ultimately use compact and field deployable broadband rotational seismometers instead of ADRs. Rotational motions were predicted from well-constrained deviatoric MT solutions of nine earthquakes recorded by the arrays and other seismic networks. Additionally, we formed three station sparse datasets with (3-C and 6-C) and without rotational ground motions (3-C only) for eight earthquakes testing the benefits of including rotational waveforms in MT inversions when they are equally weighted with translational waveforms. Adding rotational motions improved the double-couple components and reduced compensated-linear-vector-dipole and isotropic components in full-MT solutions using sparse datasets with poor coverage.

58 GEOSCIENCES↗

Machine learning elastic constants of multi-component alloys

The present manuscript explores application of machine learning methods for determining elastic constants and other derived mechanical properties of multi-component alloys. Here, a number of machine learning models, including linear regression, neural network and random forest based models, are trained and tested on a dataset of binary alloys generated using density functional theory (DFT) calculations and spanning over a large number of elemental species in the periodic table. Starting with a wide range of simple and easily accessible compositionally-averaged elemental features, a correlation-based feature selection strategy was used to systematically down-select a set of most relevant features towards the prediction of the elasticity tensor components. The true predictive performance and the associated uncertainties of the models were established by testing on unseen data and bootstrapping, respectively. A single and pair-wise feature partial dependence analysis was performed to visualize the average property trends in the multi-dimensional feature space in order to further understand the achieved predictive performance. The utility of the trained model is further demonstrated by obtaining sufficiently accurate yet highly efficient approximations for bulk modulus, Young’s modulus, shear modulus and Poisson’s ratio for alloys beyond the binary space (i.e., two-component alloys) on which the model was originally trained. More importantly, we test and validate the predictive performance of the developed model directly against the experimentally measured elastic constants of technologically relevant multi-component alloys (such as, Ni- and Ti-based alloys). Finally, utility of such a data-enabled route is demonstrated by predicting the possible range of various elastic properties for vast composition space available within the five component Ni-Cr-Fe-Mo-W alloy system in a high-throughput manner.

36 MATERIALS SCIENCE↗

Lunar accelerometer network gravitational observatory (LANGO)

With ground-based interferometers detecting hundreds of gravitational-wave (GW) events, GW astronomy has continued to blossom. U.S. and European scientists are developing plans to construct third-generation ground-based interferometers. ESA has proceeded through the mission formulation phase of space-based interferometer in a lower-frequency band, 10 –4 –0.1 Hz. Despite all these exciting developments, there is still a missing frequency band, 0.1–10 Hz. This mid-frequency band is rich with interesting astrophysical events. Coalescence and merger of intermediate-mass black holes (IMBHs) will occur in this frequency band. Coalescing stellar-mass BHs will pass through this frequency band days before they reach the frequency band of LIGO and Virgo. Detection of such signals would enable a mid-frequency detector to issue an advance notice to the high-frequency GW detectors, as well as to optical, x-ray and γ-ray telescopes. We propose Lunar Accelerometer Network Gravitational Observatory (LANGO) to detect GWs in this frequency band. In the first phase (LANGO 1), we propose to deploy four ambient-temperature (250 K) accelerometers in the tetrahedral or in a square configuration on the hemisphere facing the Earth. After successful operation at 250 K, LANGO would be upgraded to a cryogenic (4 K) version with over two orders of magnitude increased sensitivity (LANGO 2), with coherent rejection of seismic noise implemented. LANGO is a full-tensor detector, capable of determining the source direction and wave polarization. Each test mass (TM) is suspended as a pendulum with resonance frequency ∼ 0.01 Hz, thus is only weakly coupled to the lunar surface horizontally. LANGO is designed to detect the relative motion of globally separated, nearly free, TMs by using the Moon as a large quiet platform. LANGO 1 and 2 accelerometers aim at sensitivities ⩽ 10 –11 m s –2 Hz –1/2 and ⩽ 10 –13 m s –2 Hz –1/2 in the horizontal axes over the frequency band of 1 mHz–10 Hz, which yield GW sensitivities 1.1 x 10 -21 Hz -1/2 and 3.8 x 10 -24 Hz -1/2 at 1 Hz, respectively. The LANGO accelerometers will be 10 3 –10 5 times more sensitive than Apollo seismometers. With such sensitivity, LANGO will also make great contribution to the advancement of lunar geophysics.

79 ASTRONOMY AND ASTROPHYSICS↗

Plasma production and ion heating systems for the Material Plasma Exposure eXperiment

Plasma production and ion heating in the Material Plasma Exposure eXperiment (MPEX), whose design is nearing completion, is accomplished using continuous wave RF power with average power density up to 1.6 MW/m2 at the plasma interface. Plasma is produced using helicon waves coupled through a single helical antenna at 13.56 MHz with power supplied by three 100 kW fixed-frequency RF generators feeding a power combiner network followed by the matching network and launcher. The helicon source can utilize various gasses including hydrogen, deuterium, and helium, with a magnetic field strength in the source region up to 0.2 T, and maximum device |B| of 2.5 T. Power is coupled to ions via ion cyclotron heating at the fundamental resonance using a pair of phased helical antennas operating in the frequency range 4-9 MHz, that launch waves towards the resonance from the antenna region where ω > ωci. ICH power is supplied by a single 500 kW tunable RF transmitter through a 90° power splitter and matching/decoupling network. In the case of both the helicon and ICH systems the antennas are located external to the vacuum, with power transferred through novel water-cooled coaxial vacuum windows consisting of fused quartz outer cylinders and silicon nitride inner cylinders with forced convection water cooling between them. The antenna enclosures are pressurized with dry air to 3 bar absolute for voltage standoff.Several 3-D COMSOL models have been created to simulate the two systems. A model of the helicon region utilizing a cold plasma dielectric tensor with accurate magnetic field and realistic plasma density profiles has been used to calculate the plasma loading/complex antenna input impedance at the launcher feed for various ne and |B| values, for the purpose of estimating power handling. It also incorporates the geometry of all launcher structures relevant to this determination. A still more detailed model of the launcher together with a lossy dielectric plasma surrogate has been used to determine RF electric field values and power losses in the device components.Similar models have been produced to predict the performance and power handling of the ICH launcher. For this device the impedance matrix of the two-element antenna array is calculated using a warm plasma model, necessary to properly determine the wave propagation and absorption.

Goulding, Richard↗

Research Introduction [Slides]

In the topic of Reverse Time Imaging, we proposed a new IC to reduce computation cost but reserve image resolution for distributed sensor networks. For Induced Seismicity in Oklahoma, we analyzed fault stress state analysis at state scale, and we applied machine learning techniques to polarity picking and seismicity rate forecasting. The results provide better understanding of fault properties, stress field, and the relationships among fault, stress state, injections, and potential seismic hazards. Lastly, for Microseismic Monitoring, we detected and located 770 low-frequency events (5-50 Hz): (1) Shallow events are highly clustered, consistent with the pathway from injection well 13-10A to monitoring well; moment tensor inversion shows dominant tensile cracking; (2) Deep events are scattered and show migration pattern to the basement; moment tensors show that most events are shear cracks.

58 GEOSCIENCES↗

Precursory Off-Fault Deformation in Restraining and Releasing Step Overs: Insights From Discrete Element Method Models

Accelerating geophysical activity is detected preceding some, but not all, large earthquakes. This observation may indicate that no precursors occur before some earthquakes, or that the instrumentation lacks the required sensitivity. Here, to aid crustal monitoring efforts, we use discrete element method models to identify the locations and styles of deformation that may provide useful information about approaching fault reactivation. We model the reactivation of two healed rough faults in a variety of step over configurations, embedded in a host rock with varying amounts of damage subject to shear velocity loading parallel to the faults. Both the fault geometry and ratio of fault to host rock strength control the amount of off-fault deformation. Consistent with field observations, models with larger steps and more preexisting host rock damage produce higher amounts of off-fault deformation. We assess the size of the continuous regions of high velocities and strains to compare the value of the precursory information of each velocity and strain component. Comparing the three components of the velocity vector suggests that the fault-parallel velocity produces the largest and most temporally continuous regions of elevated velocity. The size of these regions increases toward failure, indicating the usefulness of tracking this component. Comparing the volumetric and shear components of the three-dimensional strain tensor suggests that during most of the interseismic period, the shear strain provides more information about approaching fault slip than the volumetric strain. However, in the days and months preceding fault reactivation, both the shear and volumetric strains provide similarly valuable information.

58 GEOSCIENCES↗

Bridging the Gap Between LLMs and LNS with Dynamic Data Format and Architecture Codesign

Deep neural networks (DNNs) have achieved tremendous success in the past few years. However, their training and inference demand exceptional computational and memory resources. Quantization has been shown as an effective approach to mitigate the cost, with the mainstream data types reduced from FP32 to FP16/BF16 and recently FP8 in the latest NVIDIA H100 GPUs. With increasingly aggressive quantization, however, the conventional floating-point formats suffer from limited precision in representing numbers around zero. Recently, NVIDIA demonstrated the potential of using a Logarithmic Number System (LNS) for the next generation of tensor cores. While LNS mitigates the hurdles in representing small numbers, in this work we observed a mismatch between LNS and the emerging Large Language Models (LLM), where LLM exhibits significant outliers when directly adopting the LNS format. In this paper, we present a data-format/architecture codesign to bright this gap. On the format side, we propose a dynamic LNS format to flexibly represent outliers at a higher precision, by exploiting asymmetry in the LNS representation and identifying outliers through a per-vector basis. On the architecture side, for demonstration, we realize the dynamic LNS format in a systolic array, which can handle the irregularity of the outliers at runtime. We implement our approach on an Alveo U280 FPGA as a prototype. Experimental results show that our design can effectively handle the outliers and resolve the mismatch between LNS and LLM, contributing to an accuracy improvement of 15.4% and 16% over the floating-point and the original LNS baselines, using four state-of-the-art LLM models. Our observation and design lay a solid foundation for the large-scale adoption of the LNS format in the next-generation deep learning hardware.

Haghi, Pouya↗

Hutchinson Trace Estimation for high-dimensional and high-order Physics-Informed Neural Networks

Physics-Informed Neural Networks (PINNs) have proven effective in solving partial differential equations (PDEs), especially when some data are available by seamlessly blending data and physics. However, extending PINNs to high-dimensional and even high-order PDEs encounters significant challenges due to the computational cost associated with automatic differentiation in the residual loss function calculation. Herein, we address the limitations of PINNs in handling high-dimensional and high-order PDEs by introducing the Hutchinson Trace Estimation (HTE) method. Starting with the second-order high-dimensional PDEs, which are ubiquitous in scientific computing, HTE is applied to transform the calculation of the entire Hessian matrix into a Hessian vector product (HVP). This approach not only alleviates the computational bottleneck via Taylor-mode automatic differentiation but also significantly reduces memory consumption from the Hessian matrix to an HVP’s scalar output. We further showcase HTE’s convergence to the original PINN loss and its unbiased behavior under specific conditions. Comparisons with the Stochastic Dimension Gradient Descent (SDGD) highlight the distinct advantages of HTE, particularly in scenarios with significant variability and variance among dimensions. We further extend the application of HTE to higher-order and higher-dimensional PDEs, specifically addressing the biharmonic equation. By employing tensor-vector products (TVP), HTE efficiently computes the colossal tensor associated with the fourth-order high-dimensional biharmonic equation, saving memory and enabling rapid computation. The effectiveness of HTE is illustrated through experimental setups, demonstrating comparable convergence rates with SDGD under memory and speed constraints. Additionally, HTE proves valuable in accelerating the Gradient-Enhanced PINN (gPINN) version as well as the Biharmonic equation. Overall, HTE opens up a new capability in scientific machine learning for tackling high-order and high-dimensional PDEs.

Curse of dimensionality↗

Accelerating Scientific Computing in the Post-Moore’s Era

Novel uses of graphical processing units for accelerated computation revolutionized the field of high-performance scientific computing by providing specialized workflows tailored to algorithmic requirements. As the era of Moore’s law draws to a close, many new non–von Neumann processors are emerging as potential computational accelerators, including those based on the principles of neuromorphic computing, tensor algebra, and quantum information. While development of these new processors is continuing to mature, the potential impact on accelerated computing is anticipated to be profound. We discuss how different processing models can advance computing in key scientific paradigms: machine learning and constraint satisfaction. Significantly, each of these new processor types utilizes a fundamentally different model of computation, and this raises questions about how to best use such processors in the design and implementation of applications. While many processors are being developed with a specific domain target, the ubiquity of spin-glass models and neural networks provides an avenue for multi-functional applications. Furthermore, this also hints at the infrastructure needed to integrate next-generation processing units into future high-performance computing systems.

97 MATHEMATICS AND COMPUTING↗

Transversity PDFs of the proton from lattice QCD with physical quark masses

We present a lattice QCD calculation of the transversity isovector- and isoscalar-quark parton distribution functions (PDFs) of the proton utilizing a perturbative matching at next-to-leading-order (NLO) accuracy. Additionally, we determine the isovector and isoscalar tensor charges for the proton. In both calculations, the disconnected contributions to the isoscalar matrix elements have been ignored. The calculations are performed using a single ensemble of N f = 2 + 1 highly improved staggered quarks simulated with physical-mass quarks and a lattice spacing of a = 0.076 fm . The Wilson-clover action, with physical quark masses and smeared gauge links obtained from one iteration of hypercubic smearing, is used in the valence sector. Using the NLO operator product expansion, we extract the lowest four to six Mellin moments and the PDFs via a neural network from the matrix elements in the pseudo-PDF approach. In addition, we calculate the PDFs in the quasi-PDF approach with hybrid-scheme renormalization and the recently developed leading-renormalon resummation technique, at NLO with the resummation of leading small- x logarithms. Published by the American Physical Society 2024

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Sneutrino tribrid inflation, metastable cosmic strings and gravitational waves

Here, we present a successful realization of sneutrino tribrid inflation model based on a gauged U(1)_B-L extension of Minimal Supersymmetric Standard Model (MSSM). A single interaction term involving the B-L Higgs field and the right-handed neutrinos serves multiple purposes. These include the generation of heavy Majorana masses for the right-handed neutrinos to provide an explanation for the tiny neutrino masses via the seesaw mechanism, a realistic scenario for reheating and non-thermal leptogenesis with a reheat temperature as low as 10 6 GeV, and a successful realization of inflation with right-handed sneutrino as the inflaton. The matter parity which helps avoid rapid proton decay survives as a Z 2 subgroup of a U(1) R-symmetry. Depending on the choice of model parameters yields the following predicted range of the tensor to scalar ratio, 3 x 10 -11 ≲ r≲ 7x 10 -4 (6 x 10 -7 ≲ r ≲ 0.01), and the running of the scalar spectral index, -0.00022 ≲ dn_s/dln k ≲ -0.0026 (-0.00014 ≲ dn_s/dln k ≲ 0.005), along with the B-L breaking scale, 3 x 10 14 ≲ M/ GeV≲ 5 x 10 15 (6 x 10 15 ≲ M/ GeV≲ 2 x 10 16 ), calculated at the central value of the scalar spectral index, n_s =0.966, reported by Planck 2018. The possibility of realizing metastable cosmic strings in a grand unified theory setup is briefly discussed. The metastable cosmic string network admits string tension values in the range 10 -8 ≲ Gμ s ≲ 10 -6 , and predicts a stochastic gravitational wave background lying within the 2-σ bounds of the recent NANOGrav 12.5-yr data.

supersymmetry and cosmology↗

Exploring the Use of Novel Spatial Accelerators in Scientific Applications

Driven by the need to find alternative accelerators which can viably replace GPUs in next-generation Supercomputing systems, this paper proposes a methodology to enable agile application/hardware co-design. The application-first methodology provides the ability to come up with design of accelerators while working with real-world workloads, available accelerators, and system software. The iterative design process targets a set of kernels in a workload for performance estimates that can prune the design space for later phases of detailed architectural evaluations. To this effect, in this paper, a novel data-parallel device model is introduced that simulates the latency of performance-sensitive operations in an accelerator including data transfers and kernel computation using multi-core CPUs. The use of off-the-shelf simulators, such as pre-RTL simulator Aladdin or multiple tools available for exploring the design of deep neural network accelerators (e.g., Timeloop) is demonstrated for evaluation of various accelerator designs using applications with realistic inputs. Examples of multiple device configurations that are instantiable in a system are explored to evaluate the performance benefit of deploying novel accelerators. The proposed device is integrated with a programming model and system software to potentially explore the impacts of high-level programming languages/compilers and low-level effects such as task scheduling on multiple accelerators. We analyze our methodology for a set of applications that represent high-performance computing (HPC) and graph analytics. The applications include a computational chemistry kernel realized using tensor contractions, triangle counting, GraphSAGE and Breadth-first Search. These applications include kernels such as dense matrix-dense matrix multiplication, sparse matrix-spare matrix multiplication, and sparse matrix-dense vector multiplication. Our results indicate potential performance benefits and insights for system design by including accelerators that realize these kernels along-side general purpose accelerators.

AI, codesign, Accelerated Computing, Modeling and ↗

Design Choices in Anomaly Detection for Industrial Control Systems: Insights from Gas Pipeline Data

Industrial control systems (ICS) remain vulnerable to increasingly sophisticated cyberattacks, yet evaluating anomaly detection models in these environments is challenging due to temporal dependencies, missing-not-at-random patterns, and extremely imbalanced datasets. These factors make common practices—especially random data splits and naïve imputation—prone to severe temporal leakage, which can inflate reported performance and obscure real-world limitations. In this work, we systematically examine classical machine learning models, temporal deep learning architecture, and tensor-decomposition–based methods on a gas-pipeline dataset using a fully temporally separated evaluation pipeline designed to mimic realistic deployment conditions. Our findings show that proper temporal handling and MNAR-aware preprocessing significantly alter the relative performance of popular anomaly-detection methods, providing practical guidance for designing reliable, leakage-resistant ICS intrusion-detection systems.

97 MATHEMATICS AND COMPUTING↗