Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Matrix equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Self-consistency in GWΓ formalism leading to quasiparticle-quasiparticle couplings

Within many-body perturbation theory, Hedin's formalism offers a systematic way to iteratively compute the self-energy Σ of any dynamically correlated interacting system, provided one can evaluate the interaction vertex Γ exactly. This is, however, impossible, in general, for it involves the functional derivative of Σ with respect to the Green's function. Here, we analyze the structure of this derivative, splitting it into four contributions and outlining the type of quasiparticle interactions that each of them generate. Moreover, we show how, in the implementation of self-consistency, the action of these contributions can be classified into two: A quantitative renormalization of previously included interaction terms and the inclusion of qualitatively distinct interaction terms through successive functional derivatives of Γ itself. Implementing this latter type of self-consistency can extend the validity of perturbative approximations based on Hedin's equations toward the high interaction limit, as we show in the example of the Hubbard dimer. Furthermore, our analysis also provides a unifying perspective on the perturbation theory landscape, showing how the T-matrix approach is completely contained in Hedin's formalism.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Beyond-classical computation in quantum simulation

Quantum computers hold the promise of solving certain problems that lie beyond the reach of conventional computers. However, establishing this capability, especially for impactful and meaningful problems, remains a central challenge. Here, we show that superconducting quantum annealing processors can rapidly generate samples in close agreement with solutions of the Schrödinger equation. We demonstrate area-law scaling of entanglement in the model quench dynamics of two-, three-, and infinite-dimensional spin glasses, supporting the observed stretched-exponential scaling of effort for matrix-product-state approaches. We show that several leading approximate methods based on tensor networks and neural networks cannot achieve the same accuracy as the quantum annealer within a reasonable time frame. Thus, quantum annealers can answer questions of practical importance that may remain out of reach for classical computation.

King, Andrew D. [D-Wave Quantum Inc., Burnaby, BC ↗

Introduction of the Adding and Doubling Method for Solving Bateman Equations for Nuclear Fuel Depletion

This paper introduces and evaluates the Adding and Doubling Method (ADM) for solving the Bateman equations for depletion systems with varying numbers of nuclides and compares it to the Chebyshev Rational Approximation Method (CRAM), both implemented in the reactor physics analysis application Griffin. ADM, when applied to the Crank-Nicolson Finite Difference method, can produce results comparable in accuracy and precision to CRAM with comparable run times for systems with 35 or 297 nuclides. For systems with more than 300 nuclides, the matrix-matrix operations required by ADM are significantly more costly than the matrix-vector operations required by CRAM, making CRAM the more efficient method for systems with large numbers of nuclides. ADM is an accurate method that maintains other advantages over CRAM in that it does not depend on pre-generated coefficients or require complex number operations. ADM also manages to outperform CRAM by a factor of more than 250 in terms of run time for depletion systems that require multiple Bateman solves while the depletion matrix and time step size remain constant over all depletion intervals.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systems

In this work, we present Lift & Learn, a physics-informed method for learning low-dimensional models for large-scale dynamical systems. The method exploits knowledge of a system’s governing equations to identify a coordinate transformation in which the system dynamics have quadratic structure. This transformation is called a lifting map because it often adds auxiliary variables to the system state. The lifting map is applied to data obtained by evaluating a model for the original nonlinear system. This lifted data is projected onto its leading principal components, and low-dimensional linear and quadratic matrix operators are fit to the lifted reduced data using a least-squares operator inference procedure. Analysis of our method shows that the Lift & Learn models are able to capture the system physics in the lifted coordinates at least as accurately as traditional intrusive model reduction approaches. This preservation of system physics makes the Lift & Learn models robust to changes in inputs. Numerical experiments on the FitzHugh–Nagumo neuron activation model and the compressible Euler equations demonstrate the generalizability of our model.

97 MATHEMATICS AND COMPUTING↗

Scalable learning of potentials to predict time-dependent Hartree–Fock dynamics

We propose a framework to learn the time-dependent Hartree–Fock (TDHF) inter-electronic potential of a molecule from its electron density dynamics. Although the entire TDHF Hamiltonian, including the inter-electronic potential, can be computed from first principles, we use this problem as a testbed to develop strategies that can be applied to learn a priori unknown terms that arise in other methods/approaches to quantum dynamics, e.g., emerging problems such as learning exchange–correlation potentials for time-dependent density functional theory. We develop, train, and test three models of the TDHF inter-electronic potential, each parameterized by a four-index tensor of size up to 60 × 60 × 60 × 60. Two of the models preserve Hermitian symmetry, while one model preserves an eight-fold permutation symmetry that implies Hermitian symmetry. Across seven different molecular systems, we find that accounting for the deeper eight-fold symmetry leads to the best-performing model across three metrics: training efficiency, test set predictive power, and direct comparison of true and learned inter-electronic potentials. All three models, when trained on ensembles of field-free trajectories, generate accurate electron dynamics predictions even in a field-on regime that lies outside the training set. To enable our models to scale to large molecular systems, we derive expressions for Jacobian-vector products that enable iterative, matrix-free training.

97 MATHEMATICS AND COMPUTING↗

PVwindow (Photovoltaic Window Simulator) [SWR-22-01]

PVwindow simulates photovoltaic window properties by allowing the user build stacks of thin film materials that compose the window layers. The only needed inputs are the complex refractive indices and thicknesses of the materials. The software will simulate the optical transmission, front reflection, and back reflection of the stack using the transfer matrix method. Properties specific to PV window optics such as visible transmittance and color are also calculated. The optics code extracts the number of absorbed photons in the PV absorber layer and solves the single diode equation to yield theoretical photovoltaic metrics such as power conversion efficiency, fill factor, open circuit voltage, and short circuit current of the PV window when illuminated at an arbitrary angle or from either side of the stack. The software tool ultimately allows researchers to design photovoltaic windows and simulate their properties. The software also exports files that can be read into LBL Window software or into the EnergyPlus and Open Studio building energy modeling software to determine larger scale energy impacts of PV window integration.

Wheeler, Lance↗

Neumann Series in MGS-GMRES and Inner-Outer Iterations: Preprint

A low-synchronization MGS-GMRES Krylov solver employing a truncated Neumann series for the inverse compact WY MGS correction matrix T is presented. A corollary to the backward stability result of Paige et al. [1] establishes that T = I - Lk is sufficient for convergence of GMRES when kLkp F = O("p)_p F (B), where the strictly lower triangular matrix L is defined by the inner products of Krylov vectors V T 1:k-2 vk-1. The preconditioner is the classical Ruge-Stuben AMG algorithm with compatible relaxation and inner-outer Gauss-Seidel smoother. This smoother may also be expressed as a truncated Neumann series. Drop tolerances are applied to the lower triangular matrices arising in the smoother in order to reduce the number of non-zeros and accelerate the time to solution. The number of small matrix elements are found to increase from fine to coarse levels and thus the effciency gains are greater for large problems with many levels in the V -cycle. The solver is applied to the pressure continuity equation for the incompressible Navier-Stokes equations. Unlike the inner-outer iteration, the solver convergence rate with the standard Gauss-Seidel smoother deteriorates with dropping. The solver compute time is reduced by up to 50% without a change in the convergence rate.

Gauss-Seidel smoother↗

Replica symmetry breaking for the integrable two-site Sachdev–Ye–Kitaev model

We analyze a two-body non-Hermitian two-site Sachdev–Ye–Kitaev (SYK) model with the couplings of one site complex conjugated to the other site. This model, with no explicit coupling between the sites, shows an infinite number of second-order phase transitions, which is a consequence of the factorization of the partition function into a product over Matsubara frequencies. We calculate the quenched free energy in two different ways: first in terms of the single-particle energies and second by solving the Schwinger–Dyson equations of the two-site model. The first calculation can be done entirely in terms of a one-site model. The conjugate replica enters due to non-analyticities when Matsubara frequencies enter the spectral support of the coupling matrix. The second calculation is based on the replica trick of the two-site partition function. Both methods give the same result. The free-fermion partition function can also be rephrased as a matrix model for the coupling matrix. Up to minor details, this model is the random matrix model that describes the chiral phase transition of QCD, and the order parameter of the two-body model corresponds to the chiral condensate of QCD. Comparing to the corresponding four-body model, we are able to determine which features of the free energy are due to the chaotic nature of the four-body model. The high-temperature phase of both models is entropy dominated, and in both cases, the free energy is determined by the spectral density. The chaotic four-body SYK model has a low-temperature phase whose free energy is almost temperature-independent, signaling an effective gap of the theory even though the actual spectrum does not exhibit a gap. On the other hand, the low-temperature free energy of the two-body SYK model is not flat; in fact, it oscillates to arbitrarily low temperature. This indicates a less desirable feature that the entropy of the two-body model is not always positive in the low-temperature phase, which most likely is a consequence of the non-hermiticity.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Linear and Nonlinear Solvers for Simulating Multiphase Flow within Large-Scale Engineered Subsurface Systems

Simulation of multiphase flow in the subsurface is well-known to be computationally challenging. While there have been many studies that have explored approaches to overcoming these challenges, they often utilize relatively simple case studies. In this paper, we focus on the unique numerical challenges posed by modeling large-scale engineered subsurface systems, characterized by discrete features embedded in a heterogeneous natural subsurface setting. The man-made features such as shafts, tunnels, and barriers often cause multiple challenges in modeling the domain for multiphase porous media flow. This flow scenario can have a wide range of applications such as nuclear waste repositories, enhanced recovery of a petroleum reservoir, geothermal engineering, and carbon sequestration. An example of these severe numerical challenges is the case of performance assessment (PA) for Waste Isolation Pilot Plant (WIPP), the only operating deep geological repository in the US, which simulates extreme material properties of bedded salt rock formation and extreme contrast due to open excavation next to the formation. The models have extremes not only of permeability and porosity but also of the constitutive models needed for multiphase flow; additionally, they have process models like salt creep closure reducing porosity over time, fracturing in clay and anhydrite interbeds of the bedded salt, gas generation from the waste materials, and unintentional human borehole intrusions in some scenarios. Numerical simulations require the solution of coupled systems of nonlinear PDEs; in our work, we use the open-source simulator PFLOTRAN which is based on Finite Volume discretization. The solution of the nonlinear equations requires use of the Newton-Raphson iteration at each time step, which entails the solution of the linearized Jacobian system at each iteration. The effects of all the processes (i.e., large number of unknowns, highly nonlinear constitutive relations, large contrasts in material properties in short distances) lead to an ill-conditioned Jacobian matrix that severely challenges traditional linear solver, i.e., stabilized biconjugate gradient with block Jacobi incomplete LU preconditioner (BCGS-ILU) leading to non-convergence for traditional Newton-Raphson nonlinear solver causing unacceptably long computation time for each model. This paper presents linear solvers such as constrained pressure residual (CPR) two-stage preconditioner with alternate-block-factorization (ABF) and quasi- implicit pressure and explicit saturation (QIMPES) decouplers and flexible generalized residual solver (FGMRES). The new general-purpose nonlinear solver, Newton trust-region dogleg Cauchy (NTRDC), is also introduced to resolve extreme nonlinearities in the models. We demonstrate the effectiveness of each method relative to the default BCGS-Newton solver. The two best cases had nearly 50 times speed-up and achieved completion of a simulation in 14 hours that never completed due to non-convergence with the default solver. We also investigate the strong scalability of each method and discuss some of the deficiencies found for Block Jacobi preconditioner using parallel domain decomposition, and node packing effects of modern processor architecture.

Preconditioner, Nonlinear, Porous media, Multiphas↗

Butterfly Factorization Via Randomized Matrix-Vector Multiplications

This paper presents an adaptive randomized algorithm for computing the butterfly factorization of an m × n matrix with m ≈ n provided that both the matrix and its transpose can be rapidly applied to arbitrary vectors. The resulting factorization is composed of O(log n) sparse factors, each containing O(n) nonzero entries. The factorization can be attained using O(n 3/2 log n) computation and O(n log n) memory resources. Furthermore, the proposed algorithm can be implemented in parallel and can apply to matrices with strong or weak admissibility conditions arising from surface integral equation solvers as well as multi-frontal-based finite-difference, finite-element, or finite-volume solvers. A distributed-memory parallel implementation of the algorithm demonstrates excellent scaling behavior.

97 MATHEMATICS AND COMPUTING↗

Emergent viscous hydrodynamics from a single quantum particle

We investigate an explicit example of how spatial decoherence can lead to hydrodynamic behavior in the late-time, long-wavelength regime of open quantum systems. We focus on the case of a single nonrelativistic quantum particle linearly coupled to a thermal bath of noninteracting harmonic oscillators at temperature T , a la Caldeira and Leggett. Taking advantage of decoherence in the position representation, we expand the reduced density matrix in powers of the off-diagonal spatial components, so that high-order terms are suppressed at late times. Truncating the resulting power series at second order leads to a set of dissipative transient hydrodynamic equations similar to the nonrelativistic limit of equations widely used in simulations of the quark-gluon plasma formed in ultrarelativistic heavy-ion collisions. Transport coefficients are directly determined by the damping constant γ , which quantifies the influence of the environment. The asymptotic limit of our hydrodynamic equations reduces to the celebrated Navier-Stokes equations for a compressible fluid in the presence of a drag force. Furthermore, our results shed new light on the onset of hydrodynamic behavior in open quantum systems where a system with few degrees of freedom is coupled to a large thermal environment.

Hydrodynamics↗

Photoluminescence of Cis-Polyacetylene Semiconductor Material

Photoluminescence (PL) is one of the key experimental characterizations of optoelectronic materials, including conjugated polymers (CPs). In this study, a simplified model of an undoped cis-polyacetylene (cis-PA) oligomer was selected and used to explain the mechanism of photoluminescence (PL) of the CPs. Using a combination of the ab initio electronic structure and a time-dependent density matrix methodology, the photo-induced time-dependent excited state dynamics were computed. We explored the phonon-induced relaxation of the photoexcited state for a single oligomer of cis-PA. Here, the dissipative Redfield equation of the motion was used to compute the dissipative excited state dynamics of electronic degrees of freedom. This equation used the nonadiabatic couplings as parameters. The computed excited state dynamics showed that the relaxation rate of the electron is faster than the relaxation rate of the hole. The dissipative excited-state dynamics were combined with radiative recombination channels to predict the PL spectrum. The simulated results showed that the absorption and emission spectra both have a similar transition. The main result is that the computed PL spectrum demonstrates two mechanisms of light emission originating from (i) the inter-band transitions, corresponding to the same range of transition energies as the absorption spectrum and (ii) intra-band transitions not available in the absorption spectra. However, the dissipative Redfield equation of the motion was used to compute the electronic degrees of freedom of the nonadiabatic couplings, which helped to process the time propagation of the excited dynamic state. This excited dynamic state shows that the relaxation rate of the electron is faster than the relaxation rate of the hole, which can be used for improving organic semiconductor materials for photovoltaic and LED applications.

36 MATERIALS SCIENCE↗

LuGo: An enhanced quantum phase estimation implementation

Quantum Phase Estimation (QPE) is a cardinal algorithm in quantum computing that plays a crucial role in various applications, including cryptography, molecular simulation, and solving systems of linear equations. However, the standard implementation of QPE faces challenges related to time complexity and circuit depth, which limit its practicality for large-scale computations. We introduce LuGo, a novel framework designed to enhance the performance of QPE by reducing circuit duplication, as well as using parallelization techniques to achieve faster generation of the QPE circuit and gate reduction. We validate the effectiveness of our framework by generating quantum linear solver circuits, which require both QPE and inverse QPE, to solve linear systems of equations. LuGo achieves significant improvements in both computational efficiency and hardware requirements without compromising on accuracy. Compared to a standard QPE implementation, LuGo reduces time consumption to generate a circuit that solves a 2 6 × 2 6 system matrix by a factor of 50.68 and over 31× reduction of quantum gates and circuit depth, with no fidelity loss on an ideal quantum simulator. Furthermore, we demonstrated the versatility and scalability of LuGo enabled HHL algorithm by simulating a canonical Hele-Shaw fluid problem using a quantum simulator. With these advantages, LuGo paves the way for more efficient implementations of QPE, enabling broader applications across several quantum computing domains.

Quantum algorithm↗

Nonadiabatic dynamics with classical trajectories: The problem of an initial coherent superposition of electronic states

Advances in coherent light sources and development of pump–probe techniques in recent decades have opened the way to study electronic motion in its natural time scale. When an ultrashort laser pulse interacts with a molecular target, a coherent superposition of electronic states is created and the triggered electron dynamics is coupled to the nuclear motion. A natural and computationally efficient choice to simulate this correlated dynamics is a trajectory-based method where the quantum-mechanical electronic evolution is coupled to a classical-like nuclear dynamics. These methods must approximate the initial correlated electron–nuclear state by associating an initial electronic wavefunction to each classical trajectory in the ensemble. Different possibilities exist that reproduce the initial populations of the exact molecular wavefunction when represented in a basis. We show that different choices yield different dynamics and explore the effect of this choice in Ehrenfest, surface hopping, and exact-factorization-based coupled-trajectory schemes in a one-dimensional two-electronic-state model system that can be solved numerically exactly. Furthermore, this work aims to clarify the problems that standard trajectory-based techniques might have when a coherent superposition of electronic states is created to initialize the dynamics, to discuss what properties and observables are affected by different choices of electronic initial conditions and to point out the importance of quantum-momentum-induced electronic transitions in coupled-trajectory schemes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A parallel strategy for density functional theory computations on accelerated nodes

Using the Löwdin orthonormalization of tall-skinny matrices as a proxy-app for wavefunction-based Density Functional Theory solvers, we investigate a distributed memory parallel strategy focusing on Graphics Processing Unit (GPU)-accelerated nodes as available on some of the top ranked supercomputers at the present time. Here we present numerical results in the strong limit regime, as it is particularly relevant for First-Principles Molecular Dynamics. We also examine how matrix product-based iterative solvers provide a competitive alternative to dense eigensolvers on GPUs, allowing to push the strong scaling limit of these computations to a larger number of distributed tasks. Our strategy, which relies on replicated Gram matrices and efficient collective communications using the NCCL library, leads to a time-to-solution under 0.5 s for the Löwdin orthonormalization of a tall-skinny matrix of 3000 columns on Summit at Oak Ridge Leadership Facility (OLCF). Given the similarity in computational operations between one iteration of a DFT solver and this proxy-app, this shows the possibility of solving accurately the DFT equations well under a minute for 3000 electronic wave functions, and thus perform First-Principles molecular dynamics of physical systems much larger than traditionally solved on CPU systems.

97 MATHEMATICS AND COMPUTING↗

The reflected entanglement spectrum for free fermions

We consider the reflected entropy and the associated entanglement spectrum for free fermions reduced to two intervals in 1 + 1 dimensions. Working directly in the continuum theory the reflected entropy can be extracted from the spectrum of a singular integral equation whose kernel is determined by the known free fermion modular evolved correlation function. We find the spectrum numerically and analytically in certain limits. For intervals that almost touch the reflected entanglement spectrum approaches the spectrum of the thermal density matrix. This suggests that the reflected entanglement spectrum is well suited to the task of extracting physical data of the theory directly from the ground state wave function.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Separable physics-informed DeepONet: Breaking the curse of dimensionality in physics-informed machine learning

The deep operator network (DeepONet) has shown remarkable potential in solving partial differential equations (PDEs) by mapping between infinite-dimensional function spaces using labeled datasets. However, in scenarios lacking labeled data, the physics-informed DeepONet (PI-DeepONet) approach, which utilizes the residual loss of the governing PDE to optimize the network parameters, faces significant computational challenges, particularly due to the curse of dimensionality. This limitation has hindered its application to high-dimensional problems, making even standard 3D spatial with 1D temporal problems computationally prohibitive. Additionally, the computational requirement increases exponentially with the discretization density of the domain. Here, to address these challenges and enhance scalability for high-dimensional PDEs, we introduce the Separable physics-informed DeepONet (Sep-PI-DeepONet). This framework employs a factorization technique, utilizing sub-networks for individual one-dimensional coordinates, thereby reducing the number of forward passes and the size of the Jacobian matrix required for gradient computations. By incorporating forward-mode automatic differentiation (AD), we further optimize computational efficiency, achieving linear scaling of computational cost with discretization density and dimensionality, making our approach highly suitable for high-dimensional PDEs. We demonstrate the effectiveness of Sep-PI-DeepONet through three benchmark PDE models: the viscous Burgers’ equation, Biot’s consolidation theory, and a parameterized heat equation. Our framework maintains accuracy comparable to the conventional PI-DeepONet while reducing training time by two orders of magnitude. Notably, for the heat equation solved as a 4D problem, the conventional PI-DeepONet was computationally infeasible (estimated 289.35 h), while the Sep-PI-DeepONet completed training in just 2.5 h. These results underscore the potential of Sep-PI-DeepONet in efficiently solving complex, high-dimensional PDEs, marking a significant advancement in physics-informed machine learning.

Neural operator↗

Hutchinson Trace Estimation for high-dimensional and high-order Physics-Informed Neural Networks

Physics-Informed Neural Networks (PINNs) have proven effective in solving partial differential equations (PDEs), especially when some data are available by seamlessly blending data and physics. However, extending PINNs to high-dimensional and even high-order PDEs encounters significant challenges due to the computational cost associated with automatic differentiation in the residual loss function calculation. Herein, we address the limitations of PINNs in handling high-dimensional and high-order PDEs by introducing the Hutchinson Trace Estimation (HTE) method. Starting with the second-order high-dimensional PDEs, which are ubiquitous in scientific computing, HTE is applied to transform the calculation of the entire Hessian matrix into a Hessian vector product (HVP). This approach not only alleviates the computational bottleneck via Taylor-mode automatic differentiation but also significantly reduces memory consumption from the Hessian matrix to an HVP’s scalar output. We further showcase HTE’s convergence to the original PINN loss and its unbiased behavior under specific conditions. Comparisons with the Stochastic Dimension Gradient Descent (SDGD) highlight the distinct advantages of HTE, particularly in scenarios with significant variability and variance among dimensions. We further extend the application of HTE to higher-order and higher-dimensional PDEs, specifically addressing the biharmonic equation. By employing tensor-vector products (TVP), HTE efficiently computes the colossal tensor associated with the fourth-order high-dimensional biharmonic equation, saving memory and enabling rapid computation. The effectiveness of HTE is illustrated through experimental setups, demonstrating comparable convergence rates with SDGD under memory and speed constraints. Additionally, HTE proves valuable in accelerating the Gradient-Enhanced PINN (gPINN) version as well as the Biharmonic equation. Overall, HTE opens up a new capability in scientific machine learning for tackling high-order and high-dimensional PDEs.

Curse of dimensionality↗