Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Variational methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Calculations of anisotropic magnetic properties using spin-orbit energy variations

We analyze several methods of obtaining the accurate relativistic total energy (TE) variations using traditional perturbation theories (PTs) and proposed coupling constant integration (CCI) methods. For this purpose, we perform benchmark calculations within the density functional theory taking the spin-orbit coupling (SOC) and its derivative as a perturbation. The TE change due to SOC addition obtained from both PTs and CCI is shown to reach the accuracy of fully self-consistent TE calculations. Similar accuracy is also obtained even for the magnetocrystalline anisotropy energy (MAE). The real advantage of the proposed methods is to use PTs and CCI methods in those electronic structure methods where accurate total energies currently cannot be obtained with required accuracy. Correspondingly, we demonstrate the applicability of suggested methods for calculations of MAE in different magnetic materials using a dynamic mean-field method. All suggested PTs and CCI methods also provide convenient site, orbital, and spin decompositions of the TE variation, creating a powerful way to analyze microscopic physics in strongly correlated materials.

36 MATERIALS SCIENCE↗

Variational Neural-Network Ansatz for Continuum Quantum Field Theory

Physicists dating back to Feynman have lamented the difficulties of applying the variational principle to quantum field theories. In nonrelativistic quantum field theories, the challenge is to parametrize and optimize over the infinitely many n-particle wave functions comprising the state’s Fock-space representation. Here we approach this problem by introducing neural-network quantum field states, a deep learning ansatz that enables application of the variational principle to nonrelativistic quantum field theories in the continuum. Our ansatz uses the Deep Sets neural network architecture to simultaneously parametrize all of the n-particle wave functions comprising a quantum field state. We employ our ansatz to approximate ground states of various field theories, including an inhomogeneous system and a system with long-range interactions, thus demonstrating a powerful new tool for probing quantum field theories.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Mapping variations of redshift distributions with probability integral transforms

We present a method for mapping variations between probability distribution functions and apply this method within the context of measuring galaxy redshift distributions from imaging survey data. This method, which we name PITPZ for the probability integral transformations it relies on, uses a difference in curves between distribution functions in an ensemble as a transformation to apply to another distribution function, thus transferring the variation in the ensemble to the latter distribution function. This procedure is broadly applicable to the problem of uncertainty propagation. In the context of redshift distributions, for example, the uncertainty contribution due to certain effects can be studied effectively only in simulations, thus necessitating a transfer of variation measured in simulations to the redshift distributions measured from data. We illustrate the use of PITPZ by using the method to propagate photometric calibration uncertainty to redshift distributions of the Dark Energy Survey Year 3 weak lensing source galaxies. For this test case, we find that PITPZ yields a lensing amplitude uncertainty estimate due to photometric calibration error within 1 per cent of the truth, compared to as much as a 30 per cent underestimate when using traditional methods.

79 ASTRONOMY AND ASTROPHYSICS↗

A machine learning-based interaction force model for non-spherical and irregular particles in low Reynolds number incompressible flows

In this study, interaction force of non-spherical particles in low Reynolds number gas-solid flow is investigated by neural network approaches. An artificial neural network (ANN) model is developed to correlate the non-spherical particle shape and the flow conditions with the interaction force. To define the particle shape, spherical harmonic expansion is applied. Furthermore, variational autoencoder model is then used to extract latent geometric features. The latent vector is utilized as an input with the Reynolds number for the ANN. The interaction force data, which is used as output data of the ANN, is obtained by particle resolved direct numerical simulation for 5200 non-spherical particles. The proposed model enables unsupervised extraction for non-spherical particle shapes and accurate predictions on the interaction force without heavy computation. This study provides the model that can explain complicated shapes of particles and be applied to a large scale, computational fluid dynamics simulation.

01 COAL, LIGNITE, AND PEAT↗

Variational quantum simulation of the critical Ising model with symmetry averaging

Here we investigate the use of deep multiscale entanglement renormalization ansatz (DMERA) circuits as a variational ansatz. We use the exactly solvable one-dimensional critical transverse-field Ising model as a test bed. Numerically exact simulation of the quantum circuit ansatz can in this case be carried out to hundreds of qubits by exploiting efficient classical algorithms for simulating matchgate circuits. We find that, for this system, the DMERA strongly outperforms a standard quantum approximate optimization algorithm (QAOA)–style ansatz, and that a major source of systematic error in correlation functions approximated using the DMERA is the breaking of the translational and Kramers-Wannier symmetries of the transverse-field Ising model. We are able to reduce this error by up to four orders of magnitude by symmetry averaging, without incurring additional cost in qubits or circuit depth. Here, we propose that this technique for mitigating systematic error could be applied to noisy intermediate-scale quantum (NISQ) simulations of physical systems with other symmetries.

1-dimensional spin chains↗

Real-time dynamics of the Schwinger model as an open quantum system with Neural Density Operators

Ab-initio simulations of multiple heavy quarks propagating in a Quark-Gluon Plasma are computationally difficult to perform due to the large dimension of the space of density matrices. This work develops machine learning algorithms to overcome this difficulty by approximating exact quantum states with neural network parametrisations, specifically Neural Density Operators. As a proof of principle demonstration in a QCD-like theory, the approach is applied to solve the Lindblad master equation in the 1 + 1d lattice Schwinger Model as an open quantum system. Neural Density Operators enable the study of in-medium dynamics on large lattice volumes, where multiple-string interactions and their effects on string-breaking and recombination phenomena can be studied. Thermal properties of the system at equilibrium can also be probed with these methods by variationally constructing the steady state of the Lindblad master equation. Scaling of this approach with system size is studied, and numerical demonstrations on up to 32 spatial lattice sites and with up to 3 interacting strings are performed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Helicity, spin, and infra-zilch of light: A Lorentz covariant formulation

Highlights: • Spin and orbital parts of angular momentum. • The helicity tensor contains the helicity, spin and infra-zilch currents. • The helicity tensor is a Noether current for a duality-symmetric action. • Symmetry generator for the helicity tensor. • The helicity tensor is conserved in Lorenz gauge. In this paper, a novel conserved Lorentz covariant tensor, termed the helicity tensor, is introduced in Maxwell theory. The conservation of the helicity tensor expresses the conservation laws contained in the helicity array, introduced by Cameron et al. (2012), including helicity, spin, as well as the spin-flux or infra-zilch. The Lorentz covariance of the helicity tensor is in contrast to previous formulations of the helicity hierarchy of conservation laws, which required the non-Lorentz covariant transverse gauge. The helicity tensor is shown to arise as a Noether current for a variational symmetry of a duality-symmetric Lagrangian for Maxwell theory. This symmetry transformation generalizes the duality symmetry and includes the symmetry underlying the conservation of the spin part of the angular momentum.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Attaining regularization length insensitivity in phase-field models of ductile failure

In this work, a cohesive phase-field model of ductile fracture in a finite-deformation setting is presented. The model is based on a free-energy function in which both elastic and plastic work contributions are coupled to damage. Using a strictly variational framework, the field evolution equations, damage kinetics, and flow rule are jointly derived from a scalar least-action principle. Particular emphasis is placed on the use of a rational function for the stress degradation that maintains a fixed effective strength with decreasing regularization length. The model is employed to examine crack growth in pure mode-I problems through the generation of crack growth resistance (J-R) curves. In contrast to alternative models, the current formulation gives rise to J-R curves that are insensitive to the regularization length. Numerical evidence suggests convergence of local fields with respect to diminishing regularization length as well.

42 ENGINEERING↗

Scalable semidefinite programming approach to variational embedding for quantum many-body problems

In quantum embedding theories, a quantum many-body system is divided into localized clusters of sites which are treated with an accurate ‘high-level’ theory and glued together self-consistently by a less accurate ‘low-level’ theory at the global scale. The recently introduced variational embedding approach for quantum many-body problems combines the insights of semidefinite relaxation and quantum embedding theory to provide a lower bound on the ground-state energy that improves as the cluster size is increased. The variational embedding method is formulated as a semidefinite program (SDP), which can suffer from poor computational scaling when treated with black-box solvers. Here, we exploit the interpretation of this SDP as an embedding method to develop an algorithm which alternates parallelizable local updates of the high-level quantities with updates that enforce the low-level global constraints. Moreover, we show how translation invariance in lattice systems can be exploited to reduce the complexity of projecting a key matrix to the positive semidefinite cone.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Noether currents for Eulerian variational principles in non-barotropic magnetohydrodynamics and topological conservations laws

We derive a Noether current for the Eulerian variational principle of ideal non-barotropic magnetohydrodynamics (MHD). It was shown previously that ideal non-barotropic MHD is mathematically equivalent to a five function field theory with an induced geometrical structure in the case that field lines cover surfaces and this theory can be described using a variational principle. Here we use various symmetries of the flow to derive topological constants of motion through the derived Noether current and discuss their implication for non-barotropic MHD.

42 ENGINEERING↗

Cross-Sections of Nanocellulose from Wood Analyzed by Quantized Polydispersity of Elementary Microfibrils

Bio-based nanocellulose has been shown to possess impressive mechanical properties and simplicity for chemical modifications. The chemical properties are largely influenced by the surface area and functionality of the nanoscale materials. However, finding the typical cross-sections of nanocellulose, such as cellulose nanofibers (CNFs), has been a long-standing puzzle, where subtle changes in extraction methods seem to yield different shapes and dimensions. Here, we extracted CNFs from wood with two different oxidation methods and variations in degree of oxidation and high-pressure homogenization. Additionally, the cross-sections of CNFs were characterized by small-angle X-ray scattering and wide-angle X-ray diffraction in dispersed and freeze-dried states, respectively, where the results were analyzed by assuming that the cross-sectional distribution was quantized with an 18-chain elementary microfibril, the building block of the cell wall. We find that the results agree well with a pseudosquare unit having a size of about 2.4 nm regardless of sample, while the aggregate level strongly depends on the extraction conditions. Furthermore, we find that aggregates have a preferred cohesion of phase boundaries parallel to the (110)-plane of the cellulose fibril, leading to a ribbon shape on average.

36 MATERIALS SCIENCE↗

Emulation With Uncertainty Quantification of Regional Sea‐Level Change Caused by the Antarctic Ice Sheet

Abstract Projecting regional sea‐level change under various climate‐change scenarios typically involves running forward simulations of the Earth's gravitational, rotational and deformational (GRD) response to ice‐mass change, which requires substantial computational cost if applied to probabilistic frameworks requiring thousands to millions of samples. Here we build emulators of regional sea‐level change at 27 coastal locations, due to the GRD effects associated with future Antarctic Ice Sheet mass change over the 21st century. The emulators are evaluated against a numerical sea‐level model applied to an ensemble of ice‐sheet model simulations of the Antarctic Ice Sheet through 2100. We build a physics‐based emulator using a recent sensitivity kernel approach and compare it to machine learning based emulators (neural network and conditional variational autoencoder methods). In order to quantify uncertainty, we derive well‐calibrated prediction intervals for regional sea‐level change via split‐conformal inference and linear regression, and show that Monte Carlo dropout does not yield well‐calibrated uncertainties in this instance. We also demonstrate substantial gains in computational efficiency using both the physics‐based emulator and neural networks in comparison to the numerical model for the complete regional sea‐level solution. Overall, we find the physics‐based emulator modestly outperforms the machine learning emulators for this problem.

58 GEOSCIENCES↗

Generalization in quantum machine learning from few training data

Modern quantum machine learning (QML) methods involve variationally optimizing a parameterized quantum circuit on a training data set, and subsequently making predictions on a testing data set (i.e., generalizing). In this work, we provide a comprehensive study of generalization performance in QML after training on a limited number N of training data points. We show that the generalization error of a quantum machine learning model with T trainable gates scales at worst as $\sqrt{T/N}$. When only K$\ll$T gates have undergone substantial change in the optimization process, we prove that the generalization error improves to $\sqrt{K/N}$. Our results imply that the compiling of unitaries into a polynomial number of native gates, a crucial application for the quantum computing industry that typically uses exponential-size training data, can be sped up significantly. We also show that classification of quantum states across a phase transition with a quantum convolutional neural network requires only a very small training data set. Other potential applications include learning quantum error correcting codes or quantum dynamical simulation. Our work injects new hope into the field of QML, as good generalization is guaranteed from few training data.

97 MATHEMATICS AND COMPUTING↗

Evaluating the Limits of QAOA Parameter Transfer at High-Rounds on Sparse Ising Models With Geometrically Local Cubic Terms

The emergent practical applicability of the Quantum Approximate Optimization Algorithm (QAOA) for approximate combinatorial optimization is a subject of considerable interest. One of the primary limitations of QAOA is the task of finding a set of good parameters, which is usually done using a variational optimization loop. Parameter transfer, or parameter concentration, is a phenomenon where QAOA angles trained on problem instances that are self-similar tend to perform well for other problem instances from that similar class. This suggests a potentially highly efficient and scalable non-variational learning method for QAOA angle finding. In this work, we systematically study QAOA parameter transferability from small problem sizes (16 and 27 decision variables) onto large problem instances (up to 156 qubits) for heavy-hex graph Ising models with geometrically local higher order terms using the Julia based QAOA simulation tool \texttt{JuliQAOA} to perform classical angle finding for up to $49$ QAOA layers ($p$). Parameter transfer of the fixed angles is validated using a combination of full statevector, Projected Entangled Pair States (PEPS), Matrix Product State (MPS), and LOWESA numerical simulations. We find that the QAOA parameter transfer from single instances applied to other (unseen) problem instances does not in general provide monotonically improving performance as a function of $p$ - there are many cases where the performance temporarily decreases as a function of $p$ - but despite this the transferred angles have a general trend of improved expectation value as the QAOA depth increases, in many cases converging close to the true ground-state energy of the $100+$ qubit instances. We also sample the hardware-compatible Ising models using the ensemble of transfer-learned QAOA parameters on several superconducting qubit IBM Quantum processors with 127, 133, and 156 qubits. We find continuous solution quality improvement of the hardware-compatible QAOA circuits run on the IBM NISQ processors up to $p=5$ on \texttt{ibm\_fez}, up to $p=9$ on \texttt{ibm\_torino}, and up to $p=10$ on \texttt{ibm\_pittsburgh}.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Neuralized fermionic tensor networks for quantum many-body systems

In this work, we describe a class of neuralized fermionic tensor network states (NN-fTNSs) that introduce nonlinearity into fermionic tensor networks through configuration-dependent neural network transformations of the local tensors. The construction uses the fTNS algebra to implement a natural fermionic sign structure and is compatible with standard tensor network algorithms but gains enhanced expressivity through the neural network parametrization. Using the 1D and 2D Fermi-Hubbard models as benchmarks, we demonstrate that NN-fTNSs achieve order of magnitude improvements in the ground-state energy compared to pure fTNSs with the same bond dimension and can be systematically improved through both the tensor network bond dimension and the neural network parametrization. Compared to existing fermionic neural quantum states based on Slater determinants and Pfaffians, NN-fTNSs offer a physically motivated alternative fermionic structure. Furthermore, compared to such states, NN-fTNSs naturally exhibit improved computational scaling and we demonstrate a construction that achieves linear scaling with the lattice size.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Electromagnetic Analysis of ITER Electron Cyclotron Emission Model

The ITER electron cyclotron emission (ECE) diagnostic system is located at diagnostics shielding module 2 (DSM2), equatorial port 9 (EP9), to measure electron temperature profile and electron temperature fluctuations, and also assess nonthermal electron distributions via the oblique view. Therefore, ECE has both radial and oblique views with two hot sources for calibration and two couples of mirrors for two different optical views. It shall receive that the large electromagnetic (EM) loads up to 100-MN/m3 force density due to the eddy currents on the copper mirrors generated by the short transient plasma disruption. The simplified EM analysis model using magnetic field ( B ) data and flux variations (dB/dt) method based on the worst case of plasma disruption, MD_DW_EXP16MS_CATIII, has been developed to calculate the force and moments for each ECE component and support structure for EP9 DSM2 Bay2 and Bay3. The B and dB/dt methods use the constant B and dB/dt assumed for each local bay space, but the real B and dB/dt are basically varied along the radial direction of each bay. The complex global model with the local ECE components and support structure using Maxwell transient has been developed to do EM analysis to compare the results of the B and dB/dt models. The volumetric EM force density of the whole ECE components and support structure can be used for the subsequent structural analysis. In conclusion, combined with the thermal and nuclear loads and seismic and initial loads, the ECE integration analysis can be finalized for the operation case.

Fang, J. [Princeton Plasma Physics Laboratory (PPP↗

Data-Driven Clustering and Classification of Outage Patterns with Insights into their Links to Extreme Events

At a global level extreme events have increased in both scale and impact. These events have the potential to affect the electrical grid infrastructure and cause a wide range of outages, which can lead to a disruption in daily patterns, cost millions of dollars and also the loss of life. Currently, to track these outage events there have been various approaches developed ranging from regional to national level quantifications for what defines an outage. However, this variation in methods can potentially lead to subjective decision-making and a lack of proper management in relation to the event. While previous work has made strides in determining spatio-temporal patterns, minimal attention has been given to the type and number of outages an area may be exposed to. The differences in incurred cost and the overall severity of an event between a transformer box malfunction and a hurricane are drastic, and by finding historical signals, we can allow for more efficient management, potentially saving lives and millions of dollars. Here, we leverage unsupervised machine learning techniques to delineate outage patterns among 22 counties within the United States and find that there are clear, segregated clusters (0.93 silhouette) of data which are related by event behavior and underlying cause. This finding will allow for energy stakeholders, policy makers, and researchers to gain a deeper understanding of the extent and severity of historic events and to better prepare for electrical grid infrastructure planning and management.

Koob, Benjamin [ORNL]↗

The Impact of Constrained Data Assimilation on the Forecasts of Three Convection Systems During the ARM MC3E Field Campaign

A constrained data assimilation (CDA) system based on the ensemble variational (EnVar) method and physical constraints of mass and water conservations is evaluated through three convective cases during the Midlatitude Continental Convective Clouds Experiment (MC3E) of the Atmospheric Radiation Measurement (ARM) program. Compared to the original data assimilation (ODA), the CDA is shown to perform better in the forecasted state variables and simulated precipitation. The CDA is also shown to greatly mitigate the loss of forecast skills in observation denial experiments when radar radial winds are withheld in the assimilation. Modifications to the algorithm and sensitivities of the CDA to the calculation of the time tendencies in the constraints are described.

54 ENVIRONMENTAL SCIENCES↗