Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Numerical algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Minimum entropy filtering for a single output non-Gaussian stochastic system using state transformation

This paper presents a novel filter design for the single-output stochastic non-linear systems subjected to non-Gaussian noises and the proposed assumptions. Based on a state transformation, the unmeasurable states of the systems can be estimated where non-linear terms in the systems have been eliminated. It has been shown that the estimation error is linearly dynamical regarding to the presented vector-valued filter gain which can be optimised by minimising the entropy-based performance criterion. In addition, the convergence of the presented algorithm is analysed in mean-square sense and a numerical example is given to verify the effectiveness of the presented filtering algorithm. Meanwhile, the extended Kalman filter, unscented particle filter and minimum entropy filter are given for the comparisons of the filtering performance. Following the presented framework, some extensions of the presented filtering algorithm are discussed to indicate the flexibility of the filter design. The contribution of this paper can be summarised as establishing a novel minimum entropy filtering framework which consists of model transformation, entropy optimisation and convergence analysis.

42 ENGINEERING↗

Adaptive Quantum Generative Training using an Unbounded Loss Function

We propose a generative quantum learning algorithm using the Adaptive Derivative-Assembled Problem Tailored ansatz (ADAPT) framework in which the loss function to be minimized is the maximal quantum Rényi divergence of order two, an unbounded function that mitigates barren plateaus which inhibit training variational circuits. We benchmark this method against other state-of-the-art adaptive algorithms by learning random two-local thermal states. We perform numerical experiments of up to 12 qubits comparing our method learning algorithms that use linear objective functions and show that Rényi-ADAPT is capable of constructing shallow quantum circuits competitive with existing methods, while the gradients remain favorable resulting from the maximal Rényi divergence loss function.

quantum algorithms, quantum machine learning, quan↗

Integral Kernel Methods for Nonlinear Parabolic-Elliptic Systems

Nonlinear parabolic-elliptic systems arise in many physical, biological, and chemical phenomena such as chemotaxis, ion transport, self-gravitating particles, and Brownian vortices. Existing methods struggle with the strong coupling and high nonlinearity and nonlocality of some of these systems, especially the ill-conditioned, convection-dominated problems. To overcome numerical difficulties, current approaches rely on initial guesses, preconditioning, or iterative techniques with no convergence guarantees. They might suffer from poor scalability, large memory usage, and difficulty to parallelize. Inspired by the connection of parabolic-elliptic systems to stochastic processes, we introduce a novel meshless, monolithic, and fully explicit method that naturally encapsulates the elliptic and parabolic operators into a single step which updates each node deterministically with global information. By being fully quadrature-based, it avoids solving systems of discretized equations and does not utilize initial guesses or preconditioning, while requiring little memory and being easy to parallelize. We first derive the method in an integral kernel formulation with quadratic complexity in the number of integration nodes and then leverage kernel-independent fast multipole methods (FMM) to present a scalable algorithm with linear complexity. We provide numerical examples for the Poisson-Nernst-Planck equations in one, two, and three dimensions, together with the derivation of the integral kernel for each case. Furthermore, the examples demonstrate the fast convergence and scalability of the FMM-accelerated algorithm, as well as its suitability for convection-dominated problems, making it competitive against traditional PDE solvers.

PDE systems↗

Efficient phase-factor evaluation in quantum signal processing

Quantum signal processing (QSP) is a powerful quantum algorithm to exactly implement matrix polynomials on quantum computers. Asymptotic analysis of quantum algorithms based on QSP has shown that asymptotically optimal results can in principle be obtained for a range of tasks, such as Hamiltonian simulation and the quantum linear system problem. A further benefit of QSP is that it uses a minimal number of ancilla qubits, which facilitates its implementation on near-to-intermediate term quantum architectures. However, there is so far no classically stable algorithm allowing computation of the phase factors that are needed to build QSP circuits. Existing methods require the use of variable precision arithmetic and can only be applied to polynomials of a relatively low degree. We present here an optimization-based method that can accurately compute the phase factors using standard double precision arithmetic operations. We demonstrate the performance of this approach with applications to Hamiltonian simulation, eigenvalue filtering, and quantum linear system problems. Furthermore, our numerical results show that the optimization algorithm can find phase factors to accurately approximate polynomials of a degree larger than 10000 with errors below 10 -12 .

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Geometry of Non-Diffusive Tracer Transport in Gridded Atmospheric Models

A first-order linear and numerically non-diffusive Eulerian transport algorithm, minVAR, was recently developed for preservation of correlations between interrelated tracers during advective transport. The present study extends this work by: (1) providing further investigation of several interesting geometric constructions found in contours of constant minVAR, short for minimum variance, through extension to three coordinate dimensions. These contours capture point-by-point representations of thousands of individual atmospheric aerosol and/or cloud particles as they evolve and are rendered on Eulerian grids at a level of sub-grid resolution limited only by numerical precision; and (2) exploration of geometric similarities between the Arakawa C-grid, used to obtain interpolated values of the wind field at grid scale and minVAR. In particular, we consider interpolation of the u and v horizontal components of wind velocity from grid to sub-grid scales. The last results are motivated by recent applications of the Weather Research and Forecasting (WRF) model applied in the coastal Houston region, where the recent TRacking Aerosol Convection Interactions ExpeRiment (TRACER) field campaign was organized. A unique and fully consistent mapping is obtained between particles moving along meteorological wind trajectories and the non-diffusive, non-dispersive representation of such trajectories on an Eulerian grid.

54 ENVIRONMENTAL SCIENCES↗

Non-Adiabatic Excited State Molecular Dynamics Methodologies: comparison and convergence

Direct atomistic simulation of nonadiabatic molecular dynamics is a challenging goal that allows important insights into fundamental physical phenomena. A variety of frameworks, ranging from fully quantum treatment of nuclei to semiclassical and mixed quantum–classical approaches, were developed. These algorithms are then coupled to specific electronic structure techniques. Such diversity and lack of standardized implementation make it difficult to compare the performance of different methodologies when treating realistic systems. Here, we compare three popular methods for large chromophores: Ehrenfest, surface hopping, and multiconfigurational Ehrenfest with ab initio multiple cloning (MCE-AIMC). These approaches are implemented in the NEXMD software, which features a common computational chemistry model. The resulting comparisons reveal the method performance for population relaxation and coherent vibronic dynamics. Finally, we study the numerical convergence of MCE-AIMC algorithms by considering the number of trajectories, cloning thresholds, and Gaussian wavepacket width. Our results provide helpful reference data for selecting an optimal methodology for simulating excited-state molecular dynamics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Modeling wave propagation in elastic solids via high-order accurate implicit-mesh discontinuous Galerkin methods

Here, a high-order accurate implicit-mesh discontinuous Galerkin framework for wave propagation in single-phase and bi-phase solids is presented. The framework belongs to the embedded-boundary techniques and its novelty regards the spatial discretization, which enables boundary and interface conditions to be enforced with high-order accuracy on curved embedded geometries. High-order accuracy is achieved via high-order quadrature rules for implicitly-defined domains and boundaries, whilst a cell-merging strategy addresses the presence of small cut cells. The framework is used to discretize the governing equations of elastodynamics, written using a first-order hyperbolic momentum-strain formulation, and an exact Riemann solver is employed to compute the numerical flux at the interface between dissimilar materials with general anisotropic properties. The space-discretized equations are then advanced in time using explicit high-order Runge–Kutta algorithms. Several two- and three-dimensional numerical tests including dynamic adaptive mesh refinement are presented to demonstrate the high-order accuracy and the capability of the method in the elastodynamic analysis of single- and bi-phases solids containing complex geometries.

42 ENGINEERING↗

PyDA: A Hands-On Introduction to Dynamical Data Assimilation with Python

Dynamic data assimilation offers a suite of algorithms that merge measurement data with numerical simulations to predict accurate state trajectories. Meteorological centers rely heavily on data assimilation to achieve trustworthy weather forecast. With the advance in measurement systems, as well as the reduction in sensor prices, data assimilation (DA) techniques are applicable to various fields, other than meteorology. However, beginners usually face hardships digesting the core ideas from the available sophisticated resources requiring a steep learning curve. In this tutorial, we lay out the mathematical principles behind DA with easy-to-follow Python module implementations so that this group of newcomers can quickly feel the essence of DA algorithms. We explore a series of common variational, and sequential techniques, and highlight major differences and potential extensions. We demonstrate the presented approaches using an array of fluid flow applications with varying levels of complexity.

97 MATHEMATICS AND COMPUTING↗

A Cartesian-diffusion Langevin method for hybrid kinetic-fluid Coulomb scattering in particle-in-cell plasma simulations

A novel, drag-diffusion Langevin method of hybrid, kinetic-fluid Coulomb scattering in plasmas is presented. Unlike previous methods, the frictional drag is always applied in the simulation frame of reference. The velocity-space diffusion is performed in the stationary-fluid frame of reference when anisotropic, and in the laboratory frame when isotropic. While the general method is mass-ratio independent, we focus on interactions of kinetic-ions and fluid-electrons to show first-order modifications to the electron velocity distribution function that are an important correction for the accurate calculation of electric resistivity. Inclusion of sub-cycling and a limit to the maximum collision frequency is shown to allow for arbitrarily large timesteps without numerical failure. Here the Langevin method is compared with a grid-based binary method and found to require a much less restrictive timestep in cases of ion–electron slowing and temperature equilibration; this finding differs from previous work and is dependent on the mass ratio.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Data-Driven Learning of Nonautonomous Systems

In this work, we present a numerical framework for recovering unknown nonautonomous dynamical systems with time-dependent inputs. To circumvent the difficulty presented by the nonautonomous nature of the system, our method transforms the solution state into piecewise integration of the system over a discrete set of time instances. The time-dependent inputs are then locally parameterized by using a proper model, for example, polynomial regression, in the pieces determined by the time instances. This transforms the original system into a piecewise parametric system that is locally time invariant. We then design a deep neural network structure to learn the local models. Once the network model is constructed, it can be iteratively used over time to conduct global system prediction. We provide theoretical analysis of our algorithm and present a number of numerical examples to demonstrate the effectiveness of the method.

97 MATHEMATICS AND COMPUTING↗

Data-Driven Learning of Non-Autonomous Systems

We present a numerical framework for recovering unknown non-autonomous dynamical systems with time-dependent inputs. To circumvent the difficulty presented by the non-autonomous nature of the system, our method transforms the solution state into piecewise integration of the system over a discrete set of time instances. The time-dependent inputs are then locally parameterized by using a proper model, for example, polynomial regression, in the pieces determined by the time instances. This transforms the original system into a piecewise parametric system that is locally time invariant. We then design a deep neural network structure to learn the local models. Once the network model is constructed, it can be iteratively used over time to conduct global system prediction. We provide theoretical analysis of our algorithm and present a number of numerical examples to demonstrate the effectiveness of the method.

97 MATHEMATICS AND COMPUTING↗

Sparse Cholesky factorization for solving nonlinear PDEs via Gaussian processes

In recent years, there has been widespread adoption of machine learning-based approaches to automate the solving of partial differential equations (PDEs). Among these approaches, Gaussian processes (GPs) and kernel methods have garnered considerable interest due to their flexibility, robust theoretical guarantees, and close ties to traditional methods. They can transform the solving of general nonlinear PDEs into solving quadratic optimization problems with nonlinear, PDE-induced constraints. However, the complexity bottleneck lies in computing with dense kernel matrices obtained from pointwise evaluations of the covariance kernel, and its partial derivatives, a result of the PDE constraint and for which fast algorithms are scarce. The primary goal of this paper is to provide a near-linear complexity algorithm for working with such kernel matrices. We present a sparse Cholesky factorization algorithm for these matrices based on the near-sparsity of the Cholesky factor under a novel ordering of pointwise and derivative measurements. The near-sparsity is rigorously justified by directly connecting the factor to GP regression and exponential decay of basis functions in numerical homogenization. We then employ the Vecchia approximation of GPs, which is optimal in the Kullback-Leibler divergence, to compute the approximate factor. This enables us to compute ϵ-approximate inverse Cholesky factors of the kernel matrices with complexity O(N log d (N/ϵ)) in space and O(N log 2d (N/ϵ)) in time. We integrate sparse Cholesky factorizations into optimization algorithms to obtain fast solvers of the nonlinear PDE. We numerically illustrate our algorithm’s near-linear space/time complexity for a broad class of nonlinear PDEs such as the nonlinear elliptic, Burgers, and Monge-Ampère equations. In summary, we provide a fast, scalable, and accurate method for solving general PDEs with GPs and kernel methods.

97 MATHEMATICS AND COMPUTING↗

A scalable algorithm for the optimization of neural network architectures

In this work, we propose a new scalable method to optimize the architecture of an artificial neural network. The proposed algorithm, called Greedy Search for Neural Network Architecture, aims to determine a neural network with minimal number of layers that is at least as performant as neural networks of the same structure identified by other hyperparameter search algorithms in terms of accuracy and computational cost. Numerical results performed on benchmark datasets show that, for these datasets, our method outperforms state-of-the-art hyperparameter optimization algorithms in terms of attainable predictive performance by the selected neural network architecture, and time-to-solution for the hyperparameter optimization to complete.

97 MATHEMATICS AND COMPUTING↗

Magnon heat transport in a two-dimensional Mott insulator

Whether or not anomalies in the thermal conductivity in insulating cuprates can be attributed to antiferromagnetic order and magnons in a 2D Mott insulator remains an intriguing open question. To shed light on this issue, we investigate the thermal conductivity $\kappa$ and its relationship with the specific heat $c_v$ in the half-filled 2D single-band Hubbard model, using the numerically exact determinant quantum Monte Carlo algorithm and maximum entropy analytic continuation. At low temperatures where the charge degrees of freedom are gapped-out and $c_v$ exhibits a clear magnon peak, we observe that thermal conductivity $\kappa$ also tends to form a peak at similar temperatures. Reducing temperature further produces a sharp upturn in $\kappa$, associated with an increasing mean-free path. Here we identify this as the high-temperature side of the anomalous peak in insulating cuprates, where the mean-free path eventually is cut-off by other scattering effects, including phonons, disorder, and physical size. Different scattering effects in our model are identified and analyzed in the thermal diffusivity.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Viterbi decoding of CRES signals in Project 8

Abstract Cyclotron radiation emission spectroscopy (CRES) is a modern approach for determining charged particle energies via high-precision frequency measurements of the emitted cyclotron radiation. For CRES experiments with gas within the fiducial volume, signal and noise dynamics can be modelled by a hidden Markov model. We introduce a novel application of the Viterbi algorithm in order to derive informational limits on the optimal detection of cyclotron radiation signals in this class of gas-filled CRES experiments, thereby providing concrete limits from which future reconstruction algorithms, as well as detector designs, can be constrained. The validity of the resultant decision rules is confirmed using both Monte Carlo and Project 8 data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Towards Robustness Guarantees for Feedback-Based Optimization

Feedback-based online optimization algorithms have gained traction in recent years because of their simple implementation, their ability to reject disturbances in real time, and their increased robustness to model mismatch. While the robustness properties have been observed both in simulation and experimental results, the theoretical analysis in the literature is mostly limited to nominal conditions. In this work, we propose a framework to systematically assess the robust stability of feedback-based online optimization algorithms. We leverage tools from monotone operator theory, variational inequalities and classical robust control to obtain tractable numerical tests that guarantee robust convergence properties of online algorithms in feedback with a physical system, even in the presence of disturbances and model uncertainty. The results are illustrated via an academic example and a case study of a power distribution system.

approximation algorithms↗

Full wave modeling of radio-frequency beams in tokamaks in the electron cyclotron frequency range

Simulation of full wave, without paraxial approximation, high-resolution solution of wave equations in frequency domain in the electron cyclotron resonance (ECR) frequency range for realistic Tokamak plasma parameters became possible by using recently formulated hybrid iterative algorithm [Svidzinski et al., Phys. Plasmas 25, 082509 (2018)] for numerically solving discretized wave equations. This approach combines time evolution and iterative relaxation techniques into iteration cycles. This algorithm is implemented in 2D code FullWave, solving wave equations in Tokamaks in cold and hot plasma models, and it has been tested in 3D full wave iterative RF beams simulation tool, which is presently being developed to model 3D ECRH RF beams in fusion devices using dynamic grid adaptation. The results of 2D full wave modeling, assuming specified toroidal mode number, of ECRH RF beams in DIII-D plasma, performed in the cold and hot plasma models for outboard and top launch scenarios using FullWave are presented. Nonlocal hot plasma response model, based on accurate numerical solution of linearized Vlasov equation, is used to model beam propagation and absorption in the 2nd electron cyclotron harmonic region. Demonstration of capability of the hybrid iterative algorithm to model ECRH RF beams in 3D is made by simulating a substantial part of realistic beam in DIII-D, launched from outboard side of the machine. All relevant physics of RF beam propagation, most of which is not captured in paraxial approximation, such as beam's divergence, interference between the X and O modes in the beam, X-O mode conversion, beam splitting into the X and O mode beams, transformation of beam's cross section, and absorption at the 2nd electron cyclotron harmonic, is captured in the simulations. A numerical technique to find an optimal beam polarization at the launcher to launch a nearly pure X or O mode beam in plasma is developed and tested.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗