Exponential Convergence in Feedforward Adaptive Systems Without Persistent Excitation
Conditions are investigated for exponential convergence of the tracking error in feedforward adaptive systems without persistent excitation.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Conditions are investigated for exponential convergence of the tracking error in feedforward adaptive systems without persistent excitation.
Persistent excitation conditions which ensure parameter convergence in adaptive algorithms have been studied by many researchers. Here, conditions are investigated for exponential convergence of the tracking error in feedforward adaptive systems without persistent excitation. Particular attention is paid to the continuous-time LMS algorithm in the overparametrized case. Results are presented.
Many practical adaptive feedforward systems are overparametrized and for this reason will not satisfy persistent excitation (PE) conditions. For these systems, a weaker PE condition is proposed under which it is shown that the tracking error (the error between the desired and estimated outputs) converges exponentially.
It is shown that persistent excitation (PE) conditions are overly stringent for ensuring exponential convergence of the tracking error in overparametrized adaptive feedforward systems.
Emerging tensor network techniques for solutions of partial differential equations (PDEs), known for their ability to break the curse of dimensionality, deliver new mathematical methods for ultra-fast numerical solutions of high-dimensional problems. Here, we introduce a Tensor Train (TT) Chebyshev spectral collocation method, in both space and time, for the solution of the time-dependent convection-diffusion-reaction (CDR) equation with inhomogeneous boundary conditions, in Cartesian geometry. Previous methods for numerical solution of time-dependent PDEs often used finite difference for time, and a spectral scheme for the spatial dimensions, which led to a slow linear convergence. Spectral collocation space-time methods show exponential convergence; however, for realistic problems they need to solve large four-dimensional systems. We overcome this difficulty by using a TT approach, as its complexity only grows linearly with the number of dimensions. We show that our TT space-time Chebyshev spectral collocation method converges exponentially, when the solution of the CDR is smooth, and demonstrate that it leads to a very high compression of linear operators from terabytes to kilobytes in TT-format, and a speedup of tens of thousands of times when compared to a full-grid space-time spectral method. These advantages allow us to obtain the solutions at much higher resolutions.
It is well known that the Fourier series of an analytic or periodic function, truncated after 2N+1 terms, converges exponentially with N, even in the maximum norm, although the function is still analytic. This is known as the Gibbs phenomenon. Here, we show that the first 2N+1 Fourier coefficients contain enough information about the function, so that an exponentially convergent approximation (in the maximum norm) can be constructed.
We analyze the convergence of a nonlocal gradient descent method for minimizing a class of high-dimensional non-convex functions, where a directional Gaussian smoothing (DGS) is proposed to define the nonlocal gradient (also referred to as the DGS gradient). The method was first proposed in [Zhang et al., Enabling long-range exploration in minimization of multimodal functions, UAI 2021], in which multiple numerical experiments showed that replacing the traditional local gradient with the DGS gradient can help the optimizers escape local minima more easily and significantly improve their performance. However, a rigorous theory for the efficiency of the method on nonconvex landscape is lacking. In this work, we investigate the scenario where the objective function is composed of a convex function, perturbed by deterministic oscillating noise. We provide a convergence theory under which the iterates exponentially converge to a tightened neighborhood of the solution, whose size is characterized by the noise wavelength. Here, we also establish a correlation between the optimal values of the Gaussian smoothing radius and the noise wavelength, thus justifying the advantage of using moderate or large smoothing radii with the method. Furthermore, if the noise level decays to zero when approaching the global minimum, we prove that DGS-based optimization converges to the exact global minimum with linear rates, similarly to standard gradient-based methods in optimizing convex functions. Several numerical experiments are provided to confirm our theory and illustrate the superiority of the approach over those based on the local gradient.
Many practical adaptive feedforward systems are overparametrized and for this reason will not satisy persistent excitation (PE) conditions. For these systems, a weaker PE condition is poposed under which it is shown that the tracking error (the error between the desired and estimated outputs) converges exponentially.
A discrete steepest ascent method which allows controls which are not piecewise constant (for example, it allows all continuous piecewise linear controls) was derived for the solution of optimal programming problems. This method is based on the continuous steepest ascent method of Bryson and Denham and new concepts introduced by Kelley and Denham in their development of compatible adjoints for taking into account the effects of numerical integration. The method is a generalization of the algorithm suggested by Canon, Cullum, and Polak with the details of the gradient computation given. The discrete method was compared with the continuous method for an aerodynamics problem for which an analytic solution is given by Pontryagin's maximum principle, and numerical results are presented. The discrete method converges more rapidly than the continuous method at first, but then for some undetermined reason, loses its exponential convergence rate. A comparsion was also made for the algorithm of Canon, Cullum, and Polak using piecewise constant controls. This algorithm is very competitive with the continuous algorithm.
In this paper we develop the theory of high-order radiation boundary conditions for wave propagation problems. In particular, we study the convergence of sequences of time-local approximate conditions to the exact boundary condition, and subsequently estimate the error in the solutions obtained using these approximations. We show that for finite times the Pade approximants proposed by Engquist and Majda lead to exponential convergence if the solution is smooth, but that good long-time error estimates cannot hold for spatially local conditions. Applications in fluid dynamics are also discussed.
New stability theorems are developed for the convergence analysis of a class of one and two-time scale time-varying nonlinear systems using averaging theory. These theorems are applied to a class of continuous time adaptive identifiers and model reference adaptive controllers to obtain estimates of the parameter rate of exponential convergence.
A family of simple, periodic basis functions with 'built-in' discontinuities are introduced, and their properties are analyzed and discussed. Some of their potential usefulness is illustrated in conjunction with the Fourier series representations of functions with discontinuities. In particular, it is demonstrated how they can be used to construct a sequence of approximations which converges exponentially in the maximum norm to a piece-wise smooth function. The theory is illustrated with several examples and the results are discussed in the context of other sequences of functions which can be used to approximate discontinuous functions.
The problem of accurately reconstructing a piece-wise smooth, 2(pi)-periodic function f and its first few derivatives, given only a truncated Fourier series representation of f, is studied and solved. The reconstruction process is divided into two steps. In the first step, the first 2N + 1 Fourier coefficients of f are used to approximate the locations and magnitudes of the discontinuities in f and its first M derivatives. This is accomplished by first finding initial estimates of these quantities based on certain properties of Gibbs phenomenon, and then refining these estimates by fitting the asymptotic form of the Fourier coefficients to the given coefficients using a least-squares approach. It is conjectured that the locations of the singularities are approximated to within O(N(sup -M-2), and the associated jump of the k(sup th) derivative of f is approximated to within O(N(sup -M-l+k), as N approaches infinity, and the method is robust. These estimates are then used with a class of singular basis functions, which have certain 'built-in' singularities, to construct a new sequence of approximations to f. Each of these new approximations is the sum of a piecewise smooth function and a new Fourier series partial sum. When N is proportional to M, it is shown that these new approximations, and their derivatives, converge exponentially in the maximum norm to f, and its corresponding derivatives, except in the union of a finite number of small open intervals containing the points of singularity of f. The total measure of these intervals decreases exponentially to zero as M approaches infinity. The technique is illustrated with several examples.
Here, the no-core shell model (NCSM) is an ab initio method that solves the nuclear many-body problem by expanding the many-particle wave function into a (typically) harmonic oscillator basis and minimizing the energy to obtain the expansion coefficients. Extensions of the NCSM, such as its coupling with microscopic-cluster basis states, further allow for an ab initio treatment of light-ion nuclear reactions of interest for both astrophysics and nuclear technology applications. A downside of the method is the exponential scaling of the basis size with increasing number of nucleons and excitation quanta, which limits its applicability to mass A ≲ 16 nuclei, except for variants where the basis is further down-selected via some truncation scheme. We consider a basis selection method for the NCSM that was first introduced in the context of the large-scale shell model and captures the essential degrees of freedom of the nuclear wave function leading to a favorable complexity scaling for calculations and enabling ab initio reaction calculations in sd-shell nuclei. The particle configurations within the NCSM basis are ordered based on their contribution to the first moment of the Hamiltonian matrix that results from the projection onto the many-body basis. The truncation scheme then consists in retaining only the lowest-first-moment configurations, which typically contain only few many-body basis states (Slater determinants). As the energy threshold above which configurations are disregarded is increased, the size of the basis becomes an almost-continuous variable, allowing for tunable fidelity in the obtained wave functions. The resulting wave functions can then be used directly in ab initio reaction calculations. We present calculations for 7 Li and n + 12 C scattering using nucleon-nucleon interactions derived from chiral effective field theory and softened using the similarity renormalization group method. The obtained energy levels invariably demonstrate exponential convergence with the size of the basis, and we find improved convergence in scattering calculations. To demonstrate the possibilities enabled by the approach, we also present a first calculation for the scattering of neutrons from 24 Mg. The method presented in this work appears promising for future studies of nuclei with mass A > 16, opening multiple future research directions impacting both nuclear astrophysics and nuclear technology applications.
Hadron wave packets are prepared and time evolved in the Schwinger model using 112 qubits of IBM’s 133-qubit Heron quantum computer ibm_torino. The initialization of the hadron wave packet is performed in two steps. First, the vacuum is prepared across the whole lattice using the recently developed SC-ADAPT-VQE algorithm and workflow. SC-ADAPT-VQE is then extended to the preparation of localized states, and used to establish a hadron wave packet on top of the vacuum. This is done by adaptively constructing low-depth circuits that maximize the overlap with an adiabatically prepared hadron wave packet. Due to the localized nature of the wavepacket, these circuits can be determined on a sequence of small lattices using classical computers, and then robustly scaled to prepare wave packets on large lattices for simulations using quantum computers. Time evolution is implemented with a second-order Trotterization. To reduce both the required qubit connectivity and circuit depth, an approximate quasilocal interaction is introduced. This approximation is made possible by the emergence of confinement at long distances, and converges exponentially with increasing distance of the interactions. Using multiple error-mitigation strategies, up to 14 Trotter steps of time evolution are performed, employing 13,858 two-qubit gates (with a CNOT depth of 370). The propagation of hadrons is clearly identified, with results that compare favorably with Matrix Product State simulations. Finally, prospects for a near-term quantum advantage in simulations of hadron scattering are discussed.
Counterdiabatic (CD) driving has the potential to speed up adiabatic quantum state preparation by suppressing unwanted excitations. However, existing approaches either require intractable classical computations or are based on approximations that do not have performance guarantees. We propose and analyze a nonvariational, system-agnostic CD expansion method and analytically show that it converges exponentially quickly in the expansion order. In finite systems, the required resources scale inversely with the spectral gap, which we argue is asymptotically optimal. To extend our method to the thermodynamic limit and suppress errors stemming from high-frequency transitions, we leverage finite-time adiabatic protocols. In particular, we show that a time determined by the quantum speed limit is sufficient to prepare the desired ground state, without the need to optimize the adiabatic trajectory. Numerical tests of our method on the quantum Ising chain show that our method can outperform state-of-the-art variational CD approaches.
We present an efficient and robust numerical algorithm for solving the linear elasticity problem that combines the Quantized Tensor Train format and a domain partitioning strategy. This approach makes it possible to solve the linear elasticity problem on a computational domain that is more general than a square. By integrating Z-ordering and subdomain concatenation, our method substantially decreases memory usage and achieves a notable reduction in rank compared to established Finite Element implementations like the FEniCS platform. This efficiency is maintained while still guaranteeing exponential convergence with respect to the number of degrees of freedom. This performance gain, however, requires a fundamental rethinking of how core finite element operations are implemented. This includes changes to mesh discretization, node and degree of freedom ordering, stiffness matrix and internal nodal force assembly, and the execution of algebraic matrix-vector operations. In this work, we discuss all these aspects in detail and assess the method’s performance in the numerical approximation of three representative test cases.
Cloud liquid water path (L) adjusts to perturbations in cloud droplet number concentration (N) over time. We explore the magnitude and timescale of this adjustment in nocturnal non-precipitating marine stratocumuli using large eddy simulations of baseline conditions and aerosol seeding experiments for 22 meteorological conditions. The results confirm that the L adjustment (δL) slope (k) is more negative for simulation pairs with relatively low N and less negative for high N. Overall, k is unlikely to be lower than −0.4 within 24 h of seeding start, meaning the L adjustment is unlikely to fully offset the brightening due to the Twomey effect. After seeding, the δL becomes increasingly negative, which can be characterized by an exponential convergence. This evolution is governed by a short timescale around 5 h and lasts for around 8–12 h. It is driven by the feedback between entrainment, L, and boundary layer (BL) turbulence. Other processes, including radiation, surface fluxes, and subsidence, respond to the seeding weakly. This short timescale is insensitive to the amount of seeding, making the evolution of δL and some other deviations similar for different seeding amounts after appropriate scaling. The timescale of k evolution is closely related to the δL timescale and hence also short, while it could also be affected by the δN evolution. The results are most relevant to conditions where seeding is applied to a large area of marine stratocumulus in well-mixed and overcast BL where shear is not a primary source of turbulence.