SEARCH · Engineering Papers

Results for “nonlinear least squares”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

All sources NASA NTRS DOE OSTI

NASA NTRS2005

A least-squares parameter estimation algorithm for switched hammerstein systems with applications to the VOR

A "Multimode" or "switched" system is one that switches between various modes of operation. When a switch occurs from one mode to another, a discontinuity may result followed by a smooth evolution under the new regime. Characterizing the switching behavior of these systems is not well understood and, therefore, identification of multimode systems typically requires a preprocessing step to classify the observed data according to a mode of operation. A further consequence of the switched nature of these systems is that data available for parameter estimation of any subsystem may be inadequate. As such, identification and parameter estimation of multimode systems remains an unresolved problem. In this paper, we 1) show that the NARMAX model structure can be used to describe the impulsive-smooth behavior of switched systems, 2) propose a modified extended least squares (MELS) algorithm to estimate the coefficients of such models, and 3) demonstrate its applicability to simulated and real data from the Vestibulo-Ocular Reflex (VOR). The approach will also allow the identification of other nonlinear bio-systems, suspected of containing "hard" nonlinearities.

Evaluation Studies↗

DOE OSTI2022

Nonlinear dimension reduction for surrogate modeling using gradient information

We introduce a method for the nonlinear dimension reduction of a high-dimensional function $u:{\mathbb{R}}^d\rightarrow{\mathbb{R}}$, $d\gg 1$. Our objective is to identify a nonlinear feature map $g:{\mathbb{R}}^d\rightarrow{\mathbb{R}}^m$, with a prescribed intermediate dimension $m\ll d$, so that $u$ can be well approximated by $f\circ g$ for some profile function $f:{\mathbb{R}}^m\rightarrow{\mathbb{R}}$. We propose to build the feature map by aligning the Jacobian $\nabla g$ with the gradient $\nabla u$, and we theoretically analyze the properties of the resulting $g$. Once $g$ is built, we construct $f$ by solving a gradient-enhanced least squares problem. Our practical algorithm uses a sample $\{{\textbf{x}}^{(i)},u({\textbf{x}}^{(i)}),\nabla u({\textbf{x}}^{(i)})\}_{i=1}^N$ and builds both $g$ and $f$ on adaptive downward-closed polynomial spaces, using cross validation to avoid overfitting. We numerically evaluate the performance of our algorithm across different benchmarks, and explore the impact of the intermediate dimension $m$. We show that building a nonlinear feature map $g$ can permit more accurate approximation of $u$ than a linear $g$, for the same input data set.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2002

Development of MLPG and LBIE Methods for Nonlinear Problems of Fracture

The truly meshless local Petrov-Galerkin (MLPG) method holds a great promise in solving boundary value problems, using a local symmetric weak form as a natural approach. In the present paper, in the context of MLPG and the meshless interpolation of a moving least squares (MLS) type, a method which uses primary and secondary nodes in the domain and on the global boundary is introduced, in order to improve the accuracy of solution. The secondary nodes can be placed at any location where one needs to obtain a better resolution. The sub-domains for the shape functions in the MLS approximation are defined only from the primary nodes, and the secondary nodes use the same sub-domains. The shape functions based on the MLS approximation, in an integration domain, have a single type of a rational function, which reduces the difficulty of numerical integration to evaluate the weak form. The present method is very useful in an adaptive calculation, because the secondary nodes can be easily added and/or moved without an additional mesh. The essential boundary conditions can be imposed exactly, and non-convex boundaries can be treated without special techniques. Several numerical examples are presented to illustrate the performance of the present method.

Atluri, Satya N.↗

DOE OSTI2022

On Projection of Safe Operation for Grid-Following Inverters - Grid Parameter Estimation

This work investigates the projection of safe operation for grid-following inverters using a reference model. This work applies recursive-least square and model reference adaptive estimation techniques to estimate the unknown grid parameters. The estimated grid parameters are used in a dynamic reference model to project the safe operation of the inverter. This work also demonstrates that the controller nonlinearity and parameter variations can cause unsafe operations, such as unexpected instability at low power levels, namely hidden mode of instability. This instability issue in the nominal operating range may occur for given control parameters in a weak-grid condition. The dynamic reference model for PQ-controlled inverters is applied to analyze this instability issue using the estimated grid parameters. Both adaptive identification techniques can estimate the unknown parameters accurately, and the dynamic reference model can safeguard inverters from an unsafe operation, i.e., hidden instability, by examining the incoming new power setpoints before engaging them to the local controller. The findings are experimentally verified using a small-scale two-level 208 V, 5 kVA inverter feeding a 12 kW NHR 9410 power grid emulator.

Hossen, Tareq↗

DOE OSTI2025

Bayesian learning with Gaussian processes for low-dimensional representations of time-dependent nonlinear systems

This work presents a data-driven method for learning low-dimensional time-dependent physics-based surrogate models whose predictions are endowed with uncertainty estimates. We use the operator inference approach to model reduction that poses the problem of learning low-dimensional model terms as a regression of state space data and corresponding time derivatives by minimizing the residual of reduced system equations. Standard operator inference models perform well with accurate training data that are dense in time, but producing stable and accurate models when the state data are noisy and/or sparse in time remains a challenge. Another challenge is the lack of uncertainty estimation for the predictions from the operator inference models. Our approach addresses these challenges by incorporating Gaussian process surrogates into the operator inference framework to (1) probabilistically describe uncertainties in the state predictions and (2) procure analytical time derivative estimates with quantified uncertainties. The formulation leads to a generalized least-squares regression and, ultimately, reduced-order models that are described probabilistically with a closed-form expression for the posterior distribution of the operators. The resulting probabilistic surrogate model propagates uncertainties from the observed state data to reduced-order predictions. Furthermore, we demonstrate the method is effective for constructing low-dimensional models of two nonlinear partial differential equations representing a compressible flow and a nonlinear diffusion–reaction process, as well as for estimating the parameters of a low-dimensional system of nonlinear ordinary differential equations representing compartmental models in epidemiology.

Data-driven model reduction↗

NASA NTRS1994

Analysis of cloud top height and cloud coverage from satellites using the O2 A and B bands

Cloud height and cloud coverage detection are important for total ozone retrieval using ultraviolet and visible scattered light. Use of the O2 A and B bands, around 761 and 687 nm, by a satellite-borne instrument of moderately high spectral resolution viewing in the nadir makes it possible to detect cloud top height and related parameters, including fractional coverage. The measured values of a satellite-borne spectrometer are convolutions of the instrument slit function and the atmospheric transmittance between cloud top and satellite. Studies here determine the optical depth between a satellite orbit and the Earth or cloud top height to high accuracy using FASCODE 3. Cloud top height and a cloud coverage parameter are determined by least squares fitting to calculated radiance ratios in the oxygen bands. A grid search method is used to search the parameter space of cloud top height and the coverage parameter to minimize an appropriate sum of squares of deviations. For this search, nonlinearity of the atmospheric transmittance (i.e., leverage based on varying amounts of saturation in the absorption spectrum) is important for distinguishing between cloud top height and fractional coverage. Using the above-mentioned method, an operational cloud detection algorithm which uses minimal computation time can be implemented.

Kuze, Akihiko↗

NASA NTRS1973

An application of a linear programing technique to nonlinear minimax problems

A differential correction technique for solving nonlinear minimax problems is presented. The basis of the technique is a linear programing algorithm which solves the linear minimax problem. By linearizing the original nonlinear equations about a nominal solution, both nonlinear approximation and estimation problems using the minimax norm may be solved iteratively. Some consideration is also given to improving convergence and to the treatment of problems with more than one measured quantity. A sample problem is treated with this technique and with the least-squares differential correction method to illustrate the properties of the minimax solution. The results indicate that for the sample approximation problem, the minimax technique provides better estimates than the least-squares method if a sufficient amount of data is used. For the sample estimation problem, the minimax estimates are better if the mathematical model is incomplete.

Schiess, J. R.↗

DOE OSTI2021

Measurements of the $^{5}D^{°}_{4}$–$^{5}P_{3}$ transition of singly ionized atomic iodine using intermodulated laser induced fluorescence

Iodine has been an element of recent interest for commercial use as fuel in electrostatic propulsion systems. A lingering problem when investigating ionized iodine using non-perturbative, laser-based techniques is determining the spectral width, i.e., the species temperature, of iodine. To this end, the hyperfine structure must be well understood to develop a spatially resolved diagnostic technique capable of ion flow and temperature measurements. Previous work investigated the lineshape of the transition between the $^{5}D^{°}_{4}$ and $^{5}P_{3}$ states of singly-ionized atomic iodine (I II) with laser induced fluorescence (LIF), but the hyperfine structure of the transition was unresolved in those measurements. In this work, an intermodulated LIF technique is used to measure an enhanced lineshape of the same I II transition. Here, a linear least squares fitting algorithm is used to fit the transition lineshape, where hyperfine transition locations and theorized relative amplitudes are constrained by theory. A lineshape model that incorporates hyperfine transition amplitude enhancement introduced from an intermodulated laser technique is implemented into the fitting function, as well as a nonlinear laser saturation effect. We report converged hyperfine coupling coefficients for these I II states.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS1989

The determination of third order linear models from a seventh order nonlinear jet engine model

Results are presented that demonstrate how good reduced-order models can be obtained directly by recursive parameter identification using input/output (I/O) data of high-order nonlinear systems. Three different methods of obtaining a third-order linear model from a seventh-order nonlinear turbojet engine model are compared. The first method is to obtain a linear model from the original model and then reduce the linear model by standard reduction techniques such as residualization and balancing. The second method is to identify directly a third-order linear model by recursive least-squares parameter estimation using I/O data of the original model. The third method is to obtain a reduced-order model from the original model and then linearize the reduced model. Frequency responses are used as the performance measure to evaluate the reduced models. The reduced-order models along with their Bode plots are presented for comparison purposes.

Lalonde, Rick J.↗

NASA NTRS1997

Detection of chaotic determinism in time series from randomly forced maps

Time series from biological system often display fluctuations in the measured variables. Much effort has been directed at determining whether this variability reflects deterministic chaos, or whether it is merely "noise". Despite this effort, it has been difficult to establish the presence of chaos in time series from biological sytems. The output from a biological system is probably the result of both its internal dynamics, and the input to the system from the surroundings. This implies that the system should be viewed as a mixed system with both stochastic and deterministic components. We present a method that appears to be useful in deciding whether determinism is present in a time series, and if this determinism has chaotic attributes, i.e., a positive characteristic exponent that leads to sensitivity to initial conditions. The method relies on fitting a nonlinear autoregressive model to the time series followed by an estimation of the characteristic exponents of the model over the observed probability distribution of states for the system. The method is tested by computer simulations, and applied to heart rate variability data.

Non-NASA Center↗

NASA NTRS1977

Fundamental Analysis of the Linear Multiple Regression Technique for Quantification of Water Quality Parameters from Remote Sensing Data

Constituents with linear radiance gradients with concentration may be quantified from signals which contain nonlinear atmospheric and surface reflection effects for both homogeneous and non-homogeneous water bodies provided accurate data can be obtained and nonlinearities are constant with wavelength. Statistical parameters must be used which give an indication of bias as well as total squared error to insure that an equation with an optimum combination of bands is selected. It is concluded that the effect of error in upwelled radiance measurements is to reduce the accuracy of the least square fitting process and to increase the number of points required to obtain a satisfactory fit. The problem of obtaining a multiple regression equation that is extremely sensitive to error is discussed.

Whitlock, C. H., III↗

NASA NTRS1991

A new finite element formulation for computational fluid dynamics. X - The compressible Euler and Navier-Stokes equations

A space-time element method is presented for solving the compressible Euler and Navier-Stokes equations. The proposed formulation includes the variational equation, predictor multi-corrector algorithms and boundary conditions. The variational equation is based on the time-discontinuous Galerkin method, in which the physical entropy variables are employed. A least-squares operator and a discontinuity-capturing operator are added, resulting in a high-order accurate and unconditionally stable method. Implicit/explicit predictor multi-corrector algorithms, applicable to steady as well as unsteady problems, are presented; techniques are developed to enhance their efficiency. Implementation of boundary conditions is addressed; in particular, a technique is introduced to satisfy nonlinear essential boundary conditions, and a consistent method is presented to calculate boundary fluxes. Numerical results are presented to demonstrate the performance of the method.

Shakib, Farzin↗

NASA NTRS1981

Nonparametric identification of a class of nonlinear close-coupled dynamic systems

A nonparametric identification technique for the identification of close coupled dynamic systems with arbitrary memoryless nonlinearities is presented. The method utilizes noisy recorded data (acceleration, velocity and displacement) to identify the restoring forces in the system. The masses in the system are assumed to be known (or fairly well estimated from the design drawings). The restoring forces are expanded in a series of orthogonal polnomials and the coefficients of these polynomial expansions are obtained by using least square fit method. A particularly simple and computationally efficient method is proposed for dealing with separable restoring forces. The identified results are found to be relatively insensitive to measurement noise. An analysis of the effects of measurement noise on the quality of the estimates is given. The computations are shown to be relatively quick (when compared say to the Wiener identification method) and the core storage required relatively small, making the method suitable for onboard identification of large space structures.

Udwadia, F. E.↗

NASA NTRS1987

Deconvolution of spectra for intimate mixtures

Visible to near infrared reflectance spectra of macroscopic mixtures have been shown to be linear combinations of the reflections of the pure mineral components in the mixture. However, for microscopic mixtures the mixing systematics are in general nonlinear. The systematics may be linearized by conversion of reflectance to single scattering albedo (w), where the equations which relate reflectance to w depend on the method of data collection. Several proposed mixing models may be used to estimate mineral abundances from the reflectance spectra of intimate mixtures. These models are summarized and a revised model is presented. A noniterative (linear) least squares approach was used for curve fitting and the data, measured as bi-directional reflectance with incidence and emergence angles of 30 and 0 deg were converted to w by a simplified version of Hapke's equation for bi-directional reflectance. This model was tested with two mixture series composed of 45 to 75 micron particles: an anorthite-enstatite series and an olivine-magnetite series. The data indicate that the simplified Hapke's equation may be used to convolve reflectance spectra into mineral abundances if appropriate endmembers are known or derived from other techniques. For surfaces that contain a significant component of very low albedo material, a somewhat modified version of this technique will need to be developed. Since the abundances are calculated using a noniterative approach, the application of this method is especially efficient for large spectral data sets, such as those produced by mapping spectrometers.

Mustard, John F.↗

NASA NTRS1992

Frequency domain state-space system identification

An algorithm for identifying state-space models from frequency response data of linear systems is presented. A matrix-fraction description of the transfer function is employed to curve-fit the frequency response data, using the least-squares method. The parameters of the matrix-fraction representation are then used to construct the Markov parameters of the system. Finally, state-space models are obtained through the Eigensystem Realization Algorithm using Markov parameters. The main advantage of this approach is that the curve-fitting and the Markov parameter construction are linear problems which avoid the difficulties of nonlinear optimization of other approaches. Another advantage is that it avoids windowing distortions associated with other frequency domain methods.

Chen, Chung-Wen↗

DOE OSTI2019

Short-term traffic state prediction from latent structures: Accuracy vs. efficiency

Recently, deep learning models have shown promising performances in many research areas, including traffic states prediction, due to their ability to model complex nonlinear relationships. However, deep learning models also have drawbacks that make them less preferable for certain short-term traffic prediction applications. For example, they require a large amount of data for model training, which is also computationally expensive. Moreover, deep learning models lack interpretability of the results. This paper develops a short-term traffic states forecasting algorithm based on partial least square (PLS) to help enhance real-time decision-making and build better insights into traffic data. The proposed model is capable of predicting short-term traffic states accurately and efficiently by capturing dominant spatiotemporal features and day-to-day variations from collinear and correlated traffic data. Three case studies are developed to demonstrate the proposed model in short-term traffic prediction applications.

99 GENERAL AND MISCELLANEOUS↗

NASA NTRS1988

Estimation of time- and state-dependent delays and other parameters in functional differential equations

A parameter estimation algorithm is developed which can be used to estimate unknown time- or state-dependent delays and other parameters (e.g., initial condition) appearing within a nonlinear nonautonomous functional differential equation. The original infinite dimensional differential equation is approximated using linear splines, which are allowed to move with the variable delay. The variable delays are approximated using linear splines as well. The approximation scheme produces a system of ordinary differential equations with nice computational properties. The unknown parameters are estimated within the approximating systems by minimizing a least-squares fit-to-data criterion. Convergence theorems are proved for time-dependent delays and state-dependent delays within two classes, which say essentially that fitting the data by using approximations will, in the limit, provide a fit to the data using the original system. Numerical test examples are presented which illustrate the method for all types of delay.

Murphy, K. A.↗

NASA NTRS1990

Estimation of time- and state-dependent delays and other parameters in functional differential equations

Murphy, K. A.↗