A nonlinear perturbation theory for estimation and control of time discrete stochastic systems
Nonlinear perturbation theory for optimal estimation and control of time-discrete, stochastic, dynamic systems when measurement data is noisy
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Nonlinear perturbation theory for optimal estimation and control of time-discrete, stochastic, dynamic systems when measurement data is noisy
Filtering and optimal control problems for discrete stochastic dynamical systems, describing various feedback controls and midcourse guidance optimization
This paper presents the formulation of a class of optimization problems dealing with selecting, at each instant of time, one measurement provided by one out of many sensors. Each measurement has an associated measurement cost. The basic problem is then to select an optimal measurement policy, during a specified observation time interval, so that a weighted combination of prediction accuracy and accumulated observation cost is optimized. The current analysis is limited to the class of linear stochastic dynamic systems and measurement subsystems. The problem of selecting the optimal measurement strategy can be transformed into a deterministic optimal control problem. It is shown that the optimal measurement policy and the associated matched Kalman-type filter can be precomputed.
Shuttle Experiment Pointing Mount System concepts and technology have been investigated and assessed with regard to payload requirements having a wide range of stability, accuracy, and control functions. Pointing systems were analyzed with end-mounted and center of gravity-mounted payloads viewing stellar and solar targets. Major error sources are identified with dynamical, stochastic, and nonlinear characteristics of structures, isolators, sensors, bearings, actuators, and controller. Results are presented which place a perspective on the potential of advanced technology to satisfy the most stringent sub-arc second pointing requirements.
The topics considered are related to linear control system design, adaptive control, failure detection, control under failure, system reliability, and large-scale systems and decentralized control. It is pointed out that the design of a linear feedback control system which regulates a process about a desirable set point or steady-state condition in the presence of disturbances is a very important problem. The linearized dynamics of the process are used for design purposes. The typical linear-quadratic design involving the solution of the optimal control problem of a linear time-invariant system with respect to a quadratic performance criterion is considered along with gain reduction theorems and the multivariable phase margin theorem. The stumbling block in many adaptive design methodologies is associated with the amount of real time computation which is necessary. Attention is also given to the desperate need to develop good theories for large-scale systems, the beginning of a microprocessor revolution, the translation of the Wiener-Hopf theory into the time domain, and advances made in dynamic team theory, dynamic stochastic games, and finite memory stochastic control.
The estimation theory of stochastic-dynamic systems is described and used in a numerical study of optimal interpolation. The general form of data assimilation methods is reviewed. The Kalman-Bucy, KB filter, and optimal interpolation (OI) filters are examined for effectiveness in performance as gain matrices using a one-dimensional form of the shallow-water equations. Control runs in the numerical analyses were performed for a ten-day forecast in concert with the OI method. The effects of optimality, initialization, and assimilation were studied. It was found that correct initialization is necessary in order to localize errors, especially near boundary points. Also, the use of small forecast error growth rates over data-sparse areas was determined to offset inaccurate modeling of correlation functions near boundaries.
A 'lagged average forecast' (LAF) model is developed for stochastic dynamic weather forecasting and used for predictions in comparison with the results of a Monte Carlo forecast (MCF). The technique involves the calculation of sample statistics from an ensemble of forecasts, with each ensemble member being an ordinary dynamical forecast (ODF). Initial conditions at a time lagging the start of the forecast period are used, with varying amounts of time for the lags. Forcing by asymmetric Newtonian heating of the lower layer is used in a two-layer, f-plane, highly truncated spectral model in a test forecasting run. Both the LAF and MCF are found to be more accurate than the ODF due to ensemble averaging with the MCF and the LAF. When a regression filter is introduced, all models become more accurate, with the LAF model giving the best results. The possibility of generating monthly or seasonal forecasts with the LAF is discussed.
The design of an actively adaptive dual controller based on an approximation of the stochastic dynamic programming equation for a multi-step horizon is presented. A dual controller that can enhance identification of the system while controlling it at the same time is derived for multi-dimensional problems. This dual controller uses sensitivity functions of the expected future cost with respect to the parameter uncertainties. A passively adaptive cautious controller and the actively adaptive dual controller are examined. In many instances, the cautious controller is seen to turn off while the latter avoids the turn-off of the control and the slow convergence of the parameter estimates, characteristic of the cautious controller. The algorithms have been applied to a multi-variable static model which represents a simplified linear version of the relationship between the vibration output and the higher harmonic control input for a helicopter. Monte Carlo comparisons based on parametric and nonparametric statistical analysis indicate the superiority of the dual controller over the baseline controller.
A general method for parallel and vector numerical solutions of stochastic dynamic programming problems is described for optimal control of general nonlinear, continuous time, multibody dynamical systems, perturbed by Poisson as well as Gaussian random white noise. Possible applications include lumped flight dynamics models for uncertain environments, such as large scale and background random atmospheric fluctuations. The numerical formulation is highly suitable for a vector multiprocessor or vectorizing supercomputer, and results exhibit high processor efficiency and numerical stability. Advanced computing techniques, data structures, and hardware help alleviate Bellman's curse of dimensionality in dynamic programming computations.
Following suggestion that substorm breakup might be caused by an interchange or ballooning instability, several magnetohydrodynamic (MHD) and gyro-kinetic stability analysis have been performed for plasma sheet magnetic field geometries. However, the stochastic ion dynamics in the highly stressed, thin high-beta near earth plasma sheet violate the locality requirements of MHD and the invarience of the magnetic moment, mu, required by gyro-kinetic theories. In this paper we develop a new linear Vlasov kinetic theory (for low frequency modes omega less than omega(sub b), omega(sub b) being the bounce frequency) which includes the dynamics of stochastic ions.
We use the Fokker-Planck-Kolmogorov equation to study the statistical aspects of stochastic dynamics of the radiation belt (RB) protons driven by nonlinear electromagnetic ion-cyclotron (EMIC) wave packets. We obtain the spectra of keV protons scattered by these waves that showsteeping near the gyroresonance, the signature of resonant wave-particle interaction that cannot be described by a simple power law. The most likely mechanism for proton precipitation events in RBs is shown to be nonlinear wave-particle interaction, namely, the scattering of RB protons into the loss cone by EMIC waves.
Characterization of non stationary and nonlinear processes is a challenge in many engineering and scientific disciplines. Climate change modeling and projection, retrieving information from Doppler measurements of hydrometeors, and modeling calibration architectures and algorithms in microwave radiometers are example applications that can benefit from improvements in the modeling and analysis of non stationary processes. Analyses of measured signals have traditionally been limited to a single measurement series. Ensemble Detection is a technique whereby mixing calibrated noise produces an ensemble measurement set. The collection of ensemble data sets enables new methods for analyzing random signals and offers powerful new approaches to studying and analyzing non stationary processes. Derived information contained in the dynamic stochastic moments of a process will enable many novel applications.
Dynamic programming applications to optimal stochastic orbital transfer strategy, describing computer program
Dynamic programming applications to optimal stochastic orbital transfer strategy, describing computer program
A general treatment of parameter identification and stochastic control for use on helicopter dynamic systems is presented. Rotor dynamic models, including specific applications to rotor blade flapping and the helicopter ground resonance problem are emphasized. Dynamic systems which are governed by periodic coefficients as well as constant coefficient models are addressed. The dynamic systems are modeled by linear state variable equations which are used in the identification and stochastic control formulation. The pure identification problem as well as the stochastic control problem which includes combined identification and control for dynamic systems is addressed. The stochastic control problem includes the effect of parameter uncertainty on the solution and the concept of learning and how this is affected by the control's duel effect. The identification formulation requires algorithms suitable for on line use and thus recursive identification algorithms are considered. The applications presented use the recursive extended kalman filter for parameter identification which has excellent convergence for systems without process noise.
A paper presents further results of continuing research reported in several previous NASA Tech Briefs articles, the two most recent being Stochastic Representations of Chaos Using Terminal Attractors (NPO-41519), [Vol. 30, No. 5 (May 2006), page 57] and Physical Principle for Generation of Randomness (NPO-43822) [Vol. 33, No. 5 (May 2009), page 56]. This research focuses upon a mathematical formalism for describing post-instability motions of a dynamical system characterized by exponential divergences of trajectories leading to chaos (including turbulence as a form of chaos). The formalism involves fictitious control forces that couple the equations of motion of the system with a Liouville equation that describes the evolution of the probability density of errors in initial conditions. These stabilizing forces create a powerful terminal attractor in probability space that corresponds to occurrence of a target trajectory with probability one. The effect in configuration space (ordinary three-dimensional space as commonly perceived) is to suppress exponential divergences of neighboring trajectories without affecting the target trajectory. As a result, the post-instability motion is represented by a set of functions describing the evolution of such statistical quantities as expectations and higher moments, and this representation is stable.
Indirect method considers effect of nonlinearity and obtains approximate probability densities of certain characteristics, from these densities various statistical properties are calculated. Direct method determines response moments directly. Neither method is restricted by system motion with regard to whether or not it is stationary.
Solar Energetic Particles (SEPs) are crucial in space weather phenomena, impacting space-based technologies and human activities in space. Understanding the dynamics of SEPs, including their acceleration and transport mechanisms, is essential for improving predictive models and mitigating adverse effects. This study investigates the impact of stochastic acceleration (SA) on the dynamics of SEPs within the heliosphere. By integrating stochastic acceleration into a SEP transport model, we assess its impact relative to diffusive shock acceleration (DSA). The investigation utilizes the Adaptive Mesh Particle Simulator (AMPS) within the Space Weather Modeling Framework (SWMF) to simulate SEP dynamics, incorporating solar wind parameters and turbulence from the Alfven Wave Solar Model (AWSoM). To do this, we solve the focused transport equation to model the propagation of SEPs along magnetic field lines, extending these lines to 5 AU to incorporate the potential effects of pitch angle scattering beyond 1 AU. This aspect could notably impact the decay phase of a SEP event. Modeling the transport of SEPs is coupled with the simulation of solar wind dynamics, the interplanetary magnetic field, and the characteristics of Alfven wave turbulence. This presentation covers the modeling approach used in this research, the characterization of the impact of the stochastic acceleration, and the role of pitch angle scattering at various heliocentric distances on the dynamics of the SEP events' decay phase.