Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Stochastic System”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Indirect Identification of Linear Stochastic Systems with Known Feedback Dynamics

An algorithm is presented for identifying a state-space model of linear stochastic systems operating under known feedback controller. In this algorithm, only the reference input and output of closed-loop data are required. No feedback signal needs to be recorded. The overall closed-loop system dynamics is first identified. Then a recursive formulation is derived to compute the open-loop plant dynamics from the identified closed-loop system dynamics and known feedback controller dynamics. The controller can be a dynamic or constant-gain full-state feedback controller. Numerical simulations and test data of a highly unstable large-gap magnetic suspension system are presented to demonstrate the feasibility of this indirect identification method.

Huang, Jen-Kuang

Linear regulator design for stochastic systems by a multiple time scales method

This paper develops a hierarchically-structured, suboptimal controller for a linear stochastic system composed of fast and slow subsystems. It is proved that the controller is optimal in the limit as the separation of time scales of the subsystems becomes infinite. The methodology is illustrated by design of a controller to suppress the phugoid and short period modes of the longitudinal dynamics of the F-8 aircraft.

Teneketzis, D.

Linear regulator design for stochastic systems by a multiple time-scales method

This short paper develops a hierarchically structured, suboptimal controller for a linear stochastic system composed of fast and slow subsystems. It is proved that the controller is optimal in the limit as the separation of time scales of the subsystems becomes infinite. The methodology is illustrated by design of a controller to suppress the phugoid and short-period modes of the longitudinal dynamics of the F-8 aircraft.

Teneketzis, D.

Connective stability of large-scale stochastic systems

The procedure of decomposition-aggregation analysis reported by Siljak (1973) and Grujic and Siljak (1973) has been used in a study of the connective-stability aspects of large-scale stochastic systems. An investigation is conducted of the tolerance of a system of interconnected deterministic subsystems to both deterministic and stochastic interactions. The connective stability in the mean is considered and the connective property of stability is defined. The defined concept is included in a modification of the comparison theorem described by Ladde (1975). Attention is also given to a derivation of the sufficient conditions for the connective stability in the mean.

Ladde, G. S.

State-space self-tuning controllers for general multivariable stochastic systems

This paper presents a state-space approach for self-tuning control of a more general class of multivariable stochastic systems having a number of inputs equal or different from the number of outputs. The dynamic system is represented in the state-space innovation form with Luenberger's canonical structures. The model parameters and the Kalman gain are identified via either the extended least-squares algorithm or the least-squares ladder algorithm. The Kalman gain matrix and states can be estimated from the identified parameters without utilizing the standard state estimation algorithm. A long division method is introduced for finding the similarity transformation matrix.

Shieh, L. S.

Parameter identification of linear discrete stochastic systems with time delays

An identification algorithm that uses the maximum likelihood technique to identify the unknown time delays, plant parameters, and noise covariances of linear discrete stochastic systems is presented. Cases of additive white noise and colored measurement noises are considered. The likelihood function is evaluated using either a minimum-variance (Kalman) filter or a minimal-order observer. The Kalman filter is used in the identification algorithm to provide minimum-variance estimates. The minimal-order observer is a lower-dimensional and computationally simpler filter, and is advantageous especially for systems with long delays. It provides a less optimal solution to the minimum-mean-square state estimation problem. The colored-noise observer algorithm has the disadvantage of having to compute an extra error covariance matrix of lower order.

Wong, E. C.

Robust Fault Detection and Isolation for Stochastic Systems

This paper outlines the formulation of a robust fault detection and isolation scheme that can precisely detect and isolate simultaneous actuator and sensor faults for uncertain linear stochastic systems. The given robust fault detection scheme based on the discontinuous robust observer approach would be able to distinguish between model uncertainties and actuator failures and therefore eliminate the problem of false alarms. Since the proposed approach involves precise reconstruction of sensor faults, it can also be used for sensor fault identification and the reconstruction of true outputs from faulty sensor outputs. Simulation results presented here validate the effectiveness of the robust fault detection and isolation system.

George, Jemin

Control of Finite-State, Finite Memory Stochastic Systems

A generalized problem of stochastic control is discussed in which multiple controllers with different data bases are present. The vehicle for the investigation is the finite state, finite memory (FSFM) stochastic control problem. Optimality conditions are obtained by deriving an equivalent deterministic optimal control problem. A FSFM minimum principle is obtained via the equivalent deterministic problem. The minimum principle suggests the development of a numerical optimization algorithm, the min-H algorithm. The relationship between the sufficiency of the minimum principle and the informational properties of the problem are investigated. A problem of hypothesis testing with 1-bit memory is investigated to illustrate the application of control theoretic techniques to information processing problems.

Sandell, Nils R.

Towards sub-optimal stochastic control of partially observable stochastic systems

A class of multidimensional stochastic control problems with noisy data and bounded controls encountered in aerospace design is examined. The emphasis is on suboptimal design, the optimality being taken in quadratic mean sense. To that effect the problem is viewed as a stochastic version of the Lurie problem known from nonlinear control theory. The main result is a separation theorem (involving a nonlinear Kalman-like filter) suitable for Lurie-type approximations. The theorem allows for discontinuous characteristics. As a byproduct the existence of strong solutions to a class of non-Lipschitzian stochastic differential equations in dimensions is proven.

Ruzicka, G. J.

Digital set point control of nonlinear stochastic systems

A technique for digital control of nonlinear stochastic plants is presented. The development achieves a practical digital algorithm with which the closed-loop system behaves in a classical Type I manner even with gross nonlinearities in the plant structure and low signal-to-noise power ratios. The design procedure is explained in detail and illustrated by an example whose simulated responses testify to the practicality of the approach.

Moose, R. L.

Implicit dual control for general stochastic systems

A new implicit dual technique is presented for stochastic adaptive control synthesis. In this technique, denoted as the method of utility costs (MOUC), a new control policy is derived from a known starting control policy by using a single iteration in time-varying policy space. An important result is that the new control policy yields a corresponding improvement in adaptive performance relative to the known starting policy. Since the starting policy can be chosen arbitrarily, the new policy has potentially superior performance relative to any existing design. Unlike other implicit dual designs, the MOUC can be applied to systems having constrained inputs, discontinuities, discrete valued disturbances, as well as in situations where the variances of the associated process statistics are large. A numerical example is given in which a controller is synthesized to provide improved performance relative to the Open-Loop Feedback policy of Dreyfus.

Bayard, D. S.

Towards sub-optimal stochastic control of partially observable stochastic systems

The paper deals with a class of multidimensional stochastic control problems with noisy data and bounded controls encountered in aerospace design. The emphasis is on suboptimal design, the optimality being taken in quadratic mean sense. To that effect the problem is viewed as a stochastic version of the Lurie problem known from nonlinear control theory. The main result is a separation theorem (involving a nonlinear Kalman-like filter) suitable for Lurie-type approximations. The theorem allows for discontinuous characteristics. As a byproduct the existence of strong solutions to a class of non-Lipschitzian stochastic differential equations in n dimensions is proved.

Ruzicka, G. J.

A new stochastic systems approach to structural integrity

This paper develops improved stochastic models for the description of a large variety of fatigue crack growth phenomena that occur in components of considerable importance to the functionality and reliability of complex engineering structures. In essence, the models are based on the McGill-Markov and Closure-Lognormal stochastic processes. Not only do these models have the capability of predicting the statistical dispersion of crack growth rates, they also, by incorporating the concept of crack closure, have the capability of transferring stochastic crack growth properties measured under ideal laboratory conditions to situations of industrial significance, such as those occurring under adverse loading and/or environmental conditions. The primary data required in order to be in a position to estimate the pertinent parameters of these stochastic models are obtained from a statistically significant number of replicate tests. In this paper, both the theory and the experimental technique are illustrated using a Ti-6Al-4V alloy. Finally, important structural integrity, reliability, availability and maintainability concepts are developed and illustrated.

Provan, James W.