Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic optimal control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1988

Stochastic time-optimal control problems

Two types of stochastic time-optimal controls in a one-dimensional setting are considered. Multidimensional problems, in the case of complete state information available and the system modeled by stochastic differential equations, are studied under the formulation of minimizing the expected transient-response time. The necessary condition of optimality is the satisfaction for the value function of a parabolic partial differential equation with boundary conditions. The sufficient condition of optimality is also provided, based on Dynkin's formula. Finally, three examples are given.

Zhang, W.↗
NASA NTRS1996

Performance Robustness of Manipulator Collision Controller

In this paper, we propose that the manipulator impact control problem be approached from a stochastic optimal control perspective. The reason is that not only is such approach be able to model uncertainties in contact environment, force sensing, as well as manipulator dynamics, the controllers obtained is optimally robust in terms of performance. This result is verified by analyses and simulations.

model uncertainties contact environment force sens↗
NASA NTRS1973

Analytical and experimental performance of optimal controller designs for a supersonic inlet

The techniques of modern optimal control theory were applied to the design of a control system for a supersonic inlet. The inlet control problem was approached as a linear stochastic optimal control problem using as the performance index the expected frequency of unstarts. The details of the formulation of the stochastic inlet control problem are presented. The computational procedures required to obtain optimal controller designs are discussed, and the analytically predicted performance of controllers designed for several different inlet conditions is tabulated. The experimental implementation of the optimal control laws is described, and the experimental results obtained in a supersonic wind tunnel are presented. The control laws were implemented with analog and digital computers. Comparisons are made between the experimental and analytically predicted performance results. Comparisons are also made between the results obtained with continuous analog computer controllers and discrete digital computer versions.

Zeller, J. R.↗
NASA NTRS1976

Estimation of characteristics and stochastic control of an aircraft flying in atmospheric turbulence

An adaptive control technique to improve the flying qualities of an aircraft in turbulence was investigated. The approach taken was to obtain maximum likelihood estimates of the unknown coefficients of the aircraft system and then, using these estimates along with the separation principle, to define the stochastic optimal control. The maximum likelihood estimation technique that accounted for the effects of turbulence provided good estimates of the unknown coefficients and of the turbulence. The assessment of the stochastic optimal control based on the maximum likelihood estimates showed that the desired effects were attained for the regulator problem of minimizing pitch angle and the tracking problem of requiring normal acceleration to follow the pilot input.

Iliff, K. W.↗
NASA NTRS1972

Application of quadratic optimization to supersonic inlet control.

This paper describes the application of linear stochastic optimal control theory to the design of the control system for the air intake, the inlet, of a supersonic air-breathing propulsion system. The controls must maintain a stable inlet shock position in the presence of random airflow disturbances and prevent inlet unstart. Two different linear time invariant controllers are developed. One is designed to minimize a nonquadratic index, the expected frequency of inlet unstart, and the other is designed to minimize the mean square value of inlet shock motion. The quadratic equivalence principle is used to obtain a linear controller that minimizes the nonquadratic index. The two controllers are compared on the basis of unstart prevention, control effort requirements, and frequency response. It is concluded that while controls designed to minimize unstarts are desirable in that the index minimized is physically meaningful, computation time required is longer than for the minimum mean square shock position approach. The simpler minimum mean square shock position solution produced expected unstart frequency values which were not significantly larger than those of the nonquadratic solution.

Lehtinen, B.↗
NASA NTRS1973

Open-loop-feedback-optimal adaptive stochastic control of linear systems

This paper considers the suboptimal stochastic control of linear discrete-time dynamical systems with unknown or stochastically varying parameters. The suboptimal scheme is based upon the use of the open-loop-feedback-optimal method. The state and parameter estimates are generated by an extended Kalman filter algorithm. Numerical results for first-order systems are presented.

Ku, R.↗
NASA NTRS1977

Stochastic optimal attitude control of spacecraft with movable appendages

This paper deals with the application of linear optimal control and filtering theory to control a spinning spacecraft with movable telescoping appendages. The equations of motion are linearized about the desired final state. A feedback control system is designed to maintain this final state, with plant noise and measurement noise present in the system. Analytic results are obtained for special cases and numerical results are presented for the general case.

Sellappan, R.↗
NASA NTRS1990

Active flutter and gust response control

After a short recall concerning the aeroelastic equations, active control law based on optimal stochastic control theory is synthesized for a wing flutter and gust response. Robustness of the control system due to structured and unstructured uncertainties is considered. Robustness recovery technique is applied to improve the stability margin.

Oli, Muluneh↗
DOE OSTI2026

Near-Optimal Performance of Stochastic Model Predictive Control

Here, this article presents a regret analysis for stochastic model predictive control (SMPC) in linear systems with quadratic performance index and additive and multiplicative uncertainties. Under a finite support assumption, the problem can be cast as a finite-dimensional quadratic program, but the problem becomes quickly intractable as the problem size grows exponentially in the horizon length. SMPC aims to compute approximate solutions by solving a sequence of problems with truncated prediction horizons and committing the solution in a receding-horizon fashion. Although this approach is widely used in practice, its performance relative to the optimal solution is not well understood. This article reports for the first time a rigorous near-optimal performance guarantee of SMPC: under stabilizability and detectability conditions, the regret of SMPC is exponentially small in the prediction horizon length, allowing SMPC to achieve near-optimal performance at a substantially reduced computational expense.

93E20, 93B45↗
NASA NTRS1972

On simultaneous choice of dynamic control and measurement strategies for stochastic systems.

Consideration of stochastic optimal control problems in which the measurement equation contains a control variable. Conditions under which it is possible to separately optimize the dynamic and measurement controls are studied, with particular emphasis on showing (by counterexample) that certain results already available for the linear-Gaussian-quadratic case do not extend to more general problems. Conditions under which the extension is possible are discussed.

Kramer, L. C.↗
NASA NTRS1973

Suboptimal stochastic controller for an n-body spacecraft

The problem is studied of determining a stochastic optimal controller for an n-body spacecraft. The approach used in obtaining the stochastic controller involves the application, interpretation, and combination of advanced dynamical principles and the theoretical aspects of modern control theory. The stochastic controller obtained for a complicated model of a spacecraft uses sensor angular measurements associated with the base body to obtain smoothed estimates of the entire state vector, can be easily implemented, and enables system performance to be significantly improved.

Larson, V.↗
NASA NTRS1978

Optimal control of a supersonic inlet to minimize frequency of inlet unstart

A preliminary investigation into the use of modern control theory for the design of controls for a supersonic inlet is described. In particular, the task of controlling a mixed-compression supersonic inlet is formulated as a linear optimal stochastic control and estimation problem. An inlet can exhibit an undesirable instability due to excessive inlet normal shock motion. For the optimal control formulation of the inlet problem, a non quadratic performance index, which is equal to the expected frequency of inlet unstarts, is used. This physically meaningful performance index is minimized for a range of inlet disturbance and measurement noise covariances.

Lehtinen, B.↗
NASA NTRS1973

A suboptimal stochastic controller for an N-body spacecraft

Considerable attention, in the open literature, is being focused on the problem of developing a suitable set of deterministic dynamical equations for a complex spacecraft. This paper considers the problem of determining a stochastic optimal controller for an n-body spacecraft. The approach used in obtaining the stochastic controller involves the application, interpretation, and combination of advanced dynamical principles and the theoretical aspects of modern control theory. The stochastic controller obtained herein for a complicated model of a spacecraft uses sensor angular measurements associated with the base body to obtain smoothed estimates of the entire state vector. It can be easily implemented, and it enables system performance to be significantly improved.

Larson, V.↗
NASA NTRS1971

Design of optimal probing signals for vector parameter estimation.

In the design of optimal inputs or probing signals for parameter estimation, it is more natural to consider functions of the Fisher information matrix as the criterion of optimality instead of some function of the error covariance matrix. The input which maximizes the Fisher information measure for efficient estimation of a scalar parameter also provides the minimum error variance. The information is thus a logical choice for the optimality criterion in scalar problems. No such obvious choice is apparent for vector parameter estimation. A number of performance measures are examined and compared in the present study, and a useful criterion is selected. The design of an optimal probing signal using this criterion is shown to be equivalent to an optimal control problem in which certain equality constraints must be satisfied. This problem may be solved by conventional techniques of deterministic or stochastic optimal control.

Nahi, N. E.↗