Stochastic compartmental analysis - Some applications and examples of estimation in a pulse labelled system
Stochastic compartmental analysis with examples of estimation in pulse labelled system
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Stochastic compartmental analysis with examples of estimation in pulse labelled system
Linear and nonlinear filtering for stochastic delay systems are studied. A representation theorem for conditional moment functionals is obtained, which, in turn, is used to derive stochastic differential equations describing the optimal linear or nonlinear filter. A complete characterization of the optimal filter is given for linear systems with Gaussian noise. Stability of the optimal filter is studied in the case where there are no delays in the observations. Using the duality between linear filtering and control, asymptotic stability of the optimal filter is proved. Finally, the cascade of the optimal filter and the deterministic optimal quadratic control system is shown to be asymptotically stable as well.
Linear distributed parameter system identification by stochastic approximation, obtaining constant parameters sequentially
Liapunov theory of stochastic stability, discussing use to obtain information about random trajectories
Optimal control of nonlinear saturating systems with stochastic inputs
This paper considers the problem of decentralized control of two weakly coupled linear stochastic systems, using quadratic performance indices. The basic idea is to have each controller control independently his own system, based upon noisy measurements of his own output. To compensate for the effects of weak coupling upon the resultant performance, fake white plant noise is introduced to each system. The appropriate intensity of the fake plant noise is obtained through the solution of an off-line deterministic matrix optimal control problem. The effects of this design method upon the overall coupled system performance are analyzed as a function of the degree of intersystem coupling.
The covariances that certain bilinear stochastic discrete time systems may possess are characterized. An explicit parameterization of all controllers that assign such covariances is given. The state feedback assignability and robustness of the system are discussed from a deterministic point of view. This work extends the theory of covariance control for continuous time bilinear systems to a discrete time setting.
Parameter estimation of sampled data control systems by stochastic approximation
Stochastic operators are applied to an analysis of some deterministic systems of signal transformation. The distribution of a random process at the output of a system is given through its distribution at the input and through a stochastic Green's function. A two-point correlation function is derived to obtain a solution to differential equations which contain coefficients, boundary conditions, or right-hand terms representing random processes.
Simulating stochastic differential equations (SDEs) in bounded domains, presents significant computational challenges due to particle exit phenomena, which requires accurate modeling of interior stochastic dynamics and boundary interactions. Despite the success of machine learning-based methods in learning SDEs, existing learning methods are not applicable to SDEs in bounded domains because they cannot accurately capture the particle exit dynamics. We present a unified hybrid data-driven approach that combines a conditional diffusion model with an exit prediction neural network to capture both interior stochastic dynamics and boundary exit phenomena. Our ML model consists of two major components: a neural network that learns exit probabilities using binary cross-entropy loss with rigorous convergence guarantees, and a training-free diffusion model that generates state transitions for non-exiting particles using closed-form score functions. The two components are integrated through a probabilistic sampling algorithm that determines particle exit at each time step and generates appropriate state transitions. Here, the performance of the proposed approach is demonstrated via three test cases: a one-dimensional simplified problem for theoretical verification, a two-dimensional advection-diffusion problem in a bounded domain, and a three-dimensional problem of interest to magnetically confined fusion plasmas.
The problem of optimal control of linear discrete-time stochastic dynamical system with unknown and, possibly, stochastically varying parameters is considered on the basis of noisy measurements. It is desired to minimize the expected value of a quadratic cost functional. Since the simultaneous estimation of the state and plant parameters is a nonlinear filtering problem, the extended Kalman filter algorithm is used. Several qualitative and asymptotic properties of the open loop feedback optimal control and the enforced separation scheme are discussed. Simulation results via Monte Carlo method show that, in terms of the performance measure, for stable systems the open loop feedback optimal control system is slightly better than the enforced separation scheme, while for unstable systems the latter scheme is far better.
Optimal zero-memory regulator for linear system with stochastic jump parameters, considering Bayes and minimax controllers
Optimal filtering equations are obtained for very general linear stochastic delay systems. Stability of the optimal filter is studied in the case where there are no delays in the observations. Using the duality between linear filtering and control, asymptotic stability of the optimal filter is proved. Finally, the cascade of the optimal filter and the deterministic optimal quadratic control system is shown to be asymptotically stable as well.
Theoretical paper presents set of sufficient conditions for asymptotic and exponential stability with probability 1 for class of stochastic interconnected systems. Theory applicable to complicated, large-scale mechanical or electrical systems, and, for several design problems, it reduces computational difficulty by relating stability criteria to fundamental structural features of system.
Viewgraphs on a stochastic approach to robust broadband structural control are presented. Topics covered include: travelling wave model; dereverberated mobility model; computation of dereverberated mobility; power flow; impedance matching; stochastic systems; control problem; control of stochastic systems; using cost functional; Bernoulli-Euler beam example; compensator design; 'power' dual variables; dereverberation of complex structure; and dereverberated transfer function.
Optimization of stochastic dynamic system with noisy output
Stochastic approximation for identification of distributed parameter system solutions described by linear partial differential equations
Control algorithm for optimization of nonlinear stochastic processes with discounted performance criteria