Stochastic differential games with constrained state estimators
Stochastic differential games with constrained state estimators, involving linear system, quadratic cost functional and white Gaussian noises corrupting output measurements
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Stochastic differential games with constrained state estimators, involving linear system, quadratic cost functional and white Gaussian noises corrupting output measurements
Bayesian inference enables informationally efficient quantum state tomography (QST) yet is challenging to scale computationally. We demonstrate a parallelizable Bayesian QST method that, although unorthodox, proves remarkably practical, attaining significant speedups in multiqubit state estimation.
This paper extends in two directions the results of prior work on generalized linear covariance analysis of both batch least-squares and sequential estimators. The first is an improved treatment of process noise in the batch, or epoch state, estimator with an epoch time that may be later than some or all of the measurements in the batch. The second is to account for process noise in specifying the gains in the epoch state estimator. We establish the conditions under which the latter estimator is equivalent to the Kalman filter.
Flight operations dependent on digitized terrain elevation data for navigational reference or trajectory generation are constrained in minimum flight altitude, due to airborne navigation errors and inaccuracies of the reference terrain elevation data. This limitation is not restrictive in traditional medium-altitude implementations of such databases, such as in unmanned aerial vehicles, missiles, or high-performance, high-speed aircraft. In low-altitude, lower speed terrain hugging helicopter missions, however, such constraints on minimum flight altitudes greatly reduce the effectiveness of their missions and diminish the benefits of employing terrain elevation maps. A Kalman filter state estimator has been developed which blends airborne navigation, stored terrain elevation data, and a radar altimeter in estimating above-ground-level (AGL) altitude. This AGL state estimator was integrated in a near-terrain guidance system aboard a research helicopter and flight tested in moderately rugged terrain over a variety of flight and system conditions. The minimum operating altidude of the terrain database referenced guidance system was reduced from 300 ft to 150 ft with the addition of the Kalman filter state estimator.
A general simulation program is presented (GSP) involving nonlinear state estimation for space vehicle flight navigation systems. A complete explanation of the iterative guidance mode guidance law, derivation of the dynamics, coordinate frames, and state estimation routines are given so as to fully clarify the assumptions and approximations involved so that simulation results can be placed in their proper perspective. A complete set of computer acronyms and their definitions as well as explanations of the subroutines used in the GSP simulator are included. To facilitate input/output, a complete set of compatable numbers, with units, are included to aid in data development. Format specifications, output data phrase meanings and purposes, and computer card data input are clearly spelled out. A large number of simulation and analytical studies were used to determine the validity of the simulator itself as well as various data runs.
The following paper is presented in viewgraph format and covers topics including: (1) linear state feedback control system; (2) Kalman filter state estimation; (3) relation between residual and stochastic part of output; (4) obtaining Kalman filter gain; (5) state estimation under unknown system model and unknown noises; and (6) relationship between filter Markov parameters and system Markov parameters.
Parameter identification and state estimation for linear systems
With the global energy transition of the electric power system, grid control, supervision, and protection is becoming more challenging. With the increasing integration of renewable energy sources (RES), the system dynamics are changing, causing traditional power system dynamic modeling with swing equation-based modeling approaches to fail. Additionally, the converter-dominated power grid is decreasing the system inertia, making the power system more fragile to the frequency swings. This paper first investigates and compares the application of a model-based Kalman filter state estimation approach with (i) a model-free machine learning approach --- neural ordinary differential equations (NODEs) --- and (ii) a data-driven system identification (SysId) approach to model and infer critical state values of the power system frequency dynamics. Then a model predictive control (MPC) framework is compared to a model-free Soft Actor-Critic (SAC) reinforcement learning (RL) control algorithm in providing efficient fast frequency response (FFR) to the power system frequency dynamics. The approaches are compared in terms of their performance goals as well as their per-timestep computational efficiency. Furthermore, the comparative study for state estimation shows that for the model-free requirement, both NODEs and SysId can provide accurate state estimates; however, with increasing model complexity, NODEs can be a better choice for model identification. Similarly, the results from the FFR comparative study show that the SAC RL-based FFR, once trained, outperforms MPC with better control signals and faster computation time, making the SAC RL-based FFR better option for providing FFR to the power system.
Estimation of precise tracking station locations for deep space navigation is based on combining state estimates derived from a multitude of planetary encounter missions with planet direction information provided by the planetary ephemeris. Procedures for reducing the dimensionality of the station location estimation problem and for analytically correcting estimates for ephemeris updates have been developed. Using Householder transforms the large scale state estimation problem is decomposed into a sequence of dynamically uncoupled problems of lower dimension. The effect of an ephemeris update is shown to be adequately approximated by Brouwer-Clemence Set III perturbations for the earth-moon barycenter and the target planet for each mission.
Real-time state estimation and forecasting are critical for the efficient operation of power grids. In this paper, a physics-informed Gaussian process regression (PhI-GPR) method is presented and used for forecasting and estimating the phase angle, angular speed, and wind mechanical power of a three-generator power grid system using sparse measurements. In standard data-driven Gaussian process regression (GPR), parameterized models for the prior statistics are fit by maximizing the marginal likelihood of observed data. In the PhI-GPR method, we propose to compute the prior statistics offline by solving stochastic differential equations (SDEs) governing the power grid dynamics. The short-term forecast of a power grid system dominated by wind generation is complicated by the stochastic nature of the wind and the resulting uncertainty in wind mechanical power. Here, we assume that the power grid dynamics are governed by swing equations, with the wind mechanical power fluctuating randomly in time. We solve these equations for the mean and covariances of the power grid states using the Monte Carlo simulation method. We demonstrate that the proposed PhI-GPR method can accurately forecast and estimate observed and unobserved states. For the considered problem, PhI-GPR has computational advantages over the ensemble Kalman filter (EnKF) method: In PhI-GPR, ensembles are computed offline and independently of the data acquisition process, whereas for EnFK, ensembles are computed online with data acquisition, rendering real-time forecast more challenging. We also demonstrate that the PhI-GPR forecast is more accurate than the EnKF forecast when the random mechanical wind power is non-Markovian. In contrast, the two methods produce similar forecasts for the Markovian mechanical wind power. For observed states, we show that PhI-GPR provides a forecast comparable to the standard data-driven GPR; both forecasts are significantly more accurate than the autoregressive integrated moving average (ARIMA) forecast. We also show that the ARIMA forecast is more sensitive to observation frequency and measurement errors than the PhI-GPR forecast.
The power distribution network is undergoing tremendous transformation due to an increase in the penetration of renewable energy resources and electric vehicles. These changes have resulted in greater uncertainty and dynamics in the distribution grid states. Therefore, the ability to track and monitor system states has become a critical need for accurate and timely control actions. In this paper, we propose two dynamic sparsity-based state estimation approaches for distribution systems: (1) locally weighted matrix completion (LW-MC) and (2) Bayesian matrix completion with Kalman filter prediction (BMC-KF). The performance of the proposed dynamic state estimation strategies is compared with the classic/static matrix completion (static-MC) approach using the IEEE 37 and IEEE 123 bus test systems. Finally, results indicate that BMC-KF approach outperforms both LW-MC as well as static-MC even when 30% of the measurement data is available. Computational complexity associated with both approaches is quantified.
This paper extends in two directions the results of prior work on generalized linear covariance analysis of both batch least-squares and sequential estimators. The first is an improved treatment of process noise in the batch, or epoch state, estimator with an epoch time that may be later than some or all of the measurements in the batch. The second is to account for process noise in specifying the gains in the epoch state estimator. We establish the conditions under which the latter estimator is equivalent to the Kalman filter.
Coordinated cyber attacks tamper with measurement data to disrupt the situational awareness of active distribution systems. Various sensors report measurements asynchronously at different rates, which introduces challenges during state estimation. In addition, this forces cyber intruders to exert greater effort to compromise multiple communication channels and launch coordinated attacks. Therefore, multi-channel and asynchronous measurements could be harnessed to develop more secure cyber defense strategies. In this paper, a prediction-correction-based multi-rate observer is designed to exploit the value of asynchronous measurements for the detection of coordinated false data injection (FDI) attacks. First, a time-function-dependent prediction-correction strategy is proposed to adjust the sampling interval for each sensor’s measurement. Then, an observer is designed based on the trade-off between estimation error and the optimal period of the most recent sampling instant, with the convergence of estimation error with the maximum permitted sampling interval. Moreover, the conditions for exponential stability are developed using the Lyapunov–Krasovskii functional technique. Next, a coordinated FDI attack detection strategy is developed based on the dual nonlinear minimization problem. The proposed attack detection and secure state estimation strategies are tested on the IEEE 13-node system. Simulation results show that these schemes are effective in enhancing attack detection based on asynchronous measurements or compromised data.
The effects of instrumentation accuracy and configuration on estimation error are studied for the small expendable-tether deployment system (SEDS) using a continuous-discrete extended Kalman filter (CDEKF) state estimator. A twelfth order model that incorporates the rigid body modes of the tether as well as the satellite attitude dynamics is developed. Simulation results using the model and the estimator indicate that the originally planned instrumentation package could not estimate the state vector adequately. Recommendations are made and results presented that reduce the estimation error by adding instruments and increasing selected measurement accuracies.
A novel approach of integrated system identification and modal state estimation is proposed for control of linear dynamical systems including flexible space structures. There are four steps involved in this approach. First, the relation between a stochastic state space model of a dynamical system and the coefficients of its autoregressive model with exogenous input is derived. Second, an adaptive least-squares transversal predictor is used to estimate the coefficients of the model. Third, a state space model and a steady state Kalman filter gain of the dynamical system are then identified from the coefficients of the model by using the eigensystem realization algorithm. Fourth, a modal state estimator is constructed using the modal parameters of the identified model. On-line implementation of this algorithm can continually improve the modal parameters and the filter gain. It can also gradually update the system model when the system characteristics are slowly changing. A numerical example is used to illustrate the feasibility of the new approach.
Minimax design criteria of linear filters for state estimation in presence of parameter uncertainties
This paper studies the optimal meter placement problem for distribution system state estimation given limited measurement resources. We formulate the problem as a mixed integer semi-definite programming that minimizes the worst case estimation errors over a set of operating points. To solve the problem, we first relax the problem as a convex optimization problem. Motivated by the lack of scalability of existing solvers, we next leverage the special structure of the cost function and propose an algorithm based on barrier method that solves the problem with significantly better numerical performance. The proposed method has been validated on the IEEE 13-bus, IEEE 123-bus, and IEEE 8,500-bus feeders.
Spacecraft state estimation and the absolute registration of Earth images acquired by cameras onboard geosynchronous satellites are described. The basic data type of the procedure consists of line and element numbers of image points called landmarks whose geodetic coordinates, relative to United States Geodetic Survey topographic maps, are known. A conventional least squares process is used to estimate navigational parameters and camera pointing biases from observed minus computed landmark line and element numbers. These estimated parameters along with orbit and attitude dynamic models are used to register images, using an automated grey level correlation technique, inside the span represented by the landmark data. In addition, the dynamic models can be employed to register images outside of the data span in a near real time mode. An important application of this mode is in support of meteorological studies where rapid data reduction is required for the rapid tracking and predicting of dynamic phenomena.