Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Quantum Model of Emerging Grammars

A special class of quantum recurrent nets simulating Markov chains with absorbing states is introduced. The absorbing states are exploited for pattern recognition: each class of patterns, each combination of patterns acquires its own meaning.

Quantum computing Markov chains↗

Radiative transfer calculated from a Markov chain formalism

The theory of Markov chains is used to formulate the radiative transport problem in a general way by modeling the successive interactions of a photon as a stochastic process. Under the minimal requirement that the stochastic process is a Markov chain, the determination of the diffuse reflection or transmission from a scattering atmosphere is equivalent to the solution of a system of linear equations. This treatment is mathematically equivalent to, and thus has many of the advantages of, Monte Carlo methods, but can be considerably more rapid than Monte Carlo algorithms for numerical calculations in particular applications. We have verified the speed and accuracy of this formalism for the standard problem of finding the intensity of scattered light from a homogeneous plane-parallel atmosphere with an arbitrary phase function for scattering. Accurate results over a wide range of parameters were obtained with computation times comparable to those of a standard 'doubling' routine. The generality of this formalism thus allows fast, direct solutions to problems that were previously soluble only by Monte Carlo methods. Some comparisons are made with respect to integral equation methods.

Esposito, L. W.↗

Set-point control of nonlinear systems

A method of nonlinear stochastic control is applied to the problem of providing set-point control. The procedure is illustrated for a nonlinear second-order plant. The controller design uses a variation of the 'multiple-model adaptive control' approach. Specific problems related to the design are investigated, including learning time and set-point accuracy dependence on the number of approximating models, chord versus tangent approximations, and the a priori Markov switching parameter values. Simulations are provided for different situations under various levels of measurement noise.

Vanlandingham, H. F.↗

Identification of linear system models and state estimators for controls

The following paper is presented in viewgraph format and covers topics including: (1) linear state feedback control system; (2) Kalman filter state estimation; (3) relation between residual and stochastic part of output; (4) obtaining Kalman filter gain; (5) state estimation under unknown system model and unknown noises; and (6) relationship between filter Markov parameters and system Markov parameters.

Chen, Chung-Wen↗

Self-Directed Cooperative Planetary Rovers

The project is concerned with the development of decision-theoretic techniques to optimize the scientific return of planetary rovers. Planetary rovers are small unmanned vehicles equipped with cameras and a variety of sensors used for scientific experiments. They must operate under tight constraints over such resources as operation time, power, storage capacity, and communication bandwidth. Moreover, the limited computational resources of the rover limit the complexity of on-line planning and scheduling. We have developed a comprehensive solution to this problem that involves high-level tools to describe a mission; a compiler that maps a mission description and additional probabilistic models of the components of the rover into a Markov decision problem; and algorithms for solving the rover control problem that are sensitive to the limited computational resources and high-level of uncertainty in this domain.

Zilberstein, Shlomo↗

Precision Measurement of Black Hole Binary Dynamics: Analyzing the LISA Data Stream

One of the richest potential sources of insight into fundamental physics that LISA will be capable of observing is the inspiral of supermassive black hole binaries (BHBs). However, the data analysis challenge presented by the LISA data stream is quite unlike the situation for present day gravitational wave detectors. In order to make the precision measurements necessary to achieve LISA's science goals, the BHB signal must be distinguished from a data stream that not only contains instrumental noise, but potentially thousands of other signals as well, so that the "background" we wish to separate out to focus on the BHB signal is likely to be highly nonstationary and nongaussian, as well as being of scientific interest in its own right. In addition, whereas the theoretical templates that we calculate in order to ultimately estimate the parameters can afford to be somewhat inaccurate and still be effective for present day and near future detectors, this is not the case for LISA, and extremely high fidelity of the theoretical templates for high signal-to-noise signals will be required to prevent theoretical errors from dominating the parameter estimates. NVe, will describe efforts in the community of LISA data analysts to address the challenges regarding the specific issue of BHB signals. These efforts include using a Markov Chain Monte Carlo approach with the freedom to model the BHB and the other signals present in the data stream simultaneously, rather than trying to remove other signals and risk biasing the remaining data. The Mock LISA Data Challenge is a community of LISA scientists who generate rounds of simulated LISA noise with increasingly difficult signal content, and invite the LISA data analysis community to exercise their methods, or develop new methods, in an attempt to extract the parameters for the signals embedded in the mock data. In addition to practical approaches such ,is this to assess the level of parameter accuracy, one can apply the Fisher matrix formalism to assess both the statistical errors from noise and the theoretical errors

McWilliams, Sean T.↗

Uncertainty Estimates of Psychoacoustic Thresholds Obtained from Group Tests

Adaptive psychoacoustic test methods, in which the next signal level depends on the response to the previous signal, are the most efficient for determining psychoacoustic thresholds of individual subjects. In many tests conducted in the NASA psychoacoustic labs, the goal is to determine thresholds representative of the general population. To do this economically, non-adaptive testing methods are used in which three or four subjects are tested at the same time with predetermined signal levels. This approach requires us to identify techniques for assessing the uncertainty in resulting group-average psychoacoustic thresholds. In this presentation we examine the Delta Method of frequentist statistics, the Generalized Linear Model (GLM), the Nonparametric Bootstrap, a frequentist method, and Markov Chain Monte Carlo Posterior Estimation and a Bayesian approach. Each technique is exercised on a manufactured, theoretical dataset and then on datasets from two psychoacoustics facilities at NASA. The Delta Method is the simplest to implement and accurate for the cases studied. The GLM is found to be the least robust, and the Bootstrap takes the longest to calculate. The Bayesian Posterior Estimate is the most versatile technique examined because it allows the inclusion of prior information.

Rathsam, Jonathan↗

Linear system identification via backward-time observer models

This paper presents an algorithm to identify a state-space model of a linear system using a backward-time approach. The procedure consists of three basic steps. First, the Markov parameters of a backward-time observer are computed from experimental input-output data. Second, the backward-time observer Markov parameters are decomposed to obtain the backward-time system Markov parameters (backward-time pulse response samples) from which a backward-time state-space model is realized using the Eigensystem Realization Algorithm. Third, the obtained backward-time state space model is converted to the usual forward-time representation. Stochastic properties of this approach will be discussed. Experimental results are given to illustrate when and to what extent this concept works.

Juang, Jer-Nan↗

A Model-Based, Bayesian Solution for Characterization of Complex Damage Scenarios in Aerospace Composite Structures

Ultrasonic damage detection and characterization is commonly used in nondestructive evaluation (NDE) of aerospace composite components. In recent years there has been an increased development of guided wave based methods. In real materials and structures, these dispersive waves result in complicated behavior in the presence of complex damage scenarios. Model-based characterization methods utilize accurate three dimensional finite element models (FEMs) of guided wave interaction with realistic damage scenarios to aid in defect identification and classification. This work describes an inverse solution for realistic composite damage characterization by comparing the wavenumber-frequency spectra of experimental and simulated ultrasonic inspections. The composite laminate material properties are first verified through a Bayesian solution (Markov chain Monte Carlo), enabling uncertainty quantification surrounding the characterization. A study is undertaken to assess the efficacy of the proposed damage model and comparative metrics between the experimental and simulated output. The FEM is then parameterized with a damage model capable of describing the typical complex damage created by impact events in composites. The damage is characterized through a transdimensional Markov chain Monte Carlo solution, enabling a flexible damage model capable of adapting to the complex damage geometry investigated here. The posterior probability distributions of the individual delamination petals as well as the overall envelope of the damage site are determined.

H. Reed↗

Adaptive control based on retrospective cost optimization

A discrete-time adaptive control law for stabilization, command following, and disturbance rejection that is effective for systems that are unstable, MIMO, and/or nonminimum phase. The adaptive control algorithm includes guidelines concerning the modeling information needed for implementation. This information includes the relative degree, the first nonzero Markov parameter, and the nonminimum-phase zeros. Except when the plant has nonminimum-phase zeros whose absolute value is less than the plant's spectral radius, the required zero information can be approximated by a sufficient number of Markov parameters. No additional information about the poles or zeros need be known. Numerical examples are presented to illustrate the algorithm's effectiveness in handling systems with errors in the required modeling data, unknown latency, sensor noise, and saturation.

Santillo, Mario A.↗

Detection of digital FSK using a phase-locked loop

A theory is presented for the design of a digital FSK receiver which employs a phase-locked loop to set up the desired matched filter as the arriving signal frequency switches. The developed mathematical model makes it possible to establish the error probability performance of systems which employ a class of digital FM modulations. The noise mechanism which accounts for decision errors is modeled on the basis of the Meyr distribution and renewal Markov process theory.

Lindsey, W. C.↗

Spectral characteristics of convolutionally coded digital signals

The power spectral density of the output symbol sequence of a convolutional encoder is computed for two different input symbol stream source models, namely, an NRZ signaling format and a first order Markov source. In the former, the two signaling states of the binary waveform are not necessarily assumed to occur with equal probability. The effects of alternate symbol inversion on this spectrum are also considered. The mathematical results are illustrated with many examples corresponding to optimal performance codes.

Divsalar, D.↗

Evaluation of computing systems using functionals of a Stochastic process

An intermediate model was used to represent the probabilistic nature of a total system at a level which is higher than the base model and thus closer to the performance variable. A class of intermediate models, which are generally referred to as functionals of a Markov process, were considered. A closed form solution of performability for the case where performance is identified with the minimum value of a functional was developed.

Meyer, J. F.↗

Estimation of unmodeled forces on a low-thrust space vehicle

The application of a sequential estimation algorithm, which compensates for random errors in the dynamic model, to the problem of estimating the state of a continuously thrusting solar electric propulsion space vehicle is investigated. The dynamic model errors, due to random anomalies in the propulsion system, are approximated successfully by both first order and second order Gauss-Markov processes to obtain a more accurate and stable orbit determination algorithm. The importance of correct dynamic and measurement modeling in achieving accurate estimates is demonstrated.

Tapley, B. D.↗

Identification and control of NASA's ACES structures

Results are presented of identification and control experiments on NASA's ACES structure at the Marshall Space Flight Center. The models used for controller design were obtained from identification experiments employing the algorithm Q-Markov cover. The OVC algorithm used for control design produces a controller minimizing the control energy of the closed-loop system, subject to inequality constraints on each of the output variances. The identified model matches the experimental data for the ACES structure reasonably well. The line of sight pointing errors of the structure are substantially reduced by the controllers.

Liu, K.↗

Pulsar Emission Geometry and Accelerating Field Strength

The high-quality Fermi LAT observations of gamma-ray pulsars have opened a new window to understanding the generation mechanisms of high-energy emission from these systems, The high statistics allow for careful modeling of the light curve features as well as for phase resolved spectral modeling. We modeled the LAT light curves of the Vela and CTA I pulsars with simulated high-energy light curves generated from geometrical representations of the outer gap and slot gap emission models. within the vacuum retarded dipole and force-free fields. A Markov Chain Monte Carlo maximum likelihood method was used to explore the phase space of the magnetic inclination angle, viewing angle. maximum emission radius, and gap width. We also used the measured spectral cutoff energies to estimate the accelerating parallel electric field dependence on radius. under the assumptions that the high-energy emission is dominated by curvature radiation and the geometry (radius of emission and minimum radius of curvature of the magnetic field lines) is determined by the best fitting light curves for each model. We find that light curves from the vacuum field more closely match the observed light curves and multiwavelength constraints, and that the calculated parallel electric field can place additional constraints on the emission geometry

DeCesar, Megan E.↗

Data flow modeling techniques

There have been a number of simulation packages developed for the purpose of designing, testing and validating computer systems, digital systems and software systems. Complex analytical tools based on Markov and semi-Markov processes have been designed to estimate the reliability and performance of simulated systems. Petri nets have received wide acceptance for modeling complex and highly parallel computers. In this research data flow models for computer systems are investigated. Data flow models can be used to simulate both software and hardware in a uniform manner. Data flow simulation techniques provide the computer systems designer with a CAD environment which enables highly parallel complex systems to be defined, evaluated at all levels and finally implemented in either hardware or software. Inherent in data flow concept is the hierarchical handling of complex systems. In this paper we will describe how data flow can be used to model computer system.

Kavi, K. M.↗