Engineering Papers⌕ Search

Engineering topics

Smyth, Padhraic J.

Publications and source records attributed to Smyth, Padhraic J..

Decadal Prediction and Stochastic Simulation of Hydroclimate Over Monsoonal Asia

We developed further our advanced methods of time series analysis and empirical model reduction (EMR) and applied them to climatic time series relevant to hydroclimate over Monsoonal Asia. The EMR methodology was both generalized further and laid on a rigorous mathematical basis via multilayered stochastic models (MSMs). We identified easily testable conditions that imply the existence of a global random attractor for MSMs and allow for non-polynomial predictors. This existence, in turn, guarantees the numerical stability of the MSMs so obtained. We showed that, in the presence of low-frequency variability (LFV), EMR prediction can be improved further by including information from selected times in the system’s past. This prediction method, dubbed Past-Noise Forecasting (PNF), was successfully applied to the Madden-Julian Oscillation (MJO). Our time series analysis and forecasting methods, based on singular-spectrum analysis (SSA) and its enhancements, were applied to several multi-centennial proxy records provided by the Lamont team. These included the Palmer Drought Severity Index (PDSI) for 1300–2005 from the Monsoonal Asia Drought Atlas (MADA), and a 300-member ensemble of pseudo-reconstructions of Indus River discharge for 1702–2005. The latter was shown to exhibit a robust 27-yr low-frequency mode, which helped multi-decadal retroactive forecasts with no look-ahead over this 300-year interval.

54 ENVIRONMENTAL SCIENCES↗

Final Technical Report for "Collaborative Research. Regional climate-change projections through next-generation empirical and dynamical models"

This project was a continuation of previous work under DOE CCPP funding in which we developed a twin approach of non-homogeneous hidden Markov models (NHMMs) and coupled ocean-atmosphere (O-A) intermediate-complexity models (ICMs) to identify the potentially predictable modes of climate variability, and to investigate their impacts on the regional-scale. We have developed a family of latent-variable NHMMs to simulate historical records of daily rainfall, and used them to downscale seasonal predictions. We have also developed empirical mode reduction (EMR) models for gaining insight into the underlying dynamics in observational data and general circulation model (GCM) simulations. Using coupled O-A ICMs, we have identified a new mechanism of interdecadal climate variability, involving the midlatitude oceans mesoscale eddy field and nonlinear, persistent atmospheric response to the oceanic anomalies. A related decadal mode is also identified, associated with the oceans thermohaline circulation. The goal of the continuation was to build on these ICM results and NHMM/EMR model developments and software to strengthen two key pillars of support for the development and application of climate models for climate change projections on time scales of decades to centuries, namely: (a) dynamical and theoretical understanding of decadal-to-interdecadal oscillations and their predictability; and (b) an interface from climate models to applications, in order to inform societal adaptation strategies to climate change at the regional scale, including model calibration, correction, downscaling and, most importantly, assessment and interpretation of spread and uncertainties in multi-model ensembles. Our main results from the grant consist of extensive further development of the hidden Markov models for rainfall simulation and downscaling specifically within the non-stationary climate change context together with the development of parallelized software; application of NHMMs to downscaling of rainfall projections over India; identification and analysis of decadal climate signals in data and models; and, studies of climate variability in terms of the dynamics of atmospheric flow regimes. Each of these project components is elaborated on below, followed by a list of publications resulting from the grant.

54 ENVIRONMENTAL SCIENCES↗

Hidden Markov models for fault detection in dynamic systems

The invention is a system failure monitoring method and apparatus which learns the symptom-fault mapping directly from training data. The invention first estimates the state of the system at discrete intervals in time. A feature vector x of dimension k is estimated from sets of successive windows of sensor data. A pattern recognition component then models the instantaneous estimate of the posterior class probability given the features, p(w(sub i) (vertical bar)/x), 1 less than or equal to i isless than or equal to m. Finally, a hidden Markov model is used to take advantage of temporal context and estimate class probabilities conditioned on recent past history. In this hierarchical pattern of information flow, the time series data is transformed and mapped into a categorical representation (the fault classes) and integrated over time to enable robust decision-making.

Smyth, Padhraic J.↗

Pseudogradient Training For A Class Of Neural Networks

Developmental second-order recurrent neural networks of special type modified to enhance stability in face of inputs beyond range of inputs on which trained. Second-order recurrent neural networks contain product feedback units and can be trained, by use of example inputs and outputs, to act as finite-state automatons. Particular second-order recurrent neural networks in question learn grammars in sense they are trained to generate binary responses to input training sequences of ones and zeros, each sequence being marked "legal" or "illegal" according to grammar to be learned.

Zeng, Zheng↗

Detecting Faults By Use Of Hidden Markov Models

Frequency of false alarms reduced. Faults in complicated dynamic system (e.g., antenna-aiming system, telecommunication network, or human heart) detected automatically by method of automated, continuous monitoring. Obtains time-series data by sampling multiple sensor outputs at discrete intervals of t and processes data via algorithm determining whether system in normal or faulty state. Algorithm implements, among other things, hidden first-order temporal Markov model of states of system. Mathematical model of dynamics of system not needed. Present method is "prior" method mentioned in "Improved Hidden-Markov-Model Method of Detecting Faults" (NPO-18982).

Smyth, Padhraic J.↗

Automated Induction Of Rule-Based Neural Networks

Prototype expert systems implemented in software and are functionally equivalent to neural networks set up automatically and placed into operation within minutes following information-theoretic approach to automated acquisition of knowledge from large example data bases. Approach based largely on use of ITRULE computer program.

Smyth, Padhraic J.↗

Improved Hidden-Markov-Model Method Of Detecting Faults

Method of automated, continuous monitoring to detect faults in complicated dynamic system based on hidden-Markov-model (HMM) approach. Simpler than another, recently proposed HMM method, but retains advantages of that method, including low susceptibility to false alarms, no need for mathematical model of dynamics of system under normal or faulty conditions, and ability to detect subtle changes in characteristics of monitored signals. Examples of systems monitored by use of this method include motors, turbines, and pumps critical in their applications; chemical-processing plants; powerplants; and biomedical systems.

Smyth, Padhraic J.↗

Hidden Markov models for fault detection in dynamic systems

The invention is a system failure monitoring method and apparatus which learns the symptom-fault mapping directly from training data. The invention first estimates the state of the system at discrete intervals in time. A feature vector x of dimension k is estimated from sets of successive windows of sensor data. A pattern recognition component then models the instantaneous estimate of the posterior class probability given the features, p(w(sub i) perpendicular to x), 1 less than or equal to i is less than or equal to m. Finally, a hidden Markov model is used to take advantage of temporal context and estimate class probabilities conditioned on recent past history. In this hierarchical pattern of information flow, the time series data is transformed and mapped into a categorical representation (the fault classes) and integrated over time to enable robust decision-making.

Smyth, Padhraic J.↗

Entropy-Based Bounds On Redundancies Of Huffman Codes

Report presents extension of theory of redundancy of binary prefix code of Huffman type which includes derivation of variety of bounds expressed in terms of entropy of source and size of alphabet. Recent developments yielded bounds on redundancy of Huffman code in terms of probabilities of various components in source alphabet. In practice, redundancies of optimal prefix codes often closer to 0 than to 1.

Smyth, Padhraic J.↗

Evaluation Of Threshold Functions For Searches Among Data

Paper presents information-theoretical analysis of problem of building system of inferences from large collection of data (data base). More specifically, problem to design searches of data base for informative conjunctive production rules. Results of analysis may lead to design of more-economical and more-effective electronic neural networks drawing inferences from data bases.

Goodman, Rodney M.↗

Algorithm Derives Rules From Data

Set of best rules based on quantitative measure. ITRULE (Information Theoretic RULE induction) algorithm induces rules from examples in data base. Algorithm not only learns rules for given concept (classification) but also simultaneously learns rules relating multiple concepts.

Smyth, Padhraic J.↗