Stochastic Systems Group
Home Research Group Members Programs  
Demos Calendar Publications Mission Statement Alumni

SSG Seminar Abstract


Augmenting the HDP-HMM to Approximate Semi-Markov Processes

Emily B. Fox
SSG, MIT


Many real-world processes, as diverse as speech signals, the human genome, and financial time-series, can be described via hidden Markov models (HMMs) or variants therefrom. The HMM assumes that there is a set of observations of an underlying (hidden) discrete-valued Markov process representing the state evolution of the system. For many applications, the Markov structure on the state sequence approximates the temporal state persistence of a truly semi-Markov process.

Recently, the hierarchical Dirichlet process (HDP) has been applied to the problem of learning HMMs with unknown state space cardinality, and is referred to as a HDP-HMM. One of the main limitations of the original HDP-HMM formulation is that it cannot be biased towards learning models with high probabilities of self-transition. This results in large sensitivities to noise since the HDP-HMM can explain the data by fast state-switching, thus obscuring the learning procedure.

In this talk we revisit the HDP-HMM and address how to augment the formulation to efficiently and effectively learn HDP-HMMs approximating semi-Markov processes. In addition, this augmented formulation allows us to further extend the model to capture arbitrarily complex observation likelihood densities.



Problems with this site should be emailed to jonesb@mit.edu