Parameterization of HMM

In the previous section, we saw an example of an HMM to get an idea of how the model works. Let's now formally parameterize an HMM.

As the latent variables of an HMM are discrete multinomial variables, we can use the 1-of-K encoding scheme to represent it, where the zn variable is represented by a K-dimensional vector of binary variables, znk ∈ {0,1}, such that znk = 1 and znj = 0 for j ≠ k if the zn variable is in the k state.

With this in mind, we can create a matrix with the transition probability matrix A, where AijPr(Znj = 1| zn-1, i = 1). As the Aij represent the probability of moving from state i to state j, it holds the property of  and can be expressed using the K(K-1) parameters. Thus we can represent ...

Get Hands-On Markov Models with Python now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.