12.4 Characterization of States for a Markov Chain. Stationary Distribution.

Before we give the main theorem of this chapter, we need to introduce several new concepts.

A reducible chain may be split into two or more classes.

or equivalently, , where denotes the transposition operation. Thus, if you like the linear algebra language better, is an eigenvector of corresponding ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training,
learning paths, books, interactive tutorials, and more.