12.4 Characterization of States for a Markov Chain. Stationary Distribution.

Before we give the main theorem of this chapter, we need to introduce several new concepts.

A reducible chain may be split into two or more classes.


or equivalently, c12-math-0365, where c12-math-0366 denotes the transposition operation. Thus, if you like the linear algebra language better, c12-math-0367 is an eigenvector of c12-math-0368 corresponding ...

Get Probability and Stochastic Processes now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.