12.4 Characterization of States for a Markov Chain. Stationary Distribution.
Before we give the main theorem of this chapter, we need to introduce several new concepts.
A reducible chain may be split into two or more classes.
or equivalently, , where denotes the transposition operation. Thus, if you like the linear algebra language better, is an eigenvector of corresponding ...
Get Probability and Stochastic Processes now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.