B.3. Markovian Systems in Equilibrium

B.3.1. Discrete-time Markov Chains

A Markov chain discrete-time Markov chain - DTMC is a random process that undergoes transitions from one state to another on a state space. It must possess the “memorylessness” property , namely, that the probability distribution of the next state depends only on the current state and not on the sequence of events that preceded it. The material presented in this subsection will be useful for the study of queuing systems treated in the later subsections of Appendix B.3 and Chapters 4 and 5.
More formally, a stochastic process {Xn,n=0,1,2,}image that takes a finite or countable number ...

Get Malware Diffusion Models for Modern Complex Networks now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.