5
Continuous-Time Markov Chains
5.1 Introduction
A stochastic process 
is a continuous-time Markov chain (CTMC) if, for all 
and nonnegative integers 
:
This means that in a CTMC, the conditional probability of the future state at time 
given the present ...
Get Markov Processes for Stochastic Modeling, 2nd Edition now with O’Reilly online learning.
O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.