5
Continuous-Time Markov Chains
5.1 Introduction
A stochastic process is a continuous-time Markov chain (CTMC) if, for all
and nonnegative integers
:
This means that in a CTMC, the conditional probability of the future state at time given the present ...
Get Markov Processes for Stochastic Modeling, 2nd Edition now with O’Reilly online learning.
O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.