2

Basic Concepts in Stochastic Processes

2.1 Introduction

Stochastic processes deal with the dynamics of probability theory. The concept of stochastic processes enlarges the random variable concept to include time. Thus, instead of thinking of a random variable X that maps an event image, where image is the sample space, to some number X(w), we think of how the random variable maps the event to different numbers at different times. This implies that instead of the number X(w) we deal with , where and T is called the parameter set of the process and is usually ...

Get Markov Processes for Stochastic Modeling, 2nd Edition now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.