Skip to Main Content
Introduction to Probability
book

Introduction to Probability

by Joseph K. Blitzstein, Jessica Hwang
September 2015
Beginner content levelBeginner
596 pages
18h 33m
English
CRC Press
Content preview from Introduction to Probability

Chapter 11

Markov chains

Markov chains were first introduced in 1906 by Andrey Markov (of Markov’s inequality), with the goal of showing that the law of large numbers can apply to random variables that are not independent. To see where the Markov model comes from, start by considering an i.i.d. sequence of random variables X0, X1, ... , Xn, ... where we think of n as time. This is the setting we worked in throughout Chapter 10, but for modeling real-world phenomena, independence can be an excessively restrictive assumption; it means that the Xn provide absolutely no information about each other. At the other extreme, allowing arbitrary interactions between the Xn makes it very difficult to compute even basic things. A Markov chain is a sequence ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Introduction to Probability.

Introduction to Probability.

N. Balakrishnan, Markos V. Koutras, Konstadinos G. Politis

Publisher Resources

ISBN: 9781466575578