Preface to the First Edition

Markov processes are used to model systems with limited memory. They are used in many areas including communication systems, transportation networks, image segmentation and analysis, biological systems and DNA sequence analysis, random atomic motion and diffusion in physics, social mobility, population studies, epidemiology, animal and insect migration, queueing systems, resource management, dams, financial engineering, actuarial science, and decision systems.

Different books have been written specifically for different types of Markov processes. For example, books on bioinformatics discuss hidden Markov models, books on financial markets and economics discuss random walks and Brownian motion, and books on image ...

Get Markov Processes for Stochastic Modeling, 2nd Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.