Chapter 14

Monte Carlo Methods

Abstract

This chapter deals with basic concepts and definitions concerning Monte Carlo sampling techniques. Rejection sampling and importance sampling are first introduced. Markov chains and some of their basic properties are discussed. Then the Metropolis-Hastings and Gibbs algorithms are presented. At the end of the chapter, a case study concerning change point detection is considered.

Keywords

Monte Carlo methods

Rejection sampling

Importance sampling

Markov chains

Metropolis-Hastings algorithm

Gibbs sampling

Change point detection

Get Machine Learning now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.