Back-Testing Market Risk Models

KEVIN DOWD, PhD

Partner, Cobden Partners, London

Abstract: Back-testing is the quantitative evaluation of a model, and back-testing a risk or probability density forecasting model involves a comparison of the model's density forecasts against subsequently realized outcomes of the random variable whose density is forecast. One purpose of back-testing is to determine whether the forecasts are sufficiently close to realized outcomes to enable us to conclude that the forecasts are statistically compatible with those outcomes. Back-tests conducted for this purpose involve statistical hypothesis tests to determine if a model's forecasts are acceptable. Hypothesis tests can be applied to observations involving a loss that exceeds the value-at-risk at a given confidence interval, or they can be applied to forecasts of VaRs at multiple confidence intervals. A second purpose of back-testing is to assist risk managers to diagnose problems with their risk models and so help improve them. A third purpose of back-testing is to rank the performance of a set of alternative risk models to determine which model gives the “best” density forecast evaluation performance.

To back-test a model is to evaluate it in quantitative terms, and back-testing a risk (or probability density forecasting) model involves a comparison of the model's density forecasts against subsequently realized outcomes of the underlying random variable whose density is forecast. The importance ...

Get Encyclopedia of Financial Models III now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.