O'Reilly logo

Case Studies in Bayesian Statistical Modelling and Analysis by Anthony N. Pettitt, Kerrie L. Mengersen, Clair L. Alston

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

4

Bayesian Analysis of the Normal Linear Regression Model

Christopher M. Strickland and Clair L. Alston

Queensland University of Technology, Brisbane, Australia

4.1 Introduction

The normal linear regression model is a fundamental tool in statistical analysis. Bayesian analysis of this model is well developed; see for instance Zellner (1971), Judge et al. (1988), Koop (2003) and Marin and Robert (2007). The linear regression model relates k covariates, xi,1, xi,2, ..., xi,k, to the ith observation yi as follows:

(4.1) equation

for i = 1, 2, ..., n, where βj, j = 1, 2, ..., k, are referred to as regression coefficients and εi is an error term, which throughout is assumed to be normally distributed.

This chapter aims to provide an introduction to the Bayesian analysis of the normal linear regression model, as given in Equation (4.1). We will use two case studies, presenting established data sets that have been widely analysed and are publicly available for researchers to use to develop their own models. These examples allow us to explore standard linear regression, variable selection, in this context, and to extend the standard model to account for serial correlation.

In this chapter, we analyse the basic linear regression model using natural conjugate priors, Jeffreys prior and Zellner's g-prior approach, illustrating the ease with which posterior estimation can be implemented. Sampling schemes ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required