Improper priors with well defined Bayes Factors
A sensible Bayesian model selection or comparison strategy implies selecting the model with the highest posterior probability. While some improper priors have attractive properties such as, e.g., low frequentist risk, it is generally claimed that Bartlett's paradox implies that using improper priors for the parameters in alternative models results in Bayes factors that are not well defined, thus preventing model comparison in this case. In this paper we demonstrate this latter result is not generally true and expand the class of priors that may be used for computing posterior odds to include some improper priors. Our approach is to give a new representation of the issue of undefined Bayes factors and, from this representation, develop classes of improper priors from which well defined Bayes factors may be derived. This approach involves either augmenting or normalising the prior measure for the parameters. One of these classes of priors includes the well known and commonly employed shrinkage prior. Estimation of Bayes factors is demonstrated for a reduced rank model.
|Keywords||Bayes factor, improper prior, marginal likelihood, measure, shrinkage prior|
Strachan, R.W., & van Dijk, H.K.. (2004). Improper priors with well defined Bayes Factors (No. EI 2004-18). Report / Econometric Institute, Erasmus University Rotterdam. Retrieved from http://hdl.handle.net/1765/1277