Resampling Markov Chain Monte Carlo Algorithms: Basic Analysis and Empirical Comparisons

Research output: Contribution to journalArticle

1 Scopus citations

Abstract

Sampling from complex distributions is an important but challenging topic in scientific and statistical computation. We synthesize three ideas, tempering, resampling, and Markov moving, and propose a general framework of resampling Markov chain Monte Carlo (MCMC). This framework not only accommodates various existing algorithms, including resample-move, importance resampling MCMC, and equi-energy sampling, but also leads to a generalized resample-move algorithm. We provide some basic analysis of these algorithms within the general framework, and present three simulation studies to compare these algorithms together with parallel tempering in the difficult situation where new modes emerge in the tails of previous tempering distributions. Our analysis and empirical results suggest that generalized resample-move tends to perform the best among all the algorithms studied when the Markov kernels lead to fast mixing or even locally so toward restricted distributions, whereas parallel tempering tends to perform the best when the Markov kernels lead to slow mixing, without even converging fast to restricted distributions. Moreover, importance resampling MCMC and equi-energy sampling perform similarly to each other, often worse than independence Metropolis resampling MCMC. Therefore, different algorithms seem to have advantages in different settings.

Original languageEnglish (US)
Pages (from-to)328-356
Number of pages29
JournalJournal of Computational and Graphical Statistics
Volume24
Issue number2
DOIs
StatePublished - Apr 3 2015

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Discrete Mathematics and Combinatorics
  • Statistics, Probability and Uncertainty

Keywords

  • Equi-energy sampling
  • Importance resampling
  • Parallel tempering
  • Potts model
  • Resample-move
  • Sequential Monte Carlo

Fingerprint Dive into the research topics of 'Resampling Markov Chain Monte Carlo Algorithms: Basic Analysis and Empirical Comparisons'. Together they form a unique fingerprint.

  • Cite this