Two-stage importance sampling with mixture proposals

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

For importance sampling (IS), multiple proposals can be combined to address different aspects of a target distribution. There are various methods for IS with multiple proposals, including Hesterberg's stratified IS estimator, Owen and Zhou's regression estimator, and Tan's maximum likelihood estimator. For the problem of efficiently allocating samples to different proposals, it is natural to use a pilot sample to select the mixture proportions before the actual sampling and estimation. However, most current discussions are in an empirical sense for such a two-stage procedure. In this article, we establish a theoretical framework of applying the two-stage procedure for various methods, including the asymptotic properties and the choice of the pilot sample size. By our simulation studies, these two-stage estimators can outperform estimators with naive choices of mixture proportions. Furthermore, while Owen and Zhou's and Tan's estimators are designed for estimating normalizing constants, we extend their usage and the two-stage procedure to estimating expectations and show that the improvement is still preserved in this extension.

Original languageEnglish (US)
Pages (from-to)1350-1365
Number of pages16
JournalJournal of the American Statistical Association
Volume108
Issue number504
DOIs
StatePublished - 2013

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Keywords

  • Control variates
  • Normalizing constant
  • Pilot samples

Fingerprint Dive into the research topics of 'Two-stage importance sampling with mixture proposals'. Together they form a unique fingerprint.

Cite this