Non-replication of association studies: "Pseudo-failures" to replicate?

Prakash Gorroochurn, Susan E. Hodge, Gary A. Heiman, Martina Durner, David A. Greenberg

Research output: Contribution to journalReview articlepeer-review

65 Scopus citations

Abstract

Recently, serious doubts have been cast on the usefulness of association studies as a means to genetically dissect complex diseases because most initial findings fail to replicate in subsequent studies. The reasons usually invoked are population stratification, genetic heterogeneity, and inflated Type I errors. In this article, we argue that, even when these problems are addressed, the scientific community usually has unreasonably high expectations on replication success, based on initial low P values, a phenomenon known as the replication fallacy. We present a modified formula that gives the replication power of a second association study based on the P value of an initial study. When both studies have similar sample sizes, this formula shows that: (1) a P value only slightly lower than the nominal α results in only approximately 50% replication power; (2) very low P values are required to achieve a replication power of at least 80% (e.g., at α = 0.05, a P value of <0.005 is required). Because many initially significant findings result in low replication power, replication failure should not be surprising or be interpreted as necessarily refuting the initial findings. We refer to replication failures for which the replication power is low as "pseudo-failures."

Original languageEnglish (US)
Pages (from-to)325-331
Number of pages7
JournalGenetics in Medicine
Volume9
Issue number6
DOIs
StatePublished - Jun 2007
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Genetics(clinical)

Keywords

  • Complex diseases
  • Effect size
  • Replication fallacy
  • Replication probability

Fingerprint Dive into the research topics of 'Non-replication of association studies: "Pseudo-failures" to replicate?'. Together they form a unique fingerprint.

Cite this