The impact of job complexity and performance measurement on the temporal consistency, stability, and test-retest reliability of employee job performance ratings

Michael C. Sturman, Robin A. Cheramie, Luke H. Cashen

Research output: Contribution to journalArticlepeer-review

107 Scopus citations

Abstract

Although research has shown that individual job performance changes over time, the extent of such changes is unknown. In this article, the authors define and distinguish between the concepts of temporal consistency, stability, and test-retest reliability when considering individual job performance ratings over time. Furthermore, the authors examine measurement type (i.e., subjective and objective measures) and job complexity in relation to temporal consistency, stability, and test-retest reliability. On the basis of meta-analytic results, the authors found that the test-retest reliability of these ratings ranged from .83 for subjective measures in low-complexity jobs to .50 for objective measures in high-complexity jobs. The stability of these ratings over a 1-year time lag ranged from .85 to .67. The analyses also reveal that correlations between performance measures decreased as the time interval between performance measurements increased, but the estimates approached values greater than zero.

Original languageEnglish (US)
Pages (from-to)269-283
Number of pages15
JournalJournal of Applied Psychology
Volume90
Issue number2
DOIs
StatePublished - Mar 2005
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Applied Psychology

Fingerprint

Dive into the research topics of 'The impact of job complexity and performance measurement on the temporal consistency, stability, and test-retest reliability of employee job performance ratings'. Together they form a unique fingerprint.

Cite this