The Ghost of Performance Reproducibility Past

Srinivasan Ramesh, Mikhail Titov, Matteo Turilli, Shantenu Jha, Allen Malony

Research output: Chapter in Book/Report/Conference proceedingConference contribution


The importance of ensemble computing is well established. However, executing ensembles at scale introduces interesting performance fluctuations that have not been well investigated. In this paper, we trace our experience uncovering performance fluctuations of ensemble applications (primarily constituting a workflow of GROMACS tasks), and unsuccessful attempts, so far, at trying to discern the underlying cause(s) of performance fluctuations. Is the failure to discern the causative or contributing factors a failure of capability? Or imagination? Do the fluctuations have their genesis in some inscrutable aspect of the system or software? Does it warrant a fundamental reassessment and rethinking of how we assume and conceptualize performance reproducibility? Answers to these questions are not straightforward, nor are they immediate or obvious. We conclude with a discussion about the performance of ensemble applications and ruminate over the implications for how we define and measure application performance.

Original languageEnglish (US)
Title of host publicationProceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages6
ISBN (Electronic)9781665461245
StatePublished - 2022
Externally publishedYes
Event18th IEEE International Conference on e-Science, eScience 2022 - Salt Lake City, United States
Duration: Oct 10 2022Oct 14 2022

Publication series

NameProceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022


Conference18th IEEE International Conference on e-Science, eScience 2022
Country/TerritoryUnited States
CitySalt Lake City

All Science Journal Classification (ASJC) codes

  • Library and Information Sciences
  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Science Applications
  • Signal Processing
  • Modeling and Simulation
  • Instrumentation


  • ensembles
  • monitoring
  • performance
  • reproducibility


Dive into the research topics of 'The Ghost of Performance Reproducibility Past'. Together they form a unique fingerprint.

Cite this