Middleware Building Blocks for Workflow Systems

Matteo Turilli, Vivek Balasubramanian, Andre Merzky, Ioannis Paraskevakos, Shantenu Jha

Research output: Contribution to journalArticle

1 Scopus citations

Abstract

This paper describes a building-block approach to the design of scientific workflow systems. We discuss RADICALCybertools as one implementation of building-block concept, showing how they are designed and developed in accordance with this approach. This paper offers three main contributions: (i) showing the relevance of the design principles underlying the building blocks approach to support scientific workflows on high performance computing platforms; (ii) illustrating a set of building blocks that enable multiple points of integration, unifying conceptual reasoning across otherwise very different tools and systems; and (iii) case studies discussing how RADICAL-Cybertools are integrated with existing workflow, workload, and general purpose computing systems, and used to develop domain-specific workflow systems.

Original languageEnglish (US)
Article number8726147
Pages (from-to)62-75
Number of pages14
JournalComputing in Science and Engineering
Volume21
Issue number4
DOIs
StatePublished - Jul 1 2019

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Engineering(all)

Fingerprint Dive into the research topics of 'Middleware Building Blocks for Workflow Systems'. Together they form a unique fingerprint.

  • Cite this

    Turilli, M., Balasubramanian, V., Merzky, A., Paraskevakos, I., & Jha, S. (2019). Middleware Building Blocks for Workflow Systems. Computing in Science and Engineering, 21(4), 62-75. [8726147]. https://doi.org/10.1109/MCSE.2019.2920048