Middleware Building Blocks for Workflow Systems

Matteo Turilli, Vivek Balasubramanian, Andre Merzky, Ioannis Paraskevakos, Shantenu Jha

Research output: Contribution to journalArticle

Abstract

This paper describes a building-block approach to the design of scientific workflow systems. We discuss RADICALCybertools as one implementation of building-block concept, showing how they are designed and developed in accordance with this approach. This paper offers three main contributions: (i) showing the relevance of the design principles underlying the building blocks approach to support scientific workflows on high performance computing platforms; (ii) illustrating a set of building blocks that enable multiple points of integration, unifying conceptual reasoning across otherwise very different tools and systems; and (iii) case studies discussing how RADICAL-Cybertools are integrated with existing workflow, workload, and general purpose computing systems, and used to develop domain-specific workflow systems.

Original languageEnglish (US)
Article number8726147
Pages (from-to)62-75
Number of pages14
JournalComputing in Science and Engineering
Volume21
Issue number4
DOIs
StatePublished - Jul 1 2019

Fingerprint

Middleware

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Engineering(all)

Cite this

Turilli, M., Balasubramanian, V., Merzky, A., Paraskevakos, I., & Jha, S. (2019). Middleware Building Blocks for Workflow Systems. Computing in Science and Engineering, 21(4), 62-75. [8726147]. https://doi.org/10.1109/MCSE.2019.2920048
Turilli, Matteo ; Balasubramanian, Vivek ; Merzky, Andre ; Paraskevakos, Ioannis ; Jha, Shantenu. / Middleware Building Blocks for Workflow Systems. In: Computing in Science and Engineering. 2019 ; Vol. 21, No. 4. pp. 62-75.
@article{17dd24e9beb1484c815259735a4a681b,
title = "Middleware Building Blocks for Workflow Systems",
abstract = "This paper describes a building-block approach to the design of scientific workflow systems. We discuss RADICALCybertools as one implementation of building-block concept, showing how they are designed and developed in accordance with this approach. This paper offers three main contributions: (i) showing the relevance of the design principles underlying the building blocks approach to support scientific workflows on high performance computing platforms; (ii) illustrating a set of building blocks that enable multiple points of integration, unifying conceptual reasoning across otherwise very different tools and systems; and (iii) case studies discussing how RADICAL-Cybertools are integrated with existing workflow, workload, and general purpose computing systems, and used to develop domain-specific workflow systems.",
author = "Matteo Turilli and Vivek Balasubramanian and Andre Merzky and Ioannis Paraskevakos and Shantenu Jha",
year = "2019",
month = "7",
day = "1",
doi = "10.1109/MCSE.2019.2920048",
language = "English (US)",
volume = "21",
pages = "62--75",
journal = "Computing in Science and Engineering",
issn = "1521-9615",
publisher = "IEEE Computer Society",
number = "4",

}

Turilli, M, Balasubramanian, V, Merzky, A, Paraskevakos, I & Jha, S 2019, 'Middleware Building Blocks for Workflow Systems', Computing in Science and Engineering, vol. 21, no. 4, 8726147, pp. 62-75. https://doi.org/10.1109/MCSE.2019.2920048

Middleware Building Blocks for Workflow Systems. / Turilli, Matteo; Balasubramanian, Vivek; Merzky, Andre; Paraskevakos, Ioannis; Jha, Shantenu.

In: Computing in Science and Engineering, Vol. 21, No. 4, 8726147, 01.07.2019, p. 62-75.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Middleware Building Blocks for Workflow Systems

AU - Turilli, Matteo

AU - Balasubramanian, Vivek

AU - Merzky, Andre

AU - Paraskevakos, Ioannis

AU - Jha, Shantenu

PY - 2019/7/1

Y1 - 2019/7/1

N2 - This paper describes a building-block approach to the design of scientific workflow systems. We discuss RADICALCybertools as one implementation of building-block concept, showing how they are designed and developed in accordance with this approach. This paper offers three main contributions: (i) showing the relevance of the design principles underlying the building blocks approach to support scientific workflows on high performance computing platforms; (ii) illustrating a set of building blocks that enable multiple points of integration, unifying conceptual reasoning across otherwise very different tools and systems; and (iii) case studies discussing how RADICAL-Cybertools are integrated with existing workflow, workload, and general purpose computing systems, and used to develop domain-specific workflow systems.

AB - This paper describes a building-block approach to the design of scientific workflow systems. We discuss RADICALCybertools as one implementation of building-block concept, showing how they are designed and developed in accordance with this approach. This paper offers three main contributions: (i) showing the relevance of the design principles underlying the building blocks approach to support scientific workflows on high performance computing platforms; (ii) illustrating a set of building blocks that enable multiple points of integration, unifying conceptual reasoning across otherwise very different tools and systems; and (iii) case studies discussing how RADICAL-Cybertools are integrated with existing workflow, workload, and general purpose computing systems, and used to develop domain-specific workflow systems.

UR - http://www.scopus.com/inward/record.url?scp=85066984077&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066984077&partnerID=8YFLogxK

U2 - 10.1109/MCSE.2019.2920048

DO - 10.1109/MCSE.2019.2920048

M3 - Article

AN - SCOPUS:85066984077

VL - 21

SP - 62

EP - 75

JO - Computing in Science and Engineering

JF - Computing in Science and Engineering

SN - 1521-9615

IS - 4

M1 - 8726147

ER -

Turilli M, Balasubramanian V, Merzky A, Paraskevakos I, Jha S. Middleware Building Blocks for Workflow Systems. Computing in Science and Engineering. 2019 Jul 1;21(4):62-75. 8726147. https://doi.org/10.1109/MCSE.2019.2920048