Delivering Rules-Based Workflows for Science

David Marchant; Mark Blomqvist; Philip Jensen; Iben Lilholm; Martin Nørgaard

doi:10.1145/3624062.3624279

Delivering Rules-Based Workflows for Science

David Marchant, Mark Blomqvist, Philip Jensen, Iben Lilholm, Martin Nørgaard

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Abstract

Rules-based workflow scheduling is a recently developed method for constructing an analysis structure, in a far more dynamic manner than traditional graph based systems. However, rules-based workflows are still in their relative infancy and lack the breadth of features available in traditional scientific workflow systems. This paper will address some of these missing features by introducing the new meow-base library for generic construction of rules-based systems while meeting the requirements of a scientific workflow management system. It will also present two example workflows, showing how rules-based systems can better enable analysis loops or human-in-the-loop interactions than more traditional workflow systems.

Original language	English
Title of host publication	Proceedings of 2023 SC Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023
Publisher	Association for Computing Machinery, Inc.
Publication date	2023
Pages	2000-2008
ISBN (Electronic)	9798400707858
DOIs	https://doi.org/10.1145/3624062.3624279
Publication status	Published - 2023
Event	2023 International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023 - Denver, United States Duration: 12 Nov 2023 → 17 Nov 2023

Conference

Conference	2023 International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023
Country/Territory	United States
City	Denver
Period	12/11/2023 → 17/11/2023
Sponsor	ACM's Special Interest Group on High Performance Computing (SIGHPC), Association for Computing Machinery, IEEE�s Technical Committee on High Performance Computing (TCHPC), Institute of Electrical and Electronics Engineers (IEEE) Computer Society

Series	ACM International Conference Proceeding Series

Bibliographical note

Publisher Copyright:
© 2023 ACM.

Keywords

BIDS
Heterogeneous
MEOW
Rules-based
Workflows

Access to Document

10.1145/3624062.3624279

Cite this

Marchant, D., Blomqvist, M., Jensen, P., Lilholm, I., & Nørgaard, M. (2023). Delivering Rules-Based Workflows for Science. In Proceedings of 2023 SC Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023 (pp. 2000-2008). Association for Computing Machinery, Inc.. ACM International Conference Proceeding Series https://doi.org/10.1145/3624062.3624279

Delivering Rules-Based Workflows for Science. / Marchant, David; Blomqvist, Mark; Jensen, Philip ; Lilholm, Iben ; Nørgaard, Martin.

Proceedings of 2023 SC Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023. Association for Computing Machinery, Inc., 2023. p. 2000-2008 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Marchant, D, Blomqvist, M, Jensen, P , Lilholm, I & Nørgaard, M 2023, Delivering Rules-Based Workflows for Science. in Proceedings of 2023 SC Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023. Association for Computing Machinery, Inc., ACM International Conference Proceeding Series, pp. 2000-2008, 2023 International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023, Denver, United States, 12/11/2023. https://doi.org/10.1145/3624062.3624279

Marchant D, Blomqvist M, Jensen P , Lilholm I , Nørgaard M. Delivering Rules-Based Workflows for Science. In Proceedings of 2023 SC Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023. Association for Computing Machinery, Inc. 2023. p. 2000-2008. (ACM International Conference Proceeding Series). https://doi.org/10.1145/3624062.3624279

Marchant, David ; Blomqvist, Mark ; Jensen, Philip ; Lilholm, Iben ; Nørgaard, Martin. / Delivering Rules-Based Workflows for Science. Proceedings of 2023 SC Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023. Association for Computing Machinery, Inc., 2023. pp. 2000-2008 (ACM International Conference Proceeding Series).

@inproceedings{5368c545672f4f268d456941cc462c3f,

title = "Delivering Rules-Based Workflows for Science",

abstract = "Rules-based workflow scheduling is a recently developed method for constructing an analysis structure, in a far more dynamic manner than traditional graph based systems. However, rules-based workflows are still in their relative infancy and lack the breadth of features available in traditional scientific workflow systems. This paper will address some of these missing features by introducing the new meow-base library for generic construction of rules-based systems while meeting the requirements of a scientific workflow management system. It will also present two example workflows, showing how rules-based systems can better enable analysis loops or human-in-the-loop interactions than more traditional workflow systems.",

keywords = "BIDS, Heterogeneous, MEOW, Rules-based, Workflows",

author = "David Marchant and Mark Blomqvist and Philip Jensen and Iben Lilholm and Martin N{\o}rgaard",

note = "Publisher Copyright: {\textcopyright} 2023 ACM.; 2023 International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023 ; Conference date: 12-11-2023 Through 17-11-2023",

year = "2023",

doi = "10.1145/3624062.3624279",

language = "English",

series = "ACM International Conference Proceeding Series",

pages = "2000--2008",

booktitle = "Proceedings of 2023 SC Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023",

publisher = "Association for Computing Machinery, Inc.",

}

TY - GEN

T1 - Delivering Rules-Based Workflows for Science

AU - Marchant, David

AU - Blomqvist, Mark

AU - Jensen, Philip

AU - Lilholm, Iben

AU - Nørgaard, Martin

PY - 2023

Y1 - 2023

N2 - Rules-based workflow scheduling is a recently developed method for constructing an analysis structure, in a far more dynamic manner than traditional graph based systems. However, rules-based workflows are still in their relative infancy and lack the breadth of features available in traditional scientific workflow systems. This paper will address some of these missing features by introducing the new meow-base library for generic construction of rules-based systems while meeting the requirements of a scientific workflow management system. It will also present two example workflows, showing how rules-based systems can better enable analysis loops or human-in-the-loop interactions than more traditional workflow systems.

AB - Rules-based workflow scheduling is a recently developed method for constructing an analysis structure, in a far more dynamic manner than traditional graph based systems. However, rules-based workflows are still in their relative infancy and lack the breadth of features available in traditional scientific workflow systems. This paper will address some of these missing features by introducing the new meow-base library for generic construction of rules-based systems while meeting the requirements of a scientific workflow management system. It will also present two example workflows, showing how rules-based systems can better enable analysis loops or human-in-the-loop interactions than more traditional workflow systems.

KW - BIDS

KW - Heterogeneous

KW - MEOW

KW - Rules-based

KW - Workflows

U2 - 10.1145/3624062.3624279

DO - 10.1145/3624062.3624279

M3 - Article in proceedings

AN - SCOPUS:85178108526

T3 - ACM International Conference Proceeding Series

SP - 2000

EP - 2008

BT - Proceedings of 2023 SC Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023

PB - Association for Computing Machinery, Inc.

T2 - 2023 International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023

Y2 - 12 November 2023 through 17 November 2023

ER -