The Globus Compute Dataset

André Bauer, Haochen Pan, Ryan Chard, Yadu Babuji, Josh Bryan, Devesh Tiwari, Ian Foster, Kyle ChardZenodo 2023 · DOI · OpenAlex

Abstract

We present a unique function-as-a-service (FaaS) dataset capturing the use of the Globus Compute (previously funcX) platform. Globus Compute implements a federated model via which users may deploy endpoints on arbitrary remote computers, from the edge to high-performance computing (HPC) cluster, and they may then invoke Python functions on those endpoints via a reliable cloud-hosted service. The dataset covers 31 weeks and includes 2,121,472 task submissions from 252 users executed on 580remote computing endpoints. It includes 277,386 registered functions.
BibTeX
@inproceedings{bauer2023globus,
  author = {André Bauer and Haochen Pan and Ryan Chard and Yadu Babuji and Josh Bryan and Devesh Tiwari and Ian Foster and Kyle Chard and Ian T. Foster},
  title = {{The Globus Compute Dataset}},
  booktitle = {Zenodo},
  year = {2023},
  doi = {10.5281/zenodo.10044779},
}

Loading related content...

Figure