MLExchange: A web-based platform enabling exchangeable machine learning workflows for scientific studies

Zhuowen Zhao, Tanny Chávez, Elizabeth Holman, Guanhua Hao, Adam Green, Harinarayan Krishnan, Dylan McReynolds, Ronald Pandolfi, Eric J. Roberts, Petrus H. Zwart, Howard Yanxon, Nicholas Schwarz, Subramanian Sankaranarayanan, Sergei V. Kalinin, Apurva Mehta, Stuart Campbel, Alexander HexemerarXiv 2022 · DOI · arXiv

TL;DR

This paper introduces MLExchange, a web-based platform designed to democratize the use of machine learning (ML) for scientific research. It addresses the complexity and programmatic demands of existing ML tools by providing an accessible, collaborative environment for scientists to manage, exchange, and deploy ML workflows and algorithms, regardless of their ML expertise.

What Problem Does This Paper Address?

Scientific user facilities, like those funded by the Department of Energy, generate massive amounts of data (petabytes annually) that are crucial for understanding complex scientific phenomena. While machine learning offers powerful tools to analyze this data, its adoption by domain scientists is hindered by several factors:

  • High Barrier to Entry: Most ML tools require significant programming skills and a deep understanding of ML concepts, which many scientists lack.
  • Data Modality: Scientific data is often multimodal (images, spectra) and requires interactive visualization for effective ML analysis.
  • Resource Management: Coordinating complex data analyses and optimizing the use of experimental and computational resources is challenging.

Existing MLOps tools like MLflow address some aspects, but a comprehensive solution tailored for scientific workflows and user accessibility was missing.

Methods

MLExchange is built as a modular, containerized platform with five core components:

  • Job Manager: A central scheduler that orchestrates job execution, allocates computational resources (CPU/GPU), and manages workflows. It uses constraint programming for worker scheduling.
  • Content Registry: Stores specifications and pointers to ML models, applications, workflows, and assets (metadata). It allows users to register, manage, and retrieve these components.
  • User Portal: Handles user authentication, authorization, and management, employing attribute-based access control (ABAC) for flexible policy enforcement across different user groups.
  • Search Engine: Utilizes Elasticsearch for fast content searching and includes a reverse image search pipeline for finding similar images based on deep neural networks.
  • Data Connector (under development): Aims to provide secure data transfer capabilities using technologies like SFTP, SCP, and Globus.

The platform's design emphasizes modularity (components can be deployed independently), scalability (accommodating large user bases and growing applications), and versatile deployment (run on personal devices to HPC clusters). A key feature is the adaptive GUI, where ML model parameter layouts are automatically generated based on keywords defined in the content registry, eliminating the need to modify frontend application code when new algorithms are added.

Datasets

The paper does not explicitly list specific datasets used for training or evaluation of the MLExchange platform itself. However, it mentions that the platform is designed to handle scientific data from various sources, including experimental and simulated data from Department of Energy user facilities. The use cases described involve image segmentation and image labeling, implying the use of relevant image datasets for these tasks.

Key Insights and Ideas

  • Democratizing ML for Science: The core idea is to abstract away the complexity of ML tools, making them accessible to scientists who are experts in their domain but not necessarily in computer science or ML engineering.
  • Containerization for Flexibility: Using containers (like Docker) for all components allows for easy deployment, scalability, and independent updates, enabling users to run the platform or its services locally or remotely.
  • Content Registry as a Knowledge Hub: Centralizing ML models, workflows, and applications in a registry facilitates sharing, discovery, and reuse within the scientific community.
  • Adaptive GUIs for Seamless Integration: Automatically generating user interfaces based on content specifications significantly lowers the barrier for integrating new ML algorithms into existing workflows.
  • Attribute-Based Access Control for Granular Permissions: The ABAC system allows for fine-grained control over access to resources and content, catering to diverse user roles and community structures.

Key Results

The paper focuses on the architecture and capabilities of MLExchange rather than presenting quantitative performance metrics for specific ML tasks. However, it highlights the successful integration of two use cases:

  • Image Segmentation: A workflow adapted from Dash Enterprise App Gallery, allowing interactive data upload, model selection (e.g., Random Forests, MSDNets), and segmentation.
  • Image Labeling: A pipeline involving three standalone applications (Label Maker, Data Clinic, MLCoach) that streamline manual and ML-assisted labeling of large datasets, leveraging self-supervised and supervised learning approaches.

The platform's design enables users to execute workflows with a single job request and adapt ML model parameters without code modification.

Limitations and Future Work

  • Data Connector Under Development: The data connector, crucial for secure data transfer, is still under development.
  • Limited Use Cases Presented: While the platform is designed for any scientific application, only two specific use cases (image segmentation and labeling) are detailed.
  • Future Work: The authors plan to focus on optimizing user experience, completing data pipelines, supporting more container technologies, and incorporating additional use cases for scientific research. They also aim to further enhance the platform's deployability and accessibility.

Summary updated

Abstract

Machine learning (ML) algorithms are showing a growing trend in helping the scientific communities across different disciplines and institutions to address large and diverse data problems. However, many available ML tools are programmatically demanding and computationally costly. The MLExchange project aims to build a collaborative platform equipped with enabling tools that allow scientists and facility users who do not have a profound ML background to use ML and computational resources in scientific discovery. At the high level, we are targeting a full user experience where managing and exchanging ML algorithms, workflows, and data are readily available through web applications. Since each component is an independent container, the whole platform or its individual service(s) can be easily deployed at servers of different scales, ranging from a personal device (laptop, smart phone, etc.) to high performance clusters (HPC) accessed (simultaneously) by many users. Thus, MLExchange renders flexible using scenarios -- users could either access the services and resources from a remote server or run the whole platform or its individual service(s) within their local network.
BibTeX
@misc{zhao2022mlexchange,
  author = {Zhuowen Zhao and Tanny Chávez and Elizabeth Holman and Guanhua Hao and Adam Green and Harinarayan Krishnan and Dylan McReynolds and Ronald Pandolfi and Eric J. Roberts and Petrus H. Zwart and Howard Yanxon and Nicholas Schwarz and Subramanian Sankaranarayanan and Sergei V. Kalinin and Apurva Mehta and Stuart Campbel and Alexander Hexemer},
  title = {{MLExchange: A web-based platform enabling exchangeable machine learning workflows for scientific studies}},
  year = {2022},
  eprint = {2208.09751},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2208.09751},
}
Figure