Data-Driven Network Neuroscience: On Data Collection and Benchmark

David Tse Jung Huang, Sophi Shilpa Gururajapathy, Yiping Ke, Miao Qiao, Alan Wang, Haribalan Kumar, Yunhan Yang

TL;DR

This paper addresses the critical lack of accessible, high-quality functional brain network data for machine learning research by releasing a comprehensive dataset derived from multiple MRI sources. They provide a standardized pipeline for converting raw fMRI data into brain network graphs, along with benchmark results to facilitate future data-driven neuroscience studies.

What Problem Does This Paper Address?

The field of network neuroscience, which models the brain as a graph of interconnected regions, holds immense promise for understanding and diagnosing neurological conditions like Alzheimer's, Parkinson's, and Autism. However, a major bottleneck is the scarcity of readily available, processed brain network datasets. Transforming raw MRI scans into these graph representations is a complex, multi-step process requiring specialized domain knowledge and significant computational resources. This complexity, coupled with variations in preprocessing pipelines and parcellation strategies, makes it difficult for researchers to conduct reproducible, data-driven studies. This paper aims to bridge this gap by providing a unified, high-quality dataset and a transparent preprocessing pipeline.

Methods

The authors developed a comprehensive pipeline to convert raw resting-state functional MRI (rs-fMRI) images into brain network datasets. This pipeline involves several key stages:

  • Data Collection and Selection: They gathered data from six public and private sources, focusing on rs-fMRI and T1w images, ensuring quality and validity.
  • BIDS Conversion: Raw DICOM images were converted into the Brain Imaging Data Structure (BIDS) format for standardization and reproducibility.
  • fMRIPrep Preprocessing: The state-of-the-art fMRIPrep pipeline was employed for robust preprocessing, including motion correction, normalization, and noise reduction. This step is computationally intensive and requires careful quality control.
  • Parcellation: Preprocessed fMRI data was parcellated into Regions of Interest (ROIs) using various methods, including atlas-based (AAL, Harvard-Oxford, Schaefer) and clustering-based (k-means, Ward) approaches. This step defines the nodes of the brain network graph.
  • Brain Network Extraction: Connectivity matrices (edges) were computed based on the co-activation of ROIs (nodes), primarily using Pearson correlation. Node features were derived from aggregated BOLD signals within each ROI.

The authors emphasize their collaboration with domain experts to make informed design choices throughout this pipeline.

Datasets

The paper introduces a new, comprehensive collection of functional brain network data. The datasets originate from:

  • ABIDE: Autism Brain Imaging Data Exchange (N=1025)
  • ADNI: Alzheimer's Disease Neuroimaging Initiative (N=1327)
  • PPMI: Parkinson's Progression Markers Initiative (N=209)
  • Mātai: A new dataset from the Mātai Medical Research Institute (N=60)
  • TaoWu: (N=40)
  • Neurocon: (N=41)

In total, the collection comprises 2,702 subjects across 4 brain conditions (Autism, Alzheimer's, Parkinson's, and mTBI). The data is made publicly available via a DOI and a GitHub repository containing the preprocessing code.

Key Insights and Ideas

  • The critical need for standardized, high-quality brain network data: The paper highlights how the complexity of fMRI preprocessing and network construction has hindered data-driven research in network neuroscience. Their work directly addresses this by providing a unified dataset and pipeline.
  • The impact of parcellation strategies: The study demonstrates that different parcellation methods can significantly influence the resulting brain network structure and subsequent classification performance. Atlas-based methods generally outperformed clustering-based ones in their experiments.
  • The value of functional brain networks for disease classification: By benchmarking their dataset against various machine learning models, the authors show that these brain networks provide valuable information for distinguishing between healthy individuals and those with neurological conditions.
  • The computational cost of robust preprocessing: The paper acknowledges the significant computational resources required for pipelines like fMRIPrep, underscoring the importance of shared datasets and tools.

Key Results

  • The authors successfully created a large collection of functional brain network datasets from six diverse sources, covering four neurological conditions and totaling 2,702 subjects.
  • They tested their datasets on 12 machine learning models (6 conventional ML and 6 graph ML) and a recent graph analysis model, providing baseline performance metrics.
  • Classification Accuracy:
    • On conventional ML models, accuracy generally ranged from 60% to 70%, with atlas-based parcellations (AAL, HO, Schaefer) often yielding better results. Logistic Regression (LR) and Support Vector Machines (SVC) performed well.
  • Graph ML models showed promise, with some outperforming conventional methods on certain datasets.
  • Models based solely on BOLD time series signals performed significantly worse than those using brain networks, validating the utility of the network representation.
  • Ordinal Regression: Logistic Ordinal Regression (LOR) did not consistently outperform standard Logistic Regression (LR) for ordered classification tasks, potentially due to class imbalance in the datasets.
  • Data Quality Validation: Using a graph analysis approach (CS-P1) on the ABIDE dataset, their processed brain networks yielded comparable results to those reported in prior studies, confirming the quality of their data.
  • Sensitivity Analysis: The number of ROIs (nodes) in the parcellation significantly impacts performance, with 100 or 200 ROIs often providing the best results. Larger training set sizes (higher k in k-fold CV) consistently improved performance.

Limitations and Future Work

  • Dataset Size: While large, the current collection of 2,702 subjects may still be considered small for certain deep learning models due to high computational costs. The authors plan to continuously enrich the collection.
  • Single Modality: The current dataset focuses solely on functional MRI. Future work will involve integrating diffusion MRI data to create multi-modal brain networks, which can capture a more comprehensive picture of brain function and connectivity.
  • Class Imbalance: The ADNI and PPMI datasets exhibit skewed class distributions, which may have impacted the performance of ordinal regression models. Further research into handling class imbalance is suggested.

Summary updated

Abstract

This paper presents a comprehensive and quality collection of functional human brain network data for potential research in the intersection of neuroscience, machine learning, and graph analytics. Anatomical and functional MRI images of the brain have been used to understand the functional connectivity of the human brain and are particularly important in identifying underlying neurodegenerative conditions such as Alzheimer's, Parkinson's, and Autism. Recently, the study of the brain in the form of brain networks using machine learning and graph analytics has become increasingly popular, especially to predict the early onset of these conditions. A brain network, represented as a graph, retains richer structural and positional information that traditional examination methods are unable to capture. However, the lack of brain network data transformed from functional MRI images prevents researchers from data-driven explorations. One of the main difficulties lies in the complicated domain-specific preprocessing steps and the exhaustive computation required to convert data from MRI images into brain networks. We bridge this gap by collecting a large amount of available MRI images from existing studies, working with domain experts to make sensible design choices, and preprocessing the MRI images to produce a collection of brain network datasets. The datasets originate from 5 different sources, cover 3 neurodegenerative conditions, and consist of a total of 2,642 subjects. We test our graph datasets on 5 machine learning models commonly used in neuroscience and on a recent graph-based analysis model to validate the data quality and to provide domain baselines. To lower the barrier to entry and promote the research in this interdisciplinary field, we release our brain network data https://doi.org/10.17608/k6.auckland.21397377 and complete preprocessing details including codes.
BibTeX
@inproceedings{huang2023data,
  author = {David Tse Jung Huang and Sophi Shilpa Gururajapathy and Yiping Ke and Miao Qiao and Alan Wang and Haribalan Kumar and Yunhan Yang},
  title = {{Data-Driven Network Neuroscience: On Data Collection and Benchmark}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2023},
  url = {https://openreview.net/forum?id=vZf7jrX1el},
}
Figure