TL;DR
This paper introduces scROSHI, a novel method for identifying cell types in single-cell RNA sequencing data that bypasses the need for labeled training data. By leveraging pre-defined cell type-specific gene lists and a hierarchical classification approach, scROSHI achieves robust and accurate cell typing, outperforming existing methods, especially in scenarios with limited or diverse training data.
What Problem Does This Paper Address?
Single-cell transcriptomics has revolutionized biological research, enabling the creation of detailed "atlases" of cells within tissues. A crucial step in this process is cell type annotation – identifying what each cell is. Traditionally, this relies on machine learning models trained on large datasets with known cell type labels. However, this approach faces several challenges:
- Data Scarcity: In early-stage research or when studying novel biological systems, labeled training data is often unavailable or insufficient.
- Overfitting: Training and testing models on data from the same experimental conditions can lead to an overestimation of performance, as models learn condition-specific biases rather than generalizable features. This is particularly problematic when applying models to data from different experiments or labs.
- Complexity of Cell Types: Distinguishing between closely related cell types (e.g., developing or precursor cells) is difficult, and the sheer number of potential cell types can increase misclassification rates.
The authors aim to overcome these limitations by developing a method that is less reliant on extensive, perfectly matched training data and can better handle biological complexity.
Methods
scROSHI (robust supervised hierarchical identification of single cells) is built on three core components:
- Cell Type-Specific Gene Lists: Instead of learning features from scratch, scROSHI utilizes pre-existing, validated lists of genes known to be highly expressed in specific cell types. The key is that these lists are based on gene names, not their expression levels, making the method less susceptible to variations in experimental conditions.
- Hierarchical Classification: scROSHI doesn't try to classify cells into all possible types at once. Instead, it follows a "family tree" approach, first assigning cells to broad "major types" and then progressively refining these assignments to more specific "subtypes" within those branches. This reduces the complexity at each step and helps differentiate closely related cell types.
- Quantitative and Robust Scoring: For each cell and each candidate cell type, scROSHI compares the expression of the cell type-specific genes against the expression of genes from other cell types. It uses the Mann-Whitney rank sum test to compare the ranks of gene expression, providing a robust score that is less sensitive to outliers and doesn't require data normalization. The negative log of the p-value from this test serves as a measure of how well a cell matches a given cell type.
scROSHI also incorporates "unknown" and "uncertain" labels to explicitly account for classification uncertainty, flagging cells that may represent novel types or require further investigation.
Datasets
The study utilized three publicly available peripheral blood mononuclear cell (PBMC) datasets for benchmarking:
- Zheng_sorted set: An adult human dataset where cell types were pre-sorted.
- Adult set: An adult human dataset.
- Newborn set: A newborn human dataset.
These datasets were chosen to represent similar cell type compositions but differ in experimental settings and donor age, allowing for evaluation of inter-dataset performance. The authors also mention using curated gene lists from previous studies, such as the immune cell type gene lists (Im22) and resources for single-cell melanoma data.
Key Insights and Ideas
- Leveraging Prior Knowledge is Powerful: The success of scROSHI highlights that well-curated, prior knowledge (in the form of gene lists) can be more robust than learning from scratch, especially when dealing with data variability.
- Hierarchy Reduces Complexity: The hierarchical approach is a smart way to tackle the combinatorial explosion of cell types. By breaking down the problem, it makes classification more tractable and accurate, particularly for distinguishing similar cell types.
- Robustness to Data Variability: By relying on gene ranks rather than absolute expression values, scROSHI is inherently more resistant to batch effects and variations in experimental protocols, a major advantage in multi-dataset analyses.
- Explicit Uncertainty Handling: The "unknown" and "uncertain" labels are not just placeholders; they are crucial for identifying potential novel cell types and flagging cells that don't fit neatly into predefined categories, guiding further research.
Key Results
- Superior Performance in Challenging Scenarios: scROSHI consistently outperformed supervised methods (SVM, Random Forest, GARNETT) when trained on data different from the test set (inter-dataset evaluation). This was particularly evident when the training and test datasets were diverse.
- High Accuracy: For intra-dataset evaluation (training and testing on the same data), scROSHI performed comparably to supervised methods. For major cell types, accuracies ranged from 0.715 to 0.952 across datasets.
- Low "Unknown" Cell Fraction: Even in challenging datasets like the Zheng set, scROSHI maintained a low percentage of "unknown" cells (below 10%), whereas ML-based methods often had significantly higher fractions, indicating they couldn't confidently assign labels.
- Efficiency: The method is computationally efficient, classifying 2000 cells with 3368 genes into 11 cell types in under 35 seconds using 6 GB RAM on a standard laptop.
Limitations and Future Work
- Dependence on Gene Lists: The performance of scROSHI is directly dependent on the quality and completeness of the provided cell type-specific gene lists. If a relevant cell type is missing from the lists, it may be misclassified or labeled as "unknown."
- Future Work: The authors suggest that scROSHI is applicable to various data modalities and organisms, provided appropriate gene lists are available. They also note that while the current implementation is for tumor samples, it has no inherent limitations for other applications. The ability to identify "unexpected" cell types by removing them from the candidate list is a promising direction for discovering novel cell populations.
Summary updated