Investigation of cell development and tissue structure network based on natural Language processing of scRNA-seq data

Suwen Wei, Yuer Lu, Peng Wang, Qing Li, Jianwei Shuai, Qi Zhao, Hai Lin, Yuming PengJournal of Translational Medicine 2025 · DOI

Abstract

This method offers a computationally efficient approach for analyzing scRNA-seq data by constructing embedding representations similar to those used in large language model pre-training, but without requiring high-performance computing clusters. By generating gene embeddings that capture functional relationships, this method facilitates the study of cell development trajectories, the impact of gene perturbations, cell clustering, and the construction and analysis of tissue networks. This provides a valuable tool for single-cell data analysis.

Introduction

Single-cell RNA sequencing (scRNA-seq) provides high-dimensional data about gene expression at the individual cell level. To interpret this data, researchers typically rely on dimensionality reduction methods like PCA, t-SNE, and UMAP. However, these traditional approaches often focus on geometric or statistical distances, potentially missing deeper "semantic" biological relationships, such as complex gene regulatory networks or continuous branching trajectories of cell development.

While large language models (LLMs) have recently been applied to capture these relationships, they require massive computational resources. This paper introduces a lightweight natural language processing (NLP) approach that treats genes as "words" and cells as "sentences," providing a computationally accessible solution for capturing functional biological relationships.

Methodology

The authors adapted a classic NLP pipeline for bioinformatics, as illustrated in the workflow below:

Overview of the NLP-based scRNA-seq analysis workflow, including gene text matrix generation, Word2Vec embedding, and downstream applications.
  1. Gene Co-expression Network: Cosine similarity between gene expression profiles is calculated to build a network where nodes are genes and edges represent expression similarity.
  2. Random Walks: Random walks on this network generate sequences of genes, or "sentences," capturing local and global functional associations.
  3. Word2Vec Embeddings: These sequences are processed by a Continuous Bag-of-Words (CBOW) Word2Vec model to generate 100-dimensional vector embeddings for each gene.
  4. Hierarchical Aggregation: Cell representations are calculated as weighted sums of gene vectors, and tissue representations are formed by summing the constituent cell vectors.
  5. Downstream Analysis: These vectors enable UMAP visualization (NLP-UMAP), in silico gene perturbation, and tissue network construction.

Datasets

The model was validated across four distinct datasets:

  • Human Embryonic Stem Cells (EBs): 16,825 cells used for trajectory and perturbation analysis.
  • Zebrafish Embryos (ZE): 38,309 cells covering 12 differentiation stages.
  • Fetal Kidney Dataset: 21,452 cells used for baseline tissue network construction.
  • Human Lung Cancer Dataset: 49 clinical biopsies from 30 patients used for disease tissue network analysis.

Results and Discussion

Superior Visualization and Trajectory Mapping

Compared to standard PCA and UMAP, the NLP-UMAP method more clearly revealed continuous, branching trajectories of embryonic cell differentiation. By treating biology as a language, the algorithm learns functional relationships based on co-occurrence; genes that frequently appear together in random walks are embedded closer together, capturing semantic biological meaning.

In Silico Gene Perturbation

The model allows for the simulation of genetic knockouts or overexpressions through vector arithmetic. By scaling or zeroing a specific gene's vector and recalculating the cell's position in latent space, researchers can predict alterations in developmental trajectories.

Visualization of simulated gene perturbation effects on cell developmental trajectories, showing the shift in cell states.

In the EB dataset, perturbing key transcription factors (up-regulating OTX2 and down-regulating POU5F1) successfully shifted simulated trajectories toward the expected anterior neuroectoderm state, demonstrating the model's ability to capture multi-gene synergistic effects.

Patient-Specific Disease Networks and Efficiency

In the lung cancer dataset, tissue-level vectors successfully grouped patients with similar genetic profiles and isolated specific oncogenic mutations. Notably, the model is highly efficient; processing the ~16,000-cell EB dataset took only 38 minutes on a standard consumer laptop.

Conclusion and Future Work

This NLP-based framework provides a unified, multi-scale approach to studying biological systems from single genes to patient-level tumor heterogeneity. While Word2Vec is highly efficient, its shallow architecture has limitations in capturing long-range dependencies compared to modern Transformer-based models. Future work may involve incorporating attention mechanisms to better capture long-range regulatory relationships while maintaining the model's lightweight and accessible nature.

Summary updated

Abstract

This method offers a computationally efficient approach for analyzing scRNA-seq data by constructing embedding representations similar to those used in large language model pre-training, but without requiring high-performance computing clusters. By generating gene embeddings that capture functional relationships, this method facilitates the study of cell development trajectories, the impact of gene perturbations, cell clustering, and the construction and analysis of tissue networks. This provides a valuable tool for single-cell data analysis.
BibTeX
@article{wei2025investigation,
  author = {Suwen Wei and Yuer Lu and Peng Wang and Qing Li and Jianwei Shuai and Qi Zhao and Hai Lin and Yuming Peng},
  title = {{Investigation of cell development and tissue structure network based on natural Language processing of scRNA-seq data}},
  journal = {Journal of Translational Medicine},
  year = {2025},
  doi = {10.1186/s12967-025-06263-2},
}
Figure