CRISPR-GPT for agentic automation of gene-editing experiments

Yuanhao Qu, Kaixuan Huang, Ming Yin, Kehui Zhan, Dengcai Liu, Di Yin, Henry C. Cousins, William A. Johnson, Xiaotong Wang, Mihir Shah, Russ B. Altman, Denny Zhou, Mengdi Wang, Le Cong

TL;DR

This paper introduces CRISPR-GPT, an AI system that acts as a "co-pilot" for gene-editing experiments. By combining large language models (LLMs) with domain-specific knowledge and tools, CRISPR-GPT automates and streamlines the complex process of designing and analyzing gene-editing experiments, making advanced techniques more accessible.

What Problem Does This Paper Address?

Gene editing, particularly with CRISPR technology, is a powerful tool for biological research and medicine. However, successfully designing and executing these experiments requires a deep understanding of both the CRISPR system and the specific biological context. This complexity, coupled with the inherent variability of biological systems and the specialized nature of the field, creates a steep learning curve, especially for newcomers. While general-purpose LLMs have shown promise in various domains, they often lack the nuanced, domain-specific knowledge needed to tackle intricate biological design problems. This paper addresses the challenge of bridging this knowledge gap and automating the gene-editing workflow, from initial experimental design to data analysis.

Methods

CRISPR-GPT is built upon a multi-agent architecture, leveraging LLMs for reasoning and task execution. Key components include:

  • LLM Planner: Decomposes user requests into a sequence of tasks and builds a customized workflow.
  • Task Executor: Implements the planned workflow by managing state machines for each task.
  • User Proxy Agent: Facilitates human-AI interaction, guiding users through the process and incorporating their feedback.
  • Tool Providers: Integrate external tools and APIs for tasks like web searches, literature retrieval, and bioinformatic analyses (e.g., Primer3, CRISPRitz, CRISPResso2).

The system incorporates several novel approaches:

  • Retrieval-Augmented Generation (RAG): Combines LLM reasoning with information retrieved from a curated database of gene-editing literature and protocols.
  • Fine-tuned LLM (CRISPR-Llama): A specialized LLM trained on discussions from a CRISPR-focused Google Group, enhancing its ability to answer advanced biological questions and brainstorm ideas.
  • Chain-of-Thought Reasoning: Enables the LLM to break down complex problems into logical steps.
  • "Chain-of-Table" Methodology: For tasks like gRNA design, where LLMs process structured data tables.
  • Exon Suggestion Module: For gRNA design, this module suggests functionally important exons to target, improving the likelihood of successful gene editing.
  • Safety Mechanisms: Implemented to mitigate risks associated with dual-use technologies and protect sensitive patient data.

Datasets

  • Gene-editing bench: A newly introduced benchmark dataset comprising 288 test cases covering gene-editing planning, gRNA design, delivery method selection, and Q&A. This dataset was curated from public sources and human experts.
  • CRISPR-focused Google Group discussions: Approximately 4,000 discussion threads from 11 years of online forums were used to fine-tune the CRISPR-Llama model.
  • Curated CRISPR literature database: Approximately 50 key papers were selected for RAG.

Key Insights and Ideas

  • LLMs as "Co-pilots": The paper demonstrates that LLMs can effectively act as intelligent assistants, guiding researchers through complex scientific workflows, rather than just providing information.
  • Domain-Specific Fine-tuning is Crucial: General-purpose LLMs struggle with the nuances of gene editing. Fine-tuning with domain-specific data (like scientific discussions) significantly improves performance.
  • Multi-Agent Systems Enhance Functionality: Breaking down the complex gene-editing process into specialized agents (planner, executor, tool providers) allows for more robust and modular system design.
  • Bridging the Gap for Novice Researchers: CRISPR-GPT has the potential to democratize gene editing by providing accessible, step-by-step guidance, enabling less experienced researchers to perform sophisticated experiments.
  • Ethical Considerations are Paramount: The system incorporates safeguards against misuse and privacy breaches, highlighting the importance of responsible AI development in sensitive scientific fields.

Key Results

  • Performance Outperforms Baselines: CRISPR-GPT consistently outperformed general-purpose LLMs (GPT-3.5-turbo, GPT-40) in various tasks, including experiment planning (accuracy >0.99), gRNA design, delivery method selection, and Q&A.
  • Successful Wet-Lab Demonstrations: CRISPR-GPT guided junior researchers to successfully perform:
  • A multi-gene knockout of four genes (TGFBR1, SNAI1, BAX, BCL2L1) using CRISPR-Cas12a with high editing efficiencies (~80%).
  • Epigenetic activation of two genes (NCR3LG1, CEACAM1) using CRISPR-dCas9 with efficiencies up to 90.2%.
  • Human Expert Evaluation: Experts rated CRISPR-GPT highly for accuracy, reasoning, completeness, and conciseness, noting its ability to perform actions and provide detailed guidance without hallucination.
  • Efficiency Gains: The system streamlines experiment design and analysis, potentially reducing the time and effort required for complex gene-editing projects.

Limitations and Future Work

  • Data Dependency: The system's performance relies on high-quality instructions and discussion data from human experts, which can be challenging to collect and scale.
  • Complex/Rare Cases: CRISPR-GPT may struggle with highly complex requests or rare biological scenarios.
  • gRNA Design Expansion: The current gRNA design module primarily supports human and mouse targets and could be expanded.
  • Dynamic Task Management: The LLM Planner currently does not dynamically add or delete tasks during execution, which is a potential area for future development.
  • Integration with Automation: Future work could involve integrating CRISPR-GPT with automated laboratory platforms and robotics for end-to-end automated experiments.
  • Broader Applications: The framework could be extended to other scientific domains by connecting to new foundation models and tools.

Summary updated

Abstract

Performing effective gene-editing experiments requires a deep understanding of both the CRISPR technology and the biological system involved. Meanwhile, despite their versatility and promise, large language models (LLMs) often lack domain-specific knowledge and struggle to accurately solve biological design problems. We present CRISPR-GPT, an LLM agent system to automate and enhance CRISPR-based gene-editing design and data analysis. CRISPR-GPT leverages the reasoning capabilities of LLMs for complex task decomposition, decision-making and interactive human-artificial intelligence (AI) collaboration. This system incorporates domain expertise, retrieval techniques, external tools and a specialized LLM fine tuned with open-forum discussions among scientists. CRISPR-GPT assists users in selecting CRISPR systems, experiment planning, designing guide RNAs, choosing delivery methods, drafting protocols, designing assays and analysing data. We showcase the potential of CRISPR-GPT by knocking out four genes with CRISPR-Cas12a in a human lung adenocarcinoma cell line and epigenetically activating two genes using CRISPR-dCas9 in a human melanoma cell line. CRISPR-GPT enables fully AI-guided gene-editing experiment design and analysis across different modalities, validating its effectiveness as an AI co-pilot in genome engineering.
BibTeX
@inproceedings{qu2025crispr,
  author = {Yuanhao Qu and Kaixuan Huang and Ming Yin and Kehui Zhan and Dengcai Liu and Di Yin and Henry C. Cousins and William A. Johnson and Xiaotong Wang and Mihir Shah and Russ B. Altman and Denny Zhou and Mengdi Wang and Le Cong},
  title = {{CRISPR-GPT for agentic automation of gene-editing experiments}},
  booktitle = {Nature Biomedical Engineering},
  year = {2025},
  doi = {10.1038/s41551-025-01463-z},
}
Figure