Identifying Genomic Islands with Deep Neural Networks

Rida Assaf, Fangfang Xia, Rick StevensbioRxiv 2019 · DOI

TL;DR

This paper introduces "Shutter Island," a novel method for identifying genomic islands (GIs) in bacterial genomes using deep learning and a computer vision approach. By transforming genomic data into images and leveraging transfer learning with a pre-trained Inception V3 model, Shutter Island achieves superior generalization and identifies novel GIs, addressing the limitations of existing tools in this challenging field.

What Problem Does This Paper Address?

Bacteria are highly adaptable, largely due to horizontal gene transfer (HGT), where they acquire genetic material from other organisms. This process often results in the formation of "genomic islands" (GIs) – clusters of genes that can confer new traits like antibiotic resistance or virulence. Accurately identifying these GIs is crucial for understanding bacterial evolution, disease mechanisms, and developing new medical interventions. However, existing computational methods for GI detection are limited; they often specialize in specific types of GIs, struggle with generalization across diverse bacterial lineages, and are hampered by the scarcity of comprehensive, verified datasets. This paper aims to overcome these limitations by developing a more robust and generalizable GI detection method.

Methods

The core innovation of Shutter Island lies in its use of deep learning, specifically a transfer learning approach applied to image representations of genomic data.

  • Image Representation: Instead of traditional sequence analysis, the authors convert genomic fragments into images. This is achieved by using a "compare region viewer" service that aligns a query genome with related genomes, visualizing gene relationships, functionality, and strand directionality through colored arrows. Gaps in these alignments, representing non-conserved regions, are interpreted as potential GIs.
  • Transfer Learning: They leverage Google's Inception V3 neural network, a powerful model pre-trained on the massive ImageNet dataset for computer vision tasks. This pre-trained model is then fine-tuned on a custom dataset of genomic "images" representing GIs. This transfer learning strategy allows the model to benefit from general feature extraction capabilities learned from millions of images, even with a relatively smaller, specialized dataset for GIs.
  • Image Generation: For training and prediction, the authors generate images for every non-overlapping 10 kbp window in a genome. A length filter of 8 kbp is then applied to group predicted gene clusters into larger GIs.

Datasets

  • Training Data: The authors utilized the PATRIC (Pathosystems Resource Integration Center) database, which contains a large collection of bacterial genomes. They generated images for each 10 kbp window. To create a reliable training set, they labeled genomic fragments as GIs only if they were predicted as such by both Phispy and IslandViewer, aiming for higher confidence.
  • Evaluation Data: The primary evaluation dataset consisted of 34 bacterial genomes. This set was curated from the 41 bacterial genomes originally used by the Phispy study, excluding those for which not all comparison tools reported predictions or those that were part of the training set.

Key Insights and Ideas

  • Visualizing Genomics: Representing genomic data as images is a powerful way to leverage computer vision techniques for biological problems, especially when dealing with complex relationships and patterns that are hard to capture with traditional tabular data.
  • Transfer Learning for Data Scarcity: The success of Shutter Island highlights the effectiveness of transfer learning in fields with limited, curated datasets. By repurposing models trained on vast generic datasets, researchers can achieve high performance on specialized tasks without needing massive amounts of labeled data for the target domain.
  • Generalization is Key: The paper emphasizes that no single existing tool can detect all types of GIs. Shutter Island's ability to generalize and identify novel GIs, even those not predicted by other tools, is a significant advancement.
  • Image-Based Features: The image representation implicitly captures many important GI features, such as sporadic distribution, sequence composition differences (via color coding and alignment patterns), and the presence of mobile element genes (indicated by specific arrow colors).

Key Results

  • Superior Generalization: Shutter Island demonstrated superior generalization compared to existing tools, particularly in identifying GIs that were predicted by other methods. It achieved a high overlap with predictions from tools like Phage Finder and Phaster, despite not being explicitly trained on their specific outputs.
  • Novel Predictions: The method made a significant number of novel GI predictions (280 unique GIs) that were not identified by other tools, with 65% of these unique predictions showing GI features.
  • Performance Metrics: In terms of sensitivity (True Positive Rate), Shutter Island achieved 92.4%, second only to Alien Hunter (91.8%) but with a significantly lower false positive rate (29% vs. 50.7%).
  • Qualitative Assessment: Analysis of Shutter Island's unique predictions revealed that the included genes frequently had annotations related to mobile elements, hypothetical proteins, or other GI-associated functions, supporting the validity of these novel predictions.

Limitations and Future Work

  • Dataset Limitations: While the authors created a more reliable training set by requiring consensus predictions, the inherent scarcity of experimentally verified GI ground-truth data remains a challenge for all GI detection methods.
  • Computational Cost: Deep learning models, while powerful, can be computationally intensive. The paper mentions that improvements in algorithms are ongoing.
  • Future Work: The authors suggest that this image-based transfer learning approach could be applied to other biological problems where data is scarce or difficult to curate. Further refinement of the image generation process and exploration of different deep learning architectures could also yield improvements.

Summary updated

Abstract

Abstract Background Horizontal gene transfer is the main source of adaptability for bacteria, through which genes are obtained from different sources including bacteria, archaea, viruses, and eukaryotes. This process promotes the rapid spread of genetic information across lineages, typically in the form of clusters of genes referred to as genomic islands (GIs). Different types of GIs exist, often classified by the content of their cargo genes or their means of integration and mobility. Various computational methods have been devised to detect different types of GIs, but no single method currently is capable of detecting all GIs. Results We propose a method, which we call Shutter Island, that uses a deep learning model (Inception V3, widely used in computer vision) to detect genomic islands. The intrinsic value of deep learning methods lies in their ability to generalize. Via a technique called transfer learning, the model is pre-trained on a large generic dataset and then re-trained on images that we generate to represent genomic fragments. We demonstrate that this image-based approach generalizes better than the existing tools. Conclusions We used a deep neural network and an image-based approach to detect the most out of the correct GI predictions made by other tools, in addition to making novel GI predictions. The fact that the deep neural network was retrained on only a limited number of GI datasets and then successfully generalized indicates that this approach could be applied to other problems in the field where data is still lacking or hard to curate.
BibTeX
@misc{assaf2019identifying,
  author = {Rida Assaf and Fangfang Xia and Rick Stevens},
  title = {{Identifying Genomic Islands with Deep Neural Networks}},
  year = {2019},
  doi = {10.1101/525030},
  howpublished = {bioRxiv},
}
Figure