A communal catalogue reveals Earth’s multiscale microbial diversity

Luke Thompson, Jon G. Sanders, Daniel McDonald, Amnon Amir, Joshua Ladau, Kenneth J. Locey, Robert J. Prill, Anupriya Tripathi, Sean M. Gibbons, Gail Ackermann, José A. Navas-Molina, Stefan Janssen, Evguenia Kopylova, Yoshiki Vázquez‐Baeza, Antonio González, James T. Morton, Siavash Mirarab, Zhenjiang Zech Xu, Lingjing Jiang, Mohamed Fauzi Haroon, Jad Kanbar, Qiyun Zhu, Se Jin Song, Tomasz Kościółek, Nicholas A. Bokulich, Joshua Lefler, Colin Brislawn, Gregory Humphrey, Sarah M. Owens, Jarrad Hampton‐Marcell, Donna Berg-Lyons, Valerie J. McKenzie, Noah Fierer, Jed A. Fuhrman, Aaron Clauset, Rick Stevens, Ashley Shade, Katherine S. Pollard, Kelly D. Goodwin, Janet Jansson, Jack A. Gilbert, Rob Knight, Jose L. Agosto Rivera, Lisa Al-Moosawi, John C. Alverdy, Katherine R. Amato, Jason Andras, Largus T. Angenent, Dionysios A. Antonopoulos, Amy Apprill, David Armitage, Kate A. Ballantine, Jiří Bárta, Julia K. Baum, Allison Berry, Ashish Bhatnagar, Monica Bhatnagar, Jennifer F. Biddle, Lucie Bittner, Bazartseren Boldgiv, Eric Bottos, Donal M. Boyer, Jonathan Braun, William J. Brazelton, Francis Q. Brearley, Alexandra H. Campbell, J. Gregory Caporaso, César Cardona, JoLynn Carroll, S. Craig Cary, Brenda B. Casper, Trevor C. Charles, Haiyan Chu, Danielle C. Claar, Robert G. Clark, Jonathan B. Clayton, José C. Clemente, Alyssa T. Cochran, Maureen L. Coleman, Gavin Collins, Rita R. Colwell, Mónica Contreras, Benjamin B. Crary, Simon Creer, Daniel A. Cristol, Byron C. Crump, Duoying Cui, Sarah E. Daly, Liliana M. Dávalos, Russell D. Dawson, Jennifer R. DeFazio, Frédéric Delsuc, Hebe M. Dionisi, Maria Gloria Domínguez-Bello, Robin D. Dowell, Eric A. Dubinsky, Peter O. Dunn, Danilo Ercolini, Robert E. Espinoza, Vanessa O. EzenwaNature 2017 · DOI

Abstract

Our growing awareness of the microbial world's importance and diversity contrasts starkly with our limited understanding of its fundamental structure. Despite recent advances in DNA sequencing, a lack of standardized protocols and common analytical frameworks impedes comparisons among studies, hindering the development of global inferences about microbial life on Earth. Here we present a meta-analysis of microbial community samples collected by hundreds of researchers for the Earth Microbiome Project. Coordinated protocols and new analytical methods, particularly the use of exact sequences instead of clustered operational taxonomic units, enable bacterial and archaeal ribosomal RNA gene sequences to be followed across multiple studies and allow us to explore patterns of diversity at an unprecedented scale. The result is both a reference database giving global context to DNA sequence data and a framework for incorporating data from future studies, fostering increasingly complete characterization of Earth's microbial diversity.

Introduction

Microbial ecology has historically been fragmented. While thousands of studies have explored diverse microbiomes—from deep-sea vents to the human gut—they rarely utilize the same methodologies. Variations in DNA extraction, sequencing primers, and analytical pipelines make cross-study comparisons nearly impossible. Consequently, a "planetary-scale" view of microbial life and the fundamental ecological laws governing microbial distribution has remained elusive.

The Earth Microbiome Project (EMP) addresses this by establishing a global, collaborative framework to standardize the sampling, sequencing, and analysis of microbial communities. This effort has produced a massive, standardized catalogue of the planet’s microbial life, spanning over 27,000 samples across seven continents.

Methods and Classification

The EMP’s success is built on two pillars: standardization and high-resolution sequencing. All samples were processed using standardized DNA extraction kits and sequenced on the Illumina platform targeting the V4 region of the 16S rRNA gene.

Crucially, the project moved away from traditional "fuzzy" clustering of Operational Taxonomic Units (OTUs). Instead, it employs Deblur, a reference-free method to identify exact "tag sequences." These exact sequences serve as stable identifiers, allowing for direct comparison across different studies without the need for re-clustering. To organize this data, the team developed the Earth Microbiome Project Ontology (EMPO), a hierarchical system categorizing samples by host-association and salinity.

Figure 4: Global distribution of EMP samples and the hierarchical EMPO classification system.

Datasets

The meta-analysis encompasses 97 independent studies, totaling 27,751 samples and 2.2 billion sequence reads. These samples represent 43 countries and 92 distinct environmental features. Benchmarking against established databases like Greengenes and SILVA revealed that nearly half of the EMP sequences were novel, highlighting the vast amount of "microbial dark matter" yet to be fully characterized.

Key Insights and Results

The analysis reveals that host association is the primary determinant of microbial community structure. Generally, free-living environments (e.g., soil, water) exhibit higher diversity than host-associated ones, with the notable exception of plant rhizospheres. Furthermore, microbial communities appear "nested," where specialized microbiomes (like the human gut) often represent filtered subsets of more diverse environmental pools.

Machine learning models (Random Forest classifiers) demonstrated high predictive power. Based solely on microbial composition, the researchers could distinguish between animal-associated, plant-associated, saline, and non-saline samples with 91% accuracy. Fine-scale environmental identification reached 84% accuracy.

Figure 6: Principal Coordinates Analysis (PCoA) showing the clustering of microbial communities by environment.

Discussion and Future Directions

While the EMP represents a significant leap forward, it is not exhaustive. Geographic gaps remain, particularly across extreme chemical and physical gradients. The project's utility is also tied to the quality of metadata provided by contributors. Future work aims to expand beyond bacteria and archaea to include eukaryotes and viruses, and to integrate multi-omics data to move from cataloging "who is there" to understanding "what they are doing." Despite these limitations, the EMP provides a scalable framework and a reference database that gives global context to all future microbial sequence data.

Summary updated

Abstract

Our growing awareness of the microbial world's importance and diversity contrasts starkly with our limited understanding of its fundamental structure. Despite recent advances in DNA sequencing, a lack of standardized protocols and common analytical frameworks impedes comparisons among studies, hindering the development of global inferences about microbial life on Earth. Here we present a meta-analysis of microbial community samples collected by hundreds of researchers for the Earth Microbiome Project. Coordinated protocols and new analytical methods, particularly the use of exact sequences instead of clustered operational taxonomic units, enable bacterial and archaeal ribosomal RNA gene sequences to be followed across multiple studies and allow us to explore patterns of diversity at an unprecedented scale. The result is both a reference database giving global context to DNA sequence data and a framework for incorporating data from future studies, fostering increasingly complete characterization of Earth's microbial diversity.
BibTeX
@inproceedings{thompson2017communal,
  author = {Luke Thompson and Jon G. Sanders and Daniel McDonald and Amnon Amir and Joshua Ladau and Kenneth J. Locey and Robert J. Prill and Anupriya Tripathi and Sean M. Gibbons and Gail Ackermann and José A. Navas-Molina and Stefan Janssen and Evguenia Kopylova and Yoshiki Vázquez‐Baeza and Antonio González and James T. Morton and Siavash Mirarab and Zhenjiang Zech Xu and Lingjing Jiang and Mohamed Fauzi Haroon and Jad Kanbar and Qiyun Zhu and Se Jin Song and Tomasz Kościółek and Nicholas A. Bokulich and Joshua Lefler and Colin Brislawn and Gregory Humphrey and Sarah M. Owens and Jarrad Hampton‐Marcell and Donna Berg-Lyons and Valerie J. McKenzie and Noah Fierer and Jed A. Fuhrman and Aaron Clauset and Rick Stevens and Ashley Shade and Katherine S. Pollard and Kelly D. Goodwin and Janet Jansson and Jack A. Gilbert and Rob Knight and Jose L. Agosto Rivera and Lisa Al-Moosawi and John C. Alverdy and Katherine R. Amato and Jason Andras and Largus T. Angenent and Dionysios A. Antonopoulos and Amy Apprill and David Armitage and Kate A. Ballantine and Jiří Bárta and Julia K. Baum and Allison Berry and Ashish Bhatnagar and Monica Bhatnagar and Jennifer F. Biddle and Lucie Bittner and Bazartseren Boldgiv and Eric Bottos and Donal M. Boyer and Jonathan Braun and William J. Brazelton and Francis Q. Brearley and Alexandra H. Campbell and J. Gregory Caporaso and César Cardona and JoLynn Carroll and S. Craig Cary and Brenda B. Casper and Trevor C. Charles and Haiyan Chu and Danielle C. Claar and Robert G. Clark and Jonathan B. Clayton and José C. Clemente and Alyssa T. Cochran and Maureen L. Coleman and Gavin Collins and Rita R. Colwell and Mónica Contreras and Benjamin B. Crary and Simon Creer and Daniel A. Cristol and Byron C. Crump and Duoying Cui and Sarah E. Daly and Liliana M. Dávalos and Russell D. Dawson and Jennifer R. DeFazio and Frédéric Delsuc and Hebe M. Dionisi and Maria Gloria Domínguez-Bello and Robin D. Dowell and Eric A. Dubinsky and Peter O. Dunn and Danilo Ercolini and Robert E. Espinoza and Vanessa O. Ezenwa},
  title = {{A communal catalogue reveals Earth’s multiscale microbial diversity}},
  booktitle = {Nature},
  year = {2017},
  doi = {10.1038/nature24621},
}
Figure