POPcorn: An Online Resource Providing Access to Distributed and Diverse Maize Project Data

Ethalinda K. S. Cannon, Scott M. Birkett, Bremen L. Braun, Sateesh Kumar Kodavali, Douglas M. Jennewein, Alper Yılmaz, Valentin Antonescu, Corina Antonescu, Lisa Harper, Jack M. Gardiner, Mary Schaeffer, Darwin A. Campbell, Carson M. Andorf, Destri Andorf, Damon Lisch, Karen E. Koch, Donald R. McCarty, John Quackenbush, Erich Grotewold, Carol Lushbough, Taner Z. Sen, Carolyn J. LawrenceInternational Journal of Plant Genomics 2011 · DOI

TL;DR

This paper introduces POPcorn, a web-based portal designed to centralize and improve access to the vast and often fragmented landscape of maize genetic and genomic data. By providing a unified search interface and leveraging web services, POPcorn simplifies the discovery of research projects, facilitates sequence-based data retrieval across distributed resources, and aids in the long-term preservation of valuable data.

What Problem Does This Paper Address?

The explosion of maize genomics research, fueled by initiatives like the National Science Foundation's Plant Genome Research Program (PGRP), has led to a proliferation of independent online resources. This abundance, while beneficial, creates significant challenges for researchers:

  • Discoverability: It's difficult to find all relevant projects and their associated data.
  • Accessibility: Each resource often has unique search tools, requiring researchers to learn multiple interfaces.
  • Interoperability: Combining data or results from different sites is cumbersome.
  • Sustainability: Project websites can degrade or disappear over time, leading to data loss, especially when funding ends.

These issues make it hard for researchers to stay current, efficiently find the information they need, and leverage the full potential of the maize genomics community's collective output.

Methods

POPcorn employs a multi-pronged approach to address these challenges:

  • Centralized Project Catalog: A hand-curated database of maize research projects and resources is maintained, updated monthly, and accessible via a project search feature. This allows researchers to find ongoing work and relevant tools.
  • Sequence-Indexed Data Search: This core functionality uses web services to perform sequence-based searches (like BLAST) across multiple distributed online resources simultaneously. This bypasses the need for keyword searches and overcomes the challenge of disparate terminology across different databases.
  • Web Services Integration: POPcorn heavily relies on web services (e.g., NCBI's eUtils, wwwBLAST, PlantGDB's BioExtract) to access and query data from external databases. This allows for dynamic data retrieval without extensive local data warehousing.
  • Automated Link Verification: A daily script checks the status of all web services and links listed in the POPcorn database to ensure reliability and report issues.
  • Workflow Implementation: "Hard-coded" workflows are implemented for common multi-step tasks, such as finding mutant seed stocks associated with a gene of interest.
  • Data Migration Tools (ZeAlign): A tool is provided to help researchers prepare sequence-indexed data for migration to MaizeGDB, the long-term model organism database.

Datasets

POPcorn does not primarily host its own research data. Instead, it acts as an aggregator and access point to data housed in numerous external databases and resources. These include:

  • MaizeGDB (primary target for data migration)
  • NCBI databases (PubMed, GenBank, GSS, EST)
  • GRASSIUS
  • Gramene
  • MaizeSequence.org
  • DFCI
  • Plant Genomics MAGIs
  • PLEXdb
  • PlantGDB
  • Photosynthesis Mutant Library (PML)
  • Phytozome
  • UniformMu, Ac/Ds, and TILLING project data (for mutant seed stocks and associated information)

Key Insights and Ideas

  • Sequence as the Universal Key: Recognizing that sequence data is a common and robust feature across diverse biological datasets, POPcorn prioritizes sequence-based queries over keyword or classification searches. This simplifies cross-resource searching and avoids issues with inconsistent terminology.
  • Leveraging Existing Technologies: Instead of developing entirely new technologies, POPcorn focuses on effectively integrating existing web services and standards (like RDF and OWL, though not extensively used due to limitations) to achieve its goals.
  • Addressing Data Longevity: The project acknowledges the critical issue of data loss when research projects conclude and provides tools and a pathway (via MaizeGDB) for long-term data preservation.
  • The Value of Hand-Curation: While automated processes are used, the initial population and ongoing maintenance of the project and resource descriptions rely on human curation, ensuring a higher level of accuracy and relevance.

Key Results

  • POPcorn provides access to descriptions of 109 projects and 133 resources.
  • The "Sequence-Indexed Data Search" utility allows researchers to perform simultaneous BLAST searches against 44 different BLAST targets (as of the paper's writing).
  • The system successfully integrates data from numerous external databases, demonstrating the feasibility of a unified search portal.
  • A practical example demonstrates how a researcher can use POPcorn to quickly identify relevant publications and mutant seed stocks for a gene of interest, saving significant time and effort.
  • The platform is designed to be maintained by MaizeGDB personnel, ensuring its continued availability and integration with existing maize resources.

Limitations and Future Work

  • Limited User-Designed Workflows: Due to the project's short timeframe, the ability for users to design their own custom workflows was not implemented; instead, pre-defined workflows for common tasks were created.
  • Reliance on External Web Services: POPcorn's functionality is dependent on the availability and stability of external web services, over which it has little control. Issues with these services can impact POPcorn's performance.
  • GUI Complexity: While efforts are being made to improve the graphical user interface (GUI), some users still require assistance to perform searches, indicating a potential area for further refinement.

Future work includes:

  • Integrating POPcorn's features (especially the sequence-indexed data search) directly into the MaizeGDB website.
  • Continuously adding new project and resource records as the maize research landscape evolves.
  • Expanding the BLAST target databases and sequence-indexed data search capabilities.
  • Collaborating with researchers to ensure the logical steps for deploying new sequence-indexed data searches are correct.
  • Improving the GUI based on user feedback.

Summary updated

Abstract

The purpose of the online resource presented here, POPcorn (Project Portal for corn), is to enhance accessibility of maize genetic and genomic resources for plant biologists. Currently, many online locations are difficult to find, some are best searched independently, and individual project websites often degrade over time-sometimes disappearing entirely. The POPcorn site makes available (1) a centralized, web-accessible resource to search and browse descriptions of ongoing maize genomics projects, (2) a single, stand-alone tool that uses web Services and minimal data warehousing to search for sequence matches in online resources of diverse offsite projects, and (3) a set of tools that enables researchers to migrate their data to the long-term model organism database for maize genetic and genomic information: MaizeGDB. Examples demonstrating POPcorn's utility are provided herein.
BibTeX
@article{cannon2011popcorn,
  author = {Ethalinda K. S. Cannon and Scott M. Birkett and Bremen L. Braun and Sateesh Kumar Kodavali and Douglas M. Jennewein and Alper Yılmaz and Valentin Antonescu and Corina Antonescu and Lisa Harper and Jack M. Gardiner and Mary Schaeffer and Darwin A. Campbell and Carson M. Andorf and Destri Andorf and Damon Lisch and Karen E. Koch and Donald R. McCarty and John Quackenbush and Erich Grotewold and Carol Lushbough and Taner Z. Sen and Carolyn J. Lawrence},
  title = {{POPcorn: An Online Resource Providing Access to Distributed and Diverse Maize Project Data}},
  journal = {International Journal of Plant Genomics},
  year = {2011},
  doi = {10.1155/2011/923035},
}
Figure