Unlocking the potential of publicly available microarray data using inSilicoDb and inSilicoMerging R/Bioconductor packages

Jonatan Taminau, Stijn Meganck, Cosmin Lazar, David Steenhoff, Alain Coletta, Colin Molter, Robin Duque, Virginie de Schaetzen, David Y. Weiss Solís, Hugues Bersini, Ann NowéBMC Bioinformatics 2012 · DOI

Abstract

By providing (i) access to uniformly curated and preprocessed data, (ii) a collection of techniques to remove the batch effects between data sets from different sources, and (iii) several validation tools enabling the inspection of the integration process, these packages enable researchers to fully explore the potential of combining gene expression data for downstream analysis. The power of using both packages is demonstrated by programmatically retrieving and integrating gene expression studies from the InSilico DB repository [https://insilicodb.org/app/].

Introduction: The Challenge of Batch Effects

The proliferation of public gene expression data in repositories like NCBI GEO offers immense opportunities for large-scale meta-analysis. However, integrating these datasets is frequently hindered by the "batch effect"—technical variation introduced by different laboratories, platforms, or experimental protocols. These effects often overshadow the underlying biological signals, leading to erroneous conclusions where samples cluster by study origin rather than biological condition. While various algorithms exist to mitigate these effects, their implementation across disparate programming environments and the need for extensive data reformatting create significant bottlenecks for researchers. The authors aim to turn this bottleneck into a streamlined, reproducible pipeline within the R/Bioconductor ecosystem.

Methods: A Unified Integration Pipeline

The authors introduce two synergistic R/Bioconductor packages to address these challenges:

  1. inSilicoDb: Provides a unified programmatic interface to a curated repository of over 6,000 datasets. It ensures consistent starting points by offering "expertly-curated" and uniformly preprocessed data.
  2. inSilicoMerging: Serves as the integration engine, implementing six major batch effect removal methods: COMBAT (Empirical Bayes), DWD (Distance-Weighted Discrimination), XPN (Cross-Platform Normalization), BMC (Batch Mean Centering), GENENORM (Z-score standardization), and a "NONE" baseline for comparison.

Crucially, inSilicoMerging includes validation tools, such as Multidimensional Scaling (MDS) and Relative Log Expression (RLE) plots, alongside quantitative indices like measureSamplesOverlap to verify the biological integrity of the integrated data. By adhering to the Bioconductor ExpressionSet format, the output is immediately compatible with hundreds of downstream analysis tools like limma.

Experimental Validation

The utility of these packages was demonstrated using two lung cancer datasets retrieved via inSilicoDb: GSE19804 (Affymetrix GPL570) and GSE10072 (Affymetrix GPL96). Both datasets contain a mix of normal and tumor samples, providing a clear biological ground truth for testing the integration process across different platforms.

Key Results

The integration process effectively "unlocked" the biological signal from technical noise. Multidimensional Scaling (MDS) plots revealed that before correction, samples clustered strictly by study (the batch). After applying the COMBAT method, the samples rearranged to cluster by disease state (Normal vs. Lung Cancer).

MDS plots showing the distribution of samples before (NONE) and after (COMBAT) batch effect removal.

Quantitative analysis using the measureSamplesOverlap metric confirmed these visual findings, showing a significant reduction in the distance between biologically similar samples from different studies, proving that the integration was mathematically sound.

Discussion and Limitations

While these tools significantly lower the barrier to meta-analysis, researchers must be mindful of the "common feature constraint." When merging across different platforms, the software must reduce the data to the shared genes or probes, which inherently leads to some data loss. Additionally, the authors acknowledge there is no single "silver bullet" method for every scenario; the choice of algorithm (e.g., COMBAT vs. DWD) still requires researcher discretion. However, the inclusion of robust validation tools makes this choice much easier to justify and verify.

Summary updated

BibTeX
@article{taminau2012unlocking,
  author = {Jonatan Taminau and Stijn Meganck and Cosmin Lazar and David Steenhoff and Alain Coletta and Colin Molter and Robin Duque and Virginie de Schaetzen and David Y. Weiss Solís and Hugues Bersini and Ann Nowé},
  title = {{Unlocking the potential of publicly available microarray data using inSilicoDb and inSilicoMerging R/Bioconductor packages}},
  journal = {BMC Bioinformatics},
  year = {2012},
  doi = {10.1186/1471-2105-13-335},
}
Figure