TL;DR
Hiplot is a new, comprehensive, and user-friendly web service that simplifies the creation of publication-ready visualizations for complex biomedical data. It addresses the current gap in omics-focused platforms by offering over 230 interactive visualization tools, making advanced data analysis accessible to researchers without extensive programming skills.
What Problem Does This Paper Address?
Biomedical research generates vast amounts of complex data from clinical studies, omics experiments, and other sources. Visualizing this data is crucial for interpretation, reproducibility, and discovery. However, existing web-based bioinformatics services often fall short in providing robust, publication-quality visualization tools, especially for omics data. While some platforms offer basic visualization plugins, they lack the depth, interactivity, and ease of use required by biologists and clinicians who may not have strong bioinformatics or biostatistics backgrounds. This creates a bottleneck for researchers trying to generate compelling figures for their publications and conduct interactive data mining.
Methods
Hiplot tackles this challenge by offering a comprehensive suite of over 230 visualization plugins built on modern web technologies. Key methodological aspects include:
- User-Friendly Interface: Developed using Vue.js and Vuetify.js, Hiplot provides a consistent and intuitive user experience with a two-column layout for easy navigation and interaction.
- Interactive Spreadsheet Editor: A novel feature for large-scale biomedical visualization services, allowing users to preview, import, and edit tabular data directly within the web interface.
- JSON-Based Plugin System: This system enables dynamic deployment of new plugins and supports both the web client and a cross-platform command-line interface (CLI) program called Hctl. Plugins are structured with Meta JSON (metadata), UI JSON (interface components), and Data JSON (default parameters and demo data).
- Plumber-Based Task Response: For R-based web plugins, a plumber-based strategy is employed to significantly reduce the time for generating basic graphics by pre-loading dependencies and environments, allowing for near-instantaneous results for many tasks.
- Cross-Platform CLI (Hctl): A Go-based command-line tool that allows users to perform visualizations in different environments, enhancing reproducibility and workflow integration.
- Reproducibility Features: Users can conveniently reproduce past analyses by saving and loading task parameters as JSON files, and the system provides logging for debugging.
- Scalable Infrastructure: Built on high-performance computing nodes with substantial storage and memory, Hiplot can handle large datasets and numerous concurrent users.
Datasets
The paper demonstrates Hiplot's functionality using both demo datasets and real-world biomedical data. Specific examples mentioned include:
- Iris dataset: Used to showcase dimensionality reduction visualization.
- Lung dataset: Utilized for demonstrating predictive risk scores in survival analysis.
- TCGA (The Cancer Genome Atlas) database: Used for exploring gene expression and mutation data in various cancer types.
- UCSC Xena data hubs: Data from these hubs are integrated and visualized through applications like UCSCXenaShiny.
- BCP-ALL (B-cell precursor acute lymphoblastic leukemia) variants data: Used to validate fusion gene and chromosomal abnormality analyses.
The paper does not introduce new benchmarks but rather leverages existing public datasets to showcase the capabilities of Hiplot.
Key Insights and Ideas
- Democratizing Advanced Visualization: Hiplot significantly lowers the barrier to entry for complex data visualization, empowering researchers who lack specialized programming skills to generate publication-quality figures.
- Comprehensive Functionality: The sheer number and diversity of plugins (over 230) covering basic graphics, omics, clinical data, and machine learning approaches make Hiplot a one-stop shop for many visualization needs.
- Integrated Workflow: The combination of a user-friendly web interface, an interactive spreadsheet editor, and a powerful CLI (Hctl) provides flexibility for different user preferences and integration into existing pipelines.
- Speed and Efficiency: The plumber-based response strategy for R plugins dramatically speeds up the generation of basic graphics, a critical factor for interactive data exploration.
- Community-Driven Development: The Hiplot Consortium's collaborative approach fosters continuous development and expansion of the platform's capabilities.
Key Results
- Extensive Plugin Library: Hiplot offers over 230 interactive visualization plugins, significantly more than comparable services like ImageGP (16) and Galaxy (60+).
- High User Engagement: Since its launch, Hiplot has attracted over 2.5 million visits from 100 countries, with an average of 5,000 visits and 3,000 task submissions per day. Over 22,000 user accounts have been registered.
- Popularity of Key Plugins: Plugins like "heatmap" have been visited over 70,000 times, indicating strong demand for core visualization functionalities.
- Comparable to Commercial Software: The quality of visualizations is noted to be comparable to commercial desktop software like GraphPad.
- Reduced Task Time: The plumber-based strategy allows basic graphics to be completed in seconds, a significant improvement over traditional methods.
Limitations and Future Work
- Workflow Editor Support: The paper notes that the setup of tasks using a workflow editor is not yet supported, though it is considered feasible for future integration.
- Shiny/Streamlit Plugin Error Reproduction: The authors acknowledge that reproducing errors in Shiny- and Streamlite-based plugins remains challenging.
- Future Integration: The authors express interest in building a Galaxy-like interface for better workflow-based integration if there is strong user demand.
- Continuous Development: The website is under daily updates, indicating an ongoing development cycle with potential for further enhancements and new plugins.
Summary updated