TL;DR
The Chinese Virtual Observatory (China-VO) has developed AstroCloud, a comprehensive platform designed to manage the entire lifecycle of astronomical data, from proposal submission to data analysis and public outreach. This paper details their experiences and lessons learned in building this platform, highlighting its role in democratizing access to vast astronomical datasets and fostering a collaborative research environment.
What Problem Does This Paper Address?
Modern astronomical instruments and sky surveys are generating an unprecedented volume of data, reaching terabytes and even petabytes. This "big data" challenge makes it impossible for individual astronomers to download and analyze this information on their personal computers. To address this, there's a growing need for online science platforms that allow analysis to be performed close to the data. The paper discusses the development of such a platform, the Chinese Virtual Observatory (China-VO) and its AstroCloud system, aiming to provide a unified environment for astronomical research, education, and public engagement.
Methods
The AstroCloud platform is built on a distributed cloud storage layer, integrating third-party cloud resources like CSTCloud and Alibaba Cloud. It employs virtualization and cloud computing technologies for uniform management of distributed storage, data, and computing resources. Key functionalities include:
- Telescope Proposal Submission and Peer Review: An online system to manage the entire process from proposal submission to time allocation and notification.
- Data Archiving and Management: A system for standardizing and quality controlling observational data, storing metadata alongside the data.
- Data Access and Interoperability: A bridge connecting data resources on the cloud with users, supporting IVOA protocols for seamless data access and analysis.
- PaperData Service: A VOSpace-based service for researchers to publish scientific papers with integrated DOI services, ensuring data persistence and discoverability.
- Cloud Computing, Teaching, and Training: Providing virtual machines and templates for data analysis, university courses, and data science competitions.
- Data-driven Astronomy Education and Public Outreach (DAEPO): Initiatives like the Popular Supernova Project and localization of the WorldWide Telescope to engage the public.
Datasets
The paper mentions several large astronomical surveys and telescopes whose data is managed or utilized by the China-VO AstroCloud platform, including:
- Sloan Digital Sky Survey (SDSS)
- Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST)
- Gaia
- Transiting Exoplanet Survey Satellite (TESS)
- Square Kilometre Array (SKA)
- Five-hundred-meter Aperture Spherical radio Telescope (FAST)
- Large Synoptic Survey Telescope (LSST)
- Euclid
- Wide-Field Infrared Survey Telescope (WFIRST)
The platform also uses real observational astronomical data sets for data mining algorithm competitions.
Key Insights and Ideas
- The necessity of a full life-cycle management platform: Astronomy is moving towards an era where data is too large to download, necessitating platforms that handle everything from data acquisition to analysis and dissemination.
- Democratizing access to astronomical data: China-VO's AstroCloud aims to make vast datasets accessible to a broad range of users, including professional astronomers, amateur astronomers, students, and the public.
- The importance of interoperability: Adhering to FAIR principles (Findable, Accessible, Interoperable, Reusable) and supporting IVOA protocols are crucial for seamless data sharing and analysis across different platforms.
- Bridging the gap between research and public engagement: Initiatives like citizen science projects and data-driven education programs are vital for fostering broader interest and participation in astronomy.
- The evolving role of cloud computing: Cloud platforms are essential for handling the massive computational demands of modern astronomical data analysis, moving from offline to online research models.
Key Results
By the end of 2019, AstroCloud had served over 20,000 registered users, including more than 3,100 professional astronomers. It received over 10 million visits, serviced nearly 4.1 million searches, and facilitated more than 20 million scientific data downloads. The platform supports data services for major Chinese astronomical facilities like LAMOST and FAST. The Popular Supernova Project, a citizen science initiative, successfully identified 27 new supernova and extragalactic nova candidates, with 15 supernovae and four extragalactic novae confirmed.
Limitations and Future Work
The paper identifies two key challenges for operating a global science platform network in the next decade:
- Single Sign-On (SSO) and Interconnection: Achieving seamless authentication and interconnection among different science platforms is crucial for a truly integrated VO. China-VO is working on improving its SSO capabilities beyond its current CSTCloud passport.
- Challenges brought by mobile internet: Current VO and e-science platforms are primarily designed for PC users. The community needs to develop mobile apps and integrate mobile internet and IoT technologies to address the "last-kilometer problem" and connect a broader range of users and smart telescopes.
Future work will focus on updating the platform to handle increasing data volumes and technological advancements, including the establishment of the National Astronomical Data Center of China (NADC). The NADC aims to fuse resources for one-stop services, extending AstroCloud's capabilities for full life-cycle management and open sharing of astronomical data.
Summary updated