TL;DR
This paper describes the development and implementation of the World Data Center for Geophysics, Beijing's (WDCG-BJ) online geophysics database. It highlights the transition from simple HTML-based services to a dynamic, user-friendly web portal utilizing modern technologies like JSP, Oracle, and Apache, making vast amounts of geophysical data accessible to researchers globally.
What Problem Does This Paper Address?
The paper addresses the growing need for accessible and organized geophysical data for scientific research. Historically, geophysical data was stored in various formats, often paper-based or on localized digital media, making it difficult to access, share, and analyze. The authors recognized that with the advent of the internet and advancements in database technology, a centralized, online repository was crucial to facilitate scientific progress in geophysics. This would allow researchers to easily query, download, and utilize data for a wide range of applications, from understanding Earth's processes to national defense and resource exploration.
Methods
The WDCG-BJ's database system has evolved significantly. Initially, it relied on simple HTML for data services. Later, it transitioned to ASP language and SyBase, utilizing dedicated network servers and magnetic disk arrays. The current system, developed in stages, employs a robust technological stack:
- Database: ORACLE is used as the primary database, chosen for its cross-platform compatibility, powerful PL/SQL language, fine-tuning capabilities, and strong transaction processing functions that ensure data integrity.
- Web Server Engine: Apache HTTP server handles static pages, while Tomcat serves as the service container for dynamic pages.
- Dynamic Page Generation: Java Server Pages (JSP) technology is employed to create dynamic web pages. JSP, built on Java, allows for the creation of content-rich, dynamic web pages that can be easily maintained and are platform-independent.
- Database Connectivity: Java Database Connectivity (JDBC) is used to enable Java applications to communicate with various databases, facilitating seamless data access for web applications.
The system is designed to support central registration of data and can integrate data sources from other data centers, offering a unified search and download portal.
Datasets
The paper describes the collection and arrangement of geophysical data from long-term geophysical experiments and monitoring. The disciplines covered include:
- Solid earth geophysics
- Marine physics
- Space physics
- Atmosphere physics
- Geothermics
- Geomagnetism
- Seismology
- Ionosphere physics
- Geoelectricity
- Earth electromagnetism
Data is also classified by region, including data from Southeast China, Yunnan-Guizhou, South China Sea Islands, Qinghai-Tibet Plateau, and Antarctica. Specific examples of datasets mentioned include:
- Geomagnetic main field charts
- Microfilms of magnetograms
- Minute Mean Values (Geomagnetism)
- Hour Mean Values (Geomagnetism)
- Historical Magnetograms
- Ionospheric Physics data
- Magnetotelluric Data
- Heat Flow Data
- Gravity Data
The paper does not introduce new benchmark datasets but rather focuses on organizing and making existing data accessible.
Key Insights and Ideas
- Evolution of Data Accessibility: The paper clearly illustrates the progression from static, limited data access to dynamic, comprehensive online services, mirroring the broader trend in scientific data management.
- Leveraging Modern Web Technologies: The successful integration of JSP, Oracle, and Apache demonstrates how contemporary web technologies can be effectively applied to manage and serve large scientific datasets.
- Importance of User-Centric Design: The emphasis on simple, convenient, and unified interfaces (both Chinese and English) for users highlights the importance of user experience in data portal design.
- Global Reach and Impact: The database serves users not only within China but also internationally, underscoring the global significance of such data repositories for scientific collaboration.
- Cost-Effectiveness of Online Access: The paper explicitly states that online access is free, and the cost of obtaining data is minimal, making valuable scientific information widely available.
Key Results
The WDCG-BJ's internet database is operational and accessible via two domain names: http://gp.wdc.cn and http://wdc.geophys.cn. The system allows users to:
- Query and download data in
.txtformat. - View pictures generated by Matlab.
- Search data by site, provinces, city, county, and latitude or longitude.
- Select specific time ranges for data retrieval.
- Choose data formats, including INTERMAGNET and WDC formats.
- Upload data through a dedicated portal.
The system is described as running well in both Chinese and English versions, offering a unified style and convenient user interface.
Limitations and Future Work
Limitations:
- The paper mentions that in the earlier stages, using the same method as the WDC magnetism data center in Japan (producing magnetograms in advance) led to large storage requirements and slow search speeds. This issue was addressed by adopting a dynamic generation approach.
- While the paper highlights the system's current capabilities, it doesn't explicitly detail any ongoing technical limitations of the current Oracle/JSP implementation.
Future Work:
- The authors express a commitment to "edit more data to put on the web and provide more convenient service to the users" in the future. This suggests a continuous effort to expand the database and improve its functionality.
Summary updated