The Internet Databases of the World Data Center for Geophysics, Beijing

Fenglin Peng, Dan Wang, Xinbao Zheng, Lijun Xing, Keyun Tang, Bangyan Yue, Xiaoyang Shen, Jian Zhang, Le Peng, Qinghua HuangData 2007 · DOI

TL;DR

This paper describes the development and implementation of the World Data Center for Geophysics, Beijing's (WDCG-BJ) online geophysics database. It highlights the transition from simple HTML-based services to a dynamic, user-friendly web portal utilizing modern technologies like JSP, Oracle, and Apache, making vast amounts of geophysical data accessible to researchers globally.

What Problem Does This Paper Address?

The paper addresses the growing need for accessible and organized geophysical data for scientific research. Historically, geophysical data was stored in various formats, often paper-based or on localized digital media, making it difficult to access, share, and analyze. The authors recognized that with the advent of the internet and advancements in database technology, a centralized, online repository was crucial to facilitate scientific progress in geophysics. This would allow researchers to easily query, download, and utilize data for a wide range of applications, from understanding Earth's processes to national defense and resource exploration.

Methods

The WDCG-BJ's database system has evolved significantly. Initially, it relied on simple HTML for data services. Later, it transitioned to ASP language and SyBase, utilizing dedicated network servers and magnetic disk arrays. The current system, developed in stages, employs a robust technological stack:

  • Database: ORACLE is used as the primary database, chosen for its cross-platform compatibility, powerful PL/SQL language, fine-tuning capabilities, and strong transaction processing functions that ensure data integrity.
  • Web Server Engine: Apache HTTP server handles static pages, while Tomcat serves as the service container for dynamic pages.
  • Dynamic Page Generation: Java Server Pages (JSP) technology is employed to create dynamic web pages. JSP, built on Java, allows for the creation of content-rich, dynamic web pages that can be easily maintained and are platform-independent.
  • Database Connectivity: Java Database Connectivity (JDBC) is used to enable Java applications to communicate with various databases, facilitating seamless data access for web applications.

The system is designed to support central registration of data and can integrate data sources from other data centers, offering a unified search and download portal.

Datasets

The paper describes the collection and arrangement of geophysical data from long-term geophysical experiments and monitoring. The disciplines covered include:

  • Solid earth geophysics
  • Marine physics
  • Space physics
  • Atmosphere physics
  • Geothermics
  • Geomagnetism
  • Seismology
  • Ionosphere physics
  • Geoelectricity
  • Earth electromagnetism

Data is also classified by region, including data from Southeast China, Yunnan-Guizhou, South China Sea Islands, Qinghai-Tibet Plateau, and Antarctica. Specific examples of datasets mentioned include:

  • Geomagnetic main field charts
  • Microfilms of magnetograms
  • Minute Mean Values (Geomagnetism)
  • Hour Mean Values (Geomagnetism)
  • Historical Magnetograms
  • Ionospheric Physics data
  • Magnetotelluric Data
  • Heat Flow Data
  • Gravity Data

The paper does not introduce new benchmark datasets but rather focuses on organizing and making existing data accessible.

Key Insights and Ideas

  • Evolution of Data Accessibility: The paper clearly illustrates the progression from static, limited data access to dynamic, comprehensive online services, mirroring the broader trend in scientific data management.
  • Leveraging Modern Web Technologies: The successful integration of JSP, Oracle, and Apache demonstrates how contemporary web technologies can be effectively applied to manage and serve large scientific datasets.
  • Importance of User-Centric Design: The emphasis on simple, convenient, and unified interfaces (both Chinese and English) for users highlights the importance of user experience in data portal design.
  • Global Reach and Impact: The database serves users not only within China but also internationally, underscoring the global significance of such data repositories for scientific collaboration.
  • Cost-Effectiveness of Online Access: The paper explicitly states that online access is free, and the cost of obtaining data is minimal, making valuable scientific information widely available.

Key Results

The WDCG-BJ's internet database is operational and accessible via two domain names: http://gp.wdc.cn and http://wdc.geophys.cn. The system allows users to:

  • Query and download data in .txt format.
  • View pictures generated by Matlab.
  • Search data by site, provinces, city, county, and latitude or longitude.
  • Select specific time ranges for data retrieval.
  • Choose data formats, including INTERMAGNET and WDC formats.
  • Upload data through a dedicated portal.

The system is described as running well in both Chinese and English versions, offering a unified style and convenient user interface.

Limitations and Future Work

Limitations:

  • The paper mentions that in the earlier stages, using the same method as the WDC magnetism data center in Japan (producing magnetograms in advance) led to large storage requirements and slow search speeds. This issue was addressed by adopting a dynamic generation approach.
  • While the paper highlights the system's current capabilities, it doesn't explicitly detail any ongoing technical limitations of the current Oracle/JSP implementation.

Future Work:

  • The authors express a commitment to "edit more data to put on the web and provide more convenient service to the users" in the future. This suggests a continuous effort to expand the database and improve its functionality.

Summary updated

Abstract

The CODATA Data Science Journal is a peer-reviewed, open access, electronic journal, publishing papers on the management, dissemination, use and reuse of research data and databases across all research domains, including science, technology, the humanities and the arts. The scope of the journal includes descriptions of data systems, their implementations and their publication, applications, infrastructures, software, legal, reproducibility and transparency issues, the availability and usability of complex datasets, and with a particular focus on the principles, policies and practices for open data.All data is in scope, whether born digital or converted from other sources.
BibTeX
@inproceedings{peng2007internet,
  author = {Fenglin Peng and Dan Wang and Xinbao Zheng and Lijun Xing and Keyun Tang and Bangyan Yue and Xiaoyang Shen and Jian Zhang and Le Peng and Qinghua Huang},
  title = {{The Internet Databases of the World Data Center for Geophysics, Beijing}},
  booktitle = {Data},
  year = {2007},
  doi = {10.2481/dsj.6.s879},
}
Figure