The Customized Automatic Processing Framework for HY-2A Satellite Marine Advanced Products

Wei Liu, Shibin Liu, Lei Huang, Jianbo Duan, Jing Zhang, Xinpeng Li, Jianbo LiuRemote 2016 · DOI

TL;DR

This paper introduces the Customized Automatic Processing Framework (CAPF) for HY-2A satellite data, addressing limitations in the existing ground system by enabling on-demand processing and custom algorithm integration. This framework aims to make advanced ocean remote sensing products more accessible and adaptable to diverse user needs, thereby expanding the utility of HY-2A data.

What Problem Does This Paper Address?

The HY-2A satellite is China's first ocean dynamic environment satellite, providing valuable data for observing ocean properties. However, its existing ground application system faces several challenges during operation. These include inflexibility in responding to user demands for customized products, a gap in data delivery to users, and limitations in processing and analyzing data due to fixed workflows and disparate data formats. Users often require specific data subsets or custom processing that the current system cannot easily accommodate, hindering the full exploitation of the rich HY-2A dataset.

Methods

The paper proposes the HY-2A Customized Automatic Processing Framework (CAPF) as an extension to the existing ground application system. CAPF is designed with a focus on user-driven customization and flexibility. It comprises three main components:

  • Routine Customized Processing Subsystem: This web application, accessible within an intranet, allows State Oceanic Administration (SOA) staff to automatically generate daily, weekly, monthly, seasonal, and annual statistical products. It leverages pre-defined processing workflows and a job scheduling library to manage and execute batch processing tasks efficiently.
  • On-Demand Customized Processing Subsystem: Accessible via the internet, this subsystem caters to researchers and the public. It offers a Graphical User Interface (GUI) for users to:
  • Register their own algorithms.
  • Design custom processing workflows by connecting registered algorithms.
  • Run and test these workflows.
  • Search and download derived products. This subsystem is built on a three-layer architecture (GUI, services, data repository) and uses AJAX and REST web services for communication.

  • Integrated Algorithmic Environment: This component provides a platform for both pre-defined algorithms (developed in Python) and user-uploaded custom algorithms. It supports multiple runtime environments (Python, IDL, Windows Shell) to execute algorithms developed in different languages.

Datasets

The paper utilizes data from the HY-2A satellite, specifically:

  • Level 2 data from the HY-2A scatterometer (for wind field products).
  • Level 2 data from the HY-2A scanning microwave radiometer (for sea surface temperature, water vapor, and cloud liquid water products).

The paper does not introduce new benchmark datasets but rather demonstrates the framework's capability to process existing HY-2A data products.

Key Insights and Ideas

  • Bridging the "Last Mile" Gap: The CAPF directly addresses the critical need to bridge the gap between raw satellite data and actionable, user-tailored products, moving beyond standard processing.
  • Empowering Users: By allowing users to integrate their own algorithms and design custom workflows, the framework democratizes data analysis and fosters innovation in ocean remote sensing applications.
  • Flexibility is Key: The framework's modular design, separating routine processing from on-demand customization, provides a balanced approach to meet the needs of different user groups (operational staff vs. researchers).
  • Extensibility: The design anticipates future integration with other remote sensing data sources and programming languages, suggesting a path towards a more comprehensive data analysis platform.

Key Results

The paper demonstrates the functionality of the CAPF through several case studies, generating typical geophysical products:

  • Wind Field: A customized workflow successfully generated an ocean wind field thematic map, showing wind direction and speed derived from HY-2A scatterometer data.
  • Sea Surface Temperature: The framework produced a sea surface temperature thematic map from HY-2A scanning microwave radiometer data.
  • Water Vapor: A thematic map of water vapor concentration was generated.
  • Cloud Liquid Water: A thematic map of cloud liquid water was also successfully produced.

These case studies showcase the framework's ability to process Level 2 data, extract specific regions of interest (AOI), interpolate, grid, and visualize the results into thematic maps. The paper mentions that a beta version was released in September 2016, indicating initial operational success and positive user feedback.

Limitations and Future Work

Limitations:

  • The paper notes that the framework is an extension of the existing ground system and that further iterations are planned to expand its capabilities.
  • The current version supports three runtime environments (Python, IDL, Windows Shell), implying that algorithms developed in other languages might require adaptation.

Future Work:

  • Algorithm Expansion: Developing more pre-defined algorithms to expand the range of case studies and facilitate users in designing their own processing workflows.
  • Specialized Applications: Developing thematic mapping algorithms for specific applications, such as supporting research vessels exploring polar regions.
  • Cloud Computing Integration: Leveraging cloud storage for researcher-generated processing results and adopting novel data analysis and storage techniques.
  • Broader Language Support: Enhancing the integrated algorithmic environment to support more programming languages for user-customized algorithms.
  • Inter-domain Application: Standardizing interfaces to integrate data from other remote sensing agencies and platforms, potentially applying the framework to other domains beyond oceanography.

Summary updated

Abstract

HY-2A, as the first Chinese ocean dynamic environment satellite, provides an effective and efficient way of observing ocean properties. However, in the operational stage, some inconveniences of the existing ground application system have appeared. Based on the review of users’ requirements for data services, the Customized Automatic Processing Framework (CAPF) for HY-2A advanced products is proposed and has been developed. As an extension of the existing ground application system, the framework provides interfaces for adding customized algorithms, designing on-demand processing workflows, and scheduling the processing procedures. With the customized processing templates, the framework allows users to easily process the products according to their own expectations, which facilitates the usage of HY-2A satellite advanced products.
BibTeX
@inproceedings{liu2016customized,
  author = {Wei Liu and Shibin Liu and Lei Huang and Jianbo Duan and Jing Zhang and Xinpeng Li and Jianbo Liu},
  title = {{The Customized Automatic Processing Framework for HY-2A Satellite Marine Advanced Products}},
  booktitle = {Remote},
  year = {2016},
  doi = {10.3390/rs8121009},
}
Figure