Comparing spatial patterns of marine vessels between vessel-tracking data and satellite imagery

Shinnosuke Nakayama, WenXin Dong, Richard G. Correro, Elizabeth R. Selig, Colette C. C. Wabnitz, Trevor Hastie, Jim Leape, Serena Yeung, Fiorenza MicheliFrontiers in Marine Science 2023 · DOI

TL;DR

Researchers have developed a framework that combines deep learning vessel detection with advanced spatial statistics to quantify exactly where satellite imagery provides "new" information compared to traditional AIS tracking. By applying this to coastal Peru, they demonstrated that satellite data is essential for uncovering small-scale fishing activities that are invisible to standard tracking systems.

What Problem Does This Paper Address?

For decades, the Automatic Identification System (AIS) has been the gold standard for monitoring the world’s oceans. However, AIS has a "dark vessel" problem. It is only mandatory for larger ships, can suffer from signal interference in crowded ports, and can be intentionally turned off to hide illicit activities.

While optical satellite imagery can "see" these vessels regardless of their AIS status, we lack a rigorous way to determine where and when satellite data actually adds value. Is the satellite just seeing the same ships we already track via AIS, or is it revealing a hidden fleet? This paper introduces an analytical pipeline to answer that question by statistically contrasting the geospatial distributions of vessels across these two disparate data sources.

Methods

The authors propose a two-step framework:

  1. Automated Detection: They employed a Faster R-CNN deep learning model with a ResNet-50 backbone to detect vessels in optical satellite imagery. To handle the high volume of "empty" ocean images, they first used a binary classifier to filter for the presence of vessels before running the more computationally expensive detector.
  2. Spatial Statistical Comparison: This is the core innovation. Instead of just looking at side-by-side maps, they used a bivariate log-Gaussian Cox process (LGCP). This spatial point pattern model allows researchers to determine if two sets of coordinates (AIS vs. Satellite) are driven by the same underlying environmental or economic process, or if they represent independent distributions.

Datasets

  • Satellite Imagery: 3-meter resolution RGB-NIR images from PlanetScope satellites, covering the Peruvian shoreline from 2016 to 2021.
  • AIS Data: Sourced from Global Fishing Watch, subsampled to match the specific 10:00 AM window when the satellites captured their images.
  • Custom Benchmark: Because existing public datasets often feature high-resolution images of large ships, the authors created their own labeled dataset of 308 vessel-containing images (3,046 instances) and 11,538 "empty" images to better train the model on smaller, lower-resolution vessel signatures.

Key Insights and Ideas

  • The "Value Added" varies by location: In the port of Talara, the AIS and satellite data showed similar spatial patterns, suggesting that most vessels there were AIS-compliant. However, in Paita, the distributions were vastly different. The satellite revealed a high concentration of vessels outside the port that were completely absent from the AIS record.
  • Quantifying Bias: The LGCP model provides a "correlation" coefficient ($a_{21}$) between the two datasets. A high positive value indicates the datasets are redundant; a value near zero indicates the satellite is providing unique, independent information about vessel activity.
  • Small-Scale Fisheries are the Gap: The study highlights that in regions like Peru, where small-scale fisheries are a massive part of the economy but rarely use AIS, satellite imagery isn't just a "supplement"—it's the primary tool for accurate management.

Key Results

  • Detection Performance: The Faster R-CNN pipeline achieved an F1 score of 0.84, with a precision of 0.87 and a recall of 0.80.
  • Talara vs. Paita: In Talara, the model detected 118 vessels, showing a distribution that largely mirrored AIS data. In Paita, 151 vessels were detected, but they were concentrated in the southern part of the focal region where AIS signals were non-existent.
  • Statistical Significance: The LGCP model confirmed that in Paita, the spatial patterns were independent (the 94% Highest Density Interval for the correlation coefficient overlapped zero), proving that satellite imagery was capturing a "dark" fleet that AIS could not see.

Limitations and Future Work

The authors identify several hurdles for scaling this framework:

  • Classification Challenges: At 3-meter resolution, it is difficult to distinguish between a fishing boat, a passenger ferry, or a small cargo ship. Future work could integrate higher-resolution imagery or SAR (Synthetic Aperture Radar) to improve classification.
  • Temporal Snapshots: Optical satellites usually pass over at the same time each day (around 10:00 AM). This provides a "snapshot" but misses nocturnal activity or movement patterns throughout the day.
  • Data Integration: The next step is moving beyond "comparing" to "integrating"—using these statistical insights to create a single, unified map of global marine traffic that accounts for the biases of both sensors.

Summary updated

Abstract

Monitoring marine use is essential to effective management but is extremely challenging, particularly where capacity and resources are limited. To overcome these limitations, satellite imagery has emerged as a promising tool for monitoring marine vessel activities that are difficult to observe through publicly available vessel-tracking data. However, the broader use of satellite imagery is hindered by the lack of a clear understanding of where and when it would bring novel information to existing vessel-tracking data. Here, we outline an analytical framework to (1) automatically detect marine vessels in optical satellite imagery using deep learning and (2) statistically contrast geospatial distributions of vessels with the vessel-tracking data. As a proof of concept, we applied our framework to the coastal regions of Peru, where vessels without the Automatic Information System (AIS) are prevalent. Quantifying differences in spatial information between disparate datasets—satellite imagery and vessel-tracking data—offers insight into the biases of each dataset and the potential for additional knowledge through data integration. Our study lays the foundation for understanding how satellite imagery can complement existing vessel-tracking data to improve marine oversight and due diligence.
BibTeX
@inproceedings{nakayama2023comparing,
  author = {Shinnosuke Nakayama and WenXin Dong and Richard G. Correro and Elizabeth R. Selig and Colette C. C. Wabnitz and Trevor Hastie and Jim Leape and Serena Yeung and Fiorenza Micheli},
  title = {{Comparing spatial patterns of marine vessels between vessel-tracking data and satellite imagery}},
  booktitle = {Frontiers in Marine Science},
  year = {2023},
  doi = {10.3389/fmars.2022.1076775},
}
Figure