In-orbit demonstration of object-based change detection applied to the maritime domain

Cristopher Castro Traba, Tom Hendrix, Amaury Perrocheau, Francesco Pasanisi, Finian Rogers, Aubrey Dunne, David Rijlaarsdam, Roberto Del Prete, Nicolas Longépé, Gabriele MeoniarXiv 2026 · arXiv

TL;DR

Researchers have successfully demonstrated a real-time, object-based change detection pipeline running entirely onboard a satellite (the CogniSAT-6 mission). By shifting from traditional "bent-pipe" data transmission to onboard AI-driven vessel segmentation and geometric matching, they achieved over 80% precision and recall in tracking maritime targets—including "dark" vessels that disable their tracking transponders.

What Problem Does This Paper Address?

Traditional Earth Observation (EO) follows a "bent-pipe" model: satellites act as passive cameras, capturing massive raw images and beaming them to ground stations for processing. This creates a massive latency bottleneck—often hours or days—making it nearly impossible to respond to time-sensitive events like illegal fishing, piracy, or smuggling.

Furthermore, traditional change detection is usually pixel-based, comparing two images pixel-by-pixel. This is computationally expensive, requires enormous memory to hold two high-resolution images simultaneously, and is incredibly sensitive to even tiny misalignments (co-registration errors) or environmental changes like sun glint. This paper tackles these hurdles by moving the intelligence to the "edge"—directly onto the satellite's hardware—and switching to an object-based approach that compares extracted vessel features rather than raw pixels.

Methods

The authors propose a lightweight, three-phase operational sequence:

  1. Optimized Scheduling: The satellite is tasked to perform a "dual-request" for the same target coordinates across consecutive orbital passes, dynamically adjusting its attitude to minimize revisit time.
  2. Onboard AI Segmentation: Upon acquisition, an onboard AI model (running on the CogniSAT-XE2 platform) segments vessels from the raw imagery. Instead of saving the image, it extracts a "point cloud" of insights: geographical location, physical dimensions, and orientation.
  3. Multi-Temporal Matching: This is the core innovation. The system correlates detections between "Pass A" and "Pass B" using a hybrid algorithm:
  4. Hungarian Algorithm: Used for optimal assignment, minimizing a global "cost" based on spatial distance and vessel size similarity.
  5. RANSAC (Random Sample Consensus): Acts as a robust filter to estimate the global displacement between acquisitions and reject outliers that don't fit the movement model.
  6. Ray Casting: A spatial filter that ensures the system only compares vessels within the geographical intersection of the two image footprints.
The multi-temporal onboard change detection workflow.

Datasets

The system was validated across 11 diverse maritime scenarios:

  • Ground Verification: 14 images (7 pairs) containing 999 vessel data points.
  • In-Orbit Validation: 6 images (3 pairs) on the CogniSAT-6 spacecraft, comprising 242 vessel data points.
  • Locations: Diverse environments including low-density ports (Long Beach, Piraeus, Dakar), high-density areas (Port Said, Khor Fakkan), and high-traffic zones (Gibraltar).
  • Ground Truth: Automatic Identification System (AIS) data was used to verify "Identity Matches," though the system was specifically designed to work without it.

Key Insights and Ideas

  • Tracking the "Untrackable": One of the most significant "aha" moments was the system's ability to track "dark vessels"—ships that turn off their AIS transponders to avoid detection. By relying strictly on geometric consistency (size and location), the pipeline successfully re-detected these vessels across acquisitions.
  • Massive Data Reduction: By processing imagery onboard and only downlinking coordinates and dimensions, the data volume drops from gigabytes of raw imagery to kilobytes of telemetry. This is a game-changer for CubeSats with limited bandwidth.
  • Resilience to Misalignment: Because the algorithm matches discrete centroids rather than pixels, it is far more resilient to the slight georeferencing errors common in small satellite platforms.
  • Autonomy Foundation: This technology enables "Insight-as-a-Service." A satellite could detect a change and autonomously trigger a third, higher-resolution acquisition or "tip and cue" another satellite in a constellation without waiting for ground instructions.

Key Results

The in-orbit validation demonstrated robust performance across various maritime densities:

  • Precision and Recall: Both "Valid" Recall and Precision (based on geometric consistency) exceeded 0.80 for almost all acquisition pairs.
  • Low-Density Success: In scenarios like Long Beach, the system achieved a Valid Precision of 1.0, successfully matching all vessels.
  • Dark Vessel Detection: In the Dakar test case, the system successfully re-detected a dark vessel entirely through geometric feature matching.
Fig. 4. Matching performance under low vessel density conditions in the Dakar images taken on the 28/12/2025 (left) and the 20/12/2025 (right). The white boxes correspond to the identified matches considering the minimum vessel length, while the yellow boxes correspond to the AIS matches with the same criteria. Match 5 within the acquisitions is a dark vessel (without AIS).

Limitations and Future Work

Despite the success, the authors identified several critical constraints:

  • Georeferencing Accuracy: The system's reliability is heavily tied to how accurately the satellite knows its own position and orientation. Poor geolocation can lead to incorrectly computed intersection areas, zeroing out results.
  • Meteorological Constraints: Cloud cover remains the "kryptonite" of optical sensors. In cloudy scenes (like Port Said), the number of detectable matches dropped significantly.
  • High-Density Ambiguity: In very crowded anchorages (50+ vessels), distinguishing between many ships of similar size remains a challenge.
  • Future Directions: The team plans to add visual features (embeddings) to the matching algorithm, allowing the AI to "see" unique characteristics of a ship's deck or structure to provide even higher confidence in matches.

Summary updated

Abstract

This article presents the successful in-orbit validation of an object-based change detection pipeline for low latency maritime monitoring onboard the CogniSAT-6 mission. We propose and validate a lightweight, three-phase operational sequence: optimized ground-based dual-acquisition scheduling, real-time onboard AI-based vessel segmentation, and multi-temporal matching. Upon acquiring consecutive images over a targeted Area of Interest (AoI), the onboard system correlates vessel detections using a hybrid matching approach that integrates the Hungarian algorithm for optimal assignment with RANSAC-driven spatial and size filters for outlier rejection. A series of in-orbit validations demonstrated robust performance across 11 diverse maritime scenarios, achieving valid recall and precision values (considering only vessel size and location) exceeding 0.8. The validation demonstrated the ability of the system to track both cooperative targets and uncooperative "dark" vessels strictly through geometric consistency. This capacity to autonomously generate and act upon real-time intelligence establishes a foundation for next-generation Insight-as-a-Service (IaaS) and tipping-and-cueing architectures.
BibTeX
@misc{traba2026orbit,
  author = {Cristopher Castro Traba and Tom Hendrix and Amaury Perrocheau and Francesco Pasanisi and Finian Rogers and Aubrey Dunne and David Rijlaarsdam and Roberto Del Prete and Nicolas Longépé and Gabriele Meoni},
  title = {{In-orbit demonstration of object-based change detection applied to the maritime domain}},
  year = {2026},
  eprint = {2611.14857},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.14857},
}
Figure