MidNet: An Anchor-and-Angle-Free Detector for Oriented Ship Detection in Aerial Images

Jie Feng, Yuping Liang, Junpeng Zhang, Xiangrong Zhang, Quanhe Yao, Licheng Jiao

Abstract

MidNet is a novel object detector for oriented ships in aerial imagery that replaces traditional rotation-angle regression with a five-point keypoint representation. By predicting a center and four edge midpoints, MidNet avoids mathematical instabilities such as boundary discontinuity and high angular sensitivity. Combined with Symmetrical Deformable Convolution (SDC), MidNet achieves state-of-the-art results on major benchmarks including HRSC2016 and FGSD2021.

Introduction

Detecting ships from a bird's-eye view is notoriously difficult because ships appear at arbitrary orientations and often have very high aspect ratios. Most existing detectors rely on anchor-based methods or angular regression. Anchor-based methods require heavy manual hyper-parameter tuning, while angular regression suffers from boundary discontinuity—where tiny prediction errors near periodic boundaries (e.g., -90° vs 90°) result in massive loss values. Furthermore, for long ships, even a 1-degree error in angle prediction causes a drastic drop in Intersection over Union (IoU), leading to poor detection scores.

The MidNet Architecture

MidNet moves away from angles entirely, treating ship detection as a keypoint estimation task. The model predicts five keypoints: the center of the ship and the midpoints of its four edges.

Evolution of oriented object detection methods from traditional anchor-based and angular regression to the proposed midpoint-based keypoint representation.

Five-Point Encoding and SDC

Unlike corners, which can be ambiguous when rotated, midpoints always correspond to a specific quadrant relative to the center, leading to more stable feature learning. To enhance this, MidNet utilizes a Symmetrical Deformable Convolution (SDC) layer. Since ships are structurally symmetrical, SDC allows a midpoint on one side of the ship to learn from the features of its symmetric counterpart, which is particularly effective for detecting ships with long wakes or partial obstructions.

Adaptive Grouping and Refinement

To link these points, the model predicts a "matching radius" for the center and "centripetal shifts" for the midpoints. If a midpoint's shifted position falls within a center's radius, they are grouped. Finally, an analytical geometry algorithm refines these points to construct a precise rectangular bounding box, enforcing geometric constraints as a powerful inductive bias.

Key Insights

Midpoints over Corners

Midpoints are more likely to fall directly on the object than corners. This ensures that the features extracted at midpoint locations are richer and more representative of the ship's actual structure.

Quadrant Consistency

No matter how much a ship rotates, the "top" midpoint stays in the top quadrant relative to the center. This eliminates the orientation definition ambiguity that often plagues corner-based detectors.

The midpoint representation maintains quadrant consistency, where each midpoint is uniquely assigned to a quadrant relative to the center, avoiding orientation ambiguity.

Experimental Results

The authors evaluated MidNet on three prominent datasets:

  • HRSC2016: Achieved 90.52% AP, outperforming state-of-the-art models like Oriented R-CNN.
  • FGSD2021: Achieved 86.50% mAP, a significant 1.04% improvement over previous best methods in fine-grained classification.
  • DOTA: Achieved a competitive 86.42% AP for the ship category.

Ablation studies confirmed the design choices: switching from corners to midpoints improved accuracy by 2.23%, while the addition of SDC contributed an additional 0.87%.

Conclusion

MidNet demonstrates that an anchor-and-angle-free approach can overcome the fundamental flaws of angular regression in ship detection. While highly effective for rectangular vessels, future work will focus on adapting the model for extremely irregular shapes and exploring weakly supervised learning to reduce annotation requirements.

Summary updated

Abstract

Ship detection in aerial images remains an active yet challenging task due to its arbitrary object orientation and various aspect ratios from the bird’s-eye perspective. Most existing oriented objection detection methods rely on angular prediction or predefined anchor boxes, making these methods highly sensitive to unstable angular regression and excessive hyperparameter setting. To address these issues, we replace the angular-based object encoding with an anchor-and-angle-free paradigm and propose a novel detector deploying a center and four midpoints for encoding each oriented object, namely, MidNet. Moreover, MidNet designs a novel symmetrical deformable convolution for enhancing the features of midpoints; then, the center and midpoints for an identical ship are adaptively matched by predicting corresponding centripetal shift and matching radius. Finally, a concise analytical geometry algorithm is proposed to calculate the ship orientation and refine the keypoints stepwisely for building precise oriented bounding boxes. On two public ship detection datasets, HRSC2016 and FGSD2021, MidNet outperforms the state-of-the-art detectors by achieving APs of 90.52% and 86.50%.
BibTeX
@article{feng2023midnet,
  author = {Jie Feng and Yuping Liang and Junpeng Zhang and Xiangrong Zhang and Quanhe Yao and Licheng Jiao},
  title = {{MidNet: An Anchor-and-Angle-Free Detector for Oriented Ship Detection in Aerial Images}},
  journal = {IEEE Trans. Geosci. Remote. Sens.},
  year = {2023},
  url = {https://openreview.net/forum?id=m78z_wjKcw1},
}
Figure