CrossDet: Crossline Representation for Object Detection

Heqian Qiu, Hongliang Li, Qingbo Wu, Jianhua Cui, Zichen Song, Lanxiao Wang, Minjian Zhang

Abstract

CrossDet introduces a novel anchor-free object detection framework that represents objects using "cross lines" rather than traditional rectangular boxes or discrete points. By adaptively growing horizontal and vertical lines to fit an object's boundaries, the model captures continuous internal features while filtering out background noise, leading to superior accuracy on PASCAL VOC and MS-COCO benchmarks.

Introduction

In the world of computer vision, object representation is the foundation of detection. For years, two paradigms have dominated: anchor-based methods using predefined rectangular boxes and point-based methods using center points or keypoints. Anchor-based methods often include background "noise" in the corners and require tedious manual tuning. Point-based methods, while avoiding anchor-tuning, are discrete and often miss the continuous appearance information inside an object, making it difficult to determine exact boundaries in crowded or overlapping scenes.

CrossDet proposes a middle ground: a representation that is continuous enough to capture the object's "body" but sparse enough to ignore background interference.

Methodology

The core innovation is the Crossline Representation. Instead of a box, an object is represented by a horizontal line and a vertical line that intersect. These lines "grow" during training to match the object's extent.

The Overall Pipeline of CrossDet and the Crossline Extraction Module (CEM).

Key Components

  • Crossline Extraction Module (CEM): This module uses "axis-aware pooling" to gather context from the entire row and column, then selectively samples features along the predicted cross lines. This ensures the model "sees" the object's internal structure.
  • Decoupled Regression Mechanism: Standard detectors try to predict width, height, and center all at once. CrossDet splits the task: the horizontal branch handles horizontal offsets and width, while the vertical branch handles the vertical axis. This reduces the mathematical optimization space, making it easier for the network to converge.
  • Multi-stage Refinement: The architecture uses a multi-stage pipeline where coarse cross lines are predicted first and then refined into precise boundaries in subsequent steps.

Key Insights

  • Lines over Boxes: Rectangular boxes are inherently noisy because objects are rarely perfect rectangles. Cross lines act as a "skeleton" that captures discriminative features (center and edges) without picking up background clutter in the corners.
  • Continuous vs. Discrete: Unlike point-based methods, cross lines provide a continuous path of features. This helps the model perceive the change in features as it hits an object's boundary.
Visualization of the Crossline Representation compared to point-based and box-based methods.

Experimental Results

The researchers evaluated CrossDet on two gold-standard benchmarks: PASCAL VOC and MS-COCO. CrossDet consistently outperformed both anchor-based and point-based predecessors:

  • PASCAL VOC: Using a ResNet-50 backbone, CrossDet achieved 50.9% mAP, outperforming ATSS (49.3%) and Faster R-CNN (46.5%).
  • MS-COCO: On the more challenging COCO dataset, CrossDet reached 48.4% AP (using ResNet-101 with Deformable Convolutions), surpassing other high-end detectors like BorderDet (47.2%) and RepPoints (45.0%).
  • Ablation Studies: The authors showed that the CEM was vital; removing it caused a significant drop in performance (~2.5% AP), proving that feature sampling along lines is as critical as the lines themselves.

Limitations and Future Work

While effective, CrossDet relies on axis-aligned horizontal and vertical lines, which may be less optimal for heavily rotated objects (e.g., in aerial imagery). Additionally, the multi-stage nature and CEM module add architectural complexity compared to "one-shot" detectors. Future work could involve more complex line combinations or applying this representation to instance segmentation tasks.

Summary updated

Abstract

Object detection aims to accurately locate and classify objects in an image, which requires precise object representations. Existing methods usually use rectangular anchor boxes or a set of points to represent objects. However, these methods either introduce background noise or miss the continuous appearance information inside the object, and thus cause incorrect detection results. In this paper, we propose a novel anchor-free object detection network, called Cross-Det, which uses a set of growing cross lines along horizontal and vertical axes as object representations. An object can be flexibly represented as cross lines in different combinations. It not only can effectively reduce the interference of noise, but also take into account the continuous object information, which is useful to enhance the discriminability of object features and find the object boundaries. Based on the learned cross lines, we propose a crossline extraction module to adaptively capture features of cross lines. Furthermore, we design a decoupled regression mechanism to regress the localization along the horizontal and vertical directions respectively, which helps to decrease the optimization difficulty because the optimization space is limited to a specific direction. Our method achieves consistently improvement on the PASCAL VOC and MS-COCO datasets. The experiment results demonstrate the effectiveness of our proposed method. Code can be available at: https://github.com/QiuHeqian/CrossDet.
BibTeX
@inproceedings{qiu2021crossdet,
  author = {Heqian Qiu and Hongliang Li and Qingbo Wu and Jianhua Cui and Zichen Song and Lanxiao Wang and Minjian Zhang},
  title = {{CrossDet: Crossline Representation for Object Detection}},
  booktitle = {IEEE/CVF International Conference on Computer Vision},
  year = {2021},
  doi = {10.1109/iccv48922.2021.00318},
}
Figure