Water Reflection Detection Using Symmetric Attention

Shuxuan Yao, Chengjia Wang, Jianyuan Sun, Junyu Dong, Xinghui DongarXiv 2026 · arXiv

TL;DR

The paper introduces SAWRD-Net, an end-to-end deep learning framework designed to accurately detect reflection axes in natural water scenes. By coupling dihedral group-equivariant convolutions with a low-rank matrix-decomposition decoder, the network effectively models the geometric properties of reflections while remaining robust to real-world disturbances like water ripples and waves.

What Problem Does This Paper Address?

Standard computer vision models—such as object detectors and semantic segmentation networks—frequently stumble when encountering water reflections. Because a reflection creates a mirror-like duplicate of an object, models often confuse the virtual image with the real thing, leading to spurious false positives and inaccurate scene understanding.

Example of an object detector failing due to water reflection, and succeeding after reflection axis filtering.

To fix this, vision systems need to identify the reflection axis so they can isolate and filter out the mirrored regions. However, detecting this axis in nature is incredibly challenging. Unlike perfect laboratory mirrors, water surfaces introduce "imperfect symmetry" caused by surface ripples, light scattering, and refraction. Existing symmetry detectors either assume idealized, perfect mirror conditions or fail to explicitly encode the underlying geometry of the scene.

Methods

The authors propose the Symmetry-Aware Water Reflection Detection Network (SAWRD-Net), which processes images end-to-end to regress keypoints along the reflection axis.

The overall architecture of SAWRD-Net, including the MSRE group, Global Matrix Decomposition module, and Symmetric Attention mechanism.

The architecture consists of three core components:

  1. Multi-scale Reflection Equivariant (MSRE) Block: Instead of standard convolutions (which only guarantee translation invariance), the encoder uses $E(2)$-equivariant steerable convolutions based on the dihedral group $D_8$. This explicitly forces the network to learn features that respect eight discrete rotations and reflection transformations.
  2. Symmetric Attention (SA) Mechanism: A composite attention module that applies parallel channel-wise average and max pooling alongside multi-branch spatial dilated convolutions. This selectively amplifies reflection-specific cues while suppressing irrelevant background noise.
  3. Matrix Decomposition (MD) Decoder: To handle the imperfect nature of water symmetry, the decoder uses a Global Matrix Decomposition (GMD) block. It factorizes high-dimensional feature maps into a low-rank dictionary matrix and a coefficient matrix.
The mathematical formulation of the matrix decomposition process separating structural features from noise.

Finally, a Numerical Coordinate Regression (DSNT) head predicts a set of points along the symmetry axis, and Robust Principal Component Analysis (RPCA) fits these points into a final, clean line.

Datasets

The model was trained and evaluated on the Water Reflection Scene Data set (WRSD), which is currently the largest available benchmark for this task. WRSD contains 2,117 high-quality images featuring diverse natural scenes, varying scale dimensions, and reflection axes presented at multiple tilt angles. Every image includes manual annotations marking the ground-truth symmetry axis points.

Key Insights and Ideas

  • Equivariance vs. Invariance: Traditional CNNs throw away orientation information. By using steerable convolutions, SAWRD-Net preserves geometric consistency across layers, resulting in significantly cleaner feature maps with distinct contours.
  • Low-Rank Math for Imperfect Physics: Water ripples act as high-frequency noise on top of a globally symmetric structure. Low-rank matrix decomposition is uniquely suited for this because it naturally captures the global, low-rank symmetry of the scene while isolating the local wave perturbations as mathematical residuals.
  • Efficiency Over Self-Attention: While Vision Transformers (ViTs) can model long-range global context, their self-attention mechanisms suffer from quadratic space complexity ($O(n^2d)$) and are highly sensitive to noise. The GMD block achieves global context modeling with a linear complexity of $O(ndr)$, using just one-fifth of the memory of standard self-attention.

Key Results

SAWRD-Net achieves state-of-the-art performance on the WRSD benchmark, outperforming 22 baseline methods across generic symmetry detection, image segmentation, and object detection categories.

Performance comparison of models achieving a True Positive Rate higher than 0.80 across TP Rate, angle, and distance metrics.
  • Detection Accuracy: Under standard evaluation thresholds, SAWRD-Net achieved a True Positive (TP) Rate of 0.890, outperforming the previous best task-specific model, WRD-Net (0.823), and the top generic symmetry detector, EquiSym (0.870).
  • Geometric Precision: It recorded the lowest angular deviation (mean of $1.168^\circ$) and midpoint distance error ($4.287$ pixels) compared to all baselines.
  • Computational Efficiency: Compared to WRD-Net, SAWRD-Net reduced FLOPs by approximately 31% (51.11 G vs. 74.06 G) and cut average inference time down to 0.0434 seconds per image, making it highly viable for practical deployment.

Limitations and Future Work

Despite its robustness, SAWRD-Net still struggles under extreme environmental conditions:

  • Severe Ripples: Heavy waves cause massive geometric distortions that break the low-rank assumptions.
  • Extreme Illumination: Severe overexposure or underexposure destroys the texture and contrast required to match objects to their reflections.
  • Fragmented Reflections: Objects blocked by obstacles create broken, discontinuous reflection patterns.

To address these edge cases, the authors suggest exploring deformable convolutions to handle severe wave distortions, graph attention mechanisms to link fragmented reflections, and self-calibrated illumination modules for extreme lighting conditions.

Summary updated

Abstract

Reflections of water pose a significant challenge for computer vision systems, as standard deep learning models frequently confuse objects with their mirror images, producing spurious false positives and negatives in tasks such as object detection and semantic segmentation. As a result, detecting reflection axes in natural-water scenes is pivotal for reliable object detection and scene understanding. To mitigate this issue, we leverage the intrinsic imperfect reflective symmetry of water and introduce a Symmetry-Aware Water Reflection Detection Network, namely, SAWRD-Net, that couples dihedral group-equivariant convolutions with a matrix-decomposition decoder in an end-to-end framework. First, dihedral group convolutional layers extract geometry-consistent feature maps that explicitly encode both rotational and mirror symmetries. A Multi-scale Reflection Equivariant block then aggregates features across scales and employs a symmetric-attention mechanism to highlight reflection-relevant regions. The proposed matrix-decomposition decoder factorizes high-dimensional features into compact low-rank parameter and confidence spaces, after which the network directly regresses keypoints on the reflection axis. Then a robust principal component analysis fits the final axis. Evaluated on the largest available water reflection scene data set, SAWRD-Net achieves a true-positive rate of 0.890 against human annotations, outperforming all existing water reflection detectors.
BibTeX
@misc{yao2026water,
  author = {Shuxuan Yao and Chengjia Wang and Jianyuan Sun and Junyu Dong and Xinghui Dong},
  title = {{Water Reflection Detection Using Symmetric Attention}},
  year = {2026},
  eprint = {2607.10749},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2607.10749},
}
Figure