Study on the chessboard recognition and positioning method of chess game system

Huibai Wang, Xiao Liu, Ming ShiAdvances 2015 · DOI

Abstract

With the wide application of augmented reality technology, designing a remote chess game based on augmented reality technology has significant potential. This paper presents a new method for identifying chessboard areas in a scene based on SIFT feature matching and K-means clustering. We introduce a method for automatically obtaining segmentation thresholds based on linear distance difference parameters to exclude extraneous lines and determine a 9x10 linear model. Experiments prove that this method effectively removes constraints requiring perpendicular camera angles, allowing for accurate coordinate positioning in complex environments.

Introduction: The Challenge of Remote AR Chess

In Augmented Reality (AR) gaming, "remote chess" aims to provide an immersive experience where two players in different locations feel as though they are sitting across from the same physical board. However, a major usability bottleneck exists: most current systems require the camera to be mounted directly above the chessboard, looking straight down.

This requirement is highly restrictive. If the camera is at an angle or if the scene includes a cluttered background, traditional detection algorithms often fail. This research addresses the challenge of identifying and positioning a chessboard within a wide-angle, complex scene where the board occupies only a small portion of the image and the camera angle is arbitrary.

Methodology: A Hybrid Detection Pipeline

The proposed system utilizes a multi-stage pipeline that merges geometric feature detection with color-based segmentation to achieve robust recognition.

  1. Color Space Conversion and Clustering: To minimize the impact of uneven lighting, the system converts standard RGB images into the HSV (Hue, Saturation, Value) color space. The image is then segmented into four distinct categories using K-means clustering, helping to separate the board from the surrounding environment.
Color-based segmentation using HSV conversion (left) and K-means clustering (right) to isolate the board area.
  1. Morphological Processing: Because chess pieces and characters on the board can create "holes" in the segmented image, morphological operations—dilation and erosion—are used to fill these gaps and restore the board's solid rectangular shape.
  2. SIFT Feature Matching and RANSAC: The system uses the Scale-Invariant Feature Transform (SIFT) to extract unique points from both a chessboard template and the live scene. SIFT is robust against changes in scale, rotation, and camera angle. To clean up "false matches" from the background, the RANSAC algorithm eliminates mathematically inconsistent feature pairs.
  3. Hybrid Validation: Finally, the system counts how many SIFT matches fall within each K-means segment. The segment with the highest concentration of matches is identified as the actual chessboard.

Data and Experimental Setup

The researchers used custom scene captures of a Chinese Chess (Xiangqi) board in a typical room environment. Scene images were captured at a resolution of 640 x 480 pixels, while the chessboard template used for matching was 240 x 240 pixels. The hardware utilized for testing was a Dell Precision T5600 workstation.

Results: Robust Feature Matching

The experiment demonstrated that the system could accurately locate the 9x10 grid model of a Chinese Chess board even with distracting background elements and non-perpendicular camera angles.

SIFT feature extraction (left) and matching between the template and the live scene (right).

In the test scene, initial SIFT matching produced 211 feature points across the entire image. After applying RANSAC and K-means filtering, the system narrowed this down to 34 high-quality matching points located exclusively on the chessboard, significantly reducing noise and improving positioning accuracy.

Key Insights: Overcoming Segmentation Gaps

A critical observation was the "hole" problem: K-means clustering often fails to recognize the board as a single object because the characters on the pieces differ significantly in color from the wooden board. Using morphological operations to "heal" these segments proved to be a simple but effective fix.

The core innovation lies in the fusion of geometric and statistical methods. While K-means is effective at finding "blobs" of color, it lacks semantic understanding. SIFT provides the "identity" of the object, while K-means provides the "boundary," allowing the system to break the perpendicular camera constraint.

Limitations and Future Directions

While effective, the system has areas for improvement:

  • Computational Overhead: Specific processing times or frames-per-second (FPS) data were not provided. The real-time performance of SIFT and K-means on mobile AR devices remains to be verified.
  • Generalization: The logic for "filling holes" and the 9x10 linear model is specifically tuned for Chinese Chess. Adapting this to standard Western Chess (8x8) or boards with highly reflective surfaces may require further calibration.

Future work will focus on generalizing this framework for other types of board games and optimizing performance for mobile platforms.

Summary updated

Abstract

With the wide application of augmented reality technology, designing a remote chess game based on augmented reality technology has the research significance of potential. The system can make two people both living in different places to play chess as they are playing face to face and can communicate with each other. This paper presents a new methods for identifying the chess board areas in the scene which based on SIFT feature matching and K-means clustering. This paper presents a method of automatically obtaining segmentation threshold based on the parameters of the linear distance difference which can used to exclude the extra line detected and ultimately determine the linear model of 9*10. The experiment proved that the method proposed in this paper can effectively remove the restricted conditions that the camera can only shoot board area and the camera must be taken perpendicular to the board and the method can coordinate position of accurate positioning checkerboard. This method can be reference for similar problems.
BibTeX
@inproceedings{wang2015study,
  author = {Huibai Wang and Xiao Liu and Ming Shi},
  title = {{Study on the chessboard recognition and positioning method of chess game system}},
  booktitle = {Advances},
  year = {2015},
  doi = {10.2991/isrme-15.2015.63},
}
Figure