Introduction
Analyzing tactics in high-speed racket sports like table tennis, badminton, and tennis is traditionally a labor-intensive manual process. Professional teams rely on experts to log every stroke, a task complicated by motion blur, frequent occlusions, and the subtle physical differences between distinct techniques (e.g., a "topspin" vs. a "push"). Standard action recognition models often fail in this domain because they treat video frames as isolated events, ignoring the strategic dependencies—the "chess match"—where one stroke heavily influences the next.
Methodology: The ViSTec Framework
To address these challenges, we introduce ViSTec (Video-based Sports Technique recognition), a framework that mimics human cognition by combining visual perception with contextual logic. The architecture is divided into two primary modules:
1. Action Perception Module
This module handles the raw visual data. It utilizes a modified VideoMAE backbone optimized for high-speed sports. Unlike standard models that aggregate information over long temporal windows, ViSTec processes the video in 2-frame slices. This design choice is critical for capturing the "instantaneous" nature of a racket hitting a ball, preventing the micro-movements of a stroke from being "smeared" by temporal pooling. The pipeline operates in two stages: first, Stroke Segmentation identifies the exact timestamp of impact, and second, Stroke Classification determines the specific technique used.
2. Domain Knowledge Module ($grh$)
The core innovation of ViSTec is the integration of a directed graph representing domain-specific tactical knowledge. Nodes in this graph represent techniques, while edges represent the transition probabilities between them. By training the vision model and this graph jointly, the system gains a "contextual inductive bias." When visual evidence is ambiguous due to blur or occlusion, the model relies on the logical sequence of play to improve its prediction accuracy.
Experimental Setup and Results
The framework was evaluated using the WTT Dataset, comprising 4,000 rally clips from 18 World Table Tennis games. Annotations were provided by professional athletes to ensure high-fidelity labeling of complex techniques.
ViSTec demonstrates significant performance gains over state-of-the-art action segmentation baselines such as MS-TCN, ASFormer, and UVAST. Key metrics include:
- Frame-wise Accuracy: ViSTec achieved 83.5%, compared to 78.2% for the best-performing baseline (MS-TCN).
- Edit Score: Measuring the correctness of the predicted sequence order, ViSTec reached 76.3, outperforming the nearest competitor (73.9).
- Efficiency: The model achieves an inference speed of 39.3 FPS on a single A100 GPU, making it suitable for real-time broadcast analysis.
Tactical Analysis and Insights
Beyond simple recognition, ViSTec enables automated tactical discovery. By analyzing the predicted sequences, the system can quantify the effectiveness of specific strategies. For instance, data analysis confirmed professional intuition by identifying that the sequence "Serve → Short → Topspin" yields the highest scoring rate.
Conclusion and Future Work
ViSTec successfully bridges the gap between low-level visual perception and high-level tactical reasoning in sports video analysis. While the current model excels at technique recognition, future iterations will aim to incorporate spatial features, such as ball placement and player positioning, to provide a more comprehensive tactical overview. Additionally, the researchers plan to explore personalized modeling to identify the "signature" patterns of world-class athletes.
Summary updated