SOCCER: An Information-Sparse Discourse State Tracking Collection in the Sports Commentary Domain
Lists
Only you see this
Abstract
In the pursuit of natural language understanding, there has been a long standing interest in tracking state changes throughout narratives. Impressive progress has been made in modeling the state of transaction-centric dialogues and procedural texts. However, this problem has been less intensively studied in the realm of general discourse where ground truth descriptions of states may be loosely defined and state changes are less densely distributed over utterances. This paper proposes to turn to simplified, fully observable systems that show some of these properties: Sports events. We curated 2,263 soccer matches including time-stamped natural language commentary accompanied by discrete events such as a team scoring goals, switching players or being penalized with cards. We propose a new task formulation where, given paragraphs of commentary of a game at different timestamps, the system is asked to recognize the occurrence of in-game events. This domain allows for rich descriptions of state while avoiding the complexities of many other real-world settings. As an initial point of performance measurement, we include two baseline methods from the perspectives of sentence classification with temporal dependence and current state-of-the-art generative model, respectively, and demonstrate that even sophisticated existing methods struggle on the state tracking task when the definition of state broadens or non-event chatter becomes prevalent.
BibTeX
@inproceedings{zhang2021soccer,
author = {Ruochen Zhang and Carsten Eickhoff},
title = {{SOCCER: An Information-Sparse Discourse State Tracking Collection in the Sports Commentary Domain}},
booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
year = {2021},
doi = {10.18653/v1/2021.naacl-main.342},
}| SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentaries | Workshops @ CVPR · 2023 |
| Going for GOAL: A Resource for Grounded Football Commentaries | arXiv · 2022 |
| Generating Live Soccer-Match Commentary from Play Data | AAAI · 2019 |
| SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videos | Workshops @ CVPR · 2018 |
| Semantic Understanding of Professional Soccer Commentaries | arXiv · 2012 |
| Towards Universal Soccer Video Understanding | arXiv · 2024 |