RuSimpleSentEval-2021 Shared Task: Evaluating Sentence Simplification for Russian

Andrey Sakhovskiy, Alexandra Izhevskaya, Alena Pestova, Elena Tutubalina, Valentin Malykh, Ivan Smurov, Ekaterina ArtemovaKompʹûternaâ 2021 · DOI

Abstract

This report presents the results from the RuSimpleSentEval Shared Task conducted as a part of the Dialogue 2021 evaluation campaign. For the RSSE Shared Task, devoted to sentence simplification in Russian, a new middlescale dataset is created from scratch. It enumerates more than 3000 sentences sampled from popular Wikipedia pages. Each sentence is aligned with 2.2 simplified modifications, on average. The Shared Task implies sequenceto-sequence approaches: given an input complex sentence, a system should provide with its simplified version. A popular sentence simplification measure, SARI, is used to evaluate the system's performance.
BibTeX
@inproceedings{sakhovskiy2021rusimplesenteval,
  author = {Andrey Sakhovskiy and Alexandra Izhevskaya and Alena Pestova and Elena Tutubalina and Valentin Malykh and Ivan Smurov and Ekaterina Artemova and Ekaterina Artemova},
  title = {{RuSimpleSentEval-2021 Shared Task: Evaluating Sentence Simplification for Russian}},
  booktitle = {Kompʹûternaâ},
  year = {2021},
  doi = {10.28995/2075-7182-2021-20-607-617},
}

Loading related content...

Figure