Using Generative Pretrained Transformer-3 Models for Russian News Clustering and Title Generation tasks
Lists
Only you see this
Abstract
The paper presents a methodology for news clustering and news headline generation based on the zero-shot approach and minimal tuning of the RuGPT-3 architecture (Generative Pretrained Transformer 3 for Russian). The solution is presented in a competition for news clustering, headline selection and generation. The following approaches are described: 1) zero-shot unsupervised classification based on pairwise news perplexity: the method requires no training or model fine-tuning and yields 0.7 F1-measure. 2) fine-tuning: news headlines generation with the best result 0.292 ROUGE and 0.596 BLEU.
BibTeX
@inproceedings{tikhonova2021using,
author = {Maria Tikhonova and Tatiana Shavrina and Dina Pisarevskaya and Oleh Shliazhko and Oleh Shliazhko and SberDevices, Sberbank, Moscow, Russia},
title = {{Using Generative Pretrained Transformer-3 Models for Russian News Clustering and Title Generation tasks}},
booktitle = {Kompʹûternaâ},
year = {2021},
doi = {10.28995/2075-7182-2021-20-1214-1223},
}Loading related content...