Universal Dependencies 2.0 – CoNLL 2017 Shared Task Development and Test Data

Joakim Nivre, Żeljko Agić, Lars Ahrenberg, Lene Antonsen, María Jesús Aranzabe, Masayuki Asahara, Luma Ateyah, Mohammed Attia, Aitziber Atutxa, Jenna Kanerva, Miguel Ballesteros, Esha Banerjee, Sebastian Bank, John Bauer, Kepa Bengoetxea, Riyaz Ahmad Bhat, Eckhard Bick, Cristina Bosco, Gosse Bouma, Sam Bowman, Aljoscha Burchardt, Marie Candito, Gauthier Caron, Gülşen Eryiğit, Giuseppe G. A. Celano, Savas Cetin, Fabricio Chalub, Jinho D. Choi, Yong-Seok Cho, Silvie Cinková, Çağrı Çöltekin, Miriam Connor, Marie-Catherine de Marneffe, Valeria de Paiva, Arantza Díaz de Ilarraza, Kaja Dobrovoljc, Timothy Dozat, Kira Droganova, Marhaba Eli, Ali Elkahky, Tomaž Erjavec, Richárd Farkas, Héctor Fernández Alcalde, Jennifer Foster, Cláudia Freitas, Katarína Gajdošová, Daniel Galbraith, Marcos García, Filip Ginter, Iakes Goenaga, Koldo Gojenola, Memduh Gökırmak, Yoav Goldberg, Xavier Gómez Guinovart, Berta Gonzáles Saavedra, Matias Grioni, Normunds Grūzītis, Bruno Guillaume, Nizar Habash, Jan Hajič, Linh Hà Mỹ, Kim Harris, Dag Haug, Barbora Hladká, Jaroslava Hlaváčová, Petter Hohle, Radu Ion, Elena Irimia, Anders Johannsen, Fredrik Jørgensen, Hüner Kaşıkara, Hiroshi Kanayama, Tolga Kayadelen, Václava Kettnerová, Jesse Kirchner, Natalia Kotsyba, Simon Krek, Sookyoung Kwak, Veronika Laippala, Lorenzo Lambertino, Tatiana Lando, Phương Lê Hồng, Alessandro Lenci, Saran Lertpradit, Herman Leung, Cheuk Ying Li, Josie Li, Nikola Ljubešić, Olga Loginova, Olga Lyashevskaya, Teresa Lynn, Vivien Macketanz, Aibek Makazhanov, Michael Mandl, Christopher D. Manning, Hendra Manurung, Cătălina Mărănduc, David Mareček, Katrin MarheineckeAmericanae 2017

Abstract

Universal Dependencies is a project that seeks to develop cross-linguistically consistent treebank annotation for many languages, with the goal of facilitating multilingual parser development, cross-lingual learning, and parsing research from a language typology perspective. The annotation scheme is based on (universal) Stanford dependencies (de Marneffe et al., 2006, 2008, 2014), Google universal part-of-speech tags (Petrov et al., 2012), and the Interset interlingua for morphosyntactic tagsets (Zeman, 2008). This release contains the test data used in the CoNLL 2017 shared task on parsing Universal Dependencies. Due to the shared task the test data was held hidden and not released together with the training and development data of UD 2.0. Therefore this release complements the UD 2.0 release (http://hdl.handle.net/11234/1-1983) to a full release of UD treebanks. In addition, the present release contains 18 new parallel test sets and 4 test sets in surprise languages. The present release also includes the development data already released with UD 2.0. Unlike regular UD releases, this one uses the folder-file structure that was visible to the systems participating in the shared task.
BibTeX
@inproceedings{nivre2017universal,
  author = {Joakim Nivre and Żeljko Agić and Lars Ahrenberg and Lene Antonsen and María Jesús Aranzabe and Masayuki Asahara and Luma Ateyah and Mohammed Attia and Aitziber Atutxa and Jenna Kanerva and Miguel Ballesteros and Esha Banerjee and Sebastian Bank and John Bauer and Kepa Bengoetxea and Riyaz Ahmad Bhat and Eckhard Bick and Cristina Bosco and Gosse Bouma and Sam Bowman and Aljoscha Burchardt and Marie Candito and Gauthier Caron and Gülşen Eryiğit and Giuseppe G. A. Celano and Savas Cetin and Fabricio Chalub and Jinho D. Choi and Yong-Seok Cho and Silvie Cinková and Çağrı Çöltekin and Miriam Connor and Marie-Catherine de Marneffe and Valeria de Paiva and Arantza Díaz de Ilarraza and Kaja Dobrovoljc and Timothy Dozat and Kira Droganova and Marhaba Eli and Ali Elkahky and Tomaž Erjavec and Richárd Farkas and Héctor Fernández Alcalde and Jennifer Foster and Cláudia Freitas and Katarína Gajdošová and Daniel Galbraith and Marcos García and Filip Ginter and Iakes Goenaga and Koldo Gojenola and Memduh Gökırmak and Yoav Goldberg and Xavier Gómez Guinovart and Berta Gonzáles Saavedra and Matias Grioni and Normunds Grūzītis and Bruno Guillaume and Nizar Habash and Jan Hajič and Linh Hà Mỹ and Kim Harris and Dag Haug and Barbora Hladká and Jaroslava Hlaváčová and Petter Hohle and Radu Ion and Elena Irimia and Anders Johannsen and Fredrik Jørgensen and Hüner Kaşıkara and Hiroshi Kanayama and Jenna Kanerva and Tolga Kayadelen and Václava Kettnerová and Jesse Kirchner and Natalia Kotsyba and Simon Krek and Sookyoung Kwak and Veronika Laippala and Lorenzo Lambertino and Tatiana Lando and Phương Lê Hồng and Alessandro Lenci and Saran Lertpradit and Herman Leung and Cheuk Ying Li and Josie Li and Nikola Ljubešić and Olga Loginova and Olga Lyashevskaya and Teresa Lynn and Vivien Macketanz and Aibek Makazhanov and Michael Mandl and Christopher D. Manning and Hendra Manurung and Cătălina Mărănduc and David Mareček and Katrin Marheinecke},
  title = {{Universal Dependencies 2.0 – CoNLL 2017 Shared Task Development and Test Data}},
  booktitle = {Americanae},
  year = {2017},
}

Loading related content...

Figure