<abstract xmlns="http://www.w3.org/1999/xhtml"><p>The paper describes the preparation and development of the text collections within the framework of MorphoRuEval-2017 shared task, an evaluation campaign designed to stimulate development of the automatic morphological processing technologies for Russian. The main challenge for the organizers was to standardize all available Russian corpora with the manually verified high-quality tagging to a single format (Universal Dependencies CONLL-U). The sources of the data were the disambiguated subcorpus of the Russian National Corpus, SynTagRus, OpenCorpora.org data and GICR corpus with the resolved homonymy, all exhibiting different tagsets, rules for lemmatization, pipeline architecture, technical solutions and error systematicity. The collections includes both normative texts (the news and modern literature) and more informal discourse (social media and spoken data), the texts are available under CC BY-NC-SA 3.0 license.</p></abstract>

The paper describes the preparation and development of the text collections within the framework of MorphoRuEval-2017 shared task, an evaluation campaign designed to stimulate development of the automatic morphological processing technologies for Russian. The main challenge for the organizers was to standardize all available Russian corpora with the manually verified high-quality tagging to a single format (Universal Dependencies CONLL-U). The sources of the data were the disambiguated subcorpus of the Russian National Corpus, SynTagRus, OpenCorpora.org data and GICR corpus with the resolved homonymy, all exhibiting different tagsets, rules for lemmatization, pipeline architecture, technical solutions and error systematicity. The collections includes both normative texts (the news and modern literature) and more informal discourse (social media and spoken data), the texts are available under CC BY-NC-SA 3.0 license.

Text collections for evaluation of Russian morphological taggers

Moscow Institute of Physics and Technology

Vinogradov Institute of the Russian Language RAS

Journal of Linguistics/Jazykovedný casopis

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

{"article-title":"Text collections for evaluation of Russian morphological taggers"}

The paper describes the preparation and development of the text collections within the framework of MorphoRuEval-2017 shared task, an evaluation campaign...

Text collections for evaluation of Russian morphological taggers

Publicado en línea: 24 ene 2018

Páginas: 258 - 267

DOI: https://doi.org/10.1515/jazcas-2017-0035

Palabras clave
text collection, shared task, morphological tagging, universal dependencies, morphological parsing, Russian corpora

© 2017 Olga Lyashevskaya et al., published by De Gruyter Open

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Text collections for evaluation of Russian morphological taggers

Publicado en línea: 24 ene 2018

Páginas: 258 - 267

DOI: https://doi.org/10.1515/jazcas-2017-0035

Palabras clavetext collection, shared task, morphological tagging, universal dependencies, morphological parsing, Russian corpora

© 2017 Olga Lyashevskaya et al., published by De Gruyter Open

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Palabras clave
text collection, shared task, morphological tagging, universal dependencies, morphological parsing, Russian corpora