<abstract xmlns="http://www.w3.org/1999/xhtml"><p>The paper describes the preparation and development of the text collections within the framework of MorphoRuEval-2017 shared task, an evaluation campaign designed to stimulate development of the automatic morphological processing technologies for Russian. The main challenge for the organizers was to standardize all available Russian corpora with the manually verified high-quality tagging to a single format (Universal Dependencies CONLL-U). The sources of the data were the disambiguated subcorpus of the Russian National Corpus, SynTagRus, OpenCorpora.org data and GICR corpus with the resolved homonymy, all exhibiting different tagsets, rules for lemmatization, pipeline architecture, technical solutions and error systematicity. The collections includes both normative texts (the news and modern literature) and more informal discourse (social media and spoken data), the texts are available under CC BY-NC-SA 3.0 license.</p></abstract>

The paper describes the preparation and development of the text collections within the framework of MorphoRuEval-2017 shared task, an evaluation campaign designed to stimulate development of the automatic morphological processing technologies for Russian. The main challenge for the organizers was to standardize all available Russian corpora with the manually verified high-quality tagging to a single format (Universal Dependencies CONLL-U). The sources of the data were the disambiguated subcorpus of the Russian National Corpus, SynTagRus, OpenCorpora.org data and GICR corpus with the resolved homonymy, all exhibiting different tagsets, rules for lemmatization, pipeline architecture, technical solutions and error systematicity. The collections includes both normative texts (the news and modern literature) and more informal discourse (social media and spoken data), the texts are available under CC BY-NC-SA 3.0 license.

Text collections for evaluation of Russian morphological taggers

Moscow Institute of Physics and Technology

Vinogradov Institute of the Russian Language RAS

Journal of Linguistics/Jazykovedný casopis

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

{"article-title":"Text collections for evaluation of Russian morphological taggers"}

The paper describes the preparation and development of the text collections within the framework of MorphoRuEval-2017 shared task, an evaluation campaign...

Text collections for evaluation of Russian morphological taggers

Pubblicato online: 24 gen 2018

Pagine: 258 - 267

DOI: https://doi.org/10.1515/jazcas-2017-0035

Parole chiave
text collection, shared task, morphological tagging, universal dependencies, morphological parsing, Russian corpora

© 2017 Olga Lyashevskaya et al., published by De Gruyter Open

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Text collections for evaluation of Russian morphological taggers

Pubblicato online: 24 gen 2018

Pagine: 258 - 267

DOI: https://doi.org/10.1515/jazcas-2017-0035

Parole chiavetext collection, shared task, morphological tagging, universal dependencies, morphological parsing, Russian corpora

© 2017 Olga Lyashevskaya et al., published by De Gruyter Open

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Parole chiave
text collection, shared task, morphological tagging, universal dependencies, morphological parsing, Russian corpora