Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review
FactRuEval 2016 : Evaluation of named entity recognition and fact extraction systems for Russian. / Starostin, A. S.; Bocharov, V. V.; Alexeeva, S. V.; Bodrova, A. A.; Chuchunkov, A. S.; Dzhumaev, S. S.; Efimenko, I. V.; Granovsky, D. V.; Khoroshevsky, V. F.; Krylova, I. V.; Nikolaeva, M. A.; Smurov, I. M.; Toldova, S. Y.
FactRuEval 2016: Evaluation of Named Entity Recognition and Fact Extraction Systems for Russian. 2016. p. 702-720 (Komp'juternaja Lingvistika i Intellektual'nye Tehnologii).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review
}
TY - GEN
T1 - FactRuEval 2016
T2 - 2016 International Conference on Computational Linguistics and Intellectual Technologies, Dialogue 2016
AU - Starostin, A. S.
AU - Bocharov, V. V.
AU - Alexeeva, S. V.
AU - Bodrova, A. A.
AU - Chuchunkov, A. S.
AU - Dzhumaev, S. S.
AU - Efimenko, I. V.
AU - Granovsky, D. V.
AU - Khoroshevsky, V. F.
AU - Krylova, I. V.
AU - Nikolaeva, M. A.
AU - Smurov, I. M.
AU - Toldova, S. Y.
N1 - Copyright: Copyright 2017 Elsevier B.V., All rights reserved.
PY - 2016
Y1 - 2016
N2 - In this paper, we describe the rules and results of the FactRuEval information extraction competition held in 2016 as part of the Dialogue Evaluation initiative in the run-up to Dialogue 2016. The systems were to extract information from Russian texts and competed in two named entity extraction tracks and one fact extraction track. The paper describes the tasks set before the participants and presents the scores achieved by the contending systems. Additionally, we dwell upon the scoring methods employed for evaluating the results of all the three tracks and provide some preliminary analysis of the state of the art in Information Extraction for Russian texts. We also provide a detailed description of the composition and general organization of the annotated corpus created for the competition by volunteers using the OpenCorpora.org platform. The corpus is publicly available and is expected to evolve in the future.
AB - In this paper, we describe the rules and results of the FactRuEval information extraction competition held in 2016 as part of the Dialogue Evaluation initiative in the run-up to Dialogue 2016. The systems were to extract information from Russian texts and competed in two named entity extraction tracks and one fact extraction track. The paper describes the tasks set before the participants and presents the scores achieved by the contending systems. Additionally, we dwell upon the scoring methods employed for evaluating the results of all the three tracks and provide some preliminary analysis of the state of the art in Information Extraction for Russian texts. We also provide a detailed description of the composition and general organization of the annotated corpus created for the competition by volunteers using the OpenCorpora.org platform. The corpus is publicly available and is expected to evolve in the future.
KW - Evaluation
KW - Fact extraction
KW - Information extraction
KW - Named entity recognition
KW - Relation extraction
UR - http://www.scopus.com/inward/record.url?scp=85006096132&partnerID=8YFLogxK
M3 - Conference contribution
T3 - Komp'juternaja Lingvistika i Intellektual'nye Tehnologii
SP - 702
EP - 720
BT - FactRuEval 2016: Evaluation of Named Entity Recognition and Fact Extraction Systems for Russian
Y2 - 1 June 2016 through 4 June 2016
ER -
ID: 7569428