The paper deals with collocation extraction from corpus data. A collocation is meant as a special type of a set phrase. Many modern authors and most of corpus linguists understand collocations as statistically determined set phrases. The above approach is the basic point of this paper which is aimed at evaluation of various statistical methods of automatic collocation extraction. There are several ways to calculate the degree of coherence of parts of a collocation. A whole number of formulae have been created to integrate different factors that determine the association between the collocation components. Usually, such formulae are called association measures. The experiments are described which objective was to study the method of collocation extraction based on the statistical association measures. We extracted collocations for the word (water) and some others by means of the tool Collocations of the NoSketch Engine system using 7 association measures. It is important to stress that the experiments were conducted using representative corpora, with large amount of the resulting collocations being under study. The data on the measure precision allows to establish to some degree that in cases when collocation extraction is not used for some special purposes such measures as MI.l-og-f, log-Dice, and minimum sensitivity should be used. No measure is ideal, which is why various options of their integration are desirable and useful. And we propose a number of parameters that allow to rank collocates in an integrated list, namely, an average rank, a normalised rank and an optimised rank.

Original languageEnglish
Pages (from-to)387-398
Number of pages12
JournalKomp'juternaja Lingvistika i Intellektual'nye Tehnologii
Volume1
Issue number16
StatePublished - 2017
Event2017 International Conference on Internet and Modern Society, IMS 2017: международная объединенная конференция - Университет ИТМО, Санкт-Петербург, Russian Federation
Duration: 21 Jun 201723 Jun 2017
Conference number: XX
http://icims.ifmo.ru/
http://ims.ifmo.ru/ru/pages/28/IMS_2017.htm

    Research areas

  • Association measures, Average rank, Collocation extraction, Evaluation, Normalised rank, Optimised medium rank

    Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language
  • Computer Science Applications

ID: 92112217