The paper deals with collocation extraction from corpus data. A collocation is meant as a special type of a set phrase. Many modern authors and most of corpus linguists understand collocations as statistically determined set phrases. The above approach is the basic point of this paper which is aimed at evaluation of various statistical methods of automatic collocation extraction. There are several ways to calculate the degree of coherence of parts of a collocation. A whole number of formulae have been created to integrate different factors that determine the association between the collocation components. Usually, such formulae are called association measures. The experiments are described which objective was to study the method of collocation extraction based on the statistical association measures. We extracted collocations for the word (water) and some others by means of the tool Collocations of the NoSketch Engine system using 7 association measures. It is important to stress that the experiments were conducted using representative corpora, with large amount of the resulting collocations being under study. The data on the measure precision allows to establish to some degree that in cases when collocation extraction is not used for some special purposes such measures as MI.l-og-f, log-Dice, and minimum sensitivity should be used. No measure is ideal, which is why various options of their integration are desirable and useful. And we propose a number of parameters that allow to rank collocates in an integrated list, namely, an average rank, a normalised rank and an optimised rank.

Язык оригиналаанглийский
Страницы (с-по)387-398
Число страниц12
ЖурналKomp'juternaja Lingvistika i Intellektual'nye Tehnologii
Том1
Номер выпуска16
СостояниеОпубликовано - 2017
СобытиеXX Международная объединенная научная конференция «Интернет и современное общество»: международная объединенная конференция - Университет ИТМО, Санкт-Петербург, Российская Федерация
Продолжительность: 21 июн 201723 июн 2017
Номер конференции: XX
http://icims.ifmo.ru/
http://ims.ifmo.ru/ru/pages/28/IMS_2017.htm

    Предметные области Scopus

  • Языки и лингвистика
  • Языки и лингвистика
  • Прикладные компьютерные науки

ID: 92112217