Research output: Contribution to journal › Conference article › peer-review
The paper deals with collocation extraction from corpus data. A collocation is meant as a special type of a set phrase. Many modern authors and most of corpus linguists understand collocations as statistically determined set phrases. The above approach is the basic point of this paper which is aimed at evaluation of various statistical methods of automatic collocation extraction. There are several ways to calculate the degree of coherence of parts of a collocation. A whole number of formulae have been created to integrate different factors that determine the association between the collocation components. Usually, such formulae are called association measures. The experiments are described which objective was to study the method of collocation extraction based on the statistical association measures. We extracted collocations for the word (water) and some others by means of the tool Collocations of the NoSketch Engine system using 7 association measures. It is important to stress that the experiments were conducted using representative corpora, with large amount of the resulting collocations being under study. The data on the measure precision allows to establish to some degree that in cases when collocation extraction is not used for some special purposes such measures as MI.l-og-f, log-Dice, and minimum sensitivity should be used. No measure is ideal, which is why various options of their integration are desirable and useful. And we propose a number of parameters that allow to rank collocates in an integrated list, namely, an average rank, a normalised rank and an optimised rank.
Original language | English |
---|---|
Pages (from-to) | 387-398 |
Number of pages | 12 |
Journal | Komp'juternaja Lingvistika i Intellektual'nye Tehnologii |
Volume | 1 |
Issue number | 16 |
State | Published - 2017 |
Event | 2017 International Conference on Internet and Modern Society, IMS 2017: международная объединенная конференция - Университет ИТМО, Санкт-Петербург, Russian Federation Duration: 21 Jun 2017 → 23 Jun 2017 Conference number: XX http://icims.ifmo.ru/ http://ims.ifmo.ru/ru/pages/28/IMS_2017.htm |
ID: 92112217