Результаты исследований: Публикации в книгах, отчётах, сборниках, трудах конференций › статья в сборнике материалов конференции › научная › Рецензирование
For the purposes of searching for various communities on the Internet, automatic typology of text messages defined via application of methods of cluster analysis may be used. In this paper, we address one of the significant issues in text classification via cluster analysis, namely determination of the number of clusters. For clustering based on semantics, text documents are typically represented in the form of vectors within n-dimensional linear space. What we suggest as a method for determining the number of clusters is the agglomerative clustering of vectors in the linear space. In our work, statistical analysis is combined with neural network algorithms to obtain a more accurate semantic portrait of a text. Then, using the techniques of distributive semantics, mapping of the derived network structures into a vector form is constructed. A statistical criterion for the completion of the clustering process is derived, defined as a Markovian moment. By obtaining automatic partitioning into clusters, one can compare texts that are closest to the centroids with actual content samples or evaluate such texts with the help of experts. If the display of texts in a vector form is adequate, all informational messages from a fixed cluster have the same meaning and the same emotional coloring. In addition, we discuss a possibility to use vector representation of texts for sentiment detection in short texts like search engines input or tweets.
Язык оригинала | английский |
---|---|
Название основной публикации | Internet Science. 6th International Conference, INSCI 2019 |
Подзаголовок основной публикации | Proceedings |
Редакторы | Samira El Yacoubi, Franco Bagnoli, Giovanna Pacini |
Место публикации | Cham |
Издатель | Springer Nature |
Страницы | 235-249 |
Число страниц | 15 |
ISBN (электронное издание) | 9780030347703 |
ISBN (печатное издание) | 9783030347697 |
DOI | |
Состояние | Опубликовано - 1 дек 2019 |
Событие | 6th International Conference on Internet Science (INSCI) 2019 - Perpignan, Франция Продолжительность: 2 дек 2019 → 5 дек 2019 |
Название | Lecture Notes in Computer Science |
---|---|
Издатель | Springer |
Том | 11938 |
ISSN (печатное издание) | 0302-9743 |
ISSN (электронное издание) | 1611-3349 |
конференция | 6th International Conference on Internet Science (INSCI) 2019 |
---|---|
Сокращенное название | INSCI'2019 |
Страна/Tерритория | Франция |
Город | Perpignan |
Период | 2/12/19 → 5/12/19 |
ID: 49785323