Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review
For the purposes of searching for various communities on the Internet, automatic typology of text messages defined via application of methods of cluster analysis may be used. In this paper, we address one of the significant issues in text classification via cluster analysis, namely determination of the number of clusters. For clustering based on semantics, text documents are typically represented in the form of vectors within n-dimensional linear space. What we suggest as a method for determining the number of clusters is the agglomerative clustering of vectors in the linear space. In our work, statistical analysis is combined with neural network algorithms to obtain a more accurate semantic portrait of a text. Then, using the techniques of distributive semantics, mapping of the derived network structures into a vector form is constructed. A statistical criterion for the completion of the clustering process is derived, defined as a Markovian moment. By obtaining automatic partitioning into clusters, one can compare texts that are closest to the centroids with actual content samples or evaluate such texts with the help of experts. If the display of texts in a vector form is adequate, all informational messages from a fixed cluster have the same meaning and the same emotional coloring. In addition, we discuss a possibility to use vector representation of texts for sentiment detection in short texts like search engines input or tweets.
Original language | English |
---|---|
Title of host publication | Internet Science. 6th International Conference, INSCI 2019 |
Subtitle of host publication | Proceedings |
Editors | Samira El Yacoubi, Franco Bagnoli, Giovanna Pacini |
Place of Publication | Cham |
Publisher | Springer Nature |
Pages | 235-249 |
Number of pages | 15 |
ISBN (Electronic) | 9780030347703 |
ISBN (Print) | 9783030347697 |
DOIs | |
State | Published - 1 Dec 2019 |
Event | 6th International Conference on Internet Science, INSCI 2019 - Perpignan, France Duration: 2 Dec 2019 → 5 Dec 2019 |
Name | Lecture Notes in Computer Science |
---|---|
Publisher | Springer |
Volume | 11938 |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference | 6th International Conference on Internet Science, INSCI 2019 |
---|---|
Abbreviated title | INSCI'2019 |
Country/Territory | France |
City | Perpignan |
Period | 2/12/19 → 5/12/19 |
ID: 49785323