Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review
We present a freely available Russian language sentiment lexicon PolSentiLex designed to detect sentiment in user-generated content related to social and political issues. The lexicon was generated from a database of posts and comments of the top 2,000 LiveJournal bloggers posted during one year (1.5 million posts and 20 million comments). Following a topic modeling approach, we extracted 85,898 documents that were used to retrieve domain-specific terms. This term list was then merged with several external sources. Together, they formed a lexicon (16,399 units) marked-up using a crowdsourcing strategy. A sample of Russian native speakers (n = 105) was asked to assess words’ sentiment given the context of their use (randomly paired) as well as the prevailing sentiment of the respective texts. In total, we received 59,208 complete annotations for both texts and words. Several versions of the marked-up lexicon were experimented with, and the final version was tested for quality against the only other freely available Russian language lexicon and against three machine learning algorithms. All experiments were run on two different collections. They have shown that, in terms of, lexicon-based approaches outperform machine learning by 11%, and our lexicon outperforms the alternative one by 11% on the first collection, and by 7% on the negative scale of the second collection while showing similar quality on the positive scale and being three times smaller. Our lexicon also outperforms or is similar to the best existing sentiment analysis results for other types of Russian-language texts.
Original language | English |
---|---|
Title of host publication | Artificial Intelligence and Natural Language - 9th Conference, AINL 2020, Proceedings |
Editors | Andrey Filchenkov, Janne Kauttonen, Lidia Pivovarova |
Publisher | Springer Nature |
Pages | 1-16 |
Number of pages | 16 |
ISBN (Print) | 9783030590819 |
DOIs | |
State | Published - 2020 |
Event | 9th Conference on Artificial Intelligence and Natural Language, AINL 2020 - Helsinki, Finland Duration: 7 Oct 2020 → 9 Oct 2020 |
Name | Communications in Computer and Information Science |
---|---|
Volume | 1292 CCIS |
ISSN (Print) | 1865-0929 |
ISSN (Electronic) | 1865-0937 |
Conference | 9th Conference on Artificial Intelligence and Natural Language, AINL 2020 |
---|---|
Abbreviated title | AINL 2020 |
Country/Territory | Finland |
City | Helsinki |
Period | 7/10/20 → 9/10/20 |
ID: 71870169