Application of automated tools in researching internet discourses: Experience of using the recurrent neural networks for studying discussions on pension reform

Petr Begen, Yuri Misnikov, Olga Filatova

Research outputpeer-review

Abstract

The paper presents the results of an experiment that applied the Recurrent Neural Network (RNN) and long short-term memory (LSTM) networks to assess how accurately they can determine the attitude of 998 participants towards the pension reform policy in Russia who posted 10,592 comments on 16 online forums in 11 cities. The training set was assembled and coded according to a proposed conceptual model of a moral discourse based on Jurgen Habermas’s discourse ethics theory. The main conclusion of this experiment is that the discourse-based approach — based on the identification of basic validity claims — can be instrumental in building training datasets for deep machine learning on a socially salient topic. The experiment also shows benefits and limitations of using artificial neural networks for a deeper understanding of the results of public discussions in an online environment. The main benefit was that the built neural networks have proven to be sufficiently accurate in predicting positions of discourse participants towards the pension reform policy, with almost 90% in the case of binary classification (two “For” and “Against” positions). However, the accuracy level drops with the inclusion of a third “Neutral” category (to 78%), which was a major limitation of the research; that is, the variation in the prediction accuracy is due to the uneven distribution of data among categories and an increase of new data. Yet this indicator is still acceptable when working with Internet discourse data.

Original languageEnglish
Title of host publication21st Conference on Scientific Services and Internet, SSI 2019
Pages336-344
Number of pages9
Volume2543
Publication statusPublished - 1 Jan 2020
Event21st Conference on Scientific Services and Internet, SSI 2019 - Novorossiysk-Abrau
Duration: 23 Sep 201928 Sep 2019

Publication series

NameCEUR Workshop Proceedings
PublisherRWTH Aahen University
ISSN (Print)1613-0073

Conference

Conference21st Conference on Scientific Services and Internet, SSI 2019
CountryRussian Federation
CityNovorossiysk-Abrau
Period23/09/1928/09/19

    Fingerprint

Scopus subject areas

  • Computer Science(all)

Cite this

Begen, P., Misnikov, Y., & Filatova, O. (2020). Application of automated tools in researching internet discourses: Experience of using the recurrent neural networks for studying discussions on pension reform. In 21st Conference on Scientific Services and Internet, SSI 2019 (Vol. 2543, pp. 336-344). (CEUR Workshop Proceedings).