Application of automated tools in researching internet discourses: Experience of using the recurrent neural networks for studying discussions on pension reform

Petr Begen, Yuri Misnikov, Olga Filatova

Результат исследований: Публикации в книгах, отчётах, сборниках, трудах конференцийстатья в сборнике материалов конференциинаучнаярецензирование

Аннотация

The paper presents the results of an experiment that applied the Recurrent Neural Network (RNN) and long short-term memory (LSTM) networks to assess how accurately they can determine the attitude of 998 participants towards the pension reform policy in Russia who posted 10,592 comments on 16 online forums in 11 cities. The training set was assembled and coded according to a proposed conceptual model of a moral discourse based on Jurgen Habermas’s discourse ethics theory. The main conclusion of this experiment is that the discourse-based approach — based on the identification of basic validity claims — can be instrumental in building training datasets for deep machine learning on a socially salient topic. The experiment also shows benefits and limitations of using artificial neural networks for a deeper understanding of the results of public discussions in an online environment. The main benefit was that the built neural networks have proven to be sufficiently accurate in predicting positions of discourse participants towards the pension reform policy, with almost 90% in the case of binary classification (two “For” and “Against” positions). However, the accuracy level drops with the inclusion of a third “Neutral” category (to 78%), which was a major limitation of the research; that is, the variation in the prediction accuracy is due to the uneven distribution of data among categories and an increase of new data. Yet this indicator is still acceptable when working with Internet discourse data.

Язык оригиналаанглийский
Название основной публикации21st Conference on Scientific Services and Internet, SSI 2019
Страницы336-344
Число страниц9
Том2543
СостояниеОпубликовано - 1 янв 2020
Событие21st Conference on Scientific Services and Internet, SSI 2019 - Novorossiysk-Abrau, Российская Федерация
Продолжительность: 23 сен 201928 сен 2019

Серия публикаций

НазваниеCEUR Workshop Proceedings
ИздательRWTH Aahen University
ISSN (печатное издание)1613-0073

конференция

конференция21st Conference on Scientific Services and Internet, SSI 2019
СтранаРоссийская Федерация
ГородNovorossiysk-Abrau
Период23/09/1928/09/19

Предметные области Scopus

  • Компьютерные науки (все)

Fingerprint Подробные сведения о темах исследования «Application of automated tools in researching internet discourses: Experience of using the recurrent neural networks for studying discussions on pension reform». Вместе они формируют уникальный семантический отпечаток (fingerprint).

  • Цитировать

    Begen, P., Misnikov, Y., & Filatova, O. (2020). Application of automated tools in researching internet discourses: Experience of using the recurrent neural networks for studying discussions on pension reform. В 21st Conference on Scientific Services and Internet, SSI 2019 (Том 2543, стр. 336-344). (CEUR Workshop Proceedings).