Topic modeling for Twitter discussions: Model selection and quality assessment

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

Topic modeling is a method of automated definition of subtopics in a text corpus. Usage of topic modeling for short texts, e.g. tweets, is highly complicated due to their short length and grammatical restructuring, including broken word order, abbreviations, and contamination of different languages. In this paper, the authors use the BTM topic modelling algorithm (previously found to work best in comparison with two other topic models measured by automated coherence metrics Umass and NPMI) to test three topic quality metrics independent from topic coherence. Topic modelling is applied to three cases of ethnic conflict discussions on Twitter in three different main languages, namely the Charlie Hebdo shooting (France), the Ferguson unrest (the USA), and the anti-immigrant bashings in Biryulevo (Russia), thus combining a large multilingual, a large monolingual, and a mid-range monolingual type of discussion. We measure the quality of modeling by looking at topic interpretability, topic robustness, and topic saliency. The results of the experiment show that the three topic features may be interdependent (but not always are); the multilingual discussion performs better than the monolingual ones in terms of interdependence of the metrics and formation of ideal topics; and interpretability does not depend on multi-/monolingualism and the dataset volume.
Original languageEnglish
Title of host publication6TH SWS INTERNATIONAL SCIENTIFIC CONFERENCES ON SOCIAL SCIENCES 2019
Subtitle of host publicationConference proceedings
Place of PublicationSofia, Bulgaria
PublisherSTEF92 Technology Ltd.
Pages207-214
Number of pages8
Volume6
ISBN (Print)978-619-7408-95-9
StatePublished - Aug 2019
Event6th SWS International Scientific Conference on Social Sciences 2019 - Paradise Blue 5 *****, Congress Center, Albena, Bulgaria
Duration: 26 Aug 20191 Sep 2019
Conference number: 6
https://www.sgemsocial.org/

Conference

Conference6th SWS International Scientific Conference on Social Sciences 2019
Abbreviated titleISCSS 2019
CountryBulgaria
CityAlbena
Period26/08/191/09/19
Internet address

Keywords

  • Topic modelling
  • Twitter
  • QUALITY ASSESSMENT
  • BTM
  • HUMAN CODING
  • TOPIC COHERENCE
  • INTERPRETABILITY
  • TOPIC SALIENCY
  • TOPIC ROBUSTNESS

Fingerprint

Dive into the research topics of 'Topic modeling for Twitter discussions: Model selection and quality assessment'. Together they form a unique fingerprint.

Cite this