The paper examines the properties of expert manual annotation of Russian spontaneous speech. While it is well known that experts exhibit variability in the ways they mark transcripted speech, our aim is to arrive at the reasons behind such variability. In this study we focus on the annotator’s psychological profile (personality traits, working memory capacity, processing speed and lateral asymmetry). Our focus is to determine whether there is a relationship between the annotated sentence length and the psychological and cognitive characteristics of the annotator. We also study inter-annotator agreement in different text types. The participants (n = 80) detected sentence boundaries in the transcripts of Russian spontaneous speech and performed several test tasks. Personality traits were measured using the Five Factor Personality Inventory. Working memory capacity was measured through reading span and operation span tasks. To compute processing speed we used Letter Comparison and Pattern Comparison tasks. A dominant hemisphere for speech processing was established based on a dichotic listening task. The data analysis did not reveal any relationship between annotators individual characteristics and segmentation results. However, we found that annotators do tend to mark sentence length in a way that is individual to them and that such practices remain relatively stable regardless of text type or even language.

Original languageEnglish
Title of host publicationSpeech and Computer - 21st International Conference, SPECOM 2019, Proceedings
EditorsAlbert Ali Salah, Albert Ali Salah, Alexey Karpov, Rodmonga Potapova
PublisherSpringer Nature
Pages459-470
Number of pages12
Volume11658
ISBN (Print)9783030260606
DOIs
StatePublished - 1 Jan 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11658 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

    Research areas

  • Annotation, Dominant hemisphere, Lateral asymmetry, Personality, Russian, Segmentation, Sentence boundary detection, Spontaneous speech, Working memory capacity

    Scopus subject areas

  • Arts and Humanities(all)
  • Theoretical Computer Science
  • Computer Science(all)

ID: 45428529