Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review
The paper examines the properties of expert manual annotation of Russian spontaneous speech. While it is well known that experts exhibit variability in the ways they mark transcripted speech, our aim is to arrive at the reasons behind such variability. In this study we focus on the annotator’s psychological profile (personality traits, working memory capacity, processing speed and lateral asymmetry). Our focus is to determine whether there is a relationship between the annotated sentence length and the psychological and cognitive characteristics of the annotator. We also study inter-annotator agreement in different text types. The participants (n = 80) detected sentence boundaries in the transcripts of Russian spontaneous speech and performed several test tasks. Personality traits were measured using the Five Factor Personality Inventory. Working memory capacity was measured through reading span and operation span tasks. To compute processing speed we used Letter Comparison and Pattern Comparison tasks. A dominant hemisphere for speech processing was established based on a dichotic listening task. The data analysis did not reveal any relationship between annotators individual characteristics and segmentation results. However, we found that annotators do tend to mark sentence length in a way that is individual to them and that such practices remain relatively stable regardless of text type or even language.
Original language | English |
---|---|
Title of host publication | Speech and Computer - 21st International Conference, SPECOM 2019, Proceedings |
Editors | Albert Ali Salah, Albert Ali Salah, Alexey Karpov, Rodmonga Potapova |
Publisher | Springer Nature |
Pages | 459-470 |
Number of pages | 12 |
Volume | 11658 |
ISBN (Print) | 9783030260606 |
DOIs | |
State | Published - 1 Jan 2019 |
Name | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
---|---|
Volume | 11658 LNAI |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
ID: 45428529