Ссылки

DOI

The study of speech in different emotional, psychophysiological and cognitive states is an important task for the development of speech systems. Cognitive load is the load on a person's cognitive system when performing a task. This paper analyses speech characteristics and facial features that can serve as the markers of cognitive load. Previous research revealed that cognitive load is associated with increasing fundamental frequency (F0), laryngealization, narrowing F0 range, changing articulation rate. Cognitive load can also be recognized using head pose, eye gaze and facial expressions. Two experiments were conducted in order to study speech and facial movements under cognitive load. During the first experiment, the participants played a driving simulator game and answered general knowledge questions simultaneously. Audio and videosamples were recorded. The information about action units (facial muscle movements) was obtained using Open Face 2.2.0. The results revealed that the most frequent visual characteristics of cognitive load are turning eyes to the right (AU62) and dimpler (AU14, the contraction of the buccinator muscle). In the second experiment, three episodes of a talk show were studied. The interviewer was driving a vehicle and conducting an interview as a dual task. The results showed that the most common visual markers of cognitive load are AU01 (inner brow raising), AU02 (outer brow raising), AU05 (upper lid raiser), AU10 (upper lip raiser), AU15 (lip corner depressor). The findings in both experiments suggest that cognitive load could be recognized by movements in the eye area and lip area.
Язык оригиналаанглийский
Название основной публикацииSpeech and Computer. SPECOM 2025.
ИздательSpringer Nature
Страницы302-317
Число страниц16
ISBN (печатное издание)9783032079589
DOI
СостояниеОпубликовано - 2026
Событие27th International Conference on Speech and Computer - Szeged, Hungary, Szeged, Венгрия
Продолжительность: 13 окт 202514 окт 2025
Номер конференции: 27
https://specom.inf.u-szeged.hu/

Серия публикаций

НазваниеLecture Notes in Computer Science
Том16188 LNCS

конференция

конференция27th International Conference on Speech and Computer
Сокращенное названиеSpecom 2025
Страна/TерриторияВенгрия
Город Szeged
Период13/10/2514/10/25
Прочее 27-й Международной конференции по вопросам речи и компьютера (SPECOM 2025)
Сайт в сети Internet

ID: 142344420