TY - GEN

T1 - What Do LLMs know about human emotions? The Russian case study

AU - Митрофанова, Ольга Александровна

AU - Бакаев, Максим Александрович

AU - Юрьевцева, Полина Николаевна

N1 - Conference code: 27

PY - 2025/10/13

Y1 - 2025/10/13

N2 - The purpose of this study is to investigate the ability of Large Language Models (LLMs) to recognize linguistic markers of emotions in Russian and to assess their potential for profiling emotional users of AI. We conducted a series of experiments to verify psycholinguistic models of emotions, including J. Russell’s circumplex model and R. Plutchik’s wheel of emotions. We created synthetic personas with different emotional states and used them to experiment with LLMs, such as YandexGPT 5 Pro, using personalized emotional prompts. To assess the consistency of LLM responses, we employed ANOVA procedures, which allowed us to test hypotheses about differences in how synthetic personas reacted to the same emotional stimuli. The results of our study demonstrate that LLMs and humans structure emotions differently. The novelty of this work lies in the application of a personalized approach to analyzing LLM emotional perception, which allows us to take into account the sociodemographic characteristics and emotional state of communicants. This research is significant because it aims to develop methods for assessing LLM emotional intelligence and creating the foundation for improving emotional AI systems that can provide empathic support in dialogue.

AB - The purpose of this study is to investigate the ability of Large Language Models (LLMs) to recognize linguistic markers of emotions in Russian and to assess their potential for profiling emotional users of AI. We conducted a series of experiments to verify psycholinguistic models of emotions, including J. Russell’s circumplex model and R. Plutchik’s wheel of emotions. We created synthetic personas with different emotional states and used them to experiment with LLMs, such as YandexGPT 5 Pro, using personalized emotional prompts. To assess the consistency of LLM responses, we employed ANOVA procedures, which allowed us to test hypotheses about differences in how synthetic personas reacted to the same emotional stimuli. The results of our study demonstrate that LLMs and humans structure emotions differently. The novelty of this work lies in the application of a personalized approach to analyzing LLM emotional perception, which allows us to take into account the sociodemographic characteristics and emotional state of communicants. This research is significant because it aims to develop methods for assessing LLM emotional intelligence and creating the foundation for improving emotional AI systems that can provide empathic support in dialogue.

KW - Emotion Recognition

KW - LLM

KW - Russian

KW - Synthetic Personas

UR - https://www.mendeley.com/catalogue/3278583a-488d-3b2a-a9be-225b1d508478/

U2 - 10.1007/978-3-032-07956-5_9

DO - 10.1007/978-3-032-07956-5_9

M3 - Conference contribution

SN - 9783032079558

T3 - Lecture Notes in Computer Science

SP - 129

EP - 144

BT - 27th International Conference “Speech and Computer”, SPECOM 2025. Szeged, Hungary. October 13–15, 2025. Рroceedings. Part I. Springer, Cham. Lecture Notes in Computer Science. Vol. 16187.

PB - Springer Nature

T2 - 27th International Conference on Speech and Computer

Y2 - 13 October 2025 through 14 October 2025

ER -