Standard
Emotional State of Children with ASD and Intellectual Disabilities: Perceptual Experiment and Automatic Recognition by Video, Audio and Text Modalities. / Ляксо, Елена Евгеньевна; Фролова, Ольга Владимировна; Николаев, Александр Сергеевич; Гречаный, Северин Вячеславович; Матвеев, Антон Юрьевич; Матвеев, Юрий Николаевич; Махныткина, Олеся Владимировна; Ruban, Nersisson.
Speech and Computer-25th International Conference, SPECOM 2023, Proceedings : 25th International Conference, SPECOM 2023, Dharwad, India, November 29–December 02, 2023, Proceedings. ed. / Alexey Karpov; K. Samudravijaya; K. T. Deepak; Rajesh M. Hegde; Shyam S. Agrawal; S. R. Mahadeva Prasanna. Vol. LNAI 14338 Springer Nature, 2023. p. 535–549 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. LNAI 14338).
Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review
Harvard
Ляксо, ЕЕ, Фролова, ОВ, Николаев, АС, Гречаный, СВ, Матвеев, АЮ
, Матвеев, ЮН, Махныткина, ОВ & Ruban, N 2023,
Emotional State of Children with ASD and Intellectual Disabilities: Perceptual Experiment and Automatic Recognition by Video, Audio and Text Modalities. in A Karpov, K Samudravijaya, KT Deepak, RM Hegde, SS Agrawal & SRM Prasanna (eds),
Speech and Computer-25th International Conference, SPECOM 2023, Proceedings : 25th International Conference, SPECOM 2023, Dharwad, India, November 29–December 02, 2023, Proceedings. vol. LNAI 14338, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. LNAI 14338, Springer Nature, pp. 535–549, 25TH INTERNATIONAL CONFERENCE ON SPEECH AND COMPUTER SPECOM 2023, Hubli-Dharwad, India,
29/11/23.
https://doi.org/10.1007/978-3-031-48309-7_43
APA
Ляксо, Е. Е., Фролова, О. В., Николаев, А. С., Гречаный, С. В., Матвеев, А. Ю.
, Матвеев, Ю. Н., Махныткина, О. В., & Ruban, N. (2023).
Emotional State of Children with ASD and Intellectual Disabilities: Perceptual Experiment and Automatic Recognition by Video, Audio and Text Modalities. In A. Karpov, K. Samudravijaya, K. T. Deepak, R. M. Hegde, S. S. Agrawal, & S. R. M. Prasanna (Eds.),
Speech and Computer-25th International Conference, SPECOM 2023, Proceedings : 25th International Conference, SPECOM 2023, Dharwad, India, November 29–December 02, 2023, Proceedings (Vol. LNAI 14338, pp. 535–549). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. LNAI 14338). Springer Nature.
https://doi.org/10.1007/978-3-031-48309-7_43
Vancouver
Ляксо ЕЕ, Фролова ОВ, Николаев АС, Гречаный СВ, Матвеев АЮ
, Матвеев ЮН et al.
Emotional State of Children with ASD and Intellectual Disabilities: Perceptual Experiment and Automatic Recognition by Video, Audio and Text Modalities. In Karpov A, Samudravijaya K, Deepak KT, Hegde RM, Agrawal SS, Prasanna SRM, editors, Speech and Computer-25th International Conference, SPECOM 2023, Proceedings : 25th International Conference, SPECOM 2023, Dharwad, India, November 29–December 02, 2023, Proceedings. Vol. LNAI 14338. Springer Nature. 2023. p. 535–549. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
https://doi.org/10.1007/978-3-031-48309-7_43
Author
Ляксо, Елена Евгеньевна ; Фролова, Ольга Владимировна ; Николаев, Александр Сергеевич ; Гречаный, Северин Вячеславович ; Матвеев, Антон Юрьевич
; Матвеев, Юрий Николаевич ; Махныткина, Олеся Владимировна ; Ruban, Nersisson. /
Emotional State of Children with ASD and Intellectual Disabilities: Perceptual Experiment and Automatic Recognition by Video, Audio and Text Modalities. Speech and Computer-25th International Conference, SPECOM 2023, Proceedings : 25th International Conference, SPECOM 2023, Dharwad, India, November 29–December 02, 2023, Proceedings. editor / Alexey Karpov ; K. Samudravijaya ; K. T. Deepak ; Rajesh M. Hegde ; Shyam S. Agrawal ; S. R. Mahadeva Prasanna. Vol. LNAI 14338 Springer Nature, 2023. pp. 535–549 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
BibTeX
@inproceedings{1a6c1901660948919c80f04675d2c04a,
title = "Emotional State of Children with ASD and Intellectual Disabilities: Perceptual Experiment and Automatic Recognition by Video, Audio and Text Modalities",
abstract = "The paper presents the results of perceptual experiments (by humans) and automatic recognition of the emotional states of children with Autism Spectrum Disorders (ASD) and Intellectual Disabilities (ID) by video, audio and text modalities. The participants of the study were 50 children aged 5 - 15 years: 25 children with ASD, 25 children with ID, and 20 adults - the participants of the perceptual experiment. Automatic analysis of facial expression by video was performed using FaceReader software runs on the Microsoft Azure cloud platform and convolutional neural network. Automatic recognition of the emotional states of children by speech was carried out using a recurrent neural network. This study was conducted in accordance with the design developed in the study of the recognition of the emotional states of children with Down syndrome by facial expression, voice, and text. The results of the perceptual experiment showed a greater accuracy in recognizing the emotional states of children with ASD and ID in comparison with automatic classification. The emotions of children with ASD are more accurately recognized by the video modality, children with ID - by the text modality. The novelty of the research is the comparative results for groups of children with similar and overlapping symptoms of ASD and ID, and in setting tasks related to the analysis of the emotional sphere of children with atypical development.",
keywords = "emotional state, perceptual and automatic recognition, children with Autism Spectrum Disorders and Intellectual Disabilities, video, audio and text modalities, Audio and Text Modalities, Children with Autism Spectrum Disorders and Intellectual Disabilities, Emotional State, Perceptual and Automatic Recognition, Video",
author = "Ляксо, {Елена Евгеньевна} and Фролова, {Ольга Владимировна} and Николаев, {Александр Сергеевич} and Гречаный, {Северин Вячеславович} and Матвеев, {Антон Юрьевич} and Матвеев, {Юрий Николаевич} and Махныткина, {Олеся Владимировна} and Nersisson Ruban",
note = "Funding Information: Acknowledgements This study is financially supported by the Russian Science Foundation (project 22–45-02007) - for Russian researches, DST/INT/RUS/RSF/P-57/2021 – for Indian researches.; null ; Conference date: 29-11-2023 Through 02-12-2023",
year = "2023",
month = nov,
day = "22",
doi = "10.1007/978-3-031-48309-7_43",
language = "English",
isbn = "978-3-031-48308-0",
volume = "LNAI 14338",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Nature",
pages = "535–549",
editor = "Alexey Karpov and K. Samudravijaya and Deepak, {K. T.} and Hegde, {Rajesh M.} and Agrawal, {Shyam S.} and Prasanna, {S. R. Mahadeva}",
booktitle = "Speech and Computer-25th International Conference, SPECOM 2023, Proceedings : 25th International Conference, SPECOM 2023, Dharwad, India, November 29–December 02, 2023, Proceedings",
address = "Germany",
url = "https://www.iitdh.ac.in/specom-2023/",
}
RIS
TY - GEN
T1 - Emotional State of Children with ASD and Intellectual Disabilities: Perceptual Experiment and Automatic Recognition by Video, Audio and Text Modalities
AU - Ляксо, Елена Евгеньевна
AU - Фролова, Ольга Владимировна
AU - Николаев, Александр Сергеевич
AU - Гречаный, Северин Вячеславович
AU - Матвеев, Антон Юрьевич
AU - Матвеев, Юрий Николаевич
AU - Махныткина, Олеся Владимировна
AU - Ruban, Nersisson
N1 - Conference code: 25
PY - 2023/11/22
Y1 - 2023/11/22
N2 - The paper presents the results of perceptual experiments (by humans) and automatic recognition of the emotional states of children with Autism Spectrum Disorders (ASD) and Intellectual Disabilities (ID) by video, audio and text modalities. The participants of the study were 50 children aged 5 - 15 years: 25 children with ASD, 25 children with ID, and 20 adults - the participants of the perceptual experiment. Automatic analysis of facial expression by video was performed using FaceReader software runs on the Microsoft Azure cloud platform and convolutional neural network. Automatic recognition of the emotional states of children by speech was carried out using a recurrent neural network. This study was conducted in accordance with the design developed in the study of the recognition of the emotional states of children with Down syndrome by facial expression, voice, and text. The results of the perceptual experiment showed a greater accuracy in recognizing the emotional states of children with ASD and ID in comparison with automatic classification. The emotions of children with ASD are more accurately recognized by the video modality, children with ID - by the text modality. The novelty of the research is the comparative results for groups of children with similar and overlapping symptoms of ASD and ID, and in setting tasks related to the analysis of the emotional sphere of children with atypical development.
AB - The paper presents the results of perceptual experiments (by humans) and automatic recognition of the emotional states of children with Autism Spectrum Disorders (ASD) and Intellectual Disabilities (ID) by video, audio and text modalities. The participants of the study were 50 children aged 5 - 15 years: 25 children with ASD, 25 children with ID, and 20 adults - the participants of the perceptual experiment. Automatic analysis of facial expression by video was performed using FaceReader software runs on the Microsoft Azure cloud platform and convolutional neural network. Automatic recognition of the emotional states of children by speech was carried out using a recurrent neural network. This study was conducted in accordance with the design developed in the study of the recognition of the emotional states of children with Down syndrome by facial expression, voice, and text. The results of the perceptual experiment showed a greater accuracy in recognizing the emotional states of children with ASD and ID in comparison with automatic classification. The emotions of children with ASD are more accurately recognized by the video modality, children with ID - by the text modality. The novelty of the research is the comparative results for groups of children with similar and overlapping symptoms of ASD and ID, and in setting tasks related to the analysis of the emotional sphere of children with atypical development.
KW - emotional state, perceptual and automatic recognition, children with Autism Spectrum Disorders and Intellectual Disabilities, video, audio and text modalities
KW - Audio and Text Modalities
KW - Children with Autism Spectrum Disorders and Intellectual Disabilities
KW - Emotional State
KW - Perceptual and Automatic Recognition
KW - Video
UR - https://link.springer.com/chapter/10.1007/978-3-031-48309-7_43#citeas
UR - https://www.mendeley.com/catalogue/7addac54-7df6-31fb-aeec-8f1f91a17cc1/
U2 - 10.1007/978-3-031-48309-7_43
DO - 10.1007/978-3-031-48309-7_43
M3 - Conference contribution
SN - 978-3-031-48308-0
VL - LNAI 14338
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 535
EP - 549
BT - Speech and Computer-25th International Conference, SPECOM 2023, Proceedings : 25th International Conference, SPECOM 2023, Dharwad, India, November 29–December 02, 2023, Proceedings
A2 - Karpov, Alexey
A2 - Samudravijaya, K.
A2 - Deepak, K. T.
A2 - Hegde, Rajesh M.
A2 - Agrawal, Shyam S.
A2 - Prasanna, S. R. Mahadeva
PB - Springer Nature
Y2 - 29 November 2023 through 2 December 2023
ER -
