Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review
Automatic Classification of the Emotional State of Atypically Developing Children. / Matveev, Yuri; Lyakso, Elena; Matveev, Anton; Frolova, Olga; Grigorev, Aleksey; Nikolaev, Aleksandr.
Proceedings of the 24 th International Congress of Acoustics: A15 SPEECH. Gyeongju, 2022. ABS-0338.Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review
}
TY - GEN
T1 - Automatic Classification of the Emotional State of Atypically Developing Children
AU - Matveev, Yuri
AU - Lyakso, Elena
AU - Matveev, Anton
AU - Frolova, Olga
AU - Grigorev, Aleksey
AU - Nikolaev, Aleksandr
PY - 2022
Y1 - 2022
N2 - To study of the emotional state reflection in the voice and speech of 6-12 years old children with autism spectrum disorders (ASD), Down syndrome (DS) and typical development (TD), the automatic classification of children’s emotional speech on the states “comfort – neutral – discomfort” were conducted. Child speech was recorded in model situations a dialogue with the experimenter and playing with a standard set of toys and annotated by three experts. Automatic classification of children’s speech on three states was performed usingautomatically extracted sets of acoustic features GeMAPS and extended eGeMAPS. As classifiers, we used classifiers based on Gaussian Mixture Models (GMM) and Support Vector Machine (SVM). The state of discomfort is classified better for children with ASD (0.523; 0.305 – precision and recall) and DS (0.504; 0.564); the state of comfort – for TD children (0.546; 0.241). The minimal GeMAPS feature set gives better results (accuracy - 0.687, 0.725, 0.641 – for ASD, DS, TD children) than the extended eGeMAPS feature set(0.671, 0.717, 0.631), that indicates the importance of low-level features. A comparison with the data of an auditory perceptual experiment (100 listeners) was made. Listeners better recognized discomfort in children with ASD and DS (78%) and comfort state in TD children (58%).
AB - To study of the emotional state reflection in the voice and speech of 6-12 years old children with autism spectrum disorders (ASD), Down syndrome (DS) and typical development (TD), the automatic classification of children’s emotional speech on the states “comfort – neutral – discomfort” were conducted. Child speech was recorded in model situations a dialogue with the experimenter and playing with a standard set of toys and annotated by three experts. Automatic classification of children’s speech on three states was performed usingautomatically extracted sets of acoustic features GeMAPS and extended eGeMAPS. As classifiers, we used classifiers based on Gaussian Mixture Models (GMM) and Support Vector Machine (SVM). The state of discomfort is classified better for children with ASD (0.523; 0.305 – precision and recall) and DS (0.504; 0.564); the state of comfort – for TD children (0.546; 0.241). The minimal GeMAPS feature set gives better results (accuracy - 0.687, 0.725, 0.641 – for ASD, DS, TD children) than the extended eGeMAPS feature set(0.671, 0.717, 0.631), that indicates the importance of low-level features. A comparison with the data of an auditory perceptual experiment (100 listeners) was made. Listeners better recognized discomfort in children with ASD and DS (78%) and comfort state in TD children (58%).
KW - emotions
KW - speech
KW - Children with Atypical development
KW - perceptual experiment
KW - Automatic Classification
UR - https://ica2022korea.org/
M3 - Conference contribution
BT - Proceedings of the 24 th International Congress of Acoustics
CY - Gyeongju
T2 - 24th International Congress on Acoustics
Y2 - 24 October 2022 through 28 October 2022
ER -
ID: 100863416