Experimental formation of visual-auditory associations in phoneme recognition

Research output

Abstract

In this study we investigated a question about a possibility to form auditory-visual associations during discrimination of speech sounds (phonemes) when they presented simultaneously with visual stimuli. It was used two types of static images--geometrical figures and images of hand gestures. We judge about formation of auditory-visual association by behavioural disturbance (reaction time, percentage of wrong reactions) after changes in experimental protocol viz. partial substitution of preceiding pairs of stimuli for the new combinations of previous images and sounds. It seems possible to get pronounced auditory-visual association when using images of hand gestures in combinnation with phoneme sounds. On the contrary, employment of images of geometrical figures instead of gestures produced only traces of auditory-visual association. We suggest that it is possible to explain the observed differencies by involvement of additional neuronal populations in auditory-visual assosiation that are preferentially responsive to biological motion.

Original languageEnglish
Pages (from-to)850-856
Number of pages7
JournalRossiǐskii fiziologicheskiǐ zhurnal imeni I.M. Sechenova / Rossiǐskaia akademiia nauk
Volume95
Issue number8
Publication statusPublished - Aug 2009

Fingerprint

Gestures
Hand
Phonetics
Reaction Time
Population

Scopus subject areas

  • Physiology

Cite this

@article{fec1aec7d4ec43e5bf3ea0222d45bfdf,
title = "Experimental formation of visual-auditory associations in phoneme recognition",
abstract = "In this study we investigated a question about a possibility to form auditory-visual associations during discrimination of speech sounds (phonemes) when they presented simultaneously with visual stimuli. It was used two types of static images--geometrical figures and images of hand gestures. We judge about formation of auditory-visual association by behavioural disturbance (reaction time, percentage of wrong reactions) after changes in experimental protocol viz. partial substitution of preceiding pairs of stimuli for the new combinations of previous images and sounds. It seems possible to get pronounced auditory-visual association when using images of hand gestures in combinnation with phoneme sounds. On the contrary, employment of images of geometrical figures instead of gestures produced only traces of auditory-visual association. We suggest that it is possible to explain the observed differencies by involvement of additional neuronal populations in auditory-visual assosiation that are preferentially responsive to biological motion.",
author = "Aleksandrov, {A. A.} and Stankevich, {L. N.}",
year = "2009",
month = "8",
language = "English",
volume = "95",
pages = "850--856",
journal = "ФИЗИОЛОГИЧЕСКИЙ ЖУРНАЛ ИМ. И.М. СЕЧЕНОВА",
issn = "0869-8139",
publisher = "Издательство {"}Наука{"}",
number = "8",

}

TY - JOUR

T1 - Experimental formation of visual-auditory associations in phoneme recognition

AU - Aleksandrov, A. A.

AU - Stankevich, L. N.

PY - 2009/8

Y1 - 2009/8

N2 - In this study we investigated a question about a possibility to form auditory-visual associations during discrimination of speech sounds (phonemes) when they presented simultaneously with visual stimuli. It was used two types of static images--geometrical figures and images of hand gestures. We judge about formation of auditory-visual association by behavioural disturbance (reaction time, percentage of wrong reactions) after changes in experimental protocol viz. partial substitution of preceiding pairs of stimuli for the new combinations of previous images and sounds. It seems possible to get pronounced auditory-visual association when using images of hand gestures in combinnation with phoneme sounds. On the contrary, employment of images of geometrical figures instead of gestures produced only traces of auditory-visual association. We suggest that it is possible to explain the observed differencies by involvement of additional neuronal populations in auditory-visual assosiation that are preferentially responsive to biological motion.

AB - In this study we investigated a question about a possibility to form auditory-visual associations during discrimination of speech sounds (phonemes) when they presented simultaneously with visual stimuli. It was used two types of static images--geometrical figures and images of hand gestures. We judge about formation of auditory-visual association by behavioural disturbance (reaction time, percentage of wrong reactions) after changes in experimental protocol viz. partial substitution of preceiding pairs of stimuli for the new combinations of previous images and sounds. It seems possible to get pronounced auditory-visual association when using images of hand gestures in combinnation with phoneme sounds. On the contrary, employment of images of geometrical figures instead of gestures produced only traces of auditory-visual association. We suggest that it is possible to explain the observed differencies by involvement of additional neuronal populations in auditory-visual assosiation that are preferentially responsive to biological motion.

UR - http://www.scopus.com/inward/record.url?scp=70449727018&partnerID=8YFLogxK

M3 - Article

C2 - 19803214

AN - SCOPUS:70449727018

VL - 95

SP - 850

EP - 856

JO - ФИЗИОЛОГИЧЕСКИЙ ЖУРНАЛ ИМ. И.М. СЕЧЕНОВА

JF - ФИЗИОЛОГИЧЕСКИЙ ЖУРНАЛ ИМ. И.М. СЕЧЕНОВА

SN - 0869-8139

IS - 8

ER -