TY - JOUR

T1 - Look and ye shall hear

T2 - Selective auditory attention modulates the audiovisual correspondence effect

AU - Janyan, Armina

AU - Shtyrov, Yury

AU - Andriushchenko, Ekaterina

AU - Blinova, Ekaterina

AU - Shcherbakova, Olga

N1 - Publisher Copyright: © The Author(s) 2022.

PY - 2022/5/1

Y1 - 2022/5/1

N2 - One of the unresolved questions in multisensory research is that of automaticity of consistent associations between sensory features from different modalities (e.g. high visual locations associated with high sound pitch). We addressed this issue by examining a possible role of selective attention in the audiovisual correspondence effect. We orthogonally manipulated loudness and pitch, directing participants’ attention to the auditory modality only and using pitch and loudness identification tasks. Visual stimuli in high, low or central spatial locations appeared simultaneously with the sounds. If the correspondence effect is automatic, it should not be affected by task changes. The results, however, demonstrated a cross-modal pitch-verticality correspondence effect only when participants’ attention was directed to pitch, but not to loudness identification task; moreover, the effect was present only in the upper location. The findings underscore the involvement of selective attention in cross-modal associations and support a top-down account of audiovisual correspondence effects.

AB - One of the unresolved questions in multisensory research is that of automaticity of consistent associations between sensory features from different modalities (e.g. high visual locations associated with high sound pitch). We addressed this issue by examining a possible role of selective attention in the audiovisual correspondence effect. We orthogonally manipulated loudness and pitch, directing participants’ attention to the auditory modality only and using pitch and loudness identification tasks. Visual stimuli in high, low or central spatial locations appeared simultaneously with the sounds. If the correspondence effect is automatic, it should not be affected by task changes. The results, however, demonstrated a cross-modal pitch-verticality correspondence effect only when participants’ attention was directed to pitch, but not to loudness identification task; moreover, the effect was present only in the upper location. The findings underscore the involvement of selective attention in cross-modal associations and support a top-down account of audiovisual correspondence effects.

KW - audiovisual correspondence

KW - RT

KW - selective attention

UR - http://www.scopus.com/inward/record.url?scp=85131175585&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/a8d3ff9c-2627-3c2b-acb2-807e73a97e73/

U2 - 10.1177/20416695221095884

DO - 10.1177/20416695221095884

M3 - Article

AN - SCOPUS:85131175585

VL - 13

JO - i-Perception

JF - i-Perception

SN - 2041-6695

IS - 3

ER -