The aim of our study was to reveal the relationship between visual perception of the painting during free viewing and the following verbalization of the perceived information. Eye movements were recorded while 30 subjects were looking at the classic painting of a genre scene, and then they were asked to compose coherent verbal description of this painting. Comparative analysis revealed strong correlation between distribution and duration of the gaze fixations during free viewing and the following narration. The more and the longer the gaze was directed to the certain region of the picture, the more words were dedicated to it in the verbal description. The greatest effect was notably demonstrated in relationship between fixations count and words count. Also, a relevant correlation between the ordinal sequence of first gaze fixations on depicted objects and the order these objects mentioned in the narrations was found. On the whole, our results showed that the way humans perceive visual information forms the way they express it in natural language.
Original languageRussian
Title of host publication4th International Multidisciplinary Scientific Conference on Social Sciences and Arts SGEM 2017, Book 3
PublisherSTEF92 Technology Ltd.
Pages169-174
Number of pages6
ISBN (Print)978-619-7105-95-7
DOIs
StatePublished - 2017

Publication series

Name4th International Multidisciplinary Scientific Conference on Social Sciences and Arts SGEM 2017, Book 3
Volume1

ID: 33335934