As visual representation of information is getting more and more popularnowadays, studies of so called “creolized” texts integrating both verbal and nonverbal types of information are of high priority (Chernigovskaya et al., 2016,Petrova & Riekhakaynen, 2018). Sketchnoting is a perfect example of a creolizedtext, in which drawings or visual representations of complex information are aimed to make comprehension easier. Nevertheless, no experimental evidence has been provided so far concerning sketches as an educational material.This study was aimed at revealing specific features of verbal text and sketchperception and assessing sketchnoting efficiency. Our hypothesis was that readers process different formats of texts differently, sketches being easier to process and understand than a verbal text of the same content.To examine this issue, 20 Russian speaking high school students (Sirius Educational Centre, Sochi) were involved in the experiment. Four texts about biographies of Russian poets were converted into different sketches of three typical formats: linear, trajectory and radial. During the eye-tracking experiment, the participants were asked to learn 4 stimuli: 3 sketches and 1 classical text on different biographies. We measured the total dwell time, the total fixation count, average fixation duration for each verbal and non-verbal zone of the texts, for horizontal and diagonal zones. The comprehension was controlled by question-answer method, key words method, and scaling method, when they had to evaluate the level of difficulty while reading.The outcome has shown that a sketch in any format is read significantly faster and better than the text of the same content. The analysis of participants’ eye movements while reading the stimuli made it possible to propose a number of recommendations for creating sketches: (1.) It is better to separate areas of interest from each other; (2.) It is not necessary to use a diagonal position of the text because such zones are read significantly slower; (3.) It is better to control the reader’s attention with arrows/pointers as they help to learn the text faster. The best format of sketches is of the trajectory type; (4.) It is important to duplicate the information from the title because readers do not pay much attention to it; (5.) It is really helpful to back information with illustrations (e.g. to draw the portrait of the main character, if it is a biography). Supported by Russian Science Foundation (project No.14-18-02135).
Translated title of the contributionРегистрация движений глаз при обработке скетчей (на материале русского языка)
Original languageEnglish
Title of host publicationNeurobiology of Speech and Language
Subtitle of host publicationProceedings of the 2nd International Workshop
EditorsOlga Shcherbakova, Yury Shtyrov
Place of PublicationСПб.
PublisherСкифия-принт
Pages34
ISBN (Print)9785986203232
StatePublished - 25 Oct 2018
Event2nd International workshop "Neurobiology of Speech and Language" - Санкт-Петербург, Russian Federation
Duration: 28 Sep 201829 Sep 2018

Conference

Conference2nd International workshop "Neurobiology of Speech and Language"
Country/TerritoryRussian Federation
CityСанкт-Петербург
Period28/09/1829/09/18

    Scopus subject areas

  • Arts and Humanities(all)

    Research areas

  • поликодовый текст, скетчноутинг, регистрация движений глаз, обработка текста, русский язык

ID: 36209705