DOI

This paper investigates the role of lexical ambiguity in the processing and recognition of multimodal advertisements. First, we combined 28 Russian advertising posters: 14 ads with an ambiguous headline that leads to the conflict between text and pictural parts of a poster and 14 explicit ads of the same structure and advertising product as their ambiguous pairs. In Exp.1, 104 Russian participants looked at the stimuli and rated the stimuli by 6 parameters: how eye-catching, original, impelling to buy the advertised product, understandable, evoking positive emotions and matching the product the posters are. We used scales from 1 to 5. The experiment was conducted via Google Forms. 3–4 weeks later, in Exp. 2, the same participants were invited to recognize verbal and non-verbal “halves” of the posters from Exp. 1. The results of the scaling experiment showed that ambiguous advertising posters were ranked significantly higher than unambiguous ads by four of six parameters. Furthermore, ambiguous posters were rated as slightly more understandable than unambiguous posters, despite the expectation that word-play would complicate the understanding of the ambiguous posters. In the recognition task, we revealed that both verbal and non-verbal components of a poster are recognized better if they were a part of an ambiguous poster. These findings are discussed in relation to the multimodal text literature, and research perspectives are provided to explore ambiguous text processing empirically.

Язык оригиналаанглийский
Название основной публикацииProceedings of 7th International Congress on Information and Communication Technology - ICICT 2022
РедакторыXin-She Yang, Simon Sherratt, Nilanjan Dey, Amit Joshi
ИздательSpringer Nature
Страницы109-119
Число страниц11
Том4
ISBN (печатное издание)9789811923968
DOI
СостояниеОпубликовано - 2023
Событие7th International Congress on Information and Communication Technology, ICICT 2022 - Virtual, Online
Продолжительность: 21 фев 202224 фев 2022

Серия публикаций

НазваниеLecture Notes in Networks and Systems
Том465
ISSN (печатное издание)2367-3370
ISSN (электронное издание)2367-3389

конференция

конференция7th International Congress on Information and Communication Technology, ICICT 2022
ГородVirtual, Online
Период21/02/2224/02/22

    Предметные области Scopus

  • Системотехника
  • Обработка сигналов
  • Компьютерные сети и коммуникации

ID: 99938146