Image captioning is a question of great interest in a wide range of applications. In the art market there is a particularly acute shortage of specialized machine learning methods for accelerated and at the same time in-depth study of often too specific aspects of art. One of the main difficulties is caused by ambiguous names of art works, as well as clarifying (in practice, often complicating understanding and perception) signatures of the authors to them. Although previous research has established that captioning of photos can be done with high efficacy, there is little published data about generation of captions for artistic paintings. In this research, we utilize a transformer architecture to generate an artionym for a given painting in author’s manner. We describe the model and report its performance on different art styles. We assess the model performance with an expert evaluation and image captioning metrics, and then discuss their capacity to analyze art-related names.
Original languageEnglish
Pages (from-to)4445-4452
Number of pages8
JournalIAES International Journal of Artificial Intelligence
Volume13
Issue number4
DOIs
StatePublished - 1 Dec 2024

    Research areas

  • Image captioning, Machine learning in art, Text generation, Transformers, Visual art

ID: 125804249