Evaluating and analyzing click simulation inweb search

Stepan Malkevich, Ilya Markov, Elena Michailova, Maarten De Rijke

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Scopus citations

Abstract

We evaluate and analyze the quality of click models with respect to their ability to simulate users' click behavior. To this end, we propose distribution-based metrics for measuring the quality of click simulation in addition to metrics that directly compare simulated and real clicks. We perform a comparison of widely-used click models in terms of the quality of click simulation and analyze this quality for queries with different frequencies. We find that click models fail to accurately simulate user clicks, especially when simulating sessions with no clicks and sessions with a click on the first position. We also find that click models with higher click prediction performance simulate clicks better than other models.

Original languageEnglish
Title of host publicationICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval
PublisherAssociation for Computing Machinery
Pages281-284
Number of pages4
ISBN (Electronic)9781450344906
DOIs
StatePublished - 1 Oct 2017
Event7th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2017 - Amsterdam, Netherlands
Duration: 1 Oct 20174 Oct 2017

Conference

Conference7th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2017
CountryNetherlands
CityAmsterdam
Period1/10/174/10/17

Scopus subject areas

  • Information Systems
  • Computer Science (miscellaneous)

Cite this