Work-stealing is one of the popular ways to schedule near-optimal task distribution across multiple CPU cores with low overheads on time, memory and inter-thread synchronisations. In the work-stealing strategy, workers that run out of tasks for execution start claiming tasks from other workers' queues. Double ended queues (deques) based on circular arrays proved to be an effective solution for such scenario. In this paper we investigate ways to improve performance of work-stealing schedulers based on deques by enhancing internal data handling mechanisms. Traditionally, deques are designed with an assumption that task pointers are stored within these data structures, while task objects reside in the heap memory. By modifying task queues so that they can hold task objects instead of pointers we managed to increase the performance more than 2.5 times on CPU-bound applications and decrease last-level cache misses up to 30% compared to Intel TBB and Intel/MIT Cilk work-stealing schedulers.

Original languageEnglish
Pages (from-to)394-407
Number of pages14
JournalInternational Journal of Web and Grid Services
Volume15
Issue number4
DOIs
StatePublished - 1 Jan 2019

    Scopus subject areas

  • Software
  • Computer Networks and Communications

    Research areas

  • Cache locality, Fork-join parallelism, Lock-free data structures, Work-stealing deques, Work-stealing scheduler

ID: 51559010