An optimistic approach to handle out-of-order events within analytical stream processing

Igor E. Kuralenok, Nikita Marshalkin, Artem Trofimov, Boris Novikov

Research output: Contribution to journalConference articlepeer-review

2 Scopus citations

Abstract

—In recent years, there has been a growth in research and industrial solutions in the field of distributed stream processing. However, even state-of-the-art stream processing systems experience difficulties with out-of-order data arrival. The most common solution to this issue is buffering. Its main problem is the extra cost for blocking before each order-sensitive operation. The goal of this paper is to propose and evaluate an optimistic approach to handle out-of-order events. We introduce a method that is suitable for any stateful operation and needs a single buffer for the complete computational pipeline. Such technique requires extra network transfers and re-computations, but the experiments demonstrate that a prototype of our approach is able to create low overhead while ensuring the correct ordering.

Original languageEnglish
Pages (from-to)22-29
Number of pages8
JournalCEUR Workshop Proceedings
Volume2135
StatePublished - 1 Jan 2018
Event3rd Conference on Software Engineering and Information Management, SEIM 2018 - Saint Petersburg, Russian Federation
Duration: 14 Apr 2018 → …

Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'An optimistic approach to handle out-of-order events within analytical stream processing'. Together they form a unique fingerprint.

Cite this