Subordination: Cluster management without distributed consensus

I. Gankevich, Y. Tipikin, V. Gaiduchok

Research output

6 Citations (Scopus)

Abstract

Nowadays, many cluster management systems rely on distributed consensus algorithms to elect a leader that orchestrates subordinate nodes. Contrary to these studies we propose consensus-free algorithm that arranges cluster nodes into multiple levels of subordination. The algorithm structures IP address range of cluster network so that each node has ranked list of candidates, from which it chooses a leader. The results show that this approach easily scales to a large number of nodes due to its asynchronous nature, and enables fast recovery from node failures as they occur only on one level of hierarchy. Multiple levels of subordination are useful for efficiently collecting monitoring and accounting data from large number of nodes, and for scheduling general-purpose tasks on a cluster.
Original languageEnglish
Title of host publicationProceedings of International Conference on High Performance Computing & Simulation (HPCS), 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages639-642
ISBN (Print)9781467378123
DOIs
Publication statusPublished - 2015

Fingerprint Dive into the research topics of 'Subordination: Cluster management without distributed consensus'. Together they form a unique fingerprint.

Cite this