Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research
Subordination: Cluster management without distributed consensus. / Gankevich, I.; Tipikin, Y.; Gaiduchok, V.
Proceedings of International Conference on High Performance Computing & Simulation (HPCS), 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 639-642.Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research
}
TY - GEN
T1 - Subordination: Cluster management without distributed consensus
AU - Gankevich, I.
AU - Tipikin, Y.
AU - Gaiduchok, V.
PY - 2015
Y1 - 2015
N2 - Nowadays, many cluster management systems rely on distributed consensus algorithms to elect a leader that orchestrates subordinate nodes. Contrary to these studies we propose consensus-free algorithm that arranges cluster nodes into multiple levels of subordination. The algorithm structures IP address range of cluster network so that each node has ranked list of candidates, from which it chooses a leader. The results show that this approach easily scales to a large number of nodes due to its asynchronous nature, and enables fast recovery from node failures as they occur only on one level of hierarchy. Multiple levels of subordination are useful for efficiently collecting monitoring and accounting data from large number of nodes, and for scheduling general-purpose tasks on a cluster.
AB - Nowadays, many cluster management systems rely on distributed consensus algorithms to elect a leader that orchestrates subordinate nodes. Contrary to these studies we propose consensus-free algorithm that arranges cluster nodes into multiple levels of subordination. The algorithm structures IP address range of cluster network so that each node has ranked list of candidates, from which it chooses a leader. The results show that this approach easily scales to a large number of nodes due to its asynchronous nature, and enables fast recovery from node failures as they occur only on one level of hierarchy. Multiple levels of subordination are useful for efficiently collecting monitoring and accounting data from large number of nodes, and for scheduling general-purpose tasks on a cluster.
U2 - 10.1109/HPCSim.2015.7237106
DO - 10.1109/HPCSim.2015.7237106
M3 - Conference contribution
SN - 9781467378123
SP - 639
EP - 642
BT - Proceedings of International Conference on High Performance Computing & Simulation (HPCS), 2015
PB - Institute of Electrical and Electronics Engineers Inc.
ER -
ID: 3943793