Subordination: Providing resilience to simultaneous failure of multiple cluster nodes

Research output

1 Citation (Scopus)

Abstract

In this paper we describe a new framework for creating distributed programmes which are resilient to cluster node failures. Our main goal is to create a simple and reliable model, that ensures continuous execution of parallel programmes without creation of checkpoints, memory dumps and other I/O intensive activities. To achieve this we introduce multi-layered system architecture, each layer of which consists of unified entities organised into hierarchies, and then show how this system handles different node failure scenarios. We benchmark our system on the example of real-world HPC application on both physical and virtual clusters. The results of the experiments show that our approach has low overhead and scales to a large number of cluster nodes.

Original languageEnglish
Title of host publicationProceedings - 2017 International Conference on High Performance Computing and Simulation, HPCS 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages832-838
Number of pages7
ISBN (Electronic)9781538632505
DOIs
Publication statusPublished - 12 Sep 2017
EventThe 2017 International Conference on High Performance Computing and Simulation - Genoa
Duration: 16 Jul 201720 Jul 2017
Conference number: 15
http://hpcs2017.cisedu.info/

Conference

ConferenceThe 2017 International Conference on High Performance Computing and Simulation
Abbreviated titleHPCS 2017
CountryItaly
CityGenoa
Period16/07/1720/07/17
Internet address

Fingerprint

Subordination
Resilience
Data storage equipment
Vertex of a graph
Checkpoint
Experiments
Parallel Programs
Number of Clusters
Real-world Applications
System Architecture
Benchmark
Scenarios
Experiment
Node
Model

Scopus subject areas

  • Computer Science Applications
  • Information Systems and Management
  • Modelling and Simulation
  • Computer Networks and Communications
  • Computer Science (miscellaneous)

Cite this

Gankevich, I., Tipikin, Y., & Korkhov, V. (2017). Subordination: Providing resilience to simultaneous failure of multiple cluster nodes. In Proceedings - 2017 International Conference on High Performance Computing and Simulation, HPCS 2017 (pp. 832-838). [8035165] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/HPCS.2017.126
Gankevich, Ivan ; Tipikin, Yuri ; Korkhov, Vladimir. / Subordination : Providing resilience to simultaneous failure of multiple cluster nodes. Proceedings - 2017 International Conference on High Performance Computing and Simulation, HPCS 2017. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 832-838
@inproceedings{812ccfeb504441c28533f0251bdcdbb2,
title = "Subordination: Providing resilience to simultaneous failure of multiple cluster nodes",
abstract = "In this paper we describe a new framework for creating distributed programmes which are resilient to cluster node failures. Our main goal is to create a simple and reliable model, that ensures continuous execution of parallel programmes without creation of checkpoints, memory dumps and other I/O intensive activities. To achieve this we introduce multi-layered system architecture, each layer of which consists of unified entities organised into hierarchies, and then show how this system handles different node failure scenarios. We benchmark our system on the example of real-world HPC application on both physical and virtual clusters. The results of the experiments show that our approach has low overhead and scales to a large number of cluster nodes.",
author = "Ivan Gankevich and Yuri Tipikin and Vladimir Korkhov",
year = "2017",
month = "9",
day = "12",
doi = "10.1109/HPCS.2017.126",
language = "English",
pages = "832--838",
booktitle = "Proceedings - 2017 International Conference on High Performance Computing and Simulation, HPCS 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

Gankevich, I, Tipikin, Y & Korkhov, V 2017, Subordination: Providing resilience to simultaneous failure of multiple cluster nodes. in Proceedings - 2017 International Conference on High Performance Computing and Simulation, HPCS 2017., 8035165, Institute of Electrical and Electronics Engineers Inc., pp. 832-838, Genoa, 16/07/17. https://doi.org/10.1109/HPCS.2017.126

Subordination : Providing resilience to simultaneous failure of multiple cluster nodes. / Gankevich, Ivan; Tipikin, Yuri; Korkhov, Vladimir.

Proceedings - 2017 International Conference on High Performance Computing and Simulation, HPCS 2017. Institute of Electrical and Electronics Engineers Inc., 2017. p. 832-838 8035165.

Research output

TY - GEN

T1 - Subordination

T2 - Providing resilience to simultaneous failure of multiple cluster nodes

AU - Gankevich, Ivan

AU - Tipikin, Yuri

AU - Korkhov, Vladimir

PY - 2017/9/12

Y1 - 2017/9/12

N2 - In this paper we describe a new framework for creating distributed programmes which are resilient to cluster node failures. Our main goal is to create a simple and reliable model, that ensures continuous execution of parallel programmes without creation of checkpoints, memory dumps and other I/O intensive activities. To achieve this we introduce multi-layered system architecture, each layer of which consists of unified entities organised into hierarchies, and then show how this system handles different node failure scenarios. We benchmark our system on the example of real-world HPC application on both physical and virtual clusters. The results of the experiments show that our approach has low overhead and scales to a large number of cluster nodes.

AB - In this paper we describe a new framework for creating distributed programmes which are resilient to cluster node failures. Our main goal is to create a simple and reliable model, that ensures continuous execution of parallel programmes without creation of checkpoints, memory dumps and other I/O intensive activities. To achieve this we introduce multi-layered system architecture, each layer of which consists of unified entities organised into hierarchies, and then show how this system handles different node failure scenarios. We benchmark our system on the example of real-world HPC application on both physical and virtual clusters. The results of the experiments show that our approach has low overhead and scales to a large number of cluster nodes.

UR - http://www.scopus.com/inward/record.url?scp=85032352516&partnerID=8YFLogxK

U2 - 10.1109/HPCS.2017.126

DO - 10.1109/HPCS.2017.126

M3 - Conference contribution

AN - SCOPUS:85032352516

SP - 832

EP - 838

BT - Proceedings - 2017 International Conference on High Performance Computing and Simulation, HPCS 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Gankevich I, Tipikin Y, Korkhov V. Subordination: Providing resilience to simultaneous failure of multiple cluster nodes. In Proceedings - 2017 International Conference on High Performance Computing and Simulation, HPCS 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 832-838. 8035165 https://doi.org/10.1109/HPCS.2017.126