Standard

Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters. / Korkhov, Vladimir; Kobyshev, Sergey; Degtyarev, Alexander; Bogdanov, Alexander.

Computational Science and Its Applications – ICCSA 2017: 17th International Conference, Trieste, Italy, July 3-6, 2017, Proceedings, Part V. Springer Nature, 2017. p. 399-411 (Lecture Notes in Computer Science; Vol. 10408).

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Harvard

Korkhov, V, Kobyshev, S, Degtyarev, A & Bogdanov, A 2017, Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters. in Computational Science and Its Applications – ICCSA 2017: 17th International Conference, Trieste, Italy, July 3-6, 2017, Proceedings, Part V. Lecture Notes in Computer Science, vol. 10408, Springer Nature, pp. 399-411, 17th International Conference on Computational Science and Its Applications, ICCSA 2017, Trieste, Italy, 2/07/17. https://doi.org/10.1007/978-3-319-62404-4_29

APA

Korkhov, V., Kobyshev, S., Degtyarev, A., & Bogdanov, A. (2017). Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters. In Computational Science and Its Applications – ICCSA 2017: 17th International Conference, Trieste, Italy, July 3-6, 2017, Proceedings, Part V (pp. 399-411). (Lecture Notes in Computer Science; Vol. 10408). Springer Nature. https://doi.org/10.1007/978-3-319-62404-4_29

Vancouver

Korkhov V, Kobyshev S, Degtyarev A, Bogdanov A. Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters. In Computational Science and Its Applications – ICCSA 2017: 17th International Conference, Trieste, Italy, July 3-6, 2017, Proceedings, Part V. Springer Nature. 2017. p. 399-411. (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-319-62404-4_29

Author

Korkhov, Vladimir ; Kobyshev, Sergey ; Degtyarev, Alexander ; Bogdanov, Alexander. / Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters. Computational Science and Its Applications – ICCSA 2017: 17th International Conference, Trieste, Italy, July 3-6, 2017, Proceedings, Part V. Springer Nature, 2017. pp. 399-411 (Lecture Notes in Computer Science).

BibTeX

@inproceedings{3812fe34d89d4171a3fe37afc449f3f1,
title = "Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters",
abstract = "Virtualized computing infrastructures are often used to create clusters of resources tailored to solve tasks taking into account particular requirements of these tasks. An important objective is to evaluate such requirements and request optimal amount of resources which becomes challenging for parallel tasks with intercommunication. In previous works we investigated how light-weight container-based virtualization can be used for creating virtual clusters running MPI applications. Such cluster is configured according to the requirements of particular application and allocates only necessary amount of resources from the physical infrastructure leaving space for co-allocated clusters running without conflicts or resource races. In this paper we investigate similar concepts for MapReduce applications based on Hadoop framework that use Cloudply virtualization tool to create and manage light-weight virtual Hadoop clusters on Amazon cloud resources. We investigate performance of several Hadoop benchmarks in differen",
keywords = "Virtualization, Containers, Virtual cluster",
author = "Vladimir Korkhov and Sergey Kobyshev and Alexander Degtyarev and Alexander Bogdanov",
note = "Korkhov V., Kobyshev S., Degtyarev A., Bogdanov A. (2017) Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters. In: Gervasi O. et al. (eds) Computational Science and Its Applications – ICCSA 2017. ICCSA 2017. Lecture Notes in Computer Science, vol 10408. Springer, Cham. https://doi.org/10.1007/978-3-319-62404-4_29; 17th International Conference on Computational Science and Its Applications, ICCSA 2017 ; Conference date: 02-07-2017 Through 05-07-2017",
year = "2017",
doi = "10.1007/978-3-319-62404-4_29",
language = "English",
isbn = "978-3-319-62403-7",
series = "Lecture Notes in Computer Science",
publisher = "Springer Nature",
pages = "399--411",
booktitle = "Computational Science and Its Applications – ICCSA 2017",
address = "Germany",

}

RIS

TY - GEN

T1 - Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters

AU - Korkhov, Vladimir

AU - Kobyshev, Sergey

AU - Degtyarev, Alexander

AU - Bogdanov, Alexander

N1 - Conference code: 17

PY - 2017

Y1 - 2017

N2 - Virtualized computing infrastructures are often used to create clusters of resources tailored to solve tasks taking into account particular requirements of these tasks. An important objective is to evaluate such requirements and request optimal amount of resources which becomes challenging for parallel tasks with intercommunication. In previous works we investigated how light-weight container-based virtualization can be used for creating virtual clusters running MPI applications. Such cluster is configured according to the requirements of particular application and allocates only necessary amount of resources from the physical infrastructure leaving space for co-allocated clusters running without conflicts or resource races. In this paper we investigate similar concepts for MapReduce applications based on Hadoop framework that use Cloudply virtualization tool to create and manage light-weight virtual Hadoop clusters on Amazon cloud resources. We investigate performance of several Hadoop benchmarks in differen

AB - Virtualized computing infrastructures are often used to create clusters of resources tailored to solve tasks taking into account particular requirements of these tasks. An important objective is to evaluate such requirements and request optimal amount of resources which becomes challenging for parallel tasks with intercommunication. In previous works we investigated how light-weight container-based virtualization can be used for creating virtual clusters running MPI applications. Such cluster is configured according to the requirements of particular application and allocates only necessary amount of resources from the physical infrastructure leaving space for co-allocated clusters running without conflicts or resource races. In this paper we investigate similar concepts for MapReduce applications based on Hadoop framework that use Cloudply virtualization tool to create and manage light-weight virtual Hadoop clusters on Amazon cloud resources. We investigate performance of several Hadoop benchmarks in differen

KW - Virtualization

KW - Containers

KW - Virtual cluster

U2 - 10.1007/978-3-319-62404-4_29

DO - 10.1007/978-3-319-62404-4_29

M3 - Conference contribution

SN - 978-3-319-62403-7

T3 - Lecture Notes in Computer Science

SP - 399

EP - 411

BT - Computational Science and Its Applications – ICCSA 2017

PB - Springer Nature

T2 - 17th International Conference on Computational Science and Its Applications, ICCSA 2017

Y2 - 2 July 2017 through 5 July 2017

ER -

ID: 71327642