Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters

Результат исследований: Научные публикации в периодических изданияхстатья

2 Цитирования (Scopus)

Выдержка

Virtualized computing infrastructures are often used to create clusters of resources tailored to solve tasks taking into account particular requirements of these tasks. An important objective is to evaluate such requirements and request optimal amount of resources which becomes challenging for parallel tasks with intercommunication. In previous works we investigated how light-weight container-based virtualization can be used for creating virtual clusters running MPI applications. Such cluster is configured according to the requirements of particular application and allocates only necessary amount of resources from the physical infrastructure leaving space for co-allocated clusters running without conflicts or resource races. In this paper we investigate similar concepts for MapReduce applications based on Hadoop framework that use Cloudply virtualization tool to create and manage light-weight virtual Hadoop clusters on Amazon cloud resources. We investigate performance of several Hadoop benchmarks in differen
Язык оригиналаанглийский
Страницы (с-по)399-411
ЖурналLecture Notes in Computer Science
Том10408
DOI
СостояниеОпубликовано - 2017

Отпечаток

Distributed Applications
Infrastructure
Resources
Computing
Virtualization
Requirements
Containers
MapReduce
Container
Benchmark
Necessary
Evaluate

Цитировать

@article{3812fe34d89d4171a3fe37afc449f3f1,
title = "Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters",
abstract = "Virtualized computing infrastructures are often used to create clusters of resources tailored to solve tasks taking into account particular requirements of these tasks. An important objective is to evaluate such requirements and request optimal amount of resources which becomes challenging for parallel tasks with intercommunication. In previous works we investigated how light-weight container-based virtualization can be used for creating virtual clusters running MPI applications. Such cluster is configured according to the requirements of particular application and allocates only necessary amount of resources from the physical infrastructure leaving space for co-allocated clusters running without conflicts or resource races. In this paper we investigate similar concepts for MapReduce applications based on Hadoop framework that use Cloudply virtualization tool to create and manage light-weight virtual Hadoop clusters on Amazon cloud resources. We investigate performance of several Hadoop benchmarks in differen",
keywords = "Virtualization, Containers, Virtual cluster",
author = "Vladimir Korkhov and Sergey Kobyshev and Alexander Degtyarev and Alexander Bogdanov",
year = "2017",
doi = "10.1007/978-3-319-62404-4_29",
language = "English",
volume = "10408",
pages = "399--411",
journal = "Lecture Notes in Computer Science",
issn = "0302-9743",
publisher = "Springer",

}

Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters. / Korkhov, Vladimir; Kobyshev, Sergey; Degtyarev, Alexander; Bogdanov, Alexander.

В: Lecture Notes in Computer Science, Том 10408, 2017, стр. 399-411.

Результат исследований: Научные публикации в периодических изданияхстатья

TY - JOUR

T1 - Light-Weight Cloud-Based Virtual Computing Infrastructure for Distributed Applications and Hadoop Clusters

AU - Korkhov, Vladimir

AU - Kobyshev, Sergey

AU - Degtyarev, Alexander

AU - Bogdanov, Alexander

PY - 2017

Y1 - 2017

N2 - Virtualized computing infrastructures are often used to create clusters of resources tailored to solve tasks taking into account particular requirements of these tasks. An important objective is to evaluate such requirements and request optimal amount of resources which becomes challenging for parallel tasks with intercommunication. In previous works we investigated how light-weight container-based virtualization can be used for creating virtual clusters running MPI applications. Such cluster is configured according to the requirements of particular application and allocates only necessary amount of resources from the physical infrastructure leaving space for co-allocated clusters running without conflicts or resource races. In this paper we investigate similar concepts for MapReduce applications based on Hadoop framework that use Cloudply virtualization tool to create and manage light-weight virtual Hadoop clusters on Amazon cloud resources. We investigate performance of several Hadoop benchmarks in differen

AB - Virtualized computing infrastructures are often used to create clusters of resources tailored to solve tasks taking into account particular requirements of these tasks. An important objective is to evaluate such requirements and request optimal amount of resources which becomes challenging for parallel tasks with intercommunication. In previous works we investigated how light-weight container-based virtualization can be used for creating virtual clusters running MPI applications. Such cluster is configured according to the requirements of particular application and allocates only necessary amount of resources from the physical infrastructure leaving space for co-allocated clusters running without conflicts or resource races. In this paper we investigate similar concepts for MapReduce applications based on Hadoop framework that use Cloudply virtualization tool to create and manage light-weight virtual Hadoop clusters on Amazon cloud resources. We investigate performance of several Hadoop benchmarks in differen

KW - Virtualization

KW - Containers

KW - Virtual cluster

U2 - 10.1007/978-3-319-62404-4_29

DO - 10.1007/978-3-319-62404-4_29

M3 - Article

VL - 10408

SP - 399

EP - 411

JO - Lecture Notes in Computer Science

JF - Lecture Notes in Computer Science

SN - 0302-9743

ER -