Virtualized computing infrastructures are often used to create clusters of resources tailored to solve tasks taking into account particular requirements of these tasks. An important objective is to evaluate such requirements and request optimal amount of resources which becomes challenging for parallel tasks with intercommunication. In previous works we investigated how light-weight container-based virtualization can be used for creating virtual clusters running MPI applications. Such cluster is configured according to the requirements of particular application and allocates only necessary amount of resources from the physical infrastructure leaving space for co-allocated clusters running without conflicts or resource races. In this paper we investigate similar concepts for MapReduce applications based on Hadoop framework that use Cloudply virtualization tool to create and manage light-weight virtual Hadoop clusters on Amazon cloud resources. We investigate performance of several Hadoop benchmarks in differen
Язык оригиналаанглийский
Название основной публикацииComputational Science and Its Applications – ICCSA 2017
Подзаголовок основной публикации17th International Conference, Trieste, Italy, July 3-6, 2017, Proceedings, Part V
ИздательSpringer Nature
Страницы399-411
ISBN (электронное издание)978-3-319-62404-4
ISBN (печатное издание)978-3-319-62403-7
DOI
СостояниеОпубликовано - 2017
Событие17th International Conference on Computational Science and Its Applications, ICCSA 2017 - Trieste, Италия
Продолжительность: 2 июл 20175 июл 2017
Номер конференции: 17

Серия публикаций

НазваниеLecture Notes in Computer Science
ИздательSpringer Nature
Том10408
ISSN (печатное издание)0302-9743

конференция

конференция17th International Conference on Computational Science and Its Applications, ICCSA 2017
Сокращенное названиеICCSA 2017
Страна/TерриторияИталия
ГородTrieste
Период2/07/175/07/17

ID: 71327642