Virtualized computing infrastructures are often used to create clusters of resources tailored to solve tasks taking into account particular requirements of these tasks. An important objective is to evaluate such requirements and request optimal amount of resources which becomes challenging for parallel tasks with intercommunication. In previous works we investigated how light-weight container-based virtualization can be used for creating virtual clusters running MPI applications. Such cluster is configured according to the requirements of particular application and allocates only necessary amount of resources from the physical infrastructure leaving space for co-allocated clusters running without conflicts or resource races. In this paper we investigate similar concepts for MapReduce applications based on Hadoop framework that use Cloudply virtualization tool to create and manage light-weight virtual Hadoop clusters on Amazon cloud resources. We investigate performance of several Hadoop benchmarks in differen
Original languageEnglish
Title of host publicationComputational Science and Its Applications – ICCSA 2017
Subtitle of host publication17th International Conference, Trieste, Italy, July 3-6, 2017, Proceedings, Part V
PublisherSpringer Nature
Pages399-411
ISBN (Electronic)978-3-319-62404-4
ISBN (Print)978-3-319-62403-7
DOIs
StatePublished - 2017
Event17th International Conference on Computational Science and Its Applications, ICCSA 2017 - Trieste, Italy
Duration: 2 Jul 20175 Jul 2017
Conference number: 17

Publication series

NameLecture Notes in Computer Science
PublisherSpringer Nature
Volume10408
ISSN (Print)0302-9743

Conference

Conference17th International Conference on Computational Science and Its Applications, ICCSA 2017
Abbreviated titleICCSA 2017
Country/TerritoryItaly
CityTrieste
Period2/07/175/07/17

    Research areas

  • Virtualization, Containers, Virtual cluster

ID: 71327642