Research output: Contribution to journal › Article › peer-review
Boosting HPC Applications in the Cloud Through JIT Traffic-Aware Path Provisioning. / Pretto, Guilherme R.; Dalmazo, Bruno L.; Marques, Jonatas A.; Wu, Zhongke; Wang, Xingce; Korkhov, Vladimir; Navaux, Philippe O.A.; Gaspary, Luciano P.
In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 11622, 01.07.2019, p. 702-716.Research output: Contribution to journal › Article › peer-review
}
TY - JOUR
T1 - Boosting HPC Applications in the Cloud Through JIT Traffic-Aware Path Provisioning
AU - Pretto, Guilherme R.
AU - Dalmazo, Bruno L.
AU - Marques, Jonatas A.
AU - Wu, Zhongke
AU - Wang, Xingce
AU - Korkhov, Vladimir
AU - Navaux, Philippe O.A.
AU - Gaspary, Luciano P.
N1 - Conference code: 19
PY - 2019/7/1
Y1 - 2019/7/1
N2 - Data centers, clusters and grids have historically supported High-Performance Computing (HPC) applications. Due to the high capital and operational expenditures associated with such infrastructures, in recent past, we have witnessed consistent efforts to run HPC applications in the cloud. The potential advantages of this shift include higher scalability and lower costs. If on the one hand, app instantiation – through customized Virtual Machines (VMs) – is a well-solved issue, on the other, the network still represents a significant bottleneck. When switching HPC applications to be executed on the cloud, we lose control of where VMs will be positioned and of the paths that will be traversed for processes to communicate with one another. To alleviate this problem, and taking advantage of new advances in programmable networks, we propose a mechanism for dynamic, just-in-time path provisioning in cloud infrastructures. It continuously monitors the network conditions and, given the current communication patterns of the application, systematically (re)programs paths to avoid uncongested links and reduce end-to-end delays. The proposed mechanism achieves a speedup of up to 44.24% regarding application runtime when compared to the traditional shortest-path, static approach.
AB - Data centers, clusters and grids have historically supported High-Performance Computing (HPC) applications. Due to the high capital and operational expenditures associated with such infrastructures, in recent past, we have witnessed consistent efforts to run HPC applications in the cloud. The potential advantages of this shift include higher scalability and lower costs. If on the one hand, app instantiation – through customized Virtual Machines (VMs) – is a well-solved issue, on the other, the network still represents a significant bottleneck. When switching HPC applications to be executed on the cloud, we lose control of where VMs will be positioned and of the paths that will be traversed for processes to communicate with one another. To alleviate this problem, and taking advantage of new advances in programmable networks, we propose a mechanism for dynamic, just-in-time path provisioning in cloud infrastructures. It continuously monitors the network conditions and, given the current communication patterns of the application, systematically (re)programs paths to avoid uncongested links and reduce end-to-end delays. The proposed mechanism achieves a speedup of up to 44.24% regarding application runtime when compared to the traditional shortest-path, static approach.
KW - Cloud infrastructures
KW - HPC applications
KW - Link usage-aware path provisioning
UR - http://www.scopus.com/inward/record.url?scp=85068610059&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-24305-0_52
DO - 10.1007/978-3-030-24305-0_52
M3 - Article
AN - SCOPUS:85068610059
VL - 11622
SP - 702
EP - 716
JO - Lecture Notes in Computer Science
JF - Lecture Notes in Computer Science
SN - 0302-9743
T2 - 19th International Conference on Computational Science and Its Applications, ICCSA 2019
Y2 - 1 July 2019 through 4 July 2019
ER -
ID: 44016927