Результаты исследований: Научные публикации в периодических изданиях › статья в журнале по материалам конференции › Рецензирование
Towards Russian national data lake prototype. / Alekseev, A.; Campana, S.; Espinal, X.; Jezequel, S.; Kiryanov, A.; Klimentov, A.; Mitsyn, V.; Zarochentsev, A.
в: CEUR Workshop Proceedings, Том 2507, 2019, стр. 44-50.Результаты исследований: Научные публикации в периодических изданиях › статья в журнале по материалам конференции › Рецензирование
}
TY - JOUR
T1 - Towards Russian national data lake prototype
AU - Alekseev, A.
AU - Campana, S.
AU - Espinal, X.
AU - Jezequel, S.
AU - Kiryanov, A.
AU - Klimentov, A.
AU - Mitsyn, V.
AU - Zarochentsev, A.
N1 - Publisher Copyright: Copyright © 2019 for this paper by its authors.
PY - 2019
Y1 - 2019
N2 - The evolution of the computing facilities and the way storage will be organized and consolidated will play a key role in how this possible shortage of resources will be addressed by the LHC experiments. The need for an effective distributed data storage has been identified as fundamental from the beginning of LHC, and this topic has become particularly vital in the light of the preparation for the HL-LHC run. WLCG has started an R&D within DOMA project and in this contribution we will report the recent results related to the Russian federated data storage systems configuration and testing. We will describe different system configurations and various approaches to test data storage federation. We are considering EOS and dCache storage systems as a backbone software for data federation and xCache for data caching. We'll also report about synthetic tests and experiments specific tests developed by ATLAS and ALICE for federated storage prototype in Russia. Data Lake project has been launched in Russian Federation in 2019 to set up a National Data Lake prototype for HENP and to consolidate geographically distributed data storage systems connected by fast network with low latency, we will report the project objectives and status.
AB - The evolution of the computing facilities and the way storage will be organized and consolidated will play a key role in how this possible shortage of resources will be addressed by the LHC experiments. The need for an effective distributed data storage has been identified as fundamental from the beginning of LHC, and this topic has become particularly vital in the light of the preparation for the HL-LHC run. WLCG has started an R&D within DOMA project and in this contribution we will report the recent results related to the Russian federated data storage systems configuration and testing. We will describe different system configurations and various approaches to test data storage federation. We are considering EOS and dCache storage systems as a backbone software for data federation and xCache for data caching. We'll also report about synthetic tests and experiments specific tests developed by ATLAS and ALICE for federated storage prototype in Russia. Data Lake project has been launched in Russian Federation in 2019 to set up a National Data Lake prototype for HENP and to consolidate geographically distributed data storage systems connected by fast network with low latency, we will report the project objectives and status.
KW - Data Lake
KW - Distributed Storage
KW - DOMA
KW - HL-LHC
KW - WLCG
UR - http://www.scopus.com/inward/record.url?scp=85077626932&partnerID=8YFLogxK
M3 - Conference article
AN - SCOPUS:85077626932
VL - 2507
SP - 44
EP - 50
JO - CEUR Workshop Proceedings
JF - CEUR Workshop Proceedings
SN - 1613-0073
T2 - 27th Symposium on Nuclear Electronics and Computing, NEC 2019
Y2 - 30 September 2019 through 4 October 2019
ER -
ID: 91875994