TY - JOUR

T1 - BigData and computing challenges in high energy and nuclear physics

AU - Klimentov, A.

AU - Grigorieva, M.

AU - Kiryanov, A.

AU - Zarochentsev, A.

N1 - Funding Information: This work was funded in part by the Russian Ministry of Science and Education under Contract No. 14.Z50.31.0024 and the U. S. Department of Energy, Office of Science, High Energy Physics and Advanced Scientific Computing under Contracts No. DE-AC02-98CH10886 and DE-AC02-06CH11357, the federated storage project is funded by the Russian Fund for Fundamental Research under contract 15-29-0794-2 ofi-m and the data knowledge base project is funded by the Russian Science Foundation under contract N16-11-10280. Publisher Copyright: © 2017 IOP Publishing Ltd and Sissa Medialab. Copyright: Copyright 2017 Elsevier B.V., All rights reserved.

PY - 2017/6/29

Y1 - 2017/6/29

N2 - In this contribution we discuss the various aspects of the computing resource needs experiments in High Energy and Nuclear Physics, in particular at the Large Hadron Collider. This will evolve in the future when moving from LHC to HL-LHC in ten years from now, when the already exascale levels of data we are processing could increase by a further order of magnitude. The distributed computing environment has been a great success and the inclusion of new super-computing facilities, cloud computing and volunteering computing for the future is a big challenge, which we are successfully mastering with a considerable contribution from many super-computing centres around the world, academic and commercial cloud providers. We also discuss R&D computing projects started recently in National Research Center 'Kurchatov Institute'

AB - In this contribution we discuss the various aspects of the computing resource needs experiments in High Energy and Nuclear Physics, in particular at the Large Hadron Collider. This will evolve in the future when moving from LHC to HL-LHC in ten years from now, when the already exascale levels of data we are processing could increase by a further order of magnitude. The distributed computing environment has been a great success and the inclusion of new super-computing facilities, cloud computing and volunteering computing for the future is a big challenge, which we are successfully mastering with a considerable contribution from many super-computing centres around the world, academic and commercial cloud providers. We also discuss R&D computing projects started recently in National Research Center 'Kurchatov Institute'

KW - Computing (architecture, farms, GRID for recording, storage, archiving, and distribution of data)

KW - Data processing methods

KW - Software architectures (event data models, frameworks and databases)

UR - http://www.scopus.com/inward/record.url?scp=85023172258&partnerID=8YFLogxK

U2 - 10.1088/1748-0221/12/06/C06044

DO - 10.1088/1748-0221/12/06/C06044

M3 - Article

AN - SCOPUS:85023172258

VL - 12

JO - Journal of Instrumentation

JF - Journal of Instrumentation

SN - 1748-0221

IS - 6

M1 - C06044

ER -