TY - GEN

T1 - Hierarchical Virtual Storage

AU - Ибатуллин, Евгений Вадимович

AU - Хватов, Валерий

AU - Богданов, Александр Владимирович

AU - Щеголева, Надежда Львовна

PY - 2025/6/28

Y1 - 2025/6/28

N2 - The increasing complexity of data management and storage systems, coupled with the growing demand for flexible and efficient solutions, has led to the emergence of data virtualization technologies. This study investigates the potential for enhancing data storage methodologies through virtualization approaches, particularly focusing on the integration of hierarchical storage systems. Additionally, the research explores methods for organizing the management of such systems. The principles, methodologies, and architectures underlying distributed storage systems employed for handling big data tasks are analyzed. Experimental validation was conducted through the physical implementation of a prototype system on hardware. The results demonstrate a hierarchical data storage system leveraging virtualization, facilitating seamless data access and integration from disparate sources independently of their structure or storage method. Furthermore, a management approach based on reinforcement learning is proposed for controlling the developed storage system.

AB - The increasing complexity of data management and storage systems, coupled with the growing demand for flexible and efficient solutions, has led to the emergence of data virtualization technologies. This study investigates the potential for enhancing data storage methodologies through virtualization approaches, particularly focusing on the integration of hierarchical storage systems. Additionally, the research explores methods for organizing the management of such systems. The principles, methodologies, and architectures underlying distributed storage systems employed for handling big data tasks are analyzed. Experimental validation was conducted through the physical implementation of a prototype system on hardware. The results demonstrate a hierarchical data storage system leveraging virtualization, facilitating seamless data access and integration from disparate sources independently of their structure or storage method. Furthermore, a management approach based on reinforcement learning is proposed for controlling the developed storage system.

KW - Containers cluster

KW - Data Lake approach

KW - Data management

KW - Data virtualization technologies

KW - Data-mesh system

KW - Distributed File System

KW - Storage systems

UR - https://www.mendeley.com/catalogue/ffbf011d-39a6-3d87-9e89-82325f69e187/

U2 - 10.1007/978-3-031-97648-3_16

DO - 10.1007/978-3-031-97648-3_16

M3 - Conference contribution

SN - 9783031976476

T3 - Lecture Notes in Computer Science

SP - 231

EP - 248

BT - Computational Science and Its Applications – ICCSA 2025 Workshops

T2 - Computational Science and Its Applications – ICCSA 2025 Workshops

Y2 - 30 June 2025 through 3 July 2025

ER -