StorAlloc: A Simulator for Job Scheduling on Heterogeneous Storage Resources - Archive ouverte HAL Access content directly
Conference Papers Year :

StorAlloc: A Simulator for Job Scheduling on Heterogeneous Storage Resources

(1) , (1) , (1) , (1)
1

Abstract

The ability of large-scale infrastructures to store and retrieve a massive amount of data is now decisive to scale up scientific applications. However, there is an ever-widening gap between I/O and computing performance. A way to mitigate this consists of deploying new intermediate storage tiers (node-local storage, burst-buffers, ...) between the compute nodes and the traditional global shared parallel file-system. Unfortunately, without advanced techniques to allocate and size these resources, they remain underutilized. In this paper, we investigate how heterogeneous storage resources can be allocated on an HPC platform, in a similar way as compute resources. In that regard, we introduce StorAlloc, a simulator used as a testbed for assessing storage-aware job scheduling algorithms and evaluating various storage infrastructures.
Fichier principal
Vignette du fichier
StorAlloc_2022.pdf (383.83 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03683568 , version 1 (31-05-2022)
hal-03683568 , version 2 (06-12-2022)

Identifiers

  • HAL Id : hal-03683568 , version 2

Cite

Julien Monniot, François Tessier, Matthieu Robert, Gabriel Antoniu. StorAlloc: A Simulator for Job Scheduling on Heterogeneous Storage Resources. HeteroPar 2022, Aug 2022, Glasgow, United Kingdom. ⟨hal-03683568v2⟩
86 View
73 Download

Share

Gmail Facebook Twitter LinkedIn More