論文

査読有り
2020年1月

Gfarm/BB — Gfarm File System for Node-Local Burst Buffer

Journal of Computer Science and Technology
  • Tatebe, Osamu
  • ,
  • Moriwake, Shukuko
  • ,
  • Oyama, Yoshihiro

35
1
開始ページ
61
終了ページ
71
記述言語
英語
掲載種別
研究論文(学術雑誌)
DOI
10.1007/s11390-020-9803-z
出版者・発行元
Springer

Burst buffer has become a major component to meet the I/O performance requirement of HPC bursty traffic. This paper proposes Gfarm/BB that is a file system for a burst buffer efficiently exploiting node-local storage systems. Although node-local storages improve storage performance, they are only available during the job allocation. Gfarm/BB should have better access and metadata performance while it should be constructed on-demand before the job execution. To improve the read and write performance, it exploits the file descriptor passing and remote direct memory access (RDMA). It improves the metadata performance by omitting the persistency and the redundancy since it is a temporal file system. Using RDMA, writes and reads bandwidth are improved by 1.7x and 2.2x compared with IP over InfiniBand (IPoIB), respectively. It achieves 14 700 operations per second in the directory creation performance, which is 13.4x faster than the fully persistent and redundant case. The construction of Gfarm/BB takes 0.31 seconds using 2 nodes. IOR benchmark and ARGOT-IO application I/O benchmark show the scalable performance improvement by exploiting the locality of node-local storages. Compared with BeeOND, Gfarm/BB shows 2.6x and 2.4x better performance in IOR write and read benchmarks, respectively, and it shows 2.5x better performance in ARGOT-IO.

リンク情報
DOI
https://doi.org/10.1007/s11390-020-9803-z
ID情報
  • DOI : 10.1007/s11390-020-9803-z
  • ISSN : 1000-9000

エクスポート
BibTeX RIS