TY - GEN
T1 - The full path to full-path indexing
AU - Zhan, Yang
AU - Conway, Alex
AU - Jiao, Yizheng
AU - Knorr, Eric
AU - Bender, Michael A.
AU - Farach-Colton, Martin
AU - Jannen, William
AU - Johnson, Rob
AU - Porter, Donald E.
AU - Yuan, Jun
PY - 2018/1/1
Y1 - 2018/1/1
N2 - Full-path indexing can improve I/O efficiency for workloads that operate on data organized using traditional, hierarchical directories, because data is placed on persistent storage in scan order. Prior results indicate, however, that renames in a local file system with full-path indexing are prohibitively expensive. This paper shows how to use full-path indexing in a file system to realize fast directory scans, writes, and renames. The paper introduces a range-rename mechanism for efficient key-space changes in a write-optimized dictionary. This mechanism is encapsulated in the key-value API and simplifies the overall file system design. We implemented this mechanism in BetrFS, an in-kernel, local file system for Linux. This new version, BetrFS 0.4, performs recursive greps 1.5x faster and random writes 1.2x faster than BetrFS 0.3, but renames are competitive with indirection-based file systems for a range of sizes. BetrFS 0.4 outperforms BetrFS 0.3, as well as traditional file systems, such as ext4, XFS, and ZFS, across a variety of workloads.
AB - Full-path indexing can improve I/O efficiency for workloads that operate on data organized using traditional, hierarchical directories, because data is placed on persistent storage in scan order. Prior results indicate, however, that renames in a local file system with full-path indexing are prohibitively expensive. This paper shows how to use full-path indexing in a file system to realize fast directory scans, writes, and renames. The paper introduces a range-rename mechanism for efficient key-space changes in a write-optimized dictionary. This mechanism is encapsulated in the key-value API and simplifies the overall file system design. We implemented this mechanism in BetrFS, an in-kernel, local file system for Linux. This new version, BetrFS 0.4, performs recursive greps 1.5x faster and random writes 1.2x faster than BetrFS 0.3, but renames are competitive with indirection-based file systems for a range of sizes. BetrFS 0.4 outperforms BetrFS 0.3, as well as traditional file systems, such as ext4, XFS, and ZFS, across a variety of workloads.
UR - http://www.scopus.com/inward/record.url?scp=85055378329&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85055378329&partnerID=8YFLogxK
M3 - Conference contribution
T3 - Proceedings of the 16th USENIX Conference on File and Storage Technologies, FAST 2018
SP - 123
EP - 138
BT - Proceedings of the 16th USENIX Conference on File and Storage Technologies, FAST 2018
PB - USENIX Association
T2 - 16th USENIX Conference on File and Storage Technologies, FAST 2018
Y2 - 12 February 2018 through 15 February 2018
ER -