TY - GEN
T1 - SCTuner
T2 - 6th IEEE/ACM International Parallel Data Systems Workshop, PDSW 2021
AU - Tang, Houjun
AU - Xie, Bing
AU - Byna, Suren
AU - Carns, Philip
AU - Koziol, Quincey
AU - Kannan, Sudarsun
AU - Lofstead, Jay
AU - Oral, Sarp
N1 - Funding Information:
ACKNOWLEDGMENT This research is supported by the Director, Office of Science, Office of Advanced Scientific Computing Research, of the U.S. Department of Energy under Contract No. DE-AC02-05CH11231. This work was supported by the U.S. Department of Energy, Office of Science, Advanced Scientific Computing Research, under Contract DE-AC02-06CH11357.This work used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725.Sandia National Laboratories is a multimission laboratory managed and operated by National Technology and Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International, Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525 (SAND2021-12186 C). Sudarsun Kannan was partially supported by NSF CNS 1850297 award. This material is based upon work supported by the U.S. Department of Energy , Office of Science, under contract DE-AC02-06CH11357.
Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - In high-performance computing (HPC), scientific applications often manage a massive amount of data using I/O libraries. These libraries provide convenient data model abstractions, help ensure data portability, and, most important, empower end users to improve I/O performance by tuning configurations across multiple layers of the HPC I/O stack. We propose SCTuner, an autotuner integrated within the I/O library itself to dynamically tune both the I/O library and the underlying I/O stack at application runtime. To this end, we introduce a statistical benchmarking method to profile the behaviors of individual supercomputer I/O subsystems with varied configurations across I/O layers. We use the benchmarking results as the built-in knowledge in SCTuner, implement an I/O pattern extractor, and plan to implement an online performance tuner as the SCTuner runtime. We conducted a benchmarking analysis on the Summit supercomputer and its GPFS file system Alpine. The preliminary results show that our method can effectively extract the consistent I/O behaviors of the target system under production load, building the base for I/O autotuning at application runtime.
AB - In high-performance computing (HPC), scientific applications often manage a massive amount of data using I/O libraries. These libraries provide convenient data model abstractions, help ensure data portability, and, most important, empower end users to improve I/O performance by tuning configurations across multiple layers of the HPC I/O stack. We propose SCTuner, an autotuner integrated within the I/O library itself to dynamically tune both the I/O library and the underlying I/O stack at application runtime. To this end, we introduce a statistical benchmarking method to profile the behaviors of individual supercomputer I/O subsystems with varied configurations across I/O layers. We use the benchmarking results as the built-in knowledge in SCTuner, implement an I/O pattern extractor, and plan to implement an online performance tuner as the SCTuner runtime. We conducted a benchmarking analysis on the Summit supercomputer and its GPFS file system Alpine. The preliminary results show that our method can effectively extract the consistent I/O behaviors of the target system under production load, building the base for I/O autotuning at application runtime.
UR - http://www.scopus.com/inward/record.url?scp=85124180778&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85124180778&partnerID=8YFLogxK
U2 - 10.1109/PDSW54622.2021.00010
DO - 10.1109/PDSW54622.2021.00010
M3 - Conference contribution
AN - SCOPUS:85124180778
T3 - Proceedings of PDSW 2021: IEEE/ACM 6th International Parallel Data Systems Workshop, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis
SP - 29
EP - 34
BT - Proceedings of PDSW 2021
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 15 November 2021
ER -