DART: A substrate for high speed asynchronous data IO

Ciprian Docan, Manish Parashar, Scott Klasky

Research output: Chapter in Book/Report/Conference proceedingConference contribution

22 Scopus citations

Abstract

Large scale simulations of complex physics phenomena have long run times and generate massive amounts of data. Saving this data to external storage systems or transferring it to remote locations for analysis is a costly operation that quickly becomes a performance bottleneck. In this paper, we present DART (Decoupled and Asynchronous Remote Transfers), an efficient data transfer substrate that effectively minimizes the data I/O overhead on the running simulations. DART is a thin software layer built on RDMA technology to enable fast, low-overhead and asynchronous access to data from a running simulation, and support high-throughput, low-latency data transfers.

Original languageEnglish (US)
Title of host publicationProceedings of the 17th International Symposium on High Performance Distributed Computing 2008, HPDC'08
Pages219-220
Number of pages2
DOIs
StatePublished - 2008
Event17th International Symposium on High Performance Distributed Computing 2008, HPDC'08 - Boston, MA, United States
Duration: Jun 23 2008Jun 27 2008

Publication series

NameProceedings of the 17th International Symposium on High Performance Distributed Computing 2008, HPDC'08

Other

Other17th International Symposium on High Performance Distributed Computing 2008, HPDC'08
Country/TerritoryUnited States
CityBoston, MA
Period6/23/086/27/08

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Software

Keywords

  • Experimentation

Fingerprint

Dive into the research topics of 'DART: A substrate for high speed asynchronous data IO'. Together they form a unique fingerprint.

Cite this