Why Reading Patterns Matter in Storage Coding & Scheduling Design

Ulric J. Ferner, Emina Soljanin, Muriel Medard

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Coding techniques for storage systems are gaining traction in data center (DC) applications, owing to their data survivability performance, and more recently, to their ability to mitigate traffic congestion. This paper considers stochastic allocation schedules in networks that admit bulk file requests, across three drive blocking models. We consider a block-based code and a stochastic scheduling algorithm which is beneficial in the case of continuous chunk read patterns. In particular, we demonstrate that in systems with continuous chunk reading patterns, when drive blocking is either independent or from traffic congestion, block coded storage can reduce average download time by 10 - 66%, given modern system parameters. However, a distinction should be made between systems with continuous and those with interrupted chunk read patterns. For interrupted chunk read systems, given our allocation algorithm that performs well for continuous reads, block coded storage performance can be worse than replication, numerical illustrations show relative losses over 66%. These illustrations demonstrate that to harness the full benefits of coded storage and to avoid pitfalls, careful attention must be paid to continuous vs. Interrupted chunk reading patterns, codes other than block codes should be considered, as could joint code-scheduling design.

Original languageEnglish (US)
Title of host publicationProceedings - 2015 IEEE 8th International Conference on Cloud Computing, CLOUD 2015
EditorsCalton Pu, Ajay Mohindra
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages357-364
Number of pages8
ISBN (Electronic)9781467372879
DOIs
StatePublished - Aug 19 2015
Externally publishedYes
Event8th IEEE International Conference on Cloud Computing, CLOUD 2015 - New York, United States
Duration: Jun 27 2015Jul 2 2015

Publication series

NameProceedings - 2015 IEEE 8th International Conference on Cloud Computing, CLOUD 2015

Other

Other8th IEEE International Conference on Cloud Computing, CLOUD 2015
Country/TerritoryUnited States
CityNew York
Period6/27/157/2/15

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications

Keywords

  • Blocking probability
  • Bulk requests
  • Cloud computing architectures
  • Coded storage
  • Design patterns
  • Download time
  • File chunks
  • Reading patterns
  • Storage

Fingerprint

Dive into the research topics of 'Why Reading Patterns Matter in Storage Coding & Scheduling Design'. Together they form a unique fingerprint.

Cite this