Feedback-Control & Queueing Theory-Based Resource Management for Streaming Applications

Rafael Tolosana-Calasanz, Javier Diaz-Montes, Omer F. Rana, Manish Parashar

Research output: Contribution to journalArticlepeer-review

11 Scopus citations

Abstract

Recent advances in sensor technologies and instrumentation have led to an extraordinary growth of data sources and streaming applications. A wide variety of devices, from smart phones to dedicated sensors, have the capability of collecting and streaming large amounts of data at unprecedented rates. A number of distinct streaming data models have been proposed. Typical applications for this include smart cites & built environments for instance, where sensor-based infrastructures continue to increase in scale and variety. Understanding how such streaming content can be processed within some time threshold remains a non-trivial and important research topic. We investigate how a cloud-based computational infrastructure can autonomically respond to such streaming content, offering Quality of Service guarantees. We propose an autonomic controller (based on feedback control and queueing theory) to elastically provision virtual machines to meet performance targets associated with a particular data stream. Evaluation is carried out using a federated Cloud-based infrastructure (implemented using CometCloud)-where the allocation of new resources can be based on: (i) differences between sites, i.e., types of resources supported (e.g., GPU versus CPU only), (ii) cost of execution; (iii) failure rate and likely resilience, etc. In particular, we demonstrate how Little's Law-a widely used result in queuing theory-can be adapted to support dynamic control in the context of such resource provisioning.

Original languageEnglish (US)
Pages (from-to)1061-1075
Number of pages15
JournalIEEE Transactions on Parallel and Distributed Systems
Volume28
Issue number4
DOIs
StatePublished - Apr 1 2017

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Hardware and Architecture
  • Computational Theory and Mathematics

Keywords

  • Elastic resource provisioning
  • autonomic systems
  • feedback control

Fingerprint Dive into the research topics of 'Feedback-Control & Queueing Theory-Based Resource Management for Streaming Applications'. Together they form a unique fingerprint.

Cite this