MicroMon: A monitoring framework for tackling distributed heterogeneity

Babar Khalid; Nolan Rudolph; Ramakrishnan Durairajan; Sudarsun Kannan

MicroMon: A monitoring framework for tackling distributed heterogeneity

Babar Khalid, Nolan Rudolph, Ramakrishnan Durairajan, Sudarsun Kannan

School of Arts and Sciences, Computer Science

Research output: Contribution to conference › Paper › peer-review

Abstract

We present MicroMon, a multi-dimensional monitoring framework for geo-distributed applications using heterogeneous hardware. In MicroMon, we introduce micrometrics, which is a set of fine-grained hardware and software metrics required to study the combined impact of heterogeneous resources on application performance. Besides collecting micrometrics, in MicroMon, we propose anomaly reports and concerted effort between the programmable switches and host OSes to reduce the overhead of collecting and disseminating thousands of micrometrics in WAN. We evaluate the MicroMon prototype on Cassandra deployed across multiple data centers and show 10-50% throughput gains in a geo-distributed setting with storage and network heterogeneity.

Original language	English (US)
State	Published - 2020
Event	12th USENIX Workshop on Hot Topics in Storage and File Systems, HotStorage 2020, co-located withUSENIX ATC 2020 - Virtual, Online Duration: Jul 13 2020 → Jul 14 2020

Conference

Conference	12th USENIX Workshop on Hot Topics in Storage and File Systems, HotStorage 2020, co-located withUSENIX ATC 2020
City	Virtual, Online
Period	7/13/20 → 7/14/20

All Science Journal Classification (ASJC) codes

Software
Computer Networks and Communications
Hardware and Architecture
Information Systems

Cite this

@conference{ded280135d834e4a9a0c9800750c9aef,

title = "MicroMon: A monitoring framework for tackling distributed heterogeneity",

abstract = "We present MicroMon, a multi-dimensional monitoring framework for geo-distributed applications using heterogeneous hardware. In MicroMon, we introduce micrometrics, which is a set of fine-grained hardware and software metrics required to study the combined impact of heterogeneous resources on application performance. Besides collecting micrometrics, in MicroMon, we propose anomaly reports and concerted effort between the programmable switches and host OSes to reduce the overhead of collecting and disseminating thousands of micrometrics in WAN. We evaluate the MicroMon prototype on Cassandra deployed across multiple data centers and show 10-50% throughput gains in a geo-distributed setting with storage and network heterogeneity.",

author = "Babar Khalid and Nolan Rudolph and Ramakrishnan Durairajan and Sudarsun Kannan",

note = "Funding Information: We thank the anonymous reviewers and our Shepherd, Malte Schwarzkopf, for their insightful feedback. This work is supported by NSF CNS 1910593 and NSF CNS 1850297 awards. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of NSF. Publisher Copyright: {\textcopyright} HotStorage 2020 - 12th USENIX Workshop on Hot Topics in Storage and File Systems, co-located with USENIX ATC 2020. All rights reserved.; 12th USENIX Workshop on Hot Topics in Storage and File Systems, HotStorage 2020, co-located withUSENIX ATC 2020 ; Conference date: 13-07-2020 Through 14-07-2020",

year = "2020",

language = "English (US)",

}

TY - CONF

T1 - MicroMon

T2 - 12th USENIX Workshop on Hot Topics in Storage and File Systems, HotStorage 2020, co-located withUSENIX ATC 2020

AU - Khalid, Babar

AU - Rudolph, Nolan

AU - Durairajan, Ramakrishnan

AU - Kannan, Sudarsun

N1 - Funding Information: We thank the anonymous reviewers and our Shepherd, Malte Schwarzkopf, for their insightful feedback. This work is supported by NSF CNS 1910593 and NSF CNS 1850297 awards. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of NSF. Publisher Copyright: © HotStorage 2020 - 12th USENIX Workshop on Hot Topics in Storage and File Systems, co-located with USENIX ATC 2020. All rights reserved.

PY - 2020

Y1 - 2020

N2 - We present MicroMon, a multi-dimensional monitoring framework for geo-distributed applications using heterogeneous hardware. In MicroMon, we introduce micrometrics, which is a set of fine-grained hardware and software metrics required to study the combined impact of heterogeneous resources on application performance. Besides collecting micrometrics, in MicroMon, we propose anomaly reports and concerted effort between the programmable switches and host OSes to reduce the overhead of collecting and disseminating thousands of micrometrics in WAN. We evaluate the MicroMon prototype on Cassandra deployed across multiple data centers and show 10-50% throughput gains in a geo-distributed setting with storage and network heterogeneity.

AB - We present MicroMon, a multi-dimensional monitoring framework for geo-distributed applications using heterogeneous hardware. In MicroMon, we introduce micrometrics, which is a set of fine-grained hardware and software metrics required to study the combined impact of heterogeneous resources on application performance. Besides collecting micrometrics, in MicroMon, we propose anomaly reports and concerted effort between the programmable switches and host OSes to reduce the overhead of collecting and disseminating thousands of micrometrics in WAN. We evaluate the MicroMon prototype on Cassandra deployed across multiple data centers and show 10-50% throughput gains in a geo-distributed setting with storage and network heterogeneity.

UR - http://www.scopus.com/inward/record.url?scp=85091871190&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85091871190&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85091871190

Y2 - 13 July 2020 through 14 July 2020

ER -

MicroMon: A monitoring framework for tackling distributed heterogeneity

Abstract

Conference

All Science Journal Classification (ASJC) codes

Other files and links

Fingerprint

Cite this