Distributed Learning of Distributions via Social Sampling

Anand D. Sarwate, Tara Javidi

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

A protocol for distributed estimation of discrete distributions is proposed. Each agent begins with a single sample from the distribution, and the goal is to learn the empirical distribution of the samples. The protocol is based on a simple message-passing model motivated by communication in social networks. Agents sample a message randomly from their current estimates of the distribution, resulting in a protocol with quantized messages. Using tools from stochastic approximation, the algorithm is shown to converge almost surely. Examples illustrate three regimes with different consensus phenomena. Simulations demonstrate this convergence and give some insight into the effect of network topology.

Original languageEnglish (US)
Article number6827923
Pages (from-to)34-45
Number of pages12
JournalIEEE Transactions on Automatic Control
Volume60
Issue number1
DOIs
StatePublished - Jan 1 2015

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering

Keywords

  • Distributions
  • independent and identically distributed (i.i.d.)

Fingerprint

Dive into the research topics of 'Distributed Learning of Distributions via Social Sampling'. Together they form a unique fingerprint.

Cite this