Anomaly detection in premise energy consumption data

Yi Zhang, Weiwei Chen, Jason Black

Research output: Chapter in Book/Report/Conference proceedingConference contribution

37 Scopus citations


Demand Response (DR) programs are designed to reduce energy consumption for relatively short time periods (e.g., a few hours per event). It has been widely recognized that DR can help to meet both reliability and market needs. In order for DR programs to achieve their full benefits, however, it is critical for utilities to accurately predict the reduction in energy consumption during events and increases due to the rebound effect after events. Currently, DR prediction is performed based on the historical energy consumption data without the impacts of anomalous data points. However, days with anomalous energy consumption, such as when the consumer is on vacation, can bias analysis of historical consumption behavior, and therefore significantly decrease the accuracy of DR prediction. This is especially the case when anomalous days occur during DR event periods or baseline measurement periods, where there is a small sample size for evaluation. This paper presents a method to accurately identify anomalous days for individual premises so that they can be removed from the premise data. This will enable more accurate assessments of energy consumption patterns, including normal usage, consumption baselines used for billing, and DR estimation algorithms. Several different methodologies for anomaly detection are discussed. These methods either utilize attributes generated from the customers' energy consumption profiles or use the profiles directly. Numerical results demonstrate that the anomaly detection methods can correctly identify the majority of anomalous days. The anomaly detection algorithms are validated using a detailed data set that has both premise level and device level consumption data. The anomalous days can be detected and eliminated when the customers' energy consumption profiles are carefully studied and the detection models are well tuned.

Original languageEnglish (US)
Title of host publication2011 IEEE PES General Meeting
Subtitle of host publicationThe Electrification of Transportation and the Grid of the Future
StatePublished - 2011
Externally publishedYes
Event2011 IEEE PES General Meeting: The Electrification of Transportation and the Grid of the Future - Detroit, MI, United States
Duration: Jul 24 2011Jul 28 2011

Publication series

NameIEEE Power and Energy Society General Meeting
ISSN (Print)1944-9925
ISSN (Electronic)1944-9933


Conference2011 IEEE PES General Meeting: The Electrification of Transportation and the Grid of the Future
CountryUnited States
CityDetroit, MI

All Science Journal Classification (ASJC) codes

  • Energy Engineering and Power Technology
  • Nuclear Energy and Engineering
  • Renewable Energy, Sustainability and the Environment
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Anomaly detection in premise energy consumption data'. Together they form a unique fingerprint.

Cite this