scispace - formally typeset
Open AccessJournal ArticleDOI

Big Data Mining of Energy Time Series for Behavioral Analytics and Energy Consumption Forecasting

Shailendra Singh, +1 more
- 20 Feb 2018 - 
- Vol. 11, Iss: 2, pp 452
TLDR
An intelligent data mining model to analyze, forecast and visualize energy time series to uncover various temporal energy consumption patterns and proposes unsupervised data clustering and frequent pattern mining analysis on energy timeseries, and Bayesian network prediction for energy usage forecasting.
Abstract
Responsible, efficient and environmentally aware energy consumption behavior is becoming a necessity for the reliable modern electricity grid. In this paper, we present an intelligent data mining model to analyze, forecast and visualize energy time series to uncover various temporal energy consumption patterns. These patterns define the appliance usage in terms of association with time such as hour of the day, period of the day, weekday, week, month and season of the year as well as appliance-appliance associations in a household, which are key factors to infer and analyze the impact of consumers’ energy consumption behavior and energy forecasting trend. This is challenging since it is not trivial to determine the multiple relationships among different appliances usage from concurrent streams of data. Also, it is difficult to derive accurate relationships between interval-based events where multiple appliance usages persist for some duration. To overcome these challenges, we propose unsupervised data clustering and frequent pattern mining analysis on energy time series, and Bayesian network prediction for energy usage forecasting. We perform extensive experiments using real-world context-rich smart meter datasets. The accuracy results of identifying appliance usage patterns using the proposed model outperformed Support Vector Machine (SVM) and Multi-Layer Perceptron (MLP) at each stage while attaining a combined accuracy of 81.82%, 85.90%, 89.58% for 25%, 50% and 75% of the training data size respectively. Moreover, we achieved energy consumption forecast accuracies of 81.89% for short-term (hourly) and 75.88%, 79.23%, 74.74%, and 72.81% for the long-term; i.e., day, week, month, and season respectively.

read more

Citations
More filters
Journal ArticleDOI

IoT big data analytics for smart homes with fog and cloud computing

TL;DR: A new platform that enables innovative analytics on IoT captured data from smart homes and the use of fog nodes and cloud system to allow data-driven services and address the challenges of complexities and resource demands for online and offline data processing, storage, and classification analysis is presented.
Journal ArticleDOI

Energy Sustainability in Smart Cities: Artificial Intelligence, Smart Monitoring, and Optimization of Energy Consumption

TL;DR: This paper examines smart metering and non-intrusive load monitoring (NILM) to make a case for the latter’s value added in context of profiling electric appliances’ electricity consumption and integrates insights from artificial intelligence, IoT, and big data analytics and queries them in a context defined by energy sustainability in smart cities.
Journal ArticleDOI

Big Data Analytics for Discovering Electricity Consumption Patterns in Smart Cities

TL;DR: A methodology to extract electric energy consumption patterns in big data time series, so that very valuable conclusions can be made for managers and governments is proposed.
Journal ArticleDOI

A Kalman filter-based bottom-up approach for household short-term load forecast

TL;DR: A Kalman filter-based bottom-up approach could efficiently improve household load forecast accuracy and could help give fast and accurate load forecasts for building energy management and predictive controls.
Journal ArticleDOI

Short-Term Electric Load and Price Forecasting Using Enhanced Extreme Learning Machine Optimization in Smart Grids

TL;DR: The proposed techniques efficiently increased the prediction accuracy of load and price and the computational time is increased in both scenarios.
References
More filters

Some methods for classification and analysis of multivariate observations

TL;DR: The k-means algorithm as mentioned in this paper partitions an N-dimensional population into k sets on the basis of a sample, which is a generalization of the ordinary sample mean, and it is shown to give partitions which are reasonably efficient in the sense of within-class variance.
Journal ArticleDOI

Silhouettes: a graphical aid to the interpretation and validation of cluster analysis

TL;DR: A new graphical display is proposed for partitioning techniques, where each cluster is represented by a so-called silhouette, which is based on the comparison of its tightness and separation, and provides an evaluation of clustering validity.
Book

Data Mining and Knowledge Discovery Handbook

Oded Maimon, +1 more
TL;DR: This book first surveys, then provides comprehensive yet concise algorithmic descriptions of methods, including classic methods plus the extensions and novel methods developed recently.
Journal ArticleDOI

Mining Frequent Patterns without Candidate Generation: A Frequent-Pattern Tree Approach

TL;DR: A novel frequent-pattern tree (FP-tree) structure is proposed, which is an extended prefix-tree structure for storing compressed, crucial information about frequent patterns, and an efficient FP-tree-based mining method, FP-growth, is developed for mining the complete set of frequent patterns by pattern fragment growth.
Related Papers (5)