Big Data Mining of Energy Time Series for Behavioral Analytics and Energy Consumption Forecasting
TLDR
An intelligent data mining model to analyze, forecast and visualize energy time series to uncover various temporal energy consumption patterns and proposes unsupervised data clustering and frequent pattern mining analysis on energy timeseries, and Bayesian network prediction for energy usage forecasting.Abstract:
Responsible, efficient and environmentally aware energy consumption behavior is becoming a necessity for the reliable modern electricity grid. In this paper, we present an intelligent data mining model to analyze, forecast and visualize energy time series to uncover various temporal energy consumption patterns. These patterns define the appliance usage in terms of association with time such as hour of the day, period of the day, weekday, week, month and season of the year as well as appliance-appliance associations in a household, which are key factors to infer and analyze the impact of consumers’ energy consumption behavior and energy forecasting trend. This is challenging since it is not trivial to determine the multiple relationships among different appliances usage from concurrent streams of data. Also, it is difficult to derive accurate relationships between interval-based events where multiple appliance usages persist for some duration. To overcome these challenges, we propose unsupervised data clustering and frequent pattern mining analysis on energy time series, and Bayesian network prediction for energy usage forecasting. We perform extensive experiments using real-world context-rich smart meter datasets. The accuracy results of identifying appliance usage patterns using the proposed model outperformed Support Vector Machine (SVM) and Multi-Layer Perceptron (MLP) at each stage while attaining a combined accuracy of 81.82%, 85.90%, 89.58% for 25%, 50% and 75% of the training data size respectively. Moreover, we achieved energy consumption forecast accuracies of 81.89% for short-term (hourly) and 75.88%, 79.23%, 74.74%, and 72.81% for the long-term; i.e., day, week, month, and season respectively.read more
Citations
More filters
Journal ArticleDOI
IoT big data analytics for smart homes with fog and cloud computing
TL;DR: A new platform that enables innovative analytics on IoT captured data from smart homes and the use of fog nodes and cloud system to allow data-driven services and address the challenges of complexities and resource demands for online and offline data processing, storage, and classification analysis is presented.
Journal ArticleDOI
Energy Sustainability in Smart Cities: Artificial Intelligence, Smart Monitoring, and Optimization of Energy Consumption
TL;DR: This paper examines smart metering and non-intrusive load monitoring (NILM) to make a case for the latter’s value added in context of profiling electric appliances’ electricity consumption and integrates insights from artificial intelligence, IoT, and big data analytics and queries them in a context defined by energy sustainability in smart cities.
Journal ArticleDOI
Big Data Analytics for Discovering Electricity Consumption Patterns in Smart Cities
Rubén Pérez-Chacón,José María Luna-Romera,Alicia Troncoso,Francisco Martínez-Álvarez,José C. Riquelme +4 more
TL;DR: A methodology to extract electric energy consumption patterns in big data time series, so that very valuable conclusions can be made for managers and governments is proposed.
Journal ArticleDOI
A Kalman filter-based bottom-up approach for household short-term load forecast
TL;DR: A Kalman filter-based bottom-up approach could efficiently improve household load forecast accuracy and could help give fast and accurate load forecasts for building energy management and predictive controls.
Journal ArticleDOI
Short-Term Electric Load and Price Forecasting Using Enhanced Extreme Learning Machine Optimization in Smart Grids
Aqdas Naz,Muhammad Umar Javed,Nadeem Javaid,Tanzila Saba,Musaed Alhussein,Khursheed Aurangzeb +5 more
TL;DR: The proposed techniques efficiently increased the prediction accuracy of load and price and the computational time is increased in both scenarios.
References
More filters
Some methods for classification and analysis of multivariate observations
TL;DR: The k-means algorithm as mentioned in this paper partitions an N-dimensional population into k sets on the basis of a sample, which is a generalization of the ordinary sample mean, and it is shown to give partitions which are reasonably efficient in the sense of within-class variance.
Journal ArticleDOI
Silhouettes: a graphical aid to the interpretation and validation of cluster analysis
TL;DR: A new graphical display is proposed for partitioning techniques, where each cluster is represented by a so-called silhouette, which is based on the comparison of its tightness and separation, and provides an evaluation of clustering validity.
Proceedings Article
Fast Algorithms for Mining Association Rules in Large Databases
Book
Data Mining and Knowledge Discovery Handbook
Oded Maimon,Lior Rokach +1 more
TL;DR: This book first surveys, then provides comprehensive yet concise algorithmic descriptions of methods, including classic methods plus the extensions and novel methods developed recently.
Journal ArticleDOI
Mining Frequent Patterns without Candidate Generation: A Frequent-Pattern Tree Approach
TL;DR: A novel frequent-pattern tree (FP-tree) structure is proposed, which is an extended prefix-tree structure for storing compressed, crucial information about frequent patterns, and an efficient FP-tree-based mining method, FP-growth, is developed for mining the complete set of frequent patterns by pattern fragment growth.
Related Papers (5)
Big data driven smart energy management: From big data to big insights
Kaile Zhou,Chao Fu,Shanlin Yang +2 more