scispace - formally typeset
Open accessJournal ArticleDOI: 10.3390/SYM13030405

Ensemble Prediction Approach Based on Learning to Statistical Model for Efficient Building Energy Consumption Management

02 Mar 2021-Symmetry (Multidisciplinary Digital Publishing Institute)-Vol. 13, Iss: 3, pp 405
Abstract: With the development of modern power systems (smart grid), energy consumption prediction becomes an essential aspect of resource planning and operations. In the last few decades, industrial and commercial buildings have thoroughly been investigated for consumption patterns. However, due to the unavailability of data, the residential buildings could not get much attention. During the last few years, many solutions have been devised for predicting electric consumption; however, it remains a challenging task due to the dynamic nature of residential consumption patterns. Therefore, a more robust solution is required to improve the model performance and achieve a better prediction accuracy. This paper presents an ensemble approach based on learning to a statistical model to predict the short-term energy consumption of a multifamily residential building. Our proposed approach utilizes Long Short-Term Memory (LSTM) and Kalman Filter (KF) to build an ensemble prediction model to predict short term energy demands of multifamily residential buildings. The proposed approach uses real energy data acquired from the multifamily residential building, South Korea. Different statistical measures are used, such as mean absolute error (MAE), root mean square error (RMSE), mean absolute percentage error (MAPE), and R2 score, to evaluate the performance of the proposed approach and compare it with existing models. The experimental results reveal that the proposed approach predicts accurately and outperforms the existing models. Furthermore, a comparative analysis is performed to evaluate and compare the proposed model with conventional machine learning models. The experimental results show the effectiveness and significance of the proposed approach compared to existing energy prediction models. The proposed approach will support energy management to effectively plan and manage the energy supply and demands of multifamily residential buildings.

... read more

Topics: Energy consumption (61%), Mean absolute percentage error (56%), Energy management (54%) ... read more

7 results found

Open accessJournal ArticleDOI: 10.3390/EN14113020
23 May 2021-Energies
Abstract: Due to the availability of smart metering infrastructure, high-resolution electric consumption data is readily available to study the dynamics of residential electric consumption at finely resolved spatial and temporal scales. Analyzing the electric consumption data enables the policymakers and building owners to understand consumer’s demand-consumption behaviors. Furthermore, analysis and accurate forecasting of electric consumption are substantial for consumer involvement in time-of-use tariffs, critical peak pricing, and consumer-specific demand response initiatives. Alongside its vast economic and sustainability implications, such as energy wastage and decarbonization of the energy sector, accurate consumption forecasting facilitates power system planning and stable grid operations. Energy consumption forecasting is an active research area; despite the abundance of devised models, electric consumption forecasting in residential buildings remains challenging due to high occupant energy use behavior variability. Hence the search for an appropriate model for accurate electric consumption forecasting is ever continuing. To this aim, this paper presents a spatial and temporal ensemble forecasting model for short-term electric consumption forecasting. The proposed work involves exploring electric consumption profiles at the apartment level through cluster analysis based on the k-means algorithm. The ensemble forecasting model consists of two deep learning models; Long Short-Term Memory Unit (LSTM) and Gated Recurrent Unit (GRU). First, the apartment-level historical electric consumption data is clustered. Later the clusters are aggregated based on consumption profiles of consumers. At the building and floor level, the ensemble models are trained using aggregated electric consumption data. The proposed ensemble model forecasts the electric consumption at three spatial scales apartment, building, and floor level for hourly, daily, and weekly forecasting horizon. Furthermore, the impact of spatial-temporal granularity and cluster analysis on the prediction accuracy is analyzed. The dataset used in this study comprises high-resolution electric consumption data acquired through smart meters recorded on an hourly basis over the period of one year. The consumption data belongs to four multifamily residential buildings situated in an urban area of South Korea. To prove the effectiveness of our proposed forecasting model, we compared our model with widely known machine learning models and deep learning variants. The results achieved by our proposed ensemble scheme verify that model has learned the sequential behavior of electric consumption by producing superior performance with the lowest MAPE of 4.182 and 4.54 at building and floor level prediction, respectively. The experimental findings suggest that the model has efficiently captured the dynamic electric consumption characteristics to exploit ensemble model diversities and achieved lower forecasting error. The proposed ensemble forecasting scheme is well suited for predictive modeling and short-term load forecasting.

... read more

Topics: Energy consumption (66%), Ensemble forecasting (58%), Demand response (53%) ... read more

7 Citations

Open accessJournal ArticleDOI: 10.3390/ELECTRONICS10080880
07 Apr 2021-Electronics
Abstract: In recent years, rapid development has been made to the Internet of Things communication technologies, infrastructure, and physical resources management. These developments and research trends address challenges such as heterogeneous communication, quality of service requirements, unpredictable network conditions, and a massive influx of data. One major contribution to the research world is in the form of software-defined networking applications, which aim to deploy rule-based management to control and add intelligence to the network using high-level policies to have integral control of the network without knowing issues related to low-level configurations. Machine learning techniques coupled with software-defined networking can make the networking decision more intelligent and robust. The Internet of Things application has recently adopted virtualization of resources and network control with software-defined networking policies to make the traffic more controlled and maintainable. However, the requirements of software-defined networking and the Internet of Things must be aligned to make the adaptations possible. This paper aims to discuss the possible ways to make software-defined networking enabled Internet of Things application and discusses the challenges solved using the Internet of Things leveraging the software-defined network. We provide a topical survey of the application and impact of software-defined networking on the Internet of things networks. We also study the impact of machine learning techniques applied to software-defined networking and its application perspective. The study is carried out from the different perspectives of software-based Internet of Things networks, including wide-area networks, edge networks, and access networks. Machine learning techniques are presented from the perspective of network resources management, security, classification of traffic, quality of experience, and quality of service prediction. Finally, we discuss challenges and issues in adopting machine learning and software-defined networking for the Internet of Things applications.

... read more

Topics: Software-defined networking (63%), Quality of service (54%), Virtualization (52%) ... read more

5 Citations

Open accessJournal ArticleDOI: 10.3390/ELECTRONICS10202501
14 Oct 2021-Electronics
Abstract: Internet of Things (IoT) communication technologies have brought immense revolutions in various domains, especially in health monitoring systems. Machine learning techniques coupled with advanced artificial intelligence techniques detect patterns associated with diseases and health conditions. Presently, the scientific community is focused on enhancing IoT-enabled applications by integrating blockchain technology with machine learning models to benefit medical report management, drug traceability, tracking infectious diseases, etc. To date, contemporary state-of-the-art techniques have presented various efforts on the adaptability of blockchain and machine learning in IoT applications; however, there exist various essential aspects that must also be incorporated to achieve more robust performance. This study presents a comprehensive survey of emerging IoT technologies, machine learning, and blockchain for healthcare applications. The reviewed articles comprise a plethora of research articles published in the web of science. The analysis is focused on research articles related to keywords such as ‘machine learning’, blockchain, ‘Internet of Things or IoT’, and keywords conjoined with ‘healthcare’ and ‘health application’ in six famous publisher databases, namely IEEEXplore, Nature, ScienceDirect, MDPI, SpringerLink, and Google Scholar. We selected and reviewed 263 articles in total. The topical survey of the contemporary IoT-based models is presented in healthcare domains in three steps. Firstly, a detailed analysis of healthcare applications of IoT, blockchain, and machine learning demonstrates the importance of the discussed fields. Secondly, the adaptation mechanism of machine learning and blockchain in IoT for healthcare applications are discussed to delineate the scope of the mentioned techniques in IoT domains. Finally, the challenges and issues of healthcare applications based on machine learning, blockchain, and IoT are discussed. The presented future directions in this domain can significantly help the scholarly community determine research gaps to address.

... read more

3 Citations

Open accessJournal ArticleDOI: 10.1109/ACCESS.2021.3083175
Naeem Iqbal1, Atif Rizwan1, Anam Nawaz Khan1, Rashid Ahmad2  +3 moreInstitutions (3)
25 May 2021-IEEE Access
Abstract: During the last decade, substantial resources have been invested to exploit massive amounts of boreholes data collected through groundwater extraction. Furthermore, boreholes depth can be considered one of the crucial factors in digging borehole efficiency. Therefore, a new solution is needed to process and analyze boreholes data to monitor digging operations and identify the boreholes shortcomings. This research study presents a boreholes data analysis architecture based on data and predictive analysis models to improve borehole efficiency, underground safety verification, and risk evaluation. The proposed architecture aims to process and analyze borehole data based on different hydrogeological characteristics using data and predictive analytics to enhance underground safety verification and planning of borehole resources. The proposed architecture is developed based on two modules; descriptive data analysis and predictive analysis modules. The descriptive analysis aims to utilize data and clustering analysis techniques to process and extract hidden hydrogeological characteristics from borehole history data. The predictive analysis aims to develop a bi-directional long short-term memory (BD-LSTM) to predict the boreholes depth to minimize the cost and time of the digging operations. Furthermore, different performance measures are utilized to evaluate the performance of the proposed clustering and regression models. Moreover, our proposed BD-LSTM model is evaluated and compared with conventional machine learning (ML) regression models. The $R^{2}$ score of the proposed BD-LSTM is 0.989, which indicates that the proposed model accurately and precisely predicts boreholes depth compared to the conventional regression models. The experimental and comparative analysis results reveal the significance and effectiveness of the proposed borehole data analysis architecture. The experimental results will improve underground safety management and the efficiency of boreholes for future wells.

... read more

Topics: Data modeling (52%), Cluster analysis (52%), Borehole (51%) ... read more

3 Citations

Open accessJournal ArticleDOI: 10.3390/BUILDINGS11080340
06 Aug 2021-Buildings
Abstract: Blockchain is regarded as a potential technology for transforming the architecture, engineering, and construction (AEC) industry, and the number of related publications is increasing rapidly. However, a systematic review of blockchain applications in the AEC industry is lacking. The objective of this study was to review the current status of blockchain applications via a bibliometric analysis combined with a systematic literature review. According to related articles collected from databases, the present status of blockchain was analysed with regard to the distribution of articles over publication years, journals, institutions, countries, cooperation networks between authors, keyword co-occurrence networks, and research methodologies. The results indicated that research on blockchain applications is still relatively new and fragmented with regard to several topics. Five areas of benefit were identified: (i) supply chain management, (ii) contract management, (iii) information management, (iv) stakeholder management, and (v) integration management. On the basis of the technology–organisation–environment framework, nine types of challenges were identified. Future research opportunities were proposed according to the research findings. This study contributes to the current body of knowledge and provides guidelines for further research on blockchain applications in the AEC industry.

... read more

Topics: Blockchain (57%)

2 Citations


48 results found

Journal ArticleDOI: 10.1162/NECO.1997.9.8.1735
Sepp Hochreiter1, Jürgen Schmidhuber2Institutions (2)
01 Nov 1997-Neural Computation
Abstract: Learning to store information over extended time intervals by recurrent backpropagation takes a very long time, mostly because of insufficient, decaying error backflow. We briefly review Hochreiter's (1991) analysis of this problem, then address it by introducing a novel, efficient, gradient based method called long short-term memory (LSTM). Truncating the gradient where this does not do harm, LSTM can learn to bridge minimal time lags in excess of 1000 discrete-time steps by enforcing constant error flow through constant error carousels within special units. Multiplicative gate units learn to open and close access to the constant error flow. LSTM is local in space and time; its computational complexity per time step and weight is O. 1. Our experiments with artificial data involve local, distributed, real-valued, and noisy pattern representations. In comparisons with real-time recurrent learning, back propagation through time, recurrent cascade correlation, Elman nets, and neural sequence chunking, LSTM leads to many more successful runs, and learns much faster. LSTM also solves complex, artificial long-time-lag tasks that have never been solved by previous recurrent network algorithms.

... read more

49,735 Citations

Journal ArticleDOI: 10.1162/NECO.2006.18.7.1527
01 Jul 2006-Neural Computation
Abstract: We show how to use "complementary priors" to eliminate the explaining-away effects that make inference difficult in densely connected belief nets that have many hidden layers. Using complementary priors, we derive a fast, greedy algorithm that can learn deep, directed belief networks one layer at a time, provided the top two layers form an undirected associative memory. The fast, greedy algorithm is used to initialize a slower learning procedure that fine-tunes the weights using a contrastive version of the wake-sleep algorithm. After fine-tuning, a network with three hidden layers forms a very good generative model of the joint distribution of handwritten digit images and their labels. This generative model gives better digit classification than the best discriminative learning algorithms. The low-dimensional manifolds on which the digits lie are modeled by long ravines in the free-energy landscape of the top-level associative memory, and it is easy to explore these ravines by using the directed connections to display what the associative memory has in mind.

... read more

Topics: Deep belief network (63%), Convolutional Deep Belief Networks (61%), Generative model (58%) ... read more

13,005 Citations

Open accessProceedings Article
Ilya Sutskever1, Oriol Vinyals1, Quoc V. Le1Institutions (1)
08 Dec 2014-
Abstract: Deep Neural Networks (DNNs) are powerful models that have achieved excellent performance on difficult learning tasks. Although DNNs work well whenever large labeled training sets are available, they cannot be used to map sequences to sequences. In this paper, we present a general end-to-end approach to sequence learning that makes minimal assumptions on the sequence structure. Our method uses a multilayered Long Short-Term Memory (LSTM) to map the input sequence to a vector of a fixed dimensionality, and then another deep LSTM to decode the target sequence from the vector. Our main result is that on an English to French translation task from the WMT-14 dataset, the translations produced by the LSTM achieve a BLEU score of 34.8 on the entire test set, where the LSTM's BLEU score was penalized on out-of-vocabulary words. Additionally, the LSTM did not have difficulty on long sentences. For comparison, a phrase-based SMT system achieves a BLEU score of 33.3 on the same dataset. When we used the LSTM to rerank the 1000 hypotheses produced by the aforementioned SMT system, its BLEU score increases to 36.5, which is close to the previous state of the art. The LSTM also learned sensible phrase and sentence representations that are sensitive to word order and are relatively invariant to the active and the passive voice. Finally, we found that reversing the order of the words in all source sentences (but not target sentences) improved the LSTM's performance markedly, because doing so introduced many short term dependencies between the source and the target sentence which made the optimization problem easier.

... read more

Topics: Sequence learning (52%), Phrase (50%)

9,680 Citations

Open accessJournal ArticleDOI: 10.1109/TPAMI.2013.50
Abstract: The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind the data. Although specific domain knowledge can be used to help design representations, learning with generic priors can also be used, and the quest for AI is motivating the design of more powerful representation-learning algorithms implementing such priors. This paper reviews recent work in the area of unsupervised feature learning and deep learning, covering advances in probabilistic models, autoencoders, manifold learning, and deep networks. This motivates longer term unanswered questions about the appropriate objectives for learning good representations, for computing representations (i.e., inference), and the geometrical connections between representation learning, density estimation, and manifold learning.

... read more

8,575 Citations

Journal ArticleDOI: 10.1016/S0895-4356(01)00341-9
Abstract: The performance of a predictive model is overestimated when simply determined on the sample of subjects that was used to construct the model. Several internal validation methods are available that aim to provide a more accurate estimate of model performance in new subjects. We evaluated several variants of split-sample, cross-validation and bootstrapping methods with a logistic regression model that included eight predictors for 30-day mortality after an acute myocardial infarction. Random samples with a size between n = 572 and n = 9165 were drawn from a large data set (GUSTO-I; n = 40,830; 2851 deaths) to reflect modeling in data sets with between 5 and 80 events per variable. Independent performance was determined on the remaining subjects. Performance measures included discriminative ability, calibration and overall accuracy. We found that split-sample analyses gave overly pessimistic estimates of performance, with large variability. Cross-validation on 10% of the sample had low bias and low variability, but was not suitable for all performance measures. Internal validity could best be estimated with bootstrapping, which provided stable estimates with low bias. We conclude that split-sample validation is inefficient, and recommend bootstrapping for estimation of internal validity of a predictive logistic regression model.

... read more

1,884 Citations