Hybrid neural network

About: Hybrid neural network is a research topic. Over the lifetime, 1305 publications have been published within this topic receiving 18223 citations.

A hybrid neural network strategy for identification of structural parameters

Abstract: This paper presents a multistage identification scheme for structural damage detection using modal data. Previous studies of damage assessment using neural networks mostly involved training a backpropagation neural network (BPN) to learn damage patterns that were obtained either experimentally or by simulation for different damage cases. Damage identification for large structures, especially those involving multiple member damage, could result in large training data sets that require a large BPN and consequently greater computational effort. The proposed scheme involves using a counterpropagation neural network (CPN) in the first stage for sorting the training data into clusters and giving an approximate guess of the damage extent within a very short time. After an approximate estimate of the damage is obtained, a new set of training patterns of reduced size is generated using the CPN prediction. In the second stage, a BPN trained with the Levenberg–Marquardt algorithm is used to learn the new training da...

Multi-Convolution Feature Extraction and Recurrent Neural Network Dependent Model for Short-Term Load Forecasting

Abstract: Load forecasting is critical for power system operation and market planning. With the increased penetration of renewable energy and the massive consumption of electric energy, improving load forecasting accuracy has become a difficult task. Recently, it was demonstrated that deep learning models perform well for short-term load forecasting (STLF). However, prior research has demonstrated that the hybrid deep learning model outperforms the single model. We propose a hybrid neural network in this article that combines elements of a convolutional neural network (1D-CNN) and a long short memory network (LSTM) in novel ways. Multiple independent 1D-CNNs are used to extract load, calendar, and weather features from the proposed hybrid model, while LSTM is used to learn time patterns. This architecture is referred to as a CNN-LSTM network with multiple heads (MCNN-LSTM). To demonstrate the proposed hybrid deep learning model’s superior performance, the proposed method is applied to Ireland’s load data for single-step and multi-step load forecasting. In comparison to the widely used CNN-LSTM hybrid model, the proposed model improved single-step prediction by 16.73% and 24-step load prediction by 20.33%. Additionally, we use the Maine dataset to verify the proposed model’s generalizability.

A Hybrid Neural Network Model for Commonsense Reasoning

Abstract: This paper proposes a hybrid neural network(HNN) model for commonsense reasoning. An HNN consists of two component models, a masked language model and a semantic similarity model, which share a BERTbased contextual encoder but use different model-specific input and output layers. HNN obtains new state-of-the-art results on three classic commonsense reasoning tasks, pushing the WNLI benchmark to 89%, the Winograd Schema Challenge (WSC) benchmark to 75.1%, and the PDP60 benchmark to 90.0%. An ablation study shows that language models and semantic similarity models are complementary approaches to commonsense reasoning, and HNN effectively combines the strengths of both. The code and pre-trained models will be publicly available at https: //github.com/namisan/mt-dnn.

A Hybrid Neural Network-Data Base Correlation Positioning in GSM Network

Abstract: Mobile terminal (MT) localization in a GSM environment has been of big interest in the recent years. This work exploits the advantage of position estimations from different sources in a robust fusion algorithm to reduce the positioning error. A hybrid neural network (NN)-data base correlation method (DC) is discussed. Before the fusion process, the DC position estimates are post-processed using an extra NN in order to reduce its error. Function approximation and classification properties of the NN will be investigated and the best NN architecture will be applied in the positioning algorithm. Results show that, the post processing of the DC results has a big impact on the positioning accuracy and the fusion process gets the MT estimate within a better accuracy.