Open AccessPosted Content
A C-LSTM Neural Network for Text Classification
Reads0
Chats0
TLDR
C-LSTM is a novel and unified model for sentence representation and text classification that outperforms both CNN and LSTM and can achieve excellent performance on these tasks.Abstract:
Neural network models have been demonstrated to be capable of achieving remarkable performance in sentence and document modeling. Convolutional neural network (CNN) and recurrent neural network (RNN) are two mainstream architectures for such modeling tasks, which adopt totally different ways of understanding natural languages. In this work, we combine the strengths of both architectures and propose a novel and unified model called C-LSTM for sentence representation and text classification. C-LSTM utilizes CNN to extract a sequence of higher-level phrase representations, and are fed into a long short-term memory recurrent neural network (LSTM) to obtain the sentence representation. C-LSTM is able to capture both local features of phrases as well as global and temporal sentence semantics. We evaluate the proposed architecture on sentiment classification and question classification tasks. The experimental results show that the C-LSTM outperforms both CNN and LSTM and can achieve excellent performance on these tasks.read more
Citations
More filters
Journal ArticleDOI
Leveraging Contextual Sentences for Text Classification by Using a Neural Attention Model.
DanFeng Yan,Shiyao Guo +1 more
TL;DR: Two kinds of classification algorithms are proposed, one based on convolutional neural network fusing context information and the other based on bidirectional long and short time memory network, which validate the advantages of the two models in terms of time efficiency and accuracy compared to the different models with fundamental AM architectures.
Journal ArticleDOI
Depressed People Detection from Bangla Social Media Status using LSTM and CNN Approach
TL;DR: This paper has built up a model that makes strength and support for deep learning architecture using a hybrid neural network with the word embedding technique using the Bengali Facebook status dataset.
Posted Content
Quda: Natural Language Queries for Visual Data Analytics
TL;DR: The usefulness of Quda is demonstrated by creating a prototype that makes effective design decisions for free-form user queries and it is shown that Quda can be beneficial for a wide range of applications in the visualization community by analyzing the design tasks described in academic publications.
Journal ArticleDOI
Query Expansion for Microblog Retrieval Focusing on an Ensemble of Features
Posted Content
SeMantic AnsweR Type prediction task (SMART) at ISWC 2020 Semantic Web Challenge.
Nandana Mihindukulasooriya,Mohnish Dubey,Alfio Gliozzo,Jens Lehmann,Axel-Cyrille Ngonga Ngomo,Ricardo Usbeck +5 more
TL;DR: The SeMantic AnsweR Type prediction task (SMART) was part of ISWC 2020 challenges and can play a key role in knowledge base question answering systems providing insights that are helpful to generate correct queries or rank the answer candidates.
References
More filters
Journal ArticleDOI
Long short-term memory
TL;DR: A novel, efficient, gradient based method called long short-term memory (LSTM) is introduced, which can learn to bridge minimal time lags in excess of 1000 discrete-time steps by enforcing constant error flow through constant error carousels within special units.
Proceedings Article
Distributed Representations of Words and Phrases and their Compositionality
TL;DR: This paper presents a simple method for finding phrases in text, and shows that learning good vector representations for millions of phrases is possible and describes a simple alternative to the hierarchical softmax called negative sampling.
Proceedings ArticleDOI
Learning Phrase Representations using RNN Encoder--Decoder for Statistical Machine Translation
Kyunghyun Cho,Bart van Merriënboer,Caglar Gulcehre,Dzmitry Bahdanau,Fethi Bougares,Holger Schwenk,Yoshua Bengio,Yoshua Bengio,Yoshua Bengio +8 more
TL;DR: In this paper, the encoder and decoder of the RNN Encoder-Decoder model are jointly trained to maximize the conditional probability of a target sequence given a source sequence.
Proceedings Article
Rectified Linear Units Improve Restricted Boltzmann Machines
Vinod Nair,Geoffrey E. Hinton +1 more
TL;DR: Restricted Boltzmann machines were developed using binary stochastic hidden units that learn features that are better for object recognition on the NORB dataset and face verification on the Labeled Faces in the Wild dataset.
Posted Content
Sequence to Sequence Learning with Neural Networks
TL;DR: This paper presents a general end-to-end approach to sequence learning that makes minimal assumptions on the sequence structure, and finds that reversing the order of the words in all source sentences improved the LSTM's performance markedly, because doing so introduced many short term dependencies between the source and the target sentence which made the optimization problem easier.