Randomized Deep Structured Prediction for Discourse-Level Processing.
Manuel Widmoser,Maria Leonor Pacheco,Jean Honorio,Dan Goldwasser +3 more
- pp 1174-1184
Reads0
Chats0
TLDR
This paper explored the use of randomized inference to alleviate this concern and show that they can efficiently leverage deep structured prediction and expressive neural encoders for a set of tasks involving complicated argumentative structures.Abstract:
Expressive text encoders such as RNNs and Transformer Networks have been at the center of NLP models in recent work. Most of the effort has focused on sentence-level tasks, capturing the dependencies between words in a single sentence, or pairs of sentences. However, certain tasks, such as argumentation mining, require accounting for longer texts and complicated structural dependencies between them. Deep structured prediction is a general framework to combine the complementary strengths of expressive neural encoders and structured inference for highly structured domains. Nevertheless, when the need arises to go beyond sentences, most work relies on combining the output scores of independently trained classifiers. One of the main reasons for this is that constrained inference comes at a high computational cost. In this paper, we explore the use of randomized inference to alleviate this concern and show that we can efficiently leverage deep structured prediction and expressive neural encoders for a set of tasks involving complicated argumentative structures.read more
Citations
More filters
Proceedings ArticleDOI
Analysis of Nuanced Stances and Sentiment Towards Entities of US Politicians through the Lens of Moral Foundation Theory.
Shamik Roy,Dan Goldwasser +1 more
TL;DR: The Moral Foundation Theory is studied in tweets by US politicians on two politically divisive issues - Gun Control and Immigration to show there is a strong correlation between the moral foundation usage and the politicians’ nuanced stance on a particular topic.
Posted Content
Identifying Morality Frames in Political Tweets using Relational Learning
TL;DR: In this article, the authors introduce a representation framework for organizing moral attitudes directed at different entities, and propose a relational learning model to predict moral attitudes towards entities and moral foundations jointly.
Proceedings Article
Identifying Morality Frames in Political Tweets using Relational Learning
TL;DR: In this article, the authors introduce a representation framework for organizing moral attitudes directed at different entities, and propose a relational learning model to predict moral attitudes towards entities and moral foundations jointly.
References
More filters
Proceedings ArticleDOI
Glove: Global Vectors for Word Representation
TL;DR: A new global logbilinear regression model that combines the advantages of the two major model families in the literature: global matrix factorization and local context window methods and produces a vector space with meaningful substructure.
Proceedings ArticleDOI
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
TL;DR: BERT as mentioned in this paper pre-trains deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers, which can be fine-tuned with just one additional output layer to create state-of-the-art models for a wide range of tasks.
Proceedings ArticleDOI
Neural Architectures for Named Entity Recognition
TL;DR: Comunicacio presentada a la 2016 Conference of the North American Chapter of the Association for Computational Linguistics, celebrada a San Diego (CA, EUA) els dies 12 a 17 of juny 2016.
Proceedings ArticleDOI
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Xuezhe Ma,Eduard Hovy +1 more
TL;DR: This paper used a combination of bidirectional LSTM, CNN and CRF for sequence labeling tasks, and achieved state-of-the-art performance on both datasets for POS tagging and CoNLL 2003 corpus for NER.
Proceedings ArticleDOI
Conditional Random Fields as Recurrent Neural Networks
Shuai Zheng,Sadeep Jayasumana,Bernardino Romera-Paredes,Vibhav Vineet,Zhizhong Su,Dalong Du,Chang Huang,Philip H. S. Torr +7 more
TL;DR: In this article, a new form of convolutional neural network that combines the strengths of Convolutional Neural Networks (CNNs) and Conditional Random Fields (CRFs)-based probabilistic graphical modelling is introduced.