"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detection
William Yang Wang
- Vol. 2, pp 422-426
Reads0
Chats0
TLDR
Li et al. as discussed by the authors designed a hybrid convolutional neural network to integrate meta-data with text and showed that this hybrid approach can improve a text-only deep learning model.Abstract:
Automatic fake news detection is a challenging problem in deception detection, and it has tremendous real-world political and social impacts. However, statistical approaches to combating fake news has been dramatically limited by the lack of labeled benchmark datasets. In this paper, we present LIAR: a new, publicly available dataset for fake news detection. We collected a decade-long, 12.8K manually labeled short statements in various contexts from PolitiFact.com, which provides detailed analysis report and links to source documents for each case. This dataset can be used for fact-checking research as well. Notably, this new dataset is an order of magnitude larger than previously largest public fake news datasets of similar type. Empirically, we investigate automatic fake news detection based on surface-level linguistic patterns. We have designed a novel, hybrid convolutional neural network to integrate meta-data with text. We show that this hybrid approach can improve a text-only deep learning model.read more
Citations
More filters
Posted Content
HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verification
TL;DR: It is shown that the performance of an existing state-of-the-art semantic-matching model degrades significantly on this dataset as the number of reasoning hops increases, hence demonstrating the necessity of many-hop reasoning to achieve strong results.
Proceedings ArticleDOI
A Closer Look at Fake News Detection: A Deep Learning Perspective
TL;DR: Different models to detect fake news based on the relation between article headline and article body are developed using the Fake News Challenge (FNC-1) dataset.
Posted Content
MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claims
Isabelle Augenstein,Christina Lioma,Dongsheng Wang,Lucas Chaves Lima,Casper Hansen,Christian Hansen,Jakob Grue Simonsen +6 more
TL;DR: In this article, the authors contribute the largest publicly available dataset of naturally occurring factual claims for the purpose of automatic claim verification, which is collected from 26 fact checking websites in English, paired with textual sources and rich metadata, and labelled for veracity by human expert journalists.
Posted Content
Towards Automated Factchecking: Developing an Annotation Schema and Benchmark for Consistent Automated Claim Detection.
TL;DR: This paper developed an annotation schema and a benchmark for automated claim detection that is more consistent across time, topics and annotators than previous approaches, achieving an F1 score of 0.83 with over 5% relative improvement over the state-of-the-art methods ClaimBuster and ClaimRank.
Proceedings ArticleDOI
DeSePtion: Dual Sequence Prediction and Adversarial Examples for Improved Fact-Checking
Christopher Hidey,Tuhin Chakrabarty,Tariq Alhindi,Siddharth Varia,Kriste Krstovski,Mona Diab,Smaranda Muresan +6 more
TL;DR: This work shows that current systems for FEVER are vulnerable to three categories of realistic challenges for fact-checking – multiple propositions, temporal reasoning, and ambiguity and lexical variation – and introduces a resource with these types of claims, and presents a system designed to be resilient to these “attacks”.
References
More filters
Journal ArticleDOI
Long short-term memory
TL;DR: A novel, efficient, gradient based method called long short-term memory (LSTM) is introduced, which can learn to bridge minimal time lags in excess of 1000 discrete-time steps by enforcing constant error flow through constant error carousels within special units.
Posted Content
Efficient Estimation of Word Representations in Vector Space
TL;DR: This paper proposed two novel model architectures for computing continuous vector representations of words from very large data sets, and the quality of these representations is measured in a word similarity task and the results are compared to the previously best performing techniques based on different types of neural networks.
Proceedings ArticleDOI
Convolutional Neural Networks for Sentence Classification
TL;DR: The CNN models discussed herein improve upon the state of the art on 4 out of 7 tasks, which include sentiment analysis and question classification, and are proposed to allow for the use of both task-specific and static vectors.
Journal Article
Natural Language Processing (Almost) from Scratch
TL;DR: A unified neural network architecture and learning algorithm that can be applied to various natural language processing tasks including part-of-speech tagging, chunking, named entity recognition, and semantic role labeling is proposed.
Proceedings Article
Character-level convolutional networks for text classification
TL;DR: In this paper, the use of character-level convolutional networks (ConvNets) for text classification has been explored and compared with traditional models such as bag of words, n-grams and their TFIDF variants.