Open AccessProceedings Article
Smatch: an Evaluation Metric for Semantic Feature Structures
Shu Cai,Kevin Knight +1 more
- pp 748-752
Reads0
Chats0
TLDR
This paper presents smatch, a metric that calculates the degree of overlap between two semantic feature structures, and gives an efficient algorithm to compute the metric and shows the results of an inter-annotator agreement study.Abstract:
The evaluation of whole-sentence semantic structures plays an important role in semantic parsing and large-scale semantic structure annotation. However, there is no widely-used metric to evaluate wholesentence semantic structures. In this paper, we present smatch, a metric that calculates the degree of overlap between two semantic feature structures. We give an efficient algorithm to compute the metric and show the results of an inter-annotator agreement study.read more
Citations
More filters
Proceedings ArticleDOI
Penman: An Open-Source Library and Tool for AMR Graphs
TL;DR: The open-source Python library Penman provides a robust parser, functions for graph inspection and manipulation, and functions for formatting graphs into PENMAN notation, thus extending its utility to non-Python setups.
Proceedings ArticleDOI
Sequence-to-sequence Models for Cache Transition Systems
TL;DR: This paper transforms the sequence to graph mapping problem to a word sequence to transition action sequence problem using a special transition system called a cache transition system, and presents a monotonic hard attention model for the transition framework to handle the strictly left-to-right alignment between each transition state and the current buffer input focus.
Proceedings ArticleDOI
Leveraging Abstract Meaning Representation for Knowledge Base Question Answering
Pavan Kapanipathi,Ibrahim Abdelaziz,Srinivas Ravishankar,Salim Roukos,Alexander G. Gray,Ramón Fernandez Astudillo,Maria Chang,Cristina Cornelio,Saswati Dana,Achille Fokoue,Dinesh Garg,Alfio Gliozzo,Sairam Gurajada,Hima P. Karanam,Naweed Khan,Dinesh Khandelwal,Young-Suk Lee,Yunyao Li,Francois P. S. Luus,Ndivhuwo Makondo,Nandana Mihindukulasooriya,Tahira Naseem,Sumit Neelam,Lucian Popa,Revanth Gangi Reddy,Ryan Riegel,Gaetano Rossiello,Udit Sharma,G. P. Shrivatsa Bhargav,Mo Yu +29 more
TL;DR: Neuro-Symbolic Question Answering (NSQA) as discussed by the authors is a modular knowledge base question answering system that leverages Abstract Meaning Representation (AMR) parses for taskindependent question understanding.
Posted Content
Core Semantic First: A Top-down Approach for AMR Parsing
TL;DR: A novel scheme for parsing a piece of text into its Abstract Meaning Representation (AMR): Graph Spanning based Parsing (GSP), which achieves the state-of-the-art performance in the sense that no heuristic graph re-categorization is adopted.
Posted Content
An AMR Aligner Tuned by Transition-based Parser
TL;DR: A new rich resource enhanced AMR aligner which produces multiple alignments and a new transition system for AMR parsing along with its oracle parser and a transition-based AMR parser that parses a sentence into its AMR graph directly are proposed.
References
More filters
Proceedings ArticleDOI
Bleu: a Method for Automatic Evaluation of Machine Translation
TL;DR: This paper proposed a method of automatic machine translation evaluation that is quick, inexpensive, and language-independent, that correlates highly with human evaluation, and that has little marginal cost per run.
Proceedings Article
A Study of Translation Edit Rate with Targeted Human Annotation
TL;DR: A new, intuitive measure for evaluating machine translation output that avoids the knowledge intensiveness of more meaning-based approaches, and the labor-intensiveness of human judgments is defined.
Book
Events in the Semantics of English: A Study in Subatomic Semantics
TL;DR: Focusing on the structure of meaning in English sentences at a "subatomic" level - that is, a level below the one most theories accept as basic or "atomic" - Parsons asserts that the semantics of simple English sentences require logical forms somewhat more complex than is normally assumed in natural language semantics.
Proceedings Article
Learning to map sentences to logical form: structured classification with probabilistic categorial grammars
Luke Zettlemoyer,Michael Collins +1 more
TL;DR: A learning algorithm is described that takes as input a training set of sentences labeled with expressions in the lambda calculus and induces a grammar for the problem, along with a log-linear model that represents a distribution over syntactic and semantic analyses conditioned on the input sentence.
Proceedings Article
From treebank to propbank
Paul R. Kingsbury,Martha Palmer +1 more
TL;DR: This paper describes the approach to the development of a Proposition Bank, which involves the addition of semantic information to the Penn English Treebank and introduces metaframes as a technique for handling similar frames among near− synonymous verbs.