Text Chunking Using Transformation-Based Learning
Lance Ramshaw,Mitchell Marcus +1 more
- pp 157-176
Reads0
Chats0
TLDR
This work has shown that the transformation-based learning approach can be applied at a higher level of textual interpretation for locating chunks in the tagged text, including non-recursive “baseNP” chunks.Abstract:
Transformation-based learning, a technique introduced by Eric Brill (1993b), has been shown to do part-of-speech tagging with fairly high accuracy. This same method can be applied at a higher level of textual interpretation for locating chunks in the tagged text, including non-recursive “baseNP” chunks. For this purpose, it is convenient to view chunking as a tagging problem by encoding the chunk structure in new tags attached to each word. In automatic tests using Treebank-derived data, this technique achieved recall and precision rates of roughly 93% for baseNP chunks (trained on 950K words) and 88% for somewhat more complex chunks that partition the sentence (trained on 200K words). Working in this new application and with larger template and training sets has also required some interesting adaptations to the transformation-based learning approach.read more
Citations
More filters
Journal ArticleDOI
Parsing noun phrases in the penn treebank
David Vadas,James Curran +1 more
TL;DR: A wide-coverage, large-scale np Bracketing system that includes a wide variety of features that provide the lexical information that was missing during the parser experiments, and as a result, outperform the parser's F-score by 9.04%.
Proceedings ArticleDOI
Sub-event detection from twitter streams as a sequence labeling problem
TL;DR: This paper establishes a neural baseline that outperforms a graph-based state-of-the-art method for binary sub-event detection and demonstrates superiority of a recurrent neural network model on the posts sequence level for labeled sub-events.
Proceedings ArticleDOI
A lightweight semantic chunking model based on tagging
TL;DR: A framework for the development of a fast, accurate, and highly portable semantic chunker is introduced based on a non-overlapping, shallow tree-structured language and results are presented that show that the phrase-by-phrase approach performs better than its word- by-word counterpart.
Proceedings ArticleDOI
R-cube: A dialogue agent for restaurant recommendation and reservation
Seokhwan Kim,Rafael E. Banchs +1 more
TL;DR: A hybrid dialogue system for restaurant recommendation and reservation that combines rule-based and data-driven components by using a flexible architecture aiming at diminishing error propagation along the different steps of the dialogue management and processing pipeline is described.
Proceedings ArticleDOI
Exploiting Non-Local Features for Spoken Language Understanding
Minwoo Jeong,Gary Geunbae Lee +1 more
TL;DR: This paper exploits non-local features as an estimate of long-distance dependencies to improve performance on the statistical spoken language understanding (SLU) problem and describes a light version of the inducer in which a simple modification is efficient and successful.
References
More filters
Book ChapterDOI
Parsing By Chunks
TL;DR: The typical chunk consists of a single content word surrounded by a constellation of function words, matching a fixed template, and the relationships between chunks are mediated more by lexical selection than by rigid templates.
Proceedings ArticleDOI
A Stochastic Parts Program and Noun Phrase Parser for Unrestricted Text
TL;DR: The authors used a linear-time dynamic programming algorithm to find an assignment of parts of speech to words that optimizes the product of (a) lexical probabilities (probability of observing part of speech i given word i) and (b) contextual probabilities (pb probability of observing n following partsof speech).
Proceedings Article
Some advances in transformation-based part of speech tagging
TL;DR: In this article, a rule-based approach to tagging unknown words is described, where the tagger-can be extended into a k-best tagger, where multiple tags can be assigned to words in some cases of uncertainty.
Journal ArticleDOI
Performance structures: A psycholinguistic and linguistic appraisal☆
James Paul Gee,François Grosjean +1 more
TL;DR: In this paper, two lines of research are combined to deal with a long-standing problem in both fields: why the performance structures of sentences (structures based on experimental data, such as pausing and parsing values) are not fully accountable for by linguistic theories of phrase structure.
Book
A corpus-based approach to language learning
TL;DR: A learning algorithm is described that takes a small structurally annotated corpus of text and a larger unannotated corpus as input, and automatically learns how to assign accurate structural descriptions to sentences not in the training corpus.