Text Chunking Using Transformation-Based Learning
Lance Ramshaw,Mitchell Marcus +1 more
- pp 157-176
Reads0
Chats0
TLDR
This work has shown that the transformation-based learning approach can be applied at a higher level of textual interpretation for locating chunks in the tagged text, including non-recursive “baseNP” chunks.Abstract:
Transformation-based learning, a technique introduced by Eric Brill (1993b), has been shown to do part-of-speech tagging with fairly high accuracy. This same method can be applied at a higher level of textual interpretation for locating chunks in the tagged text, including non-recursive “baseNP” chunks. For this purpose, it is convenient to view chunking as a tagging problem by encoding the chunk structure in new tags attached to each word. In automatic tests using Treebank-derived data, this technique achieved recall and precision rates of roughly 93% for baseNP chunks (trained on 950K words) and 88% for somewhat more complex chunks that partition the sentence (trained on 200K words). Working in this new application and with larger template and training sets has also required some interesting adaptations to the transformation-based learning approach.read more
Citations
More filters
Proceedings Article
Hidden Conditional Random Fields with M-to-N Alignments for Grapheme-to-Phoneme Conversion.
TL;DR: This work presents an approach incorporating an Mto-N alignment as a hidden variable within a transducerbased implementation of CRFs, showing it was possible to train a state-of-the-art hidden CRF system in reasonable time for an English grapheme-to-phoneme conversion task without using an external model to provide the alignment.
Proceedings ArticleDOI
Exact Decoding for Jointly Labeling and Chunking Sequences
Nobuyuki Shimizu,Andrew Haas +1 more
TL;DR: This work presents a tractable algorithm for exact inference over two layers of labels and chunks with time complexity O(n2), and provides empirical results comparing the model with linear-chain models.
Posted Content
CliniQG4QA: Generating Diverse Questions for Domain Adaptation of Clinical Question Answering.
TL;DR: This work proposes a simple yet effective framework, CliniQG4QA, which leverages question generation (QG) to synthesize QA pairs on new clinical contexts and boosts QA models without requiring manual annotations and introduces a seq2seq-based question phrase prediction (QPP) module that can be used together with most existing QG models to diversify the generation.
Journal IssueDOI
Dialogue act recognition using maximum entropy
TL;DR: A feature-based classification approach for DA recognition is applied, by using the maximum entropy (ME) method to build a classifier for labeling utterances with DA tags, which simplifies the implementation of the classifier and improves the efficiency of DA recognition, without sacrificing the classification accuracy.
Journal ArticleDOI
The Termolator: Terminology Recognition Based on Chunking, Statistical and Search Based Scores
Adam Meyers,Yifan He,Zachary Glass,John Ortega,Shasha Liao,Angus Grieve-Smith,Ralph Grishman,Olga Babko-Malaya +7 more
TL;DR: This paper expands upon previous publications about this research and includes descriptions of some of the improvements made since its initial release of the Termolator, and includes a comparison with another terminology extraction system available on-line, Termostat.
References
More filters
Book ChapterDOI
Parsing By Chunks
TL;DR: The typical chunk consists of a single content word surrounded by a constellation of function words, matching a fixed template, and the relationships between chunks are mediated more by lexical selection than by rigid templates.
Proceedings ArticleDOI
A Stochastic Parts Program and Noun Phrase Parser for Unrestricted Text
TL;DR: The authors used a linear-time dynamic programming algorithm to find an assignment of parts of speech to words that optimizes the product of (a) lexical probabilities (probability of observing part of speech i given word i) and (b) contextual probabilities (pb probability of observing n following partsof speech).
Proceedings Article
Some advances in transformation-based part of speech tagging
TL;DR: In this article, a rule-based approach to tagging unknown words is described, where the tagger-can be extended into a k-best tagger, where multiple tags can be assigned to words in some cases of uncertainty.
Journal ArticleDOI
Performance structures: A psycholinguistic and linguistic appraisal☆
James Paul Gee,François Grosjean +1 more
TL;DR: In this paper, two lines of research are combined to deal with a long-standing problem in both fields: why the performance structures of sentences (structures based on experimental data, such as pausing and parsing values) are not fully accountable for by linguistic theories of phrase structure.
Book
A corpus-based approach to language learning
TL;DR: A learning algorithm is described that takes a small structurally annotated corpus of text and a larger unannotated corpus as input, and automatically learns how to assign accurate structural descriptions to sentences not in the training corpus.