scispace - formally typeset
Open AccessBook ChapterDOI

Text Chunking Using Transformation-Based Learning

Lance Ramshaw, +1 more
- pp 157-176
TLDR
This work has shown that the transformation-based learning approach can be applied at a higher level of textual interpretation for locating chunks in the tagged text, including non-recursive “baseNP” chunks.
Abstract
Transformation-based learning, a technique introduced by Eric Brill (1993b), has been shown to do part-of-speech tagging with fairly high accuracy. This same method can be applied at a higher level of textual interpretation for locating chunks in the tagged text, including non-recursive “baseNP” chunks. For this purpose, it is convenient to view chunking as a tagging problem by encoding the chunk structure in new tags attached to each word. In automatic tests using Treebank-derived data, this technique achieved recall and precision rates of roughly 93% for baseNP chunks (trained on 950K words) and 88% for somewhat more complex chunks that partition the sentence (trained on 200K words). Working in this new application and with larger template and training sets has also required some interesting adaptations to the transformation-based learning approach.

read more

Citations
More filters
Book Chapter

Towards domain independent named entity recognition

TL;DR: This work attempts to surmount the problem of domain specific named entity recognition by proposing the use of domain independent features with a maximum entropy model and a multiobjective genetic algorithm (MOGA) to select the best features.
Proceedings ArticleDOI

Bunsetsu identification using category-exclusive rules

TL;DR: In this article, two new bunsetsu identification methods using supervised learning were described, one using category exclusive rules and the other using the category-exclusive rules with the highest similarity.
Journal ArticleDOI

Sieve-based relation extraction of gene regulatory networks from biological literature

TL;DR: A computational approach for extraction of gene regulatory networks from textual data using linear-chain conditional random fields and rules for relation extraction and successfully extracted the sporulation gene regulation network in the bacterium Bacillus subtilis for the information extraction challenge at the BioNLP 2013 conference.
Journal ArticleDOI

Automatic extraction of angiogenesis bioprocess from text

TL;DR: A range of methods for finding bioprocess terms and events related to angiogenesis, a key biological process of the growth of new blood vessels, were presented and showed that, while a supervised machine-learning model yielded the best precision, recall and F1 scores, the other methods achieved reasonable performance and less cost.
Proceedings ArticleDOI

Joint Learning with Pre-trained Transformer on Named Entity Recognition and Relation Extraction Tasks for Clinical Analytics

TL;DR: The derived NLP model provides an end-to-end solution to convert unstructured protocol texts into structured data source, which will be embedded into a comprehensive clinical analytics workflow for downstream trial design missions such like patient population extraction, patient enrollment rate estimation, and protocol amendment prediction.
References
More filters
Book ChapterDOI

Parsing By Chunks

TL;DR: The typical chunk consists of a single content word surrounded by a constellation of function words, matching a fixed template, and the relationships between chunks are mediated more by lexical selection than by rigid templates.
Proceedings ArticleDOI

A Stochastic Parts Program and Noun Phrase Parser for Unrestricted Text

TL;DR: The authors used a linear-time dynamic programming algorithm to find an assignment of parts of speech to words that optimizes the product of (a) lexical probabilities (probability of observing part of speech i given word i) and (b) contextual probabilities (pb probability of observing n following partsof speech).
Proceedings Article

Some advances in transformation-based part of speech tagging

TL;DR: In this article, a rule-based approach to tagging unknown words is described, where the tagger-can be extended into a k-best tagger, where multiple tags can be assigned to words in some cases of uncertainty.
Journal ArticleDOI

Performance structures: A psycholinguistic and linguistic appraisal☆

TL;DR: In this paper, two lines of research are combined to deal with a long-standing problem in both fields: why the performance structures of sentences (structures based on experimental data, such as pausing and parsing values) are not fully accountable for by linguistic theories of phrase structure.
Book

A corpus-based approach to language learning

Eric D. Brill
TL;DR: A learning algorithm is described that takes a small structurally annotated corpus of text and a larger unannotated corpus as input, and automatically learns how to assign accurate structural descriptions to sentences not in the training corpus.
Related Papers (5)