A Test Environment for Natural Language Understanding Systems
Li Li,Deborah A. Dahl,Lewis M. Norton,Marcia C. Linebarger,Dongdong Chen +4 more
- Vol. 2, pp 763-767
TLDR
The ETE assists in the management and analysis of the thousands of complex data structures created during natural language processing of a large corpus using relational database technology in a network environment.Abstract:
The Natural Language Understanding Engine Test Environment (ETE) is a GUI software tool that aids in the development and maintenance of large, modular, natural language understanding (NLU) systems. Natural language understanding systems are composed of modules (such as part-of-speech taggers, parsers and semantic analyzers) which are difficult to test individually because of the complexity of their output data structures. Not only are the output data structures of the internal modules complex, but also many thousands of test items (messages or sentences) are required to provide a reasonable sample of the linguistic structures of a single human language, even if the language is restricted to a particular domain. The ETE assists in the management and analysis of the thousands of complex data structures created during natural language processing of a large corpus using relational database technology in a network environment.read more
Citations
More filters
Proceedings Article
Software Infrastructure for Language Resources: a Taxonomy of Previous Work and a Requirements Analysis.
TL;DR: A taxonomy of previous work on infrastructures, architectures and development environments for representing and processing Language Resources, corpora, and annotations is presented and shows that a SALE should address common problems and support typical activities in the development, deployment, and maintenance of LE software.
Journal ArticleDOI
Empirical methods for computing phrasal and sentential semantics in Vietnamese
TL;DR: The purpose of this paper is to build the sets of clauses in definite clause grammar, which can express the phrasal and sentential semantics in Vietnamese Question-Answering System Model, and presents the technical novel, which expresses the process of creating the semantic expressions according to these models.
Theory-Neutral Parser Engineering
TL;DR: It is argued that intuitiveness and readability of the underlying grammar is an essential property of a successful parser, and that it helps a lot if the results are also intuitive and readable.
References
More filters
Proceedings ArticleDOI
Procedure for quantitatively comparing the syntactic coverage of English grammars
Steven Abney,S. Flickenger,Claudia Gdaniec,C. Grishman,Philip Harrison,Donald Hindle,Robert Ingria,Frederick Jelinek,Judith L. Klavans,Mark Liberman,Mitchell Marcus,Salim Roukos,Beatrice Santorini,Tomek Strzalkowski,Ezra Black +14 more
TL;DR: The problem of quantitatively comparing the performance of different broad-coverage grammars of English has to date resisted solution as discussed by the authors, which is a problem that has been resisted solution.
Journal ArticleDOI
Evaluating natural language processing systems
TL;DR: Evaluating Natural Language Processing Systems Designing customized methods for testing various NLP systems may be costly and expensive, so post hoc justification is needed.
ReportDOI
An Evaluation Methodology for Natural Language Processing Systems
TL;DR: The Neal-Montgomery NLP Evaluation Methodology was developed under the 'Benchmark Investigation/Identification' project as a means of determining the linguistic competence of Natural Language Processing (NLP) systems.
Proceedings ArticleDOI
Integration of Large-Scale Linguistic Resources in a Natural Language Understanding System
TL;DR: This paper describes how client-server architecture was used to make a large volume of lexical information and a large knowledge base available to the system at development and/or run time.