Journal ArticleDOI
Module-level testing for natural language understanding
Reads0
Chats0
TLDR
It is possible to produce useful quantitative and qualitative results using a module-level evaluation methodology for natural language understanding, provided certain pitfalls are avoided.Abstract:
We have examined a module-level evaluation methodology for natural language understanding, illustrating insights gained during implementation. It is possible to produce useful quantitative and qualitative results using such a methodology, provided certain pitfalls are avoided.read more
Citations
More filters
ReportDOI
Workshop on the Evaluation of Natural Language Processing Systems Held in Wayne, Pennsylvania on December 7-9, 1988
TL;DR: In order to make progress in the difficult area of natural language evaluation, a workshop was held in December 1988 at the Wayne Hotel in Wayne, Pennsylvania as mentioned in this paper, and the activities and result of that workshop are recorded in this report.
References
More filters
Journal Article
Workshop on the evaluation of natural language processing systems
Martha Palmer,Tim Finin +1 more
TL;DR: This report records the activities and result of a workshop held in December 1988 at the Wayne Hotel in Wayne, Pennsylvania in order to make progress in the difficult area of natural language evaluation.
Proceedings ArticleDOI
Plans for a task-oriented evaluation of natural language understanding systems
TL;DR: A plan is presented for evaluating natural language processing systems that have focused on the issues of text understanding as exemplified in short texts from military messages, and definition of a simulated database update task that requires NLP systems to fill a template with information found in the texts.