Evaluating Discourse Processing Algorithms
| dc.creator | Walker, Marilyn A. | |
| dc.date | 1994-10-10 | |
| dc.date | 1994-10-11 | |
| dc.date.accessioned | 2026-07-07T08:58:37Z | |
| dc.date.available | 2026-07-07T08:58:37Z | |
| dc.description | In order to take steps towards establishing a methodology for evaluating Natural Language systems, we conducted a case study. We attempt to evaluate two different approaches to anaphoric processing in discourse by comparing the accuracy and coverage of two published algorithms for finding the co-specifiers of pronouns in naturally occurring texts and dialogues. We present the quantitative results of hand-simulating these algorithms, but this analysis naturally gives rise to both a qualitative evaluation and recommendations for performing such evaluations in general. We illustrate the general difficulties encountered with quantitative evaluation. These are problems with: (a) allowing for underlying assumptions, (b) determining how to handle underspecifications, and (c) evaluating the contribution of false positives and error chaining. | |
| dc.description | plain latex but includes psfig.tex, 11 pages with one psfig, published in 27th Annual Meeting of the ACL, 1989 | |
| dc.identifier | https://arxiv.org/abs/cmp-lg/9410006 | |
| dc.identifier | http://arxiv.org/abs/cmp-lg/9410006 | |
| dc.identifier | Association of Computational Linguistics, 1989, p. 251-262 | |
| dc.identifier.uri | http://salesiana.dossiersoluciones.com/handle/123456789/147395 | |
| dc.subject | Computation and Language | |
| dc.title | Evaluating Discourse Processing Algorithms | |
| dc.type | text |