MBT: A Memory-Based Part of Speech Tagger-Generator

dc.creatorDaelemans, Walter
dc.creatorZavrel, Jakub
dc.creatorBerck, Peter
dc.creatorGillis, Steven
dc.date1996-07-11
dc.date.accessioned2026-07-07T09:10:28Z
dc.date.available2026-07-07T09:10:28Z
dc.descriptionWe introduce a memory-based approach to part of speech tagging. Memory-based learning is a form of supervised learning based on similarity-based reasoning. The part of speech tag of a word in a particular context is extrapolated from the most similar cases held in memory. Supervised learning approaches are useful when a tagged corpus is available as an example of the desired output of the tagger. Based on such a corpus, the tagger-generator automatically builds a tagger which is able to tag new text the same way, diminishing development time for the construction of a tagger considerably. Memory-based tagging shares this advantage with other statistical or machine learning approaches. Additional advantages specific to a memory-based approach include (i) the relatively small tagged corpus size sufficient for training, (ii) incremental learning, (iii) explanation capabilities, (iv) flexible integration of information in case representations, (v) its non-parametric nature, (vi) reasonably good results on unknown words without morphological analysis, and (vii) fast learning and tagging. In this paper we show that a large-scale application of the memory-based approach is feasible: we obtain a tagging accuracy that is on a par with that of known statistical approaches, and with attractive space and time complexity properties when using {\em IGTree}, a tree-based formalism for indexing and searching huge case bases.} The use of IGTree has as additional advantage that optimal context size for disambiguation is dynamically computed.
dc.description14 pages, 2 Postscript figures
dc.identifierhttps://arxiv.org/abs/cmp-lg/9607012
dc.identifierhttp://arxiv.org/abs/cmp-lg/9607012
dc.identifierProceedings WVLC, Copenhagen
dc.identifier.urihttp://salesiana.dossiersoluciones.com/handle/123456789/151361
dc.subjectComputation and Language
dc.titleMBT: A Memory-Based Part of Speech Tagger-Generator
dc.typetext

Files

Collections