Domain and Language Independent Feature Extraction for Statistical Text Categorization

dc.creatorBayer, Thomas
dc.creatorRenz, Ingrid
dc.creatorStein, Michael
dc.creatorKressel, Ulrich
dc.date1996-07-02
dc.date.accessioned2026-07-07T09:10:27Z
dc.date.available2026-07-07T09:10:27Z
dc.descriptionA generic system for text categorization is presented which uses a representative text corpus to adapt the processing steps: feature extraction, dimension reduction, and classification. Feature extraction automatically learns features from the corpus by reducing actual word forms using statistical information of the corpus and general linguistic knowledge. The dimension of feature vector is then reduced by linear transformation keeping the essential information. The classification principle is a minimum least square approach based on polynomials. The described system can be readily adapted to new domains or new languages. In application, the system is reliable, fast, and processes completely automatically. It is shown that the text categorizer works successfully both on text generated by document image analysis - DIA and on ground truth data.
dc.description12 pages, TeX file, 9 Postscript figures, uses epsf.sty
dc.identifierhttps://arxiv.org/abs/cmp-lg/9607003
dc.identifierhttp://arxiv.org/abs/cmp-lg/9607003
dc.identifierproceedings of workshop on language engineering for document analysis and recognition - ed. by L. Evett and T. Rose, part of the AISB 1996 Workshop Series, April 96, Sussex University, England, 21-32 (ISBN 0 905 488628)
dc.identifier.urihttp://salesiana.dossiersoluciones.com/handle/123456789/151353
dc.subjectComputation and Language
dc.titleDomain and Language Independent Feature Extraction for Statistical Text Categorization
dc.typetext

Files

Collections