Statistical keyword detection in literary corpora

Simple item page
dc.creatorHerrera, Juan P.
dc.creatorPury, Pedro A.
dc.date2007-01-05
dc.date2008-05-30
dc.date.accessioned2026-07-07T09:42:55Z
dc.date.available2026-07-07T09:42:55Z
dc.descriptionUnderstanding the complexity of human language requires an appropriate analysis of the statistical distribution of words in texts. We consider the information retrieval problem of detecting and ranking the relevant words of a text by means of statistical information referring to the "spatial" use of the words. Shannon's entropy of information is used as a tool for automatic keyword extraction. By using The Origin of Species by Charles Darwin as a representative text sample, we show the performance of our detector and compare it with another proposals in the literature. The random shuffled text receives special attention as a tool for calibrating the ranking indices.
dc.descriptionPublished version. 11 pages, 7 figures. SVJour for LaTeX2e
dc.identifierhttps://arxiv.org/abs/cs/0701028
dc.identifierhttp://arxiv.org/abs/cs/0701028
dc.identifierEur. Phys. J. B 63, 135-146 (2008)
dc.identifierdoi:10.1140/epjb/e2008-00206-x
dc.identifier.urihttp://salesiana.dossiersoluciones.com/handle/123456789/162364
dc.subjectComputation and Language
dc.subjectInformation Retrieval
dc.subjectPhysics and Society
dc.titleStatistical keyword detection in literary corpora
dc.typetext

Files

Collections

arXiv