Word document density and relevance scoring

Previous work addressing the issue of word distribution in documents has shown the importance of word repetitiveness as an indicator of the word content- bearing characteristics. In this paper we propose a sim- ple method using a measure of the tendency of words to repeat within a document to separate the words with similar document frequencies, but different topic discrim- inating characteristics.