Study of Sensitive Parameters of PSO Application to Clustering of Texts

Representation Of Textual Documents

The texts in natural language cannot be directly interpreted by a classifier or by classification algorithms from which the need for a mathematical representation of the text such that we can perform analytical processing thereon, all maintaining maximum semantics. The representation, which is generally used, is the use of a vector space as target representation space. The main feature of the vector representation is that each linguistic unit is associated with a specific dimension in the vector space. Two texts using the same textual segments are therefore projected onto identical vectors.

Several approaches for the representation of texts exist in the literature among which there are the bag of words representation, which is the simplest approach and widely used, the representation “bag of phrases” representation by lexical roots and of course the representation by n-grams which is independent representation of natural language (Shannon, 1948).