The Social Spiders in the Clustering of Texts: Towards an Aspect of Visual Classification

The Social Spiders in the Clustering of Texts: Towards an Aspect of Visual Classification

Reda Mohamed Hamou, Abdelmalek Amine, Ahmed Chaouki Lokbani
Copyright: © 2012 |Pages: 14
DOI: 10.4018/jalr.2012070101
OnDemand:
(Individual Articles)
Available
$37.50
No Current Special Offers
TOTAL SAVINGS: $37.50

Abstract

In this paper the authors experiment and test a new biomimetic approach based on social spiders to solve a combinatorial problem ie the automatic classification of texts because a very large data stream flows and particularly on the web. Representation of textual data was performed by a method independent of the language ie n-gram characters and words because there is currently no method of learning that can directly represent unstructured data (text). To validate the classification, the authors used a measure of evaluation based on recall and precision (F-measure). During the experiment, the authors found a powerful visualization tool in social spiders that they exploit to make visual classification.
Article Preview
Top

Introduction And Background

Given the problems faced by the supervised classification such as the need of many human, the initial classification should be reviewed when the number of documents increases, according to (Tan, 1999) where about 80% of documents are in text format. This huge volume of unstructured or semi structured gives rise to an act to find relevant information more difficult to achieve, that creates a problem known as the problem of information overload (Chen, 1997). The techniques and tools for knowledge discovery in texts (KDT; Feldman, 1995) or simply text mining (Tan. 1999) are being developed to address this problem. One such technique is clustering, a technique for grouping similar documents of a given collection by helping to understand its contents (Jain, 1999; Willet, 1988). One of his goals is to similar documents in the same group and placing documents in various different groups. The assumption is that through a process of clustering, similar objects remain in the same group based on the attributes they have in common. This assumption is known as the hypothesis of cluster described by Rijsbergen (1979).

In this paper, we introduced a new model from nature in this case the social spiders to solve a critical problem of data mining or text mining more precisely what the clustering of data by which we hope to contribute about solving this problem because the grouping or clustering of textual documents, especially Web pages, is one of the challenges of current research.

State Of The Art

A well designed clustering algorithm generally follows the four phases of design: data representation, modeling, optimization, and validation (Buhmann, 2003). Phase representation of the data structures predetermine what kind of cluster can be found in the data. Based on data representation, the modeling phase defines clusters and the criteria that separate the desired group structures of these unwanted or unfavorable. In this phase, a measure of quality, which can be either optimized or approximate when searching hidden structures in the data is produced (see Figure 1).

Figure 1.

The biomimetic algorithms that have been solving the problem of clustering

jalr.2012070101.f01

Complete Article List

Search this Journal:
Reset
Open Access Articles: Forthcoming
Volume 8: 2 Issues (2018)
Volume 7: 2 Issues (2017)
Volume 6: 2 Issues (2016)
Volume 5: 1 Issue (2015)
Volume 4: 1 Issue (2014)
Volume 3: 4 Issues (2012)
Volume 2: 4 Issues (2011)
Volume 1: 4 Issues (2010)
View Complete Journal Contents Listing