Combining Indexing Units for Arabic Information Retrieval

Combining Indexing Units for Arabic Information Retrieval

Souheila Ben Guirat (LISI: Laboratory of Computer Science for Industrial Systems, Carthage University, Tunis, Tunisia & Jarir: Joint Group for Artificial Reasoning and Information Retrieval, Tunisia), Ibrahim Bounhas (LISI: Laboratory of Computer Science for Industrial Systems, Carthage University, Tunis, Tunisia & Jarir: Joint Group for Artificial Reasoning and Information Retrieval, Higher Institute of Documentation (ISD), La Manouba University, Manouba, Tunisia) and Yahya Slimani (LISI: Laboratory of Computer Science for Industrial Systems, Carthage University, Tunis, Tunisia & Jarir: Joint Group for Artificial Reasoning and Information Retrieval, Higher Institute of Multimedia Arts of Manouba (ISAMM), La Manouba University, Manouba, Tunisia)
Copyright: © 2016 |Pages: 14
DOI: 10.4018/IJSI.2016100101
OnDemand PDF Download:
$30.00
List Price: $37.50

Abstract

Using either stems or roots as index terms offered considerable performance to Arabic Information Retrieval (IR) systems compared to the use of surface words for indexing. Many comparative works tried to find out the best from these two indexing approaches but until then, no of the two methods widely overtook the other. Each of the two index types performed better under different test circumstances in terms of recall and precision. In this paper, the authors propose a hybrid approach combining the two indexing units in a way they take the advantages from both of them and try to overcome their shortcomings. Then, based on some combining techniques, the authors assign a weight for each indexing unit and try to find out the best weighting values.
Article Preview

1. Introduction

Choosing the indexing unit is yet a challenging problem in Arabic IR (Elayeb & Bounhas, 2015). When using surface words, precision reaches high levels, but we will report low recall rates because of the high derivation and agglutination of Arabic. Furthermore, this choice requires more resources in terms of storage space and processing time (Aljlayl & Frieder, 2002). Thus, other types of indexing units gave better performance to Arabic IR systems like stems and roots. To better understand this problem, we present an example in section 1. We summarize our contribution in section 2.

1.1. Motivation

Let consider the Arabic root “kassama-قسم” and some related words (cf. Table 1). In one side, root-based methods will relate many derived words to the same form and this will cause ambiguity and reduce precision. If we consider the example, “inkassama-انقسم” (was divided) and “akssama-اقسم” (swear) will be represented by the same index i.e. “kassama-قسم” (divide).

Table 1.
Some Arabic words related to the root “kassama-قسم”
انقسم
Inkassama
استقسم
istakssama
اقتسم
iktassama
اقسم
Akssama
قاسم
kaassama
انقسام
inkissam
قسمة
kisma
الانقسامات
alinkissamat
Was dividedConjureShare somebody in something.SwearShare something with somebodyDivisionDivisionThe divisions

Stem indexes reduce ambiguity (Ayed, 2014; Bounhas et al., 2015), but it will from the other side, reduce recall, since some studies (Al-Kabi et al., 2011) showed that in most cases, morphological variants of words have somehow similar semantic interpretations and are not completely dissimilar and different word forms may bear similar meaning. When we apply a light stemming to the same example, “alinkissamat-الانقسامات” (the divisions) and “inkissam-انقسام” (division) will have the same stem but their semantic relation with “kisma -قسمة” (division) will be ignored.

Indeed, light stemming methods offer less recall and more precision. However, lemmatization helps to achieve better recall rates, but reduces precision. Thus, combining these techniques seems promising as it realizes some compromise between precision and recall, in a way we ensure that “alinkissamat -الانقسامات” (the divisions) is equal to “inkissam-انقسام” (division), not so far from “inkassama-انقسم” (was divided), a little bit different from “iktassama-اقتسم” (share somebody in something), but not totally different from “kaassama-قاسم” (share something with somebody) and that “akssama-اقسم” (swear) and “istakssama-استقسم”(conjure) are somehow related (cf. Figure 1).

Figure 1.

Hybrid index multi-level structure example for the root “kassama-قسم

Complete Article List

Search this Journal:
Reset
Open Access Articles: Forthcoming
Volume 6: 4 Issues (2018): 1 Released, 3 Forthcoming
Volume 5: 4 Issues (2017)
Volume 4: 4 Issues (2016)
Volume 3: 4 Issues (2015)
Volume 2: 4 Issues (2014)
Volume 1: 4 Issues (2013)
View Complete Journal Contents Listing