Challenges and Recommendations in Big Data Indexing Strategies

Challenges and Recommendations in Big Data Indexing Strategies

Mohamed Attia Mohamed, Manal A. Abdel-Fattah, Ayman E. Khedr
Copyright: © 2021 |Pages: 18
DOI: 10.4018/IJeC.2021040102
OnDemand:
(Individual Articles)
Available
$37.50
Current Special Offers
No Current Special Offers
TOTAL SAVINGS: $37.50

Abstract

Index structures are one of the main strategies for effective data access applied for indexing data. According to expansion of data, traditional indexing strategies on big data meets several challenges that lead to weak performance; they haven't abilities to handle the rapid increase of data in terms of accurate retrieval results and processing time. So, it is necessary to substitute traditional index with another efficient index structure called learned index. Learned index goes to use machine learning models to tackle such issues and achieve more enhancements of processing time and accurate results. In this research, the authors discuss different indexing strategies on big data both traditional and learned indexes, demonstrate the main features of them, perform comparison in terms of its performance, and present big data indexing challenges and solutions. Consequently, the research suggests replacing traditional indexes by dynamic index models, which lead to less processing time and more accurate results taking into consideration specification of hardware used.
Article Preview
Top

Indexing Strategies

There are different indexing strategies used in storing and indexing big data, each index type support specific type of data and query type (Mittal, 2018). According to new perspective of big data indexing classification, there are two main strategies used for indexing, traditional index strategies and learned index strategies and inside each category there are other subcategories as shown in Figure 1.

Figure 1.

Taxonomy of indexing strategies on big data

IJeC.2021040102.f01

Traditional Index Strategies

Big data indexing means data retrieval process is automated and the request query latency time is reduced. According to Gani et al. (2015) traditional index strategies is composed of two main approaches:

  • •

    Non-artificial intelligence index

  • •

    Artificial intelligence index

Complete Article List

Search this Journal:
Reset
Volume 20: 1 Issue (2024)
Volume 19: 7 Issues (2023)
Volume 18: 6 Issues (2022): 3 Released, 3 Forthcoming
Volume 17: 4 Issues (2021)
Volume 16: 4 Issues (2020)
Volume 15: 4 Issues (2019)
Volume 14: 4 Issues (2018)
Volume 13: 4 Issues (2017)
Volume 12: 4 Issues (2016)
Volume 11: 4 Issues (2015)
Volume 10: 4 Issues (2014)
Volume 9: 4 Issues (2013)
Volume 8: 4 Issues (2012)
Volume 7: 4 Issues (2011)
Volume 6: 4 Issues (2010)
Volume 5: 4 Issues (2009)
Volume 4: 4 Issues (2008)
Volume 3: 4 Issues (2007)
Volume 2: 4 Issues (2006)
Volume 1: 4 Issues (2005)
View Complete Journal Contents Listing