Research Challenges in Big Data Analytics

Research Challenges in Big Data Analytics

Sivamathi Chokkalingam (Bharathiar University, India) and Vijayarani S. (Bharathiar University, India)
Copyright: © 2016 |Pages: 17
DOI: 10.4018/978-1-5225-0293-7.ch004
OnDemand PDF Download:
No Current Special Offers


The term Big Data refers to large-scale information management and analysis technologies that exceed the capability of traditional data processing technologies. Big Data is differentiated from traditional technologies in three ways: volume, velocity and variety of data. Big data analytics is the process of analyzing large data sets which contains a variety of data types to uncover hidden patterns, unknown correlations, market trends, customer preferences and other useful business information. Since Big Data is new emerging field, there is a need for development of new technologies and algorithms for handling big data. The main objective of this paper is to provide knowledge about various research challenges of Big Data analytics. A brief overview of various types of Big Data analytics is discussed in this paper. For each analytics, the paper describes process steps and tools. A banking application is given for each analytics. Some of research challenges and possible solutions for those challenges of big data analytics are also discussed.
Chapter Preview


The term Big Data refers to large-scale information management and analysis technologies that exceed the capability of traditional data processing technologies (Cloud Security Alliance 2013; Duggal & Paul, 2013). Big data sizes are increasing, ranging from a few dozen terabytes in 2012 to today many petabytes of data in a single data set. Big data applications are a great benefit to organizations, business, companies and many large scale and small scale industries. Some of the real time examples of Big Data are Credit card transactions made all over the world with respect to a particular Bank, Walmart customer transactions, Facebook users generating social interaction data, The New York stock exchange, (the genealogy site), and The Internet Archive. Consider the following review. Today in every minute about (Skinner, 2015)

  • More than 204 million email messages are passed.

  • Over 2 million Google search queries are requested.

  • 48 hours of new YouTube videos are downloaded.

  • 684,000 bits of content shared on Facebook.

  • More than 100,000 tweets are created.

  • $272,000 spent on e-commerce.

  • 3,600 new photos shared on Instagram.

  • Nearly 350 new WordPress blog posts are created.

Advantages of Big Data

There are several advantages of big data. Some of the significant advantages of big data are:

  • It can handle huge volume of data with high velocity and more variety.

  • Easy integration of structured and unstructured data

  • Ability to process semi-structured and unstructured data

  • Easy to perform data analysis.

  • Decreased cost of storage.

  • Improved processing speed.

  • Able to map the entire data landscape across a company with Big Data tools, thus allow analyzing the threats.

  • Allows ever-narrower segmentation of customers and therefore possible to attain much more precisely tailored products or services.

  • Sophisticated analytics can substantially improve decision-making, reduces risks and discovers valuable insights.

Need for New Technology

Some of the traditional data mining technologies fail to provide the tools to support big data. The reasons are

  • Storing a very large quantity of data was not economically feasible.

  • Cannot handle a very huge dynamic data.

  • Unable to handle variety of data simultaneously.

  • Performing analytics and complex queries on large, structured data sets was inefficient.

  • Unable to analyze and manage unstructured data.

  • Unable to integrate structured and unstructured data.

  • Unable to discover information from unstructured data.


Literature Review

For literature review, see Table 1.

Complete Chapter List

Search this Book: