Big Data Issues and Challenges

Big Data

In today digital era, the data is generated enormously day by day from multiple resources such as social networking data, cloud computing data, online trading data etc. responsible for generating a large amount of data. The usage of the latest digital technologies and information system such as cloud computing, mobile computing, IoT etc. is also responsible for the generation of large amount of data. This data generated by various technology is not always in the same format i.e, data may be structured, unstructured and semi-structured. This inconsistency of data raises many issues and challenges in front of the data management authority as they all need to deal with these numerous types of data. Previously, data warehouses are responsible for handling the large data storage and maintenance. User will acquire their required data by applying any of the data mining technique.

The primary requirement here was that all the data is stored in a predefined format which increase data warehouse efficiency and also reduce the time for searching any valuable data by data mining. Since, now data is not always stored in the same format and also due to its large volume it become infeasible to apply all these previously data mining technique. Usage of big data have their own technology and method to handle this issue, but still facing security issues and challenges regarding the data storage and finding the useful or required data for decision making purpose in less time. This chapter focus on these issues and challenges comes in front of big data technology.

Big Data in Library

There are few reasons for the adoption of big data technology in digital libraries for personalized services as:

• •

  The consistent creation of huge measures of information makes acquiring successful data progressively troublesome. The data over-burden issue is ending up progressively visible comparative with restricted client data adequacy and time costs. In this manner, finding content that clients are really keen on from enormous scale information assets and separating unessential data to minimize the meaningless data screening expenses has turned out to be vital to improving client accomplishment in computerized libraries.

• •

  The regularly expanding measure of information prompts consistently expanding information associations. Such associations cannot just improve our comprehension of information and encourage approaches to discover target information all the more successfully what's more, proficiently, yet additionally give the essential and fundamental conditions for further investigation and examination of concealed qualities which customary single-information assets can't give. In huge measures of information, there are an extraordinary number of relationships among the information, for example, the relationship among client social information, relationship among clients and clients, relationship among clients and assets, what's more, relationship among various assets. Such associations permit clients to get the necessary help content all the more effectively and rapidly. Moreover, such associations can create new client data prerequisites and can be utilized to make new sorts of data benefits by joining existing client intrigue designs.

• •

  Users get and break down information to acquire learning identified with a specific application. The comprehension and use of the learning substance are dictated by the information and furthermore relies upon the particular application condition and current data prerequisites. Connections, cooperation, and incorporation of semantic and application connections will significantly affect client understanding of the got information (Zhang, 2005).