Opportunities and Challenges of Using Big Data Applications in Institutions of Higher Learning Libraries and Research Institutions

Introduction

The development of information communication technologies (ICTs), digital information techniques, internet technology, internet of things and cloud computing have caused an increase in data generation and use (Alotaibi and Abdullah 2016). Institutions of higher learning and research institutions produce a lot of data in their day to day operations and their libraries are busy due to high usage be it on or off campus. Libraries have a virtual presence and users are able to use the information resources regardless of location and time. The data is coming from various sources such as sensors, smart devices, social networking interactions, web pages, videos, images, personal browsing history, and online transactions among other things (Wu et al 2014, Alotaibi and Abdullah 2016). As a result, the data is presented as structured, unstructured and semi structured (Bello-Orgaz et al 2016, Zaharia et al 2016). The literature indicates that the big data concept was started in 2001 by Laney in his research notes. Laney believes that an important feature of big data is that it cannot be processed effectively by traditional data management tools (Laney, 2001). Most big data-processing methods emphasize high-speed and efficient use of large amounts of data (Li et al 2019). It is also stated that big data is a collection of datasets so large and complex that it is difficult to use on-hand database management tools, or traditional data processing applications, for their processing that includes capturing, storage, search, sharing, transfer, analysis, and visualization (Li et al 2019).

The trend towards having and dealing with larger data sets produced by different actors is also due to the additional information derivable from the analysis of a single large set of related data, as compared to separate smaller sets with the same total amount of data, allowing correlations to be found to spot business trends, determine quality of research, prevent diseases, link legal citations, combat crime, and determine real-time roadway traffic conditions. (Lu 2014). Zhan and Widen (2019) indicated that big data is data oriented and ability oriented. Data oriented shows that the data or information has certain features such as large volume and increasing rapidly while ability oriented highlights the need for technology to handle the data. In this study, a definition that was provided by Zhan and Widen (2019) was adopted. They stated that big data is “data with large size, fast growing speed, and various types which can complicate data handling techniques but also boost the creation of technological solutions. Value is generated by the proper operation and use of big data” (Zhan and Widen 2019: 563). It is in light of this background that the chapter seeks to address the following objectives:

• 1.

  To examine the big data applications that can be used by libraries in institutions of higher learning.

• 2.

  To document the opportunities of using big data applications in libraries in institutions of higher learning.

• 3.

  To discuss the challenges faced when using big data applications in libraries in institutions of higher learning.

Problem Statement

The use of big data applications in libraries is a new field where research is limited as stated by Hashem et al (2015) and Kim and Choi (2016). There is also insufficient emphasis on the practical application of big data in libraries as stated by Li et al (2019) and Lu (2014). Zhan and Widen (2019) concluded that big data are rare in librarianship. As a result, the problem statement for this study is how libraries in research institutions and institutions of higher learning can take advantage of the opportunities and challenges that are offered by big data. A structured literature review and content analysis was employed to unpack the opportunities and challenges of using big data applications in institutions of higher learning and research institutions. Big data AND libraries were the search terms that were used to retrieve electronic information resources from academic databases that documents the application of big data in libraries. Content analysis was used to analyse the collected information which was presented in themes according to the objectives of the study.