Application of Big Data in Economic Policy

Application of Big Data in Economic Policy

Brojo Kishore Mishra (C.V. Raman College of Engineering, India) and Abhaya Kumar Sahoo (C.V. Raman College of Engineering, India)
DOI: 10.4018/978-1-4666-8737-0.ch010
OnDemand PDF Download:


Now-a-days main factor of any information in different fields is data. Different database like relational, object-oriented database is very different from traditional database in case of data retrieval, data management and data updation. So, Data mining is a process of extracting hidden knowledge or useful pattern from huge amount of data in case of efficient databases. As amount of data increases day by day, so it is very difficult to manage related data to different fields. Big data analysis takes a major role for accessing, managing and manipulating of both structured and unstructured data. It is possible to transform business, government and other aspects of the economy by big data. In this chapter, we discuss how big data analytics can be applied in economic policy of government and private sector for making better decision. Here we can use map-reduce programming model provided by Hadoop for analysis of big data in economic policy management.
Chapter Preview

1.1 Introduction

In every moment data is generated from different sources like social networking sites, search and retrieval engines, media sharing sites, stock trading sites and news sources etc. Now-a-days all people use face book in every time. So large amount of data is generated from this type of social networking site[3]. Like Face book, Twitter, Google, YouTube are producing large amount of data in every day. If we consider different sources of collection of data related to human like hospital monitoring system, climate system and insurance policy system etc, then management of data is very necessary for these different systems. In old days, traditional database system was used for data storage, data manipulation and data retrieval. To solve problems of traditional database, different databases like relational, object-oriented, network, object-relational came to the market.

The traditional method of managing structured data includes a relational database and schema to manage the storage and retrieval of the dataset. For managing large datasets in a structured fashion, the primary approaches are data warehouses and data marts[7].

A data warehouse is a relational database system used for storing, analyzing, and reporting functions. The data mart is the layer used to access the data warehouse. A data warehouse focuses on data storage. The main source of the data is cleaned, transformed, catalogued, and made available for data mining and online analytical functions[7]. The data warehouse and marts are Relational databases systems. The two main approaches to storing data in a data warehouse are dimensional and normalization of data.

There are several challenges that the enterprises are faced today owing to the limitations posed by relational databases. Some of these are: a) unstructured data that could provide a real-time business decision support remains unused as they cannot be stored, processed or analyzed. b) Several data islands are created and it becomes difficult to generate meaningful information from those. c) Data models are non-scalable and data becomes unmanageable. D) The cost of managing the data increases exponentially with the growth of data [1].

Data mining consists of five major elements [9]:

  • Extract, transform, and load transaction data onto the data warehouse system.

  • Store and manage the data in a multidimensional database system.

  • Provide data access to business analysts and information technology professionals.

  • Analyze the data by application software.

  • Present the data in a useful format, such as a graph or table.

As now-a-days amount of data is increased, so it is very difficult to manage data in large data producing sources. Big data analytics takes a major role in handling huge amount of data. Now India is currently one of the world's most attractive investment destinations. With the opening up of foreign direct investment (FDI) in several sectors, the country is an eye-catching destination for overseas investors[10]. The relaxation of norms by the government has also created a vast opportunity for foreign players, who are competing for a greater role in the Indian market. Sectors projected to do well in the coming years include automotive, technology, life sciences and consumer products. So we can use big data concepts in economic policy related to government and private sector for making strong decisions. This chapter includes different sections. Section 2 explains details about big data and its working principle. Section 3 provides idea about economic policy. Section 4 explains how big data technique can be applied in economic policy.


1.2 Background

A. Evolution of Big Data

<i>A.1</i> Traditional Data Management System</div><p>Traditional data management system contains structured and unstructured data depending on various data models.</p><div class="xmlReaderFig"><i>Figure 1. </i><div class="xmlReaderFig"><p> Traditional Data Management</p></div><div style="width: 100%;"><a href="/sourcecontent/9781466687370_127505/978-1-4666-8737-0.ch010.f01.png" target="_blank"><img src="/sourcecontent/9781466687370_127505/978-1-4666-8737-0.ch010.f01.png" style="max-width: 100%;" /></a></div></graphic></div></div></div><div class="preview-footer"><a href="javascript:__doPostBack('ctl00$cphFeatured$lnkAddToCart','')">Purchase this chapter to continue reading all 20 pages ></a></div></div><div id="table-of-contents"><h2>Complete Chapter List</h2><div class="search-contents"><span class="text"> Search this Book: </span><span class="text-box-container"><input id="txtKeywords" type="text" maxlength="50" onkeypress="return SearchBookFulltextHandleEnter(event, 127505);" placeholder="Full text search terms" title="Full text search terms" class="full-text-search-box" /></span><div class="inline-block search-contents-xs-full-width"><span class="search"><span class="search-button" onclick="RemoveSpecialCharacters();SearchBookFulltext(127505);"></span></span><span class="reset"><span onclick="RemoveSpecialCharacters();SearchBookFulltextReset();" class="link-gray-s">Reset</span></span></div></div><div id="searchResults"></div><div id="full-toc"></div><div id="loading-toc" class="text-align-center"><div class="loading-icon-lg"></div></div><script type="text/javascript"> $(document).ready(function () { if (18 !== 0) { GetBookToc(127505, 139402, 5, 'True', '', '$37.50'); } else { GetBookTocFromSubmissionSystem(127505, 139402, 5, 'True', '', '$37.50'); } } ); </script></div></div></div></div><div class="contentcnav" style="display:none;"><span id="ctl00_cphFeatured_pnlAbstract"><a href="#abstract" class="navlinklightc">Abstract</a> | </span><span id="ctl00_cphFeatured_pnlPreview"><a href="#chapter-preview" class="navlinklightc">Chapter Preview</a> | </span><a href="#table-of-contents" class="navlinklightc">Complete Chapter List</a><div class="rightouter"><div class="rightheader"> Complete Book </div><div class="rightinner"><strong>$210.00 - $315.00</strong><div style="margin-top: 2px; padding-left: 2px;"><a href="/book/research-advances-integration-big-data/127505" id="ctl00_cphFeatured_lnkBookPricing" class="navlinkcsmall">View Book Pricing Options</a></div></div></div><div id="ctl00_cphFeatured_ucInfoSciOnDemandSidebar_pnlSearch"><div class="panel-heading box-corner" data-toggle="collapse" data-target="#on-demand-search-toggle"><img src="/Images/infosci-ondemand-small.png" alt="InfoSci-OnDemand Powered Search" width="155" height="32" /></div><ul id="on-demand-search-toggle" class="nav nav-stacked list-unstyled collapse navbar-collapse nav-stacked-custom"><li style="padding: 6px 10px;"><div style="margin-bottom: 7px; font-size: 11px; color: #666;"> Full-text search over 104,700 research articles and chapters. </div><div style="display:inline-block;"><a onclick="RemoveSpecialCharacters();" id="ctl00_cphFeatured_ucInfoSciOnDemandSidebar_lnkSearch" class="ButtonBlack FloatRight" href="javascript:__doPostBack('ctl00$cphFeatured$ucInfoSciOnDemandSidebar$lnkSearch','')" style="height:19px;background-color:#777;"><span class="jQueryIconBlitzer ui-icon-search"></span></a><input name="ctl00$cphFeatured$ucInfoSciOnDemandSidebar$txtSearchPhrase" type="text" id="ctl00_cphFeatured_ucInfoSciOnDemandSidebar_txtSearchPhrase" class="SearchTextBox TextBoxWatermark FloatLeft" title="Full text search term(s)" style="width: 117px;" /></div></li></ul></div><div id="ctl00_cphFeatured_pnlRelatedTitles" class="rightouter"><div class="rightheader"> Related Chapters </div><div class="rightinner"><div class="list-item-link" style="border-bottom: dotted 1px #dadada; padding: 4px 0px; font-size: 11px;"><div title='Uncertainty-Based Clustering Algorithms for Large Data Sets'><a id="Link" href="/chapter/uncertainty-based-clustering-algorithms-for-large-data-sets/185977" title='Uncertainty-Based Clustering Algorithms for Large Data Sets'> Uncertainty-Based Clustering Algorithms for Large... </a><div style="color: #555;">© 2018, 33 pp.</div></div></div><div class="list-item-link" style="border-bottom: dotted 1px #dadada; padding: 4px 0px; font-size: 11px;"><div title='Sentiment Mining Approaches for Big Data Classification and Clustering'><a id="Link" href="/chapter/sentiment-mining-approaches-for-big-data-classification-and-clustering/185978" title='Sentiment Mining Approaches for Big Data Classification and Clustering'> Sentiment Mining Approaches for Big Data... </a><div style="color: #555;">© 2018, 30 pp.</div></div></div><div class="list-item-link" style="border-bottom: dotted 1px #dadada; padding: 4px 0px; font-size: 11px;"><div title='Data Compaction Techniques'><a id="Link" href="/chapter/data-compaction-techniques/185979" title='Data Compaction Techniques'> Data Compaction Techniques </a><div style="color: #555;">© 2018, 35 pp.</div></div></div><div class="list-item-link" style="border-bottom: dotted 1px #dadada; padding: 4px 0px; font-size: 11px;"><div title='Methodologies and Technologies to Retrieve Information From Text Sources'><a id="Link" href="/chapter/methodologies-and-technologies-to-retrieve-information-from-text-sources/185980" title='Methodologies and Technologies to Retrieve Information From Text Sources'> Methodologies and Technologies to Retrieve... </a><div style="color: #555;">© 2018, 25 pp.</div></div></div><div class="list-item-link" style="border-bottom: dotted 1px #dadada; padding: 4px 0px; font-size: 11px;"><div title='Twitter Data Analysis'><a id="Link" href="/chapter/twitter-data-analysis/185981" title='Twitter Data Analysis'> Twitter Data Analysis </a><div style="color: #555;">© 2018, 28 pp.</div></div></div><div class="list-item-link" style="border-bottom: dotted 1px #dadada; padding: 4px 0px; font-size: 11px;"><div title='Use of Social Network Analysis in Telecommunication Domain'><a id="Link" href="/chapter/use-of-social-network-analysis-in-telecommunication-domain/185982" title='Use of Social Network Analysis in Telecommunication Domain'> Use of Social Network Analysis in Telecommunication... </a><div style="color: #555;">© 2018, 27 pp.</div></div></div><div class="list-item-link" style="border-bottom: dotted 1px #dadada; padding: 4px 0px; font-size: 11px;"><div title='A Review on Spatial Big Data Analytics and Visualization'><a id="Link" href="/chapter/a-review-on-spatial-big-data-analytics-and-visualization/185983" title='A Review on Spatial Big Data Analytics and Visualization'> A Review on Spatial Big Data Analytics and... </a><div style="color: #555;">© 2018, 19 pp.</div></div></div></div></div><a href="/search/?sid=5&stid=135"><div class="rightnavad featuredtitles"><span class="item" style="font-size:14px;">More Computer<br />Science & IT Titles</span><span class="details"><strong>Related Titles</strong>View all Computer<br />Science & IT search results</span></div></a></div><script type="text/javascript"> MenuAdjust(); $(window).on('resize orientationChange', function (event) { MenuAdjust(); }); </script><footer class="footer"><div class="container"><div class="row"><div class="top-margin"><div class="col-md-6"><div class="footer-header"> Learn More </div><div class="text"><a href="/about/" class="footer-link">About IGI Global</a> | <a href="/publish/partnerships/" class="footer-link">Partnerships</a> | <a href="/contact/" class="footer-link">Contact</a> | <a href="/careers/" class="footer-link">Careers</a> | <a href="/faq/" class="footer-link">FAQ</a> | <a href="/staff/" class="footer-link">Staff</a></div><div class="footer-header header-margin-top"> Resources For </div><div class="text"><a href="/librarians/" class="footerlink">Librarians</a> | <a href="/publish/" class="footerlink">Authors/Editors</a> | <a href="/distributors/" class="footerlink">Distributors</a> | <a href="/course-adoption/" class="footerlink">Instructors</a> | <a href="/translators/" class="footerlink">Translators</a> | <a href="" class="footerlink" target="_blank">Copy Editing Services</a></div><div class="footer-header header-margin-top"> Media Center </div><div class="text"><a href="/symposium/" class="footer-link">Online Symposium</a> | <a href="/newsroom/" class="footer-link">Blogs</a> | <a href="/catalogs/" class="footer-link">Catalogs</a> | <a href="/newsletters/" class="footer-link">Newsletters</a></div><div class="footer-header header-margin-top"> Policies </div><div class="text"><a href="/policies/privacy/" class="footer-link">Privacy Policy</a> | <a href="/policies/content-reuse/" class="footer-link">Content Reuse Policy</a> | <a href="/policies/ethics-and-malpractice/" class="footer-link">Ethics and Malpractice</a></div></div><div class="col-md-6 td-r"><div class="td-r-t"><div class="td-r-t-r"><a id="ctl00_lnkConferenceBadge" href="" target="_blank"><img src="/Images/frankfurt-2017.png" alt="" style="height:124px;width:250px;" /></a></div><div class="td-r-t-l"><div class="t-space" style="margin-top:31px;"><a href="" target="_blank"><span class="fb"></span></a>  <a href="" target="_blank"><span class="tw"></span></a></div><div class="b-space"><a href="" target="_blank"><img src="/images/proud-supporter-of-wfcf-07282015.png" alt="World Forgotten Children's Foundation" title="Proud Supporter of the World Forgotten Children's Foundation" width="157" height="52" /></a></div></div></div><div class="text"> Copyright © 1988-2017, IGI Global - All Rights Reserved </div><div class="td-r-ip"></div></div></div></div></div></footer><div class="aspNetHidden"><input type="hidden" name="__VIEWSTATEGENERATOR" id="__VIEWSTATEGENERATOR" value="679D6B48" /><input type="hidden" name="__EVENTVALIDATION" id="__EVENTVALIDATION" value="rrccCGCuHPidF0QjkZhLexct80/Pn4T8XFMPQsOc6YudY4MvqCxO9PXyhPP45nYfDl1kwXCbq0UG1vXpultTUD3pKllPlJFNqaAlQZDYtSlxIgoSd6nF5dS0tZWe1SpBotbWcMoDWkFMm+WiADUtvTJSb5+kBd1L9wGUWhpkJMVSpZvEjIUuUHhHOvmWbmb4g9AAfDdCmDo+tLITinfAGJVGB2C9KCTdmcIHZuMabb3ZAQt9yyoDdKAgyCk4CtwUlh07bepiu6pqSSEMQKs3QhNI+j7bdKpvJ9nrzWTt6T1jG5+LRynALKycygrP140Llq3dITpFnGogcP8UoMVgn5a7S1iKzC/tW6VnQCz4jTGpdlQkX73FXpE84xttBahRVcCa+BU4WZcj6oJYR7NaLZ6TlT/fnAnCHHTHvpRIVPXJh4C6Cmv4BtEFUzIl1bSozcQvWV//E2wltiWOzd4oDquP2os=" /></div></form></body></html>