Efficient Big Data-Based Storage and Processing Model in Internet of Things for Improving Accuracy Fault Detection in Industrial Processes

Efficient Big Data-Based Storage and Processing Model in Internet of Things for Improving Accuracy Fault Detection in Industrial Processes

Mamoon Rashid (School of Computer Science and Engineering, Lovely Professional University, India), Harjeet Singh (Department of Computer Science, Mata Gujri College, Fatehgarh Sahib, India), Vishal Goyal (Department of Computer Science, Punjabi University, India), Nazir Ahmad (Department of Information Systems, Community College, King Khalid University, Saudi Arabia) and Neeraj Mogla (Nike Inc. Global Headquarters, USA)
Copyright: © 2020 |Pages: 16
DOI: 10.4018/978-1-7998-0373-7.ch009

Abstract

As the lot of data is getting generated and captured in Internet of Things (IoT)—based industrial devices which is real time and unstructured in nature. The IoT technology—based sensors are the effective solution for monitoring these industrial processes in an efficient way. However, the real—time data storage and its processing in IoT applications is still a big challenge. This chapter proposes a new big data pipeline solution for storing and processing IoT sensor data. The proposed big data processing platform uses Apache Flume for efficiently collecting and transferring large amounts of IoT data from Cloud—based server into Hadoop Distributed File System for storage of IoT—based sensor data. Apache Storm is to be used for processing this real—time data. Next, the authors propose the use of hybrid prediction model of Density-based spatial clustering of applications with noise (DBSCAN) to remove sensor data outliers and provide better accuracy fault detection in IoT Industrial processes by using Support Vector Machine (SVM) machine learning classification technique.
Chapter Preview
Top

1. Chapter Outline

This chapter is structured around the concepts of efficient storage of sensor IoT based data and its processing in Big Data pipeline. Further the inclusion of novel prediction model will help to improve fault detection in IoT Industrial processes. In today’s scenario we have to consider the big source of data generation as well as the plausible suitable platform of such huge data analysis. Therefore, the associated challenges are also included in this chapter.

Complete Chapter List

Search this Book:
Reset