Deterministic Concept Drift Detection in Ensemble Classifier Based Data Stream Classification Process

Introduction

Batch mode is the key operational approach for many of the machine learning algorithms. A conventional machine learning solution analyses the existing set of historical data and builds a model based on given inputs. However, with the emerging trends of rapid developments and the intrinsic need for the update, the machine learning models required recurrent learning that often leads not to deliver the necessary and desired outcome, which is due to ambiguity state of data change point identification to repeat the training process. To ensure that the models are robust and suitable to rapidly emerging conditions, there is an intrinsic need for detection of concept drift i.e. data change point detection. Varied research contributions carried out on identifying the vivid kinds of drift that takes place from the machine learning solutions (Žliobaitė, 2016), (GAMA, 2014). Majority of these contributions either of qualitative in nature or has been an informal definition, and hardly any kind of standardization of the term has yielded the desired result (Abdualrhman & Padma, 2015).

The particular source of data such as data streams wherein the quantum of data generated is massive and envisaged the issues pertaining to concept drift. It is imperative that expecting data distributions to stay relevant to the emerging trends is an unrealistic expectation. The issue of concept drift in the recent past becomes noteworthy over the pattern or information mining, ML techniques, data extraction procedures etc. One of the key scenarios is about learning against the adversaries like the spam filters and intrusion detection. In the case of a predictive model, the system targets in identifying patterns characteristic of an adversary element, despite the fact that the element is aware of implementing the adaptive learning and changing its course of behaviour to stay unnoticed. The other context is about learning even during and with the existence of hidden parameters. Consumer modelling is considered as a prominent method of learning functions, wherein the system builds a method of consumer information that is not observable and could change during the course of time. The scope of drift is high even in the instance of tracking functions and prognostic maintenance. The model learns the system behaviour but also involves mechanical object’s deterioration over the learning period. Computation problems associated resulting from changes over the period of time is termed as concept drift. The changes could be infinite and could vary vividly depending on the changing trends and the system might need different range of techniques to be adapted. In such conditions, the process of “one-size-fit-all” model may not be effective for managing the concept-drift phenomenon. Alternatively, requirements in practical context might vary with common characteristics. For transferring adaptive techniques from one application to the other, there is need for a way to characterize application tasks in a structured way.