An Insight on the Class Imbalance Problem and Its Solutions in Big Data

Background

This section gives an overview about the problem that lies in the scope of this chapter and its probable solutions available. The section also incorporates a baseline study of some considerate work done in the field of problem domain including all types of solutions in the form of literature survey.

As briefly discussed in the introduction section, the problem of imbalance classification in any dataset exists where there is an occurrence of uneven class distribution. This problem can persist in binary classification as well as multi class classification. The importance to understand this problem lies in the fact that the class which is present in minority is of main concern. So, its correct classification becomes more important than classification of majority class instances. Solutions available to handle this problem lie in two categories:

• 1.

  Data Level Solutions

• 2.

  Algorithmic Solutions