To improve the learning performance of neural network (NN), this paper introduces an input attribute grouping based NN ensemble method. All of the input attributes are partitioned into exclusive groups according to the degree of inter-attribute promotion or correlation that quantifies the supportive interactions between attributes. After partitioning, multiple NNs are trained by taking each group of attributes as their respective inputs. The final classification result is obtained by integrating the results from each NN. Experimental results on several UCI datasets demonstrate the effectiveness of the proposed method.
Terminology And Concepts
Let denote the promotion rate of two attributes i and j, which is defined by: (1)
represents the classification error obtained by training with single attribute i, and
represents the classification error obtained by training with two attributes i and j. When the promotion rate of two attributes is 1, these two attributes are considered to be mutually supportive for classification. Otherwise, they are considered to be mutually interfered for classification.
To take full advantage of inter-attribute promotions, we compute the average value of all with Any pair of attributes whose classification error is less than this average value is considered to have significant promotion to each other. The smaller the corresponding classification error is, the more significant the promotion is.
In statistics, correlation measures the strength and direction of the linear relationship between two random variables. There exist many ways of calculating correlation. This paper employs the Pearson’s correlation coefficients (Sedgwick, 2012).