Algorithm of Fuzzy Support Vector Machine based on a Piecewise Linear Fuzzy Weight Method

Algorithm of Fuzzy Support Vector Machine based on a Piecewise Linear Fuzzy Weight Method

Yong-bin Yuan (College of Electrical Engineering and Automation Fuzhou University, Fuzhou, China), Sheng Lan (College of Electrical Engineering and Automation Fuzhou University, Fuzhou, China), Xu Yu (School of Information Science and Technology, Qingdao University of Science and Technology, Qingdao, China) and Miao Yu (The College of Textiles and Fashion, Qingdao University, Qingdao, China)
DOI: 10.4018/IJCINI.2018040105

Abstract

This article describes how fuzzy support vector machines (FSVMs) function well with good anti-noise performance, which receives the attention of many experts. However, the traditional center-distance fuzzy weight assignment method assigns support vectors with a small value of a membership degree and this weakens the role of support vectors in classification. In this article, a piecewise linear fuzzy weight computing method is proposed, in which boundary samples are assigned with a larger value of membership degree and samples far from the mean vector are assigned a smaller value of membership degree. The proposed method has a good classification performance, because the influence of noise samples is weakened and meanwhile the support vectors are paid much more attention. The experiments on the UCI database and MNIST data set fully verify the effectiveness of the proposed algorithm.
Article Preview

1. Introduction

Fuzzy Support Vector Machine (FSVM) theory was firstly proposed by Lin, etc. (Lin & Wang, 2002). Its main idea is to introduce the concept of fuzzy weights to the original sample, enhancing the noise resistance of this algorithm. Currently, this algorithm is widely applied in the fields of network intrusion detection (Lun, University, & Beijing, 2005; Yang, Yu, Xie, & Zhang, 2011), face recognition (Leng & Wang, 2008; Liu & Chen, 2007), text classification (Wang & Chiang, 2007, 2009) and credit risk evaluation (Wang, Wang, & Lai, 2005).

For the fuzzy support vector machine, the original sample is usually expressed as , where stands for the fuzzy weight of samples. Fuzzy support vector machine weakens the effect of noise samples for classification results through introducing fuzzy weight. Fuzzy support vector machine algorithm can be achieved by solving the following optimization problem:

(1)

Different from the traditional support vector machine algorithm, in the fuzzy support vector machine model, the misclassification penalty of samples is influenced by fuzzy weight and so the effects of noise samples for classification can be reduced by setting reasonable fuzzy weights. The key of fuzzy support vector machine algorithm is to assign the fuzzy weights, and currently the commonly applied approach is the center distance fuzzy weight assignment method. The specific calculation formula is as follows:

(2) where and denote the sample center of the two kinds of sample, and is used to avoid . and denote the radius of the two kinds of samples, and they can be defined as follows:

(3)

Complete Article List

Search this Journal:
Reset
Open Access Articles: Forthcoming
Volume 13: 4 Issues (2019): Forthcoming, Available for Pre-Order
Volume 12: 4 Issues (2018): 2 Released, 2 Forthcoming
Volume 11: 4 Issues (2017)
Volume 10: 4 Issues (2016)
Volume 9: 4 Issues (2015)
Volume 8: 4 Issues (2014)
Volume 7: 4 Issues (2013)
Volume 6: 4 Issues (2012)
Volume 5: 4 Issues (2011)
Volume 4: 4 Issues (2010)
Volume 3: 4 Issues (2009)
Volume 2: 4 Issues (2008)
Volume 1: 4 Issues (2007)
View Complete Journal Contents Listing