Feature Reduction for Support Vector Machines

Feature Reduction for Support Vector Machines

Shouxian Cheng, Frank Y. Shih
Copyright: © 2009 |Pages: 8
ISBN13: 9781605660103|ISBN10: 1605660108|EISBN13: 9781605660110
DOI: 10.4018/978-1-60566-010-3.ch134
Cite Chapter Cite Chapter

MLA

Cheng, Shouxian, and Frank Y. Shih. "Feature Reduction for Support Vector Machines." Encyclopedia of Data Warehousing and Mining, Second Edition, edited by John Wang, IGI Global, 2009, pp. 870-877. https://doi.org/10.4018/978-1-60566-010-3.ch134

APA

Cheng, S. & Shih, F. Y. (2009). Feature Reduction for Support Vector Machines. In J. Wang (Ed.), Encyclopedia of Data Warehousing and Mining, Second Edition (pp. 870-877). IGI Global. https://doi.org/10.4018/978-1-60566-010-3.ch134

Chicago

Cheng, Shouxian, and Frank Y. Shih. "Feature Reduction for Support Vector Machines." In Encyclopedia of Data Warehousing and Mining, Second Edition, edited by John Wang, 870-877. Hershey, PA: IGI Global, 2009. https://doi.org/10.4018/978-1-60566-010-3.ch134

Export Reference

Mendeley
Favorite

Abstract

The Support Vector Machine (SVM) (Cortes and Vapnik, 1995; Vapnik, 1995; Burges, 1998) is intended to generate an optimal separating hyperplane by minimizing the generalization error without the assumption of class probabilities such as Bayesian classifier. The decision hyperplane of SVM is determined by the most informative data instances, called Support Vectors (SVs). In practice, these SVMs are a subset of the entire training data. By now, SVMs have been successfully applied in many applications, such as face detection, handwritten digit recognition, text classification, and data mining. Osuna et al. (1997) applied SVMs for face detection. Heisele et al. (2004) achieved high face detection rate by using 2nd degree SVM. They applied hierarchical classification and feature reduction methods to speed up face detection using SVMs. Feature extraction and reduction are two primary issues in feature selection that is essential in pattern classification. Whether it is for storage, searching, or classification, the way the data are represented can significantly influence performances. Feature extraction is a process of extracting more effective representation of objects from raw data to achieve high classification rates. For image data, many kinds of features have been used, such as raw pixel values, Principle Component Analysis (PCA), Independent Component Analysis (ICA), wavelet features, Gabor features, and gradient values. Feature reduction is a process of selecting a subset of features with preservation or improvement of classification rates. In general, it intends to speed up the classification process by keeping the most important class-relevant features.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.