Bioinformatics Advance Access originally published online on January 5, 2008
Bioinformatics 2008 24(3):412-419; doi:10.1093/bioinformatics/btm579
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Hybrid huberized support vector machines for microarray classification and gene selection
1Ross School of Business, 2Department of Statistics, University of Michigan, Ann Arbor, MI 48109 and 3School of Statistics, University of Minnesota, Minneapolis, MN 55455, USA
*To whom correspondence should be addressed.
| Abstract |
|---|
Motivation: The standard L2-norm support vector machine (SVM) is a widely used tool for microarray classification. Previous studies have demonstrated its superior performance in terms of classification accuracy. However, a major limitation of the SVM is that it cannot automatically select relevant genes for the classification. The L1-norm SVM is a variant of the standard L2-norm SVM, that constrains the L1-norm of the fitted coefficients. Due to the singularity of the L1-norm, the L1-norm SVM has the property of automatically selecting relevant genes. On the other hand, the L1-norm SVM has two drawbacks: (1) the number of selected genes is upper bounded by the size of the training data; (2) when there are several highly correlated genes, the L1-norm SVM tends to pick only a few of them, and remove the rest.
Results: We propose a hybrid huberized support vector machine (HHSVM). The HHSVM combines the huberized hinge loss function and the elastic-net penalty. By doing so, the HHSVM performs automatic gene selection in a way similar to the L1-norm SVM. In addition, the HHSVM encourages highly correlated genes to be selected (or removed) together. We also develop an efficient algorithm to compute the entire solution path of the HHSVM. Numerical results indicate that the HHSVM tends to provide better variable selection results than the L1-norm SVM, especially when variables are highly correlated.
Availability: R code are available at http://www.stat.lsa.umich.edu/~jizhu/code/hhsvm/
Contact: jizhu{at}umich.edu
Supplementary information: Supplementary data are available at Bioinformatics online.
Received on June 15, 2007; revised on October 9, 2007; accepted on November 18, 2007