Abstract

Traditional extensions of the binary support vector machine (SVM) to multiclass problems are either heuristics or require solving a large dual optimization problem. Here, a generalized multiclass SVM called GenSVM is proposed, which can be used for classification problems where the number of classes K is larger than or equal to 2. In the proposed method, classification boundaries are constructed in a K - 1 dimensional space. The method is based on a convex loss function, which is flexible due to several different weightings. An iterative majorization algorithm is derived that solves the optimization problem without the need of a dual formulation. The method is compared to seven other multiclass SVM approaches on a large number of datasets. These comparisons show that the proposed method is competitive with existing methods in both predictive accuracy and training time, and that it significantly outperforms several existing methods on these criteria.

Additional Metadata
Keywords Support Vector Machines (SVMs), Multiclass Classification, Iterative Majorization, MM Algorithm, Classifier Comparison
Publisher Erasmus University Rotterdam
Persistent URL hdl.handle.net/1765/77638
Series Econometric Institute Research Papers
Citation
van den Burg, G.J.J, & Groenen, P.J.F. (2014). GenSVM: A Generalized Multiclass Support Vector Machine (No. EI 2014-33). Econometric Institute Research Papers. Erasmus University Rotterdam. Retrieved from http://hdl.handle.net/1765/77638