Choosing Multiple Parameters for Support Vector Machines
TLDR
The problem of automatically tuning multiple parameters for pattern recognition Support Vector Machines (SVMs) is considered by minimizing some estimates of the generalization error of SVMs using a gradient descent algorithm over the set of parameters.Abstract:
The problem of automatically tuning multiple parameters for pattern recognition Support Vector Machines (SVMs) is considered. This is done by minimizing some estimates of the generalization error of SVMs using a gradient descent algorithm over the set of parameters. Usual methods for choosing parameters, based on exhaustive search become intractable as soon as the number of parameters exceeds two. Some experimental results assess the feasibility of our approach for a large number of parameters (more than 100) and demonstrate an improvement of generalization performance.read more
Citations
More filters
Book ChapterDOI
Support vector machines for classification: a statistical portrait.
TL;DR: This chapter aims to provide an introduction to the support vector machine, covering from the basic concept of the optimal separating hyperplane to its nonlinear generalization through kernels.
Posted Content
Is rotation forest the best classifier for problems with continuous features
TL;DR: It is demonstrated that on large problems rotation forest can be made an order of magnitude faster without significant loss of accuracy, and it is maintained that without any domain knowledge to indicate an algorithm preference, rotation forest should be the default algorithm of choice for problems with continuous attributes.
Proceedings ArticleDOI
Dynamic Network Selection using Kernels
E. van den Berg,P. Gopalakrishnan,Byungsuk Kim,B. Lyles,Won-Ik Kim,Yeon Seung Shin,Yeong Jin Kim +6 more
TL;DR: A new algorithm for vertical handover and dynamic network selection is presented, based on a combination of multi- attribute utility theory, kernel learning and stochastic gradient descent, which is able to improve network selection in a non-stationary mobile environment.
Journal ArticleDOI
Prediction of factor Xa inhibitors by machine learning methods.
TL;DR: This study suggests that machine learning methods such as SVM are useful for facilitating the prediction of FXa inhibitors by using a much more diverse set of 1098 compounds than those in other studies.
Journal ArticleDOI
DA-Based Parameter Optimization of Combined Kernel Support Vector Machine for Cancer Diagnosis
Tao Xie,Jun Yao,Zhiwei Zhou +2 more
TL;DR: A novel cancer classification algorithm based on the dragonfly algorithm and SVM with a combined kernel function (DA-CKSVM) which was constructed from a radial basis function (RBF) kernel and a polynomial kernel and achieved better classification accuracy on cancer datasets.
References
More filters
Book
The Nature of Statistical Learning Theory
TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Journal ArticleDOI
Support-Vector Networks
Corinna Cortes,Vladimir Vapnik +1 more
TL;DR: High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated and the performance of the support- vector network is compared to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
Statistical learning theory
TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
TL;DR: This is the first comprehensive introduction to Support Vector Machines (SVMs), a new generation learning system based on recent advances in statistical learning theory, and will guide practitioners to updated literature, new applications, and on-line software.
Journal ArticleDOI
Molecular classification of cancer: class discovery and class prediction by gene expression monitoring.
Todd R. Golub,Todd R. Golub,Donna K. Slonim,Pablo Tamayo,Christine Huard,Michelle Gaasenbeek,Jill P. Mesirov,Hilary A. Coller,Mignon L. Loh,James R. Downing,Michael A. Caligiuri,Clara D. Bloomfield,Eric S. Lander +12 more
TL;DR: A generic approach to cancer classification based on gene expression monitoring by DNA microarrays is described and applied to human acute leukemias as a test case and suggests a general strategy for discovering and predicting cancer classes for other types of cancer, independent of previous biological knowledge.