Choosing Multiple Parameters for Support Vector Machines
TLDR
The problem of automatically tuning multiple parameters for pattern recognition Support Vector Machines (SVMs) is considered by minimizing some estimates of the generalization error of SVMs using a gradient descent algorithm over the set of parameters.Abstract:
The problem of automatically tuning multiple parameters for pattern recognition Support Vector Machines (SVMs) is considered. This is done by minimizing some estimates of the generalization error of SVMs using a gradient descent algorithm over the set of parameters. Usual methods for choosing parameters, based on exhaustive search become intractable as soon as the number of parameters exceeds two. Some experimental results assess the feasibility of our approach for a large number of parameters (more than 100) and demonstrate an improvement of generalization performance.read more
Citations
More filters
Journal ArticleDOI
A novel reconstructed training-set SVM with roulette cooperative coevolution for financial time series classification
TL;DR: A novel support vector machine named as reconstructed training-set SVM (RTS-SVM) is proposed to implement classification for high-noise data, where the roulette cooperative coevolution algorithm (R-CC) is used to optimize the parameters of R-CC to achieve the optimization of the whole model.
Posted Content
Implicit differentiation of Lasso-type models for hyperparameter optimization
Quentin Bertrand,Quentin Klopfenstein,Mathieu Blondel,Samuel Vaiter,Alexandre Gramfort,Joseph Salmon +5 more
TL;DR: The authors proposed an efficient implicit differentiation algorithm, without matrix inversion, tailored for Lasso-type problems, which scales to high-dimensional data by leveraging the sparsity of the solutions.
Journal ArticleDOI
Knowledge Discovery Employing Grid Scheme Least Squares Support Vector Machines Based on Orthogonal Design Bee Colony Algorithm
Tsung-Jung Hsieh,Wei-Chang Yeh +1 more
TL;DR: The experimental results reveal that the proposed GS-LSSVM can produce a classification model more easily interpreted using a small number of features, and can significantly outperform other methods listed in this paper.
Journal ArticleDOI
Effects of SVM parameter optimization on discrimination and calibration for post-procedural PCI mortality
TL;DR: Support vector machines (SVM) have become popular among machine learning researchers, but their applications in biomedicine have been somewhat limited and the sensitivity of the results to changes in optimization methods has not been investigated in the context of medical applications.
Direct brain-computer communication through scalp recorded EEG signals
Garcia Molina,Gary Nelson +1 more
TL;DR: This thesis considers a 2D object positioning application in a computer-rendered environment (CRE) that is operated with four mental activities (controlling MAs) and the BCI operation is asynchronous, namely the system is always active and reacts only when it recognizes any of the controlling MIAs.
References
More filters
Book
The Nature of Statistical Learning Theory
TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Journal ArticleDOI
Support-Vector Networks
Corinna Cortes,Vladimir Vapnik +1 more
TL;DR: High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated and the performance of the support- vector network is compared to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
Statistical learning theory
TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
TL;DR: This is the first comprehensive introduction to Support Vector Machines (SVMs), a new generation learning system based on recent advances in statistical learning theory, and will guide practitioners to updated literature, new applications, and on-line software.
Journal ArticleDOI
Molecular classification of cancer: class discovery and class prediction by gene expression monitoring.
Todd R. Golub,Todd R. Golub,Donna K. Slonim,Pablo Tamayo,Christine Huard,Michelle Gaasenbeek,Jill P. Mesirov,Hilary A. Coller,Mignon L. Loh,James R. Downing,Michael A. Caligiuri,Clara D. Bloomfield,Eric S. Lander +12 more
TL;DR: A generic approach to cancer classification based on gene expression monitoring by DNA microarrays is described and applied to human acute leukemias as a test case and suggests a general strategy for discovering and predicting cancer classes for other types of cancer, independent of previous biological knowledge.