de.mpg.escidoc.pubman.appbase.FacesBean
English
 
Help Guide Disclaimer Contact us Login
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT

Released

Journal Article

On the Representer Theorem and Equivalent Degrees of Freedom of SVR

MPS-Authors
http://pubman.mpdl.mpg.de/cone/persons/resource/persons83886

Dinuzzo,  F
Department Empirical Inference, Max Planck Institute for Biological Cybernetics, Max Planck Society;

Locator
There are no locators available
Fulltext (public)
There are no public fulltexts available
Supplementary Material (public)
There is no public supplementary material available
Citation

Dinuzzo, F., Neve M, De Nicolao, G., & Gianazza, U. (2007). On the Representer Theorem and Equivalent Degrees of Freedom of SVR. Journal of Machine Learning Research, 8, 2467-2495. Retrieved from http://jmlr.csail.mit.edu/papers/v8/dinuzzo07a.html.


Cite as: http://hdl.handle.net/11858/00-001M-0000-0013-CB7F-F
Abstract
Support Vector Regression (SVR) for discrete data is considered. An alternative formulation of the representer theorem is derived. This result is based on the newly introduced notion of pseudoresidual and the use of subdifferential calculus. The representer theorem is exploited to analyze the sensitivity properties of ε-insensitive SVR and introduce the notion of approximate degrees of freedom. The degrees of freedom are shown to play a key role in the evaluation of the optimism, that is the difference between the expected in-sample error and the expected empirical risk. In this way, it is possible to define a Cp-like statistic that can be used for tuning the parameters of SVR. The proposed tuning procedure is tested on a simulated benchmark problem and on a real world problem (Boston Housing data set).