v-Arc: Ensemble Learning in the Presence of Outliers

Rätsch, G; Schölkopf, B; Smola, AJ; Müller, K-R; Mika, S

Item

ITEM ACTIONSEXPORT

Add to Basket

Local TagsRelease HistoryDetailsSummary

Released

Conference Paper

v-Arc: Ensemble Learning in the Presence of Outliers

MPS-Authors

There are no MPG-Authors in the publication available

External Resource

http://papers.nips.cc/paper/1721-v-arc-ensemble-learning-in-the-presence-of-outliers.pdf
(Publisher version)

Fulltext (restricted access)

There are currently no full texts shared for your IP range.

Fulltext (public)

There are no public fulltexts stored in PuRe

Supplementary Material (public)

There is no public supplementary material available

Citation

Rätsch, G., Schölkopf, B., Smola, A., Müller, K.-R., & Mika, S. (2000). v-Arc: Ensemble Learning in the Presence of Outliers. In S. Solla, T. Leen, & K. Müller (Eds.), Advances in Neural Information Processing Systems 12 (pp. 561-567). Cambridge, MA, USA: MIT Press.

Cite as: https://hdl.handle.net/11858/00-001M-0000-0013-E4D0-D

Abstract

AdaBoost and other ensemble methods have successfully been applied to a number of classification tasks, seemingly defying problems of overfitting. AdaBoost performs gradient descent in an error function with respect to the margin, asymptotically concentrating on the patterns which are hardest to learn. For very noisy problems, however, this can be disadvantageous. Indeed, theoretical analysis has shown that the margin distribution, as opposed to just the minimal margin, plays a crucial role in understanding this phenomenon. Loosely speaking, some outliers should be tolerated if this has the benefit of substantially increasing the margin on the remaining points. We propose a new boosting algorithm which allows for the possibility of a pre-specified fraction of points to lie in the margin area or even on the wrong side of the decision boundary.