Winnow (algorithm)

From Wikipedia, the free encyclopedia

The introduction to this article provides insufficient context for those unfamiliar with the subject. Please help improve the article with a good introductory style.

The winnow algorithm is a technique from machine learning. It is closely related to the Perceptron, but uses a different update rule. Winnow is effective at removing unhelpful dimensions (hence its name). It is not a sophisticated algorithm but it scales well to high-dimensional spaces. During training, winnow is shown a sequence of positive and negative examples. From these it learns a decision hyperplane.

The update rule is (loosely):

• If an example is correctly classified, do nothing.
• If an example is incorrectly classified, double or halve all weights involved in the mistake.

Variations are also used.