6
$\begingroup$

I am reading about Gradient Boosting, AdaBoost etc.

I have found the following two concepts weak learner and weak classifier.

Are they the same?

If there is any difference what is it?

$\endgroup$
8
$\begingroup$

A weak learner can be either a classification or a regression algorithm:

Boosting (Schapire and Freund 2012) is a greedy algorithm for fitting adaptive basis-function models of the form in Equation 16.3, where the $\phi_m$ are generated by an algorithm called a weak learner or a base learner. The algorithm works by applying the weak learner sequentially to weighted versions of the data, where more weight is given to examples that were misclassified by earlier rounds. This weak learner can be any classification or regression algorithm, but it is common to use a CART model.

Source: "Machine Learning - A Probabilistic Perspective"; Murphy; 2012

So a weak classifier is simply a weak learner which is a classifier.

| improve this answer | |
$\endgroup$
  • 2
    $\begingroup$ okey! perfect! Thanks for the citation :) $\endgroup$ – Carlos Mougan Jan 5 at 22:38

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.