I have read that in ensemble learning we use the outputs of various classifiers to make the predictive modeling better but in Adaboost we just use one classifier and we make it a strong learner but how it is a part of ensemble learning.


1 Answer 1


AdaBoost or Adaptive Boost is a boosting ensemble model which works by learning from it's previous mistakes, ie: misclassified data points.

We specify the number of decision trees to be generated while training and during each training step, it calculates the following :

  1. The weighted error rate of the trained decision tree
  2. The decision tree's weight in the ensemble = learning rate * log((1-e)/e)
  3. Update weights of wrongly classified points

This process repeats until all the trees are trained. In the end, AdaBoost makes all of them "vote" by adding up the weight (of each tree) multiplying by the prediction (of each tree).

Therefore, this becomes an ensemble of multiple decision trees.

  • $\begingroup$ The information is rather nice but I think you missed partially the op question. You can improve by emphasizing that there are multiple weak learners, even if all of them are trees. I give you a point to encourage you $\endgroup$
    – rapaio
    Commented Jul 20, 2019 at 17:55
  • $\begingroup$ Oh alright. Thank you for the pointer, much appreciated. $\endgroup$ Commented Jul 20, 2019 at 18:07
  • $\begingroup$ So,in Adaboost we cann't use different classifiers together right like Naivebayes classifier,SVM,DecisionTree etc. $\endgroup$ Commented Jul 21, 2019 at 6:33

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.