I have read that in ensemble learning we use the outputs of various classifiers to make the predictive modeling better but in Adaboost we just use one classifier and we make it a strong learner but how it is a part of ensemble learning.
$\begingroup$
$\endgroup$
Add a comment
|
1 Answer
$\begingroup$
$\endgroup$
3
AdaBoost or Adaptive Boost is a boosting ensemble model which works by learning from it's previous mistakes, ie: misclassified data points.
We specify the number of decision trees to be generated while training and during each training step, it calculates the following :
- The weighted error rate of the trained decision tree
- The decision tree's weight in the ensemble = learning rate * log((1-e)/e)
- Update weights of wrongly classified points
This process repeats until all the trees are trained. In the end, AdaBoost makes all of them "vote" by adding up the weight (of each tree) multiplying by the prediction (of each tree).
Therefore, this becomes an ensemble of multiple decision trees.
-
$\begingroup$ The information is rather nice but I think you missed partially the op question. You can improve by emphasizing that there are multiple weak learners, even if all of them are trees. I give you a point to encourage you $\endgroup$– rapaioJul 20, 2019 at 17:55
-
$\begingroup$ Oh alright. Thank you for the pointer, much appreciated. $\endgroup$ Jul 20, 2019 at 18:07
-
$\begingroup$ So,in Adaboost we cann't use different classifiers together right like Naivebayes classifier,SVM,DecisionTree etc. $\endgroup$ Jul 21, 2019 at 6:33