I have the feeling that these terms often are used as synonyms for one another, however they have the same goal, namely increasing prediction accuracy by combining different algorithms.

My question thus is, is there a difference between them? And if so is there some book/paper that explains the difference?


Here is a para that I found by searching What are hybrid methods in Machine Learning, on google.

"In general, it is based on combining two different machine learning techniques. For example, a hybrid classification model can be composed of one unsupervised learner (or cluster) to pre-process the training data and one supervised learner (or classifier) to learn the clustering result or vice versa." Along with that example, let's consider an example of Ensemble Learning that is Random Forest. *

In classical ensemble learning, you have different or similar algorithms, working on different or the same data-sets (for example Random Forest Stratifies the data set and builds different Decision Trees for those data-sets, while at the same time you can build different models on the same unstratified data-set and create an ensemble method). So in essence, you have different machine learning models, working independently of each other to give a prediction and then there is a voting system (hard or soft voting) which determines the final prediction.

According to the example of the hybrid machine learning model that we saw, the models in hybrid machine learning models essentially feed their output to one another (one-way) in an effort to create an efficient and accurate machine learning model. So the difference in both is that ensemble methods work independently to vote on an outcome while hybrid methods work together to predict one single outcome, which no voting element present in it.


  • $\begingroup$ So ensemble takes different algorithms and then aggregates the results (mean, voting, ...) whilst hybrid methods feeds these results in a new model to get the result? $\endgroup$ – Tibo Geysen May 29 '20 at 13:35
  • $\begingroup$ See from the examples that I saw, you are bang on point|. They both differ in how they predict the result in general. Although they both involve different models at one time, the models behave differently. $\endgroup$ – Pushkaraj Joshi May 29 '20 at 17:08
  • $\begingroup$ Hi @TiboGeysen please accept my answer if there is no other answer. Also, i believe I have satisfactorily answered your question. $\endgroup$ – Pushkaraj Joshi Jun 10 '20 at 5:48

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.