1
$\begingroup$

I have the feeling that these terms often are used as synonyms for one another, however they have the same goal, namely increasing prediction accuracy by combining different algorithms.

My question thus is, is there a difference between them? And if so is there some book/paper that explains the difference?

$\endgroup$

2 Answers 2

1
$\begingroup$

Here is a para that I found by searching What are hybrid methods in Machine Learning, on google.

"In general, it is based on combining two different machine learning techniques. For example, a hybrid classification model can be composed of one unsupervised learner (or cluster) to pre-process the training data and one supervised learner (or classifier) to learn the clustering result or vice versa." Along with that example, let's consider an example of Ensemble Learning that is Random Forest. *

In classical ensemble learning, you have different or similar algorithms, working on different or the same data-sets (for example Random Forest Stratifies the data set and builds different Decision Trees for those data-sets, while at the same time you can build different models on the same unstratified data-set and create an ensemble method). So in essence, you have different machine learning models, working independently of each other to give a prediction and then there is a voting system (hard or soft voting) which determines the final prediction.

According to the example of the hybrid machine learning model that we saw, the models in hybrid machine learning models essentially feed their output to one another (one-way) in an effort to create an efficient and accurate machine learning model. So the difference in both is that ensemble methods work independently to vote on an outcome while hybrid methods work together to predict one single outcome, which no voting element present in it.

*https://www.sciencedirect.com/science/article/pii/S1568494609001215

$\endgroup$
3
  • $\begingroup$ So ensemble takes different algorithms and then aggregates the results (mean, voting, ...) whilst hybrid methods feeds these results in a new model to get the result? $\endgroup$ May 29, 2020 at 13:35
  • $\begingroup$ See from the examples that I saw, you are bang on point|. They both differ in how they predict the result in general. Although they both involve different models at one time, the models behave differently. $\endgroup$ May 29, 2020 at 17:08
  • $\begingroup$ Hi @TiboGeysen please accept my answer if there is no other answer. Also, i believe I have satisfactorily answered your question. $\endgroup$ Jun 10, 2020 at 5:48
0
$\begingroup$

Hybrid usually implies - symbolic + subsymbolic learning (KG/Rule-Based + ML/DL)

Ensemble Learning implies - similar/dissimilar methods competing against each other to reduce error where the models are usually defined in subsymbolic learning (SVM + KNN, Random Forest, etc)

where symbolic learning is defined as traditional rule-based methods and sub-symbolic learning as probabilistic methods.

$\endgroup$
1
  • $\begingroup$ Can you please provide some references for your definitions. $\endgroup$
    – Lynn
    Sep 18, 2022 at 5:14

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.