Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [ensemble]

The tag has no usage guidance.

0
votes
0answers
13 views

Choosing the right hyperparameter and score for building ensemble

I want to build an ensemble model from individual classifiers(e.g KNN,SVM etc) for classification purpose. Before building the ensemble mode, I want to select the best hyperparameter from the ...
0
votes
0answers
6 views

How to apply ensemble methods in a semantic segmentation task?

Let's say I have a task with only 3 classes - 0, 1 and 2. I have built some different classifiers to make pixel-wise predictions for input images. But what would be a proper way to combine their ...
0
votes
0answers
12 views

Ensemble of LSTM (for text) and machine learning models based on bagging or voting techniques

Are there any good kernels or blogs on ensemble of LSTM (on textual data) and machine learning models like Naive Bayes, Random Forest, Gradient Boosting etc. (on meta data of text) Ex data: ...
1
vote
2answers
34 views

How to visualize Ensemble Models ( Random Forest) with 1000 estimators

I am working on classification problem where I need to categorize the user in buy/ non-buy category. I have around 100 + features or predictors to predict the behavior of user. I tried to implement ...
0
votes
0answers
121 views

How to create an ensemble in tensorflow using tf.estimator?

I have created a neural network using tensorflow's estimator API: ...
0
votes
0answers
28 views

Selecting the best combination of machine learning models for voting

I am thinking about using Sklearn's VotingClassifer for a dataset. I have heard about people winning in machine learning competitions (like those from Kaggle) by correctly utilizing voting/stacking. ...
0
votes
0answers
77 views

Why using out-of-fold prediction in model stacking?

So my question is essentially the same as this one: Why do we generate out-of-fold predictions for meta-ensembling/stacking? However, I am not entirely satisfied with the answer (not detailed enough ...
2
votes
2answers
66 views

xgboost cannot identify perfectly fitting regression line

For a dataset I want to use xgboost for the optimal ensembling of $n$ forecasts instead of just using their arithmetic mean for combination. I found that xgboost generates forecasts that are worse ...
3
votes
0answers
44 views

Gridsearch XGBoost for ensemble. Do i include first-level prediction matrix of base learners in train set?

I'm not quite sure how i should go about tuning xgboost before i use it as a meta-learner in ensemble learning. Should i include the prediction matrix (ie. df containing columns of prediction results ...
0
votes
0answers
23 views

A question about stacking, why should I use the second level of model to predict the prediction of the first level of models

We firstly use the first level of models to predict the whole training data as our new training data and predict the whole test data as our new test data of the second level of model. My question ...
3
votes
1answer
196 views

Geometric and harmonic means in ensembling methods

When using ensembling methods for regression, a common approach is to average (using the arithmetic mean) the outputs of the weak learners in order to obtain the output of the ensemble. Is there a ...
3
votes
1answer
52 views

Methods for ensembling ranked lists?

I was wondering if there's a good way to use ensembling when I have two or more algoritims producing ranked lists. That is, suppose I have the following datasets consisting of ordered lists (higher ...
2
votes
2answers
103 views

How to create an ensemble that gives precedence to a specific classifier

Suppose that in a binary classification task, I have separate classifiers A, B, and C. If I ...
0
votes
0answers
39 views

Can I automate stacking?

I have learned that stacking different methods works well for machine learning problems? Do we have a clear text (any book/article/blog) that can state which methods to stack were in the layers (base ...
3
votes
1answer
71 views

Can clustering my data first help me learn better classifiers?

I was thinking about this lately. Let's say that we have a very complex space, which makes it hard to learn a classifier that can efficiently split it. But what if this very complex space is actually ...