Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [ensemble]

The tag has no usage guidance.

1
vote
2answers
31 views

How to visualize Ensemble Models ( Random Forest) with 1000 estimators

I am working on classification problem where I need to categorize the user in buy/ non-buy category. I have around 100 + features or predictors to predict the behavior of user. I tried to implement ...
0
votes
0answers
51 views

How to create an ensemble in tensorflow using tf.estimator?

I have created a neural network using tensorflow's estimator API: ...
0
votes
0answers
23 views

Selecting the best combination of machine learning models for voting

I am thinking about using Sklearn's VotingClassifer for a dataset. I have heard about people winning in machine learning competitions (like those from Kaggle) by correctly utilizing voting/stacking. ...
0
votes
0answers
54 views

Why using out-of-fold prediction in model stacking?

So my question is essentially the same as this one: Why do we generate out-of-fold predictions for meta-ensembling/stacking? However, I am not entirely satisfied with the answer (not detailed enough ...
2
votes
2answers
54 views

xgboost cannot identify perfectly fitting regression line

For a dataset I want to use xgboost for the optimal ensembling of $n$ forecasts instead of just using their arithmetic mean for combination. I found that xgboost generates forecasts that are worse ...
3
votes
0answers
32 views

Gridsearch XGBoost for ensemble. Do i include first-level prediction matrix of base learners in train set?

I'm not quite sure how i should go about tuning xgboost before i use it as a meta-learner in ensemble learning. Should i include the prediction matrix (ie. df containing columns of prediction results ...
0
votes
0answers
22 views

A question about stacking, why should I use the second level of model to predict the prediction of the first level of models

We firstly use the first level of models to predict the whole training data as our new training data and predict the whole test data as our new test data of the second level of model. My question ...
3
votes
1answer
132 views

Geometric and harmonic means in ensembling methods

When using ensembling methods for regression, a common approach is to average (using the arithmetic mean) the outputs of the weak learners in order to obtain the output of the ensemble. Is there a ...
3
votes
1answer
42 views

Methods for ensembling ranked lists?

I was wondering if there's a good way to use ensembling when I have two or more algoritims producing ranked lists. That is, suppose I have the following datasets consisting of ordered lists (higher ...
2
votes
2answers
96 views

How to create an ensemble that gives precedence to a specific classifier

Suppose that in a binary classification task, I have separate classifiers A, B, and C. If I ...
0
votes
0answers
38 views

Can I automate stacking?

I have learned that stacking different methods works well for machine learning problems? Do we have a clear text (any book/article/blog) that can state which methods to stack were in the layers (base ...
3
votes
1answer
70 views

Can clustering my data first help me learn better classifiers?

I was thinking about this lately. Let's say that we have a very complex space, which makes it hard to learn a classifier that can efficiently split it. But what if this very complex space is actually ...