Questions tagged [ensemble]

The tag has no usage guidance.

12 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
6
votes
1answer
113 views

Gridsearch XGBoost for ensemble. Do I include first-level prediction matrix of base learners in train set?

I'm not quite sure how I should go about tuning xgboost before I use it as a meta-learner in ensemble learning. Should I include the prediction matrix (ie. df containing columns of prediction results ...
5
votes
1answer
178 views

Methods for ensembling ranked lists?

I was wondering if there's a good way to use ensembling when I have two or more algoritims producing ranked lists. That is, suppose I have the following datasets consisting of ordered lists (higher ...
3
votes
1answer
74 views

Physical modelling with neural networks - single output + stack ensemble vs multi-output

We are trying to replace an existing physical model (8 inputs/7 outputs) with artificial neural networks. The physics behind the existing model is mainly thermodynamics of humid air for air ...
3
votes
1answer
602 views

grid search - optimal weighting of classifiers

I am using three different of the shelf classifiers. It's a three class classification task. I want to calculate the optimal weights (c1weight, c2weight, c3weight) for each classifier (real task more ...
1
vote
0answers
41 views

How does stacking help Bias and Variance?

How does stacking help in terms of bias and variance? I have a hunch that stacking can help reduce bias but i am not sure, could someone refer to a paper?
1
vote
0answers
11 views

Domain specific language to describe ensemble model

I'm looking for some tool/library/widely used approach to describe Hierarchical Model structure like ensemble: It's absolutely straightforward how to do it with simple ensemble like It can be ...
1
vote
0answers
442 views

How to create an ensemble in tensorflow using tf.estimator?

I have created a neural network using tensorflow's estimator API: ...
0
votes
0answers
13 views

Is XGBoost active in the Gradient Boosting widget on the Orange platform?

When I open the Gradient Boosting widget xgboost is grayed out even though it is described in detail under the documentation section on Orange. The two options are Gradient Boosting (scikit-learn) and ...
0
votes
0answers
20 views

Tuning hyper parameters for different models with caretList

I'm trying to train an ensemble using the caretList function in the caret package. I'm using these models: ...
0
votes
0answers
19 views

How to write decider function for multiple models

I have trained two classifiers .. Text Classification and Image Classification. So both models gives score for each class. For example there are 3 classes. Each model give array of 3 confidence score ...
0
votes
0answers
24 views

Any insights on gradient boosting algorithms for classification task with large class number?

Recently I have been learning Gradient Boosting (GB) on multi-class classification. I searched Google Scholar for a while and found one paper on multi-class classification using GB 1. However, little ...
0
votes
0answers
70 views

What is the best way to use Early Stopping in an ensemble (stacking) model?

I have a training and a test dataset. I would like to use the output of Model A in an ensemble model. However, I would like to use early stopping. Usually, I would create Model A for each K-fold (on ...