Questions tagged [stacking]
The stacking tag has no usage guidance.
14
questions
5
votes
1
answer
652
views
Can Boosting and Bagging be applied to heterogeneous algorithms?
Stacking can be achieved with heterogeneous algorithms such as RF, SVM and KNN. However, can such heterogeneously be achieved in Bagging or Boosting? For example, in Boosting, instead of using RF in ...
- 177
2
votes
2
answers
436
views
Stacking: Use predictions of train or test to create features for level 1 classifier
The question is pretty simple.
In stacking, the predictions of level 0 models are being used as features to train a level 1 model.
However, the predictions of what data? Intuitively it makes more ...
- 636
2
votes
0
answers
70
views
Transfer learning for tabular data
I wonder if transfer learning can be used in tabular data similarly to how it's used in neural networks for image recognition. My idea would be to train a "general" model and then "...
- 135
1
vote
1
answer
764
views
How to use SMOTE in Stacking in SKLearn?
I have a data set X,y and split them to train and test data.
...
- 201
1
vote
0
answers
68
views
Feature Importance in Stacked Model
I have built a stacked model using mlxtend StakingCVClassifier. I want to know the feature importance scores now. Is there any way I can calculate feature importance scores for the stacked model? If ...
- 11
1
vote
0
answers
181
views
How does stacking help Bias and Variance?
How does stacking help in terms of bias and variance?
I have a hunch that stacking can help reduce bias but i am not sure, could someone refer to a paper?
1
vote
0
answers
20
views
Stacking: How to best treat base learner?
With stacking, several (diverse) base learners are used to predict the dependent variable $\hat{y}_{b,m}=\beta_{b,m} X$ in a hold-out set, where $m$ are base learner models $1,...,n$. These ...
- 7,596
0
votes
1
answer
597
views
Feature importance difference in two similar machine learning models
Situation 1:
I have trained a text classification model (Model 1) which gives me a probability of true class as X. I have also trained a classification model (Model 2) using only the categorical and ...
0
votes
1
answer
105
views
Understanding of stacking
I use various autoML solutions so I can't stack my models directly (for example via StackingClassifier, mlextend or as layers in keras) so I want to implement my own pipeline for this case using only ...
- 1
0
votes
1
answer
219
views
Fit multiple models e.g classifiers -> stacking -> calibration without data-leak or getting too many datasets
I have some data X on which I want to do the following:
Train two models; SVM and Logistic Regression
Use a stacking classifier based on the models from (1)
...
- 510
0
votes
1
answer
954
views
Feature Selection using Stacking Ensemble?
I want to combine some estimators, such as Logistic Regression, Gaussian NB and ...
- 45
0
votes
1
answer
57
views
What kind of algorithms can be used as a stacker in stacked generalization?
In stacked generalization, several algorithms (I use some random trees, booster trees, etc.) are first trained and used to make the predictions which are used as input for another algorithm. However, ...
- 1,289
0
votes
0
answers
21
views
Stacking realization problems
I have two dataframes: x_train with features got from base models and y_train with ground true labels of these features using cross_validation.
...
- 1
0
votes
0
answers
210
views
KeyError: 'Resize' Error in converting from ONNX model to keras
I am trying to convert an ONNX model to a Keras model using onnx2keras, so that I can implement this: (https://machinelearningmastery.com/stacking-ensemble-for-deep-learning-neural-networks/) stacking ...
