Skip to main content

All Questions

Filter by
Sorted by
Tagged with
0 votes
0 answers
39 views

Does row order impact how a CatBoost algorithm is trained?

I'm dealing with an issue where I'm unable to replicate a particular result that I had previously obtained with CatBoost, using the same dataset (but where the rows are in different order). First, I ...
2 votes
0 answers
128 views

Tuning the learning rate parameter for GBDT models

I've always been taught that decreasing the learning rate parameter in gbdt models such as XGBoost, LightGBM and Catboost will improve the out-of-sample performance, assuming the number of iterations ...
1 vote
0 answers
63 views

Intuition behind catboost encoding techniques

Can anyone please help me in understanding the effect of various bucketing techniques used in CatBoost Algorithm for categorical features? Like there is border, buckets, binarized target mean, counter ...
1 vote
0 answers
223 views

How to tune a Catboost Regressor

I have been trying to study about hyperparameter tuning for CatBoost regressor for my regression problem. The only issue being I can't figure out what all parameters should I tune for my use case out ...
0 votes
1 answer
572 views

Catboost not able to handle a very simple dataset?

This is a post from a newbie and so might be a really poor question based on lack of knowledge. Thank you kindly! I'm using Catboost, which seems excellent, to fit a trivial dataset. The results are ...
23 votes
1 answer
18k views

Lightgbm vs xgboost vs catboost

I've seen that in Kaggle competitions people are using lightgbms where they used to use xgboost. My question is: when would you rather use xgboost instead of lightgbm? What about catboost?
1 vote
0 answers
2k views

How to use the eval set in catboost appropriately?

Let's say you have a dataset, and you split it into 80% training and 20% testing. Naturally, you want to find the optimal hyperparameters for your model, so with the training set, you plan to do cross ...
6 votes
1 answer
853 views

How to achieve SHAP values for a CatBoost model in R?

I'm asked to create a SHAP analysis in R but I cannot find it how to obtain it for a CatBoost model. I can get the SHAP values of an XGBoost model with ...
0 votes
1 answer
30 views

How do Classification Algorithms such as Catboost and Random Forest parse test data?

I would like to know how classification works with the algorithms listed above. My specific question is this, say I have a high signal continuous feature which has a certain distribution and I train a ...