Questions tagged [xgboost]

For questions related to the eXtreme Gradient Boosting algorithm.

131 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
0
votes
0answers
24 views

records with perfect correlation to the answer. Drop or Keep?

I have about 1000 records (5 numeric, 5 categorical vars) and about 25 of them have something in 5-level categorical variable that just gives away answer. It's just too obvious and I'm not worried ...
0
votes
0answers
90 views

After training an XGBoost model with a survival:cox objective, how can I get individual survival predictions for new data?

I have a large dataset and used the documentation found here to create an xgboost data object, trained my xgboost model, and then computed a c-statistic to determine the quality of the model. I am ...
0
votes
0answers
31 views

I have tried 5 different types of model but all returns really low training accuracy (~64%) and low testing accuracy (~14%). What should I do?

I am working with a typical regressor problem. There are $6$ features in the dataset that I am concerned with. There are about $800$ data points in my dataset. The features and the predicted values ...
0
votes
0answers
37 views

How to test model accuracy on new vs. historical data?

I created an XG Boost model to predict churn using a dataset of customers who were sold during 2018. The accuracy of the model is 89%. Does it make more sense to re-pull the 2018 dataset, where more ...
0
votes
0answers
88 views

XGBClassifier Feature Order

I'm working with XGBClassifier from the XGBoost Python API and recently found out that the class requires feature columns to be in the same order for predictions as they were used for training. For ...
0
votes
0answers
24 views

Using bagging and random forests together

I was looking at a kernel implementation (for text classification) and the following piece of code got me a little bit confused (I removed part of the features - in order to keep it light - as most of ...
0
votes
1answer
16 views

Product Prediction to group of customers

I have multiple groups of customer, say for segment 1 as shown in the pictures, I have a list of products that I can choose the cross-sell to that group. Consider ...
0
votes
0answers
143 views

Bad input shape; XGB

I'm trying out a simple code to test the xgboost library in python. My input matrix has 17 features and 16,718 observations X = (16718,17) My output has 3 ...
0
votes
0answers
79 views

XGBoost not learning

I have developed a train set for XGBoost to apply a learning to rank function on top of with the following parameters: ...
0
votes
1answer
57 views

GBM: small change in the trainset causes radical change in predictions

I have build a model using transactions data trying to predict the value of future transactions. The main algorithm is Gradient Boosting Machine. The overall accuracy on the testset is fine and there ...
0
votes
3answers
70 views

Can this problem be solved using deep learning?

I want to predict price of used cars. I have data like this: Is this problem suitable for deeplearning or Should I use XGBOOST, RandomForest etc.? I used one hot approach for nominal features and ...
0
votes
1answer
94 views

XGBOOST CV() producing error

I am getting the following error while using xgboost.cv() (scikit-learn interface). I am working on a regression problem. Below is the code and trace. No idea why ...
0
votes
0answers
33 views

Suggestion for model performance improvement for ML competition

I am working on highly imbalanced dataset and trying to increase accuracy(metric: roc_auc) of my model which is hovering around 82-83%. This is part of an internal ...
0
votes
0answers
52 views

Training xgboost model with more data having different characteristic

I have trained my model for ECG data which has 8528 ECG files having length 30s and sample rate 300 so total file length in csv ...
0
votes
1answer
836 views

XGBOOST (sklearn interface) REGRESSION error

I am trying to run a GRIDSEARCHCV (sklearn) on XGBRegressor. Documentation on the parameter says that if regression, then objective = reg:squarederror.(see https://...
0
votes
0answers
71 views

Reverse engineering on Xgboost model

I am doing experiments on https://www.physionet.org/challenge/2017/sources/ submission. I like one of the submission code, which use Xgboost to train the ...
0
votes
0answers
24 views

Multiple XGBoost models or just 1 for a cetain type of category?

I am building a model to predict, say house prices. Within my data I have sales and rentals. The Y variable is the price of either the sales or rentals. I also have ...
0
votes
0answers
72 views

Making a model to predict the error of another model

So basically I have a machine learning model where I want to have a prediction interval, the model is XGBoost so it is tricky to do Quantile Regression and I was looking for an alternative method to ...
0
votes
0answers
95 views

XGBoost becomes unstable when predicting more than ~300 classes

I'm using the Python implementation of XGBoosts (version 0.80) XGBoostClassifier to predict one of a large number of classes. My feature data consists of a sparse matrix of ~10M rows, ~5k columns, ...
0
votes
0answers
123 views

Using logLoss as metric function for highly unbalanced dataset

ihave an highly unbalanced dataset and the caret pacjage only allows me to select accuracy or kappa as performance metric. Is it correct to use a mlogloss function to compute model performance? Do you ...
0
votes
0answers
117 views

XGBoost feature significance and feature importance

In a regression model it is possible to judge at a specified significance level (often alpha = 5%) whether a variable has a significant influence on the target attribute. With XGBoost, you can use ...
0
votes
2answers
38 views

How to ensure same encoding pattern?

I created a XGBRegressor model with certain encoded 'object' dtypes in the data. Now if I want to run the model with new set of data which is freshly encoded it's giving wrong predictions. How to ...
0
votes
0answers
79 views

Validition score while training lower than on final model with xgboost

I have 3 three classes, but my metric is auc, so I have customer eval metric: ...
0
votes
0answers
77 views

Is plotting gain of XGBoost trees useful?

I am working on a XGBoost model for fraud detection (2 class classification) using XGBoost v0.7 on Spark. I am looking at different aspects of the model to find important features but also to ...
0
votes
0answers
74 views

XGBoost regression

I run XGBoost regression with tree as base learner. I have over 400 variables and more than 30000000 samples. I have generated most important features and was surprised to see that one feature is ...
0
votes
1answer
444 views

Improving prediction accuracy with XGBoost

I have a 32x20 matrix for which I am trying to use XGBoost (Regression). I am looping through rows to produce an out of sample forecast. I'm surprised that XGBoost only returns an out of sample ...
0
votes
1answer
2k views

How to show progress of sklearn.multioutput.MultiOutputRegressor and XGBRegressor?

Is it possible to show the training progress of the MultiOutputRegressor in sklearn? When a huge dataset is processed, my program runs a long time and I have no clue how long it will take. I have ...
0
votes
1answer
600 views

On which algorithm for boosting is the method xgbLinear of the xgboost/caret- package based on?

In caret package of R, there is a method 'xgblinear'. What is the working algorithm behind this method.
-1
votes
2answers
9k views

Determine accuracy of model on train data with Pandas DataFrame

I am trying to compare the accuracy of my XGBoost model output to that of a test set (data encoded in binary). My data is stored in a Pandas DataFrame. I am doing this with SKLearn by: ...
-1
votes
1answer
476 views

R: lightgbm is not using all the CPU?

When using xgboost, I can see my CPU is almost 100% percent, using the default settings of nthread. However, when using lightgbm, my CPU is only ~30%. I tried using ...
-1
votes
1answer
479 views

Q: xgboost regressor training on a large number of indicator variables results in same prediction for all rows in test

I'm training a XGBoost regressor in Python on a data set with a large number of indicator variables (one-hot-encoded from categorical variables) and a few numerical variables.The dataset size is over ...