I have used all types of classification algorithms on my dataset yet I couldn't improve my score no matter how I try.

So I've read about Xgboost classifier. So I was wondering is it practical to use xgboost on a dataset with around 1000 rows.

Please let me know.


Yes, XGBoost is famous for having been demonstrated to attain very good results using small datasets often with less than 1000 instances.

Of course when choosing a machine learning model to fit your data, the number of instances is important and is related to the number of model parameters you will need to fit. The greater the number of parameters in the model the more data you will need to reduce the bias of your final model. If you do get good results using a complex model on very few instances then there is a high probability that you are overfitting. For example 1000 instances is hardly enough to fit a deep neural network.

That being said, the distribution of your classes and the noise in the data is always going to be a limiting factor to how well any model you select will fit your data.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.