Is XGBoost complete by itself for prod-strength machine learning? If not, with which other tools or libs is it typically combined, and how?

(I recently read a description of a stack that included ca 5 pieces, including XGBoost and Keras.)


Yes, it is a full-strength Machine Learning paradigm.

XGBoost is basically Extreme Gradient Boosting.

It only takes in numeric matrix data. So, you might want to convert your data such that it is compatible with XGBoost.

The wide range of parameters of the xgboost paradigm is what makes it so diverse. Boosting can be done on trees and linear models, and then more parameters can be defined depending on the model you have selected.

So, yes it is a complete paradigm in itself. But, when you want more than the limitations of xgboost like linear and tree models, then you can use the concept of ensembling.

In the case of ensembles, the tools/libraries which can be used depends on the data scientist who is conducting the experiment. It can be Keras or Theano or TensorFlow, or anything which he/she is comfortable with. (opinion-based)

  • $\begingroup$ Thanks for the quick reply. Can you be more specific on the required numeric data type? Can it take vectors? (Or to what must one convert labels?) Does it do any type or range inference? $\endgroup$ – Adam Bittlingmayer Nov 22 '15 at 19:54
  • 1
    $\begingroup$ @AdamM.B. Nice doubt. XGBoost takes inputs in the format of DMatrices. So, you need to convert your data into that form. Link $\endgroup$ – Dawny33 Nov 23 '15 at 1:36

Your Answer

By clicking "Post Your Answer", you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.