1
$\begingroup$

For example, if I run a single round (nrounds=1), how does XGBoost go about making predictions? I thought it would simply return a linear regression model, but I quickly shot that theory down by working out an example.

Please note that I've already seen this and this and most of Google's top search results.

$\endgroup$

1 Answer 1

-2
$\begingroup$

gblinear uses linear functions, in contrast to dart which use tree based functions.

One primary difference between linear functions and tree-based functions is the decision boundary. Tree-based models decision boundaries are only piece-wise, perpendicular rules to each feature. Linear functions are monotonic lines through the feature space.

Tree-based functions tend to be more flexible. If the data is distributed closer to a line, then a linear function will be more parsimonious.

$\endgroup$
1
  • $\begingroup$ Can you be more specific? Which linear functions does it use? $\endgroup$
    – Ben
    Jul 10, 2021 at 21:12

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.