2
$\begingroup$

I used Decisiton Tree Classifier which I trained with 50 000 samples. I have also set with unlabeled samples, so I decided to use self training algorithm. Unlabeled set has 10 000 samples. I would like to ask if it is normal, that after retrainig model with these 10 000 unlabeled samples, accuracy didn't chaned as well as confusion matrix has same values? I expected some changes (better or worse prediction). Thank you in advance.

$\endgroup$
1
  • $\begingroup$ Out of curiosity, how to you retrain the model with the unlabeled samples? What is the target/loss? $\endgroup$
    – lpounng
    Commented May 12, 2022 at 3:16

1 Answer 1

1
$\begingroup$

Well, that is a bit of a turn down but: your model has limitations.

If the 50.000 data forms a complete set for your problem that means that more data won't be needed or helpful.

What do I mean by complete set is: there are enough samples to form a full rank correlation matrix in your feature space. So from your samples you can get a set that can generate all other samples in your feature space by linear combination.

Also, while your data might represent everything a decision three needs to know for classificating your data in the generated feature space, there may be other feature spaces that benefit from the extra data (such as deeper trees or other models)

You might try helping you decision tree by providing a few normalizations for data and feature engineering

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.