Is hyperparameter tuning done on training or validation data set? The post here gives mixed opinion as of whether the training set should be used for hyperparameter tuning. And I would like to know whether hyperparameter tuning can be done on training data set?
More, I want to know what are the consequences for why we should/should not hyperparameter-tune on training dataset.
Thanks in advance!