I am dealing with class imbalance problem. In this case, I am down sampling the majority class lables in the training set.
Among training, validation and test splits, the majority class in training split is down-sampled, and test split is retained as it is. However, should the validation split be downsampled according to the training-set or should it be retained as it is?
This is because the validation set controls the training process.