What is the difference between leave one subject out cv and leave one out cross validation (loocv)? are they same or different?. I have images of 24 subject and according to literature, leave one subject out is best cross validation for pain expression detection because of its subjective nature. is there any function for leave one subject out cv in sklearn like loocv? or I have to manually hold out one subjects images (one subject out of 23) and train for rest 23 subjects? is it right approach ?
Leave one out subject makes it sure that you don't have subject bias.
The fact that you have the same subject in your training and your testing datasets will make the model know more about your subject than it should. With a brand new subject, the model will probably perform poorly because it never trained on the subject before.
There is no such tool available in sklearn, as it's very easy to build your own if the subject id is a column in your dataset.