I have a model that predicts multiple choice answers to questions. I used an 80/20 train test split of my questions and tuned it.
The questions actually form part of a game aka 10 questions in a game. The data when split was randomly shuffled and split so the questions no longer form part of a game.
Can I now use the same questions it was trained and tested on to re-test all the questions but in order to determine the percentage of games won? Or when initially training my model should the train and test data be split by games instead of questions?