Getting equal distributions of data from different input sets

Question

I am new to ML. I am trying to create a training dataset that is equally distributed between multiple lists, each of which have a different kind of data. How can I do this? I looked into GroupKMeansFold, and StratifiedFold but I don't fully understand it.

Here's more information:

1. I have three lists a, b, c.

  a = [a1, a2, a3.... a10000]
  b = [b1, b2, b3.... b10000]
  c = [c1, c2, c3.... c10000]

I want my training, test, and val data to have 70, 15, 15 splits. I also want the 70% of the training data to be equally distributed between lists a,b,c. Same with the test and val data.

I want the training data to have 70% of the data from a, b, and c. I want the val data to have 15% of the data from a,b, and c. I want the test data to have 15% of the data from a,b, and c

Answer 1

Imho it's possible that you're overthinking this:

Easy option: regular sampling

concatenate all three lists together, then shuffle the dataset and then take the first 70% elements as training set, the next 15% as validation set and the last 15% as test set.

This option is probably enough for your purposes, but the global random sampling means that the number of items from every list is approximate. For example the training set may have 6981 items from list a instead of 7000.

Serious option: stratified sampling

To be extremely precise about the proportions across lists, what you need is stratified sampling. Stratified sampling consists in sampling independently for every value of the target variable, in your case the list. This means for example:

• Pick 7000 items from a
• Pick 7000 items from b
• Pick 7000 items from c

The training set is the concatenation of the 21,000 items. Same process for validation and test set.