0
$\begingroup$

Say I have multiple domains such that d_i is drawn from D=[d_1, d_2, ... d_K]. We have two options to train a CNN which equally represents all domains.

  • Collect samples from all domains and create a batch B
  • Generate a batch B from a randomly chosen d_i and keep shuffling domains per iteration

My intuition tells me that option A is better. However, I do not know why. I am looking for research which touches upon this topic. I would also appreciate your intuition, choice of normalization layers and other tricks/techniques that helped you navigate this problem.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.