I am a bit confused about the relation between terms "Dropout" and "BatchNorm". As I understand,
Dropout is regularization technique, which is using only during training.
BatchNorm is technique, which is using for accelerating training speed, improving accuracy and e.t.c. But I also saw some conflicting opinions about question: is BatchNorm regularization technique?
So, can somebody,please, answer some questions:
Is BatchNorm regularization technique? Why?
Should we use BatchNorm only during training process? Why?
Can we use Dropout and BatchNorm simultaneously? If we can, in what order?