Data Science Stack Exchange is a question and answer site for Data science professionals, Machine Learning specialists, and those interested in learning more about the field. It only takes a minute to sign up.
Sign up to join this community
I build my CNN on Keras, normally in the ImageDataGenerator I saw the rescale = 1. / 255 used to normalize input data (pixel value) from [0-255] to [0-1]. Then I read about Batch Normalization Layer, I wonder if they are mutually-exclusive or can they be used together in the same network?
I have tried to adapted the BN Layer to my network (BN after every activation Layer) but the loss fluctuates more than without using BN.
Its is basically not really important to rescale your input to [0,1]. Your input data should simply be in the same range. So [0,255] would be also a legit range.
BN should be different to interpret. It helps to keep your activations through the whole network on the same level. It is especially helpfull when we talk about deeper archtitectures. Actually when you spend some extra time/iterations, your network should also converge without BN.
