I'm doing some experimentation with a CNN and have 2 conv layers with 32 and 64 filters respectively. I started out with 3x3 kernel sizes and noticed that when I increased it to 5x5, 7x7 etc the time per epoch shot up! Why is this? Is this simply due to the fact that more element wise calculations are necessary per pixel in the image?
1 Answer
It is expected to train a model slower as parameters increase. Here you add more computational cost by increasing kernel size.