What is the best optimizer for Convolutional neural network (CNN)?

Can I use RMSProp for CNN or only for RNN?


Yes, you can use the same optimizers you are familiar with for CNNs.

I don't think that there is a best optimizer for CNNs. The most popular in my opinion is Adam. However some people like to use a plain SGD optimizer with custom parameters.

An excellent article explaining the differences between most popular gradient descent based optimizers can be found here.

  • $\begingroup$ I get better accuracy with default valued SGD than ADAM. I read somewhere that that tends to be the case with CNN's. I'm actually looking for a more definitive answer that does recommend and explain why one is better than the other, as I don't seem to be the only one noticing this when optimizing a CNN. towardsdatascience.com/… $\endgroup$ Feb 28 '20 at 1:18

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.