Suppose there's a network with N hidden layers.

There are 2 cases:

  1. The network is deep
  2. The network is shallow

I've been wondering how N affects choosing the activation function.

Will it affect, for example, Sigmoid more than Leaky ReLU?


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.