1
$\begingroup$

Suppose there's a network with N hidden layers.

There are 2 cases:

  1. The network is deep
  2. The network is shallow

I've been wondering how N affects choosing the activation function.

Will it affect, for example, Sigmoid more than Leaky ReLU?

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.