Skip to main content
Edited math equations to enhance readability.
Source Link
ebrahimi
  • 1.3k
  • 7
  • 20
  • 40

Please see this answer:

https://stats.stackexchange.com/q/174438answer.

An activation function is considered non-satured if

$$ \lim_{z \rightarrow \infty} f(z) = \infty $$

A saturated activation function has a compact range such as $[-1,1]$ for $\tanh$ or $[0,1]$ for the sigmoid.

Please see this answer:

https://stats.stackexchange.com/q/174438

An activation function is considered non-satured if

$$ \lim_{z \rightarrow \infty} f(z) = \infty $$

A saturated activation function has a compact range such as $[-1,1]$ for $\tanh$ or $[0,1]$ for the sigmoid.

Please see this answer.

An activation function is considered non-satured if

$$ \lim_{z \rightarrow \infty} f(z) = \infty $$

A saturated activation function has a compact range such as $[-1,1]$ for $\tanh$ or $[0,1]$ for the sigmoid.

Please see this answer:

https://stats.stackexchange.com/q/174438

An activation function is considered non-satured if limz→∞f(z)=∞

$$ \lim_{z \rightarrow \infty} f(z) = \infty $$

A saturated activation function has a compact range such as [-1,1]$[-1,1]$ for tanh$\tanh$ or [0,1]$[0,1]$ for the sigmoid.

Please see this answer:

https://stats.stackexchange.com/q/174438

An activation function is considered non-satured if limz→∞f(z)=∞

A saturated activation function has a compact range such as [-1,1] for tanh or [0,1] for the sigmoid.

Please see this answer:

https://stats.stackexchange.com/q/174438

An activation function is considered non-satured if

$$ \lim_{z \rightarrow \infty} f(z) = \infty $$

A saturated activation function has a compact range such as $[-1,1]$ for $\tanh$ or $[0,1]$ for the sigmoid.

Source Link

Please see this answer:

https://stats.stackexchange.com/q/174438

An activation function is considered non-satured if limz→∞f(z)=∞

A saturated activation function has a compact range such as [-1,1] for tanh or [0,1] for the sigmoid.