New answers tagged activation-function
2
votes
Why softmax training is more stable
The short answer is: Yes, it is easier to train a model using SoftMax for multiclass classification compared to sigmoid, and SoftMax generally yields better results (lower loss and higher accuracy).
...
0
votes
What does the descision boundary of a relu look like?
Adding on Ben's answer above, for anyone like me struggling with geometric terminology, a polytopal region is essentially a space bounded by multiple flat surfaces.
For easy visualization, in 2D space,...
5
votes
Accepted
Which activation function for multi-class classification gives true probability (softmax vs sigmoid)
They don't represent true probability because you'd still have to calibrate your model.
Let's imagine you're trying to classify cats and dogs in a given set of images (binary classification problem, ...
Top 50 recent answers are included
Related Tags
activation-function × 176neural-network × 91
deep-learning × 69
machine-learning × 54
keras × 24
tensorflow × 12
backpropagation × 12
classification × 11
python × 10
regression × 10
loss-function × 10
cnn × 9
softmax × 9
gradient-descent × 8
convolutional-neural-network × 5
pytorch × 5
lstm × 4
autoencoder × 4
mathematics × 4
reinforcement-learning × 3
optimization × 3
numpy × 3
probability × 3
gradient × 3
sigmoid × 3