# Are non-relu activations better for small/ dense datasets?

Building on the questions below, the only conclusion I could draw from the answers was that ReLu is less computationally expensive and better at sparsity.

Why is ReLU used as an activation function?

Why ReLU is better than the other activation functions

Am I better off using a smoother activation like tanh if I have a smaller, dense dataset?