Let's say that I have a model that can recognize Cats and Dogs. However, when I use a picture of a Cup or Human it generates a random prediction at 0.70 confidence. Should I use sigmoid instead of softmax?
Or is there any fix for preventing massive confidence on new class object?