I have an LSTM model for action recognition. During inference, any random actions that are not labelled or the model has not learned at all are also predicted with very high confidence score. I checked label smooothing technique, which will reduce the confidence score of overconfident model. Still, the score of wrongly predicted samples are quite high. How can we solve such problem?