I am trying to make a CNN model on IAM handwritten words data(which has images of words handwritten by multiple people and targets are text in the images). So, I can encode words to numbers(A=0, B=1 and so on for capital, small and punctuation). But, I couldn't quite decide on what loss to use for this problem, in tensforflow.keras
.
I have found out about something called CTC loss on some repositories on GitHub. But, ctc loss was used with softmax as activation in final dense layer. And since softmax outputs probabilities for each class that sum up to 1; So, I presume softmax can't output probabilties for two "o"s at the same time.
So, what are the proper activation and loss functions that I can use for a problem like this one?