I want to use a pre-trained natural-language-inference model as a zero-shot text classifier, using the transformers package.
I have a set of topics, 'technology', 'science', 'politics', 'religion'. Each document in my corpus could be about multiple of these topics (multi-label). I now have the output, scores for each topic for each document.
I would now like to set a threshold on these scores, so that I can say whether each document is or is not about each of the topics. This will help to make the output easier to understand and allow me to calculate statistics about the number of documents on each topic. How should I set this threshold? Should the threshold be the same for each topic?