Questions tagged [perplexity]
For questions related to Perplexity, a measurement of how well a probability model predicts a sample. In NLP, perplexity is a way of evaluating language models
2
questions
2
votes
0
answers
49
views
Perplexed by perplexity
I've seen 2 definitions of the perplexity metric:
$PP = 2^{H(p)}$
and
$PP = 2^{H(p, q)}$
If I'm understanding correctly, the first one only tells us about how confident the model is about its ...
- 31
1
vote
0
answers
79
views
Best measure to indicate quality of LDA model
On my corpora, I am running LDA with different settings (I experiment with different number of topics, different different ngrams and TFIDF or regular BOW).
Now, I want to rank these setups to select ...
- 179