Questions tagged [perplexity]

For questions related to Perplexity, a measurement of how well a probability model predicts a sample. In NLP, perplexity is a way of evaluating language models

Filter by
Sorted by
Tagged with
2 votes
0 answers

Perplexed by perplexity

I've seen 2 definitions of the perplexity metric: $PP = 2^{H(p)}$ and $PP = 2^{H(p, q)}$ If I'm understanding correctly, the first one only tells us about how confident the model is about its ...
omer sahban's user avatar
1 vote
0 answers

Best measure to indicate quality of LDA model

On my corpora, I am running LDA with different settings (I experiment with different number of topics, different different ngrams and TFIDF or regular BOW). Now, I want to rank these setups to select ...
Emil's user avatar
  • 179