I'm building LDA topic models in to apply against a collection of small texts and regardless of the number of topics, I'm finding that there is always one topic that is very large (in terms of representation) and the rest are very small;

This is a histogram of the strength of topics within the texts;

This is a histogram of the strength of topics within each of the texts

I'm not sure whether it's my settings of the LDA or not, there aren't any obvious articles online of people having a similar problem.

These are the parameters I'm feeding;

lda_model = gensim.models.LdaMulticore(bow_corpus, 
                                   alpha = 1.0/clusters,

Could it also be the size of the texts? This is a histogram (with log_y) of the distribution of the number of words in the text;

enter image description here

  • $\begingroup$ Hi, could you add the line of code you used to generate the histograms? And also: could you describe what the documents are like? Fi: How many words per document, where do they come from and how varied are they? $\endgroup$ – S van Balen May 16 '19 at 15:33

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.