4
$\begingroup$

Suppose I have data in the form of Query/Document Pairs, along with corresponding relevance scores (or class labels). Is there a way to use topic modeling to devise a model so that later given a query and a document, we can predict its relevance score?

$\endgroup$
  • $\begingroup$ Topic modeling might be a way to learn a representation of your text before applying supervised learning. However you might be able to use something as simple as tf-idf vectors $\endgroup$ – jamesmf Sep 25 '15 at 14:23
1
$\begingroup$

Certainly. A part of topic modeling output is typically some vector for each document describing it as a distribution over the topics in your model. You can use these as continuous-valued predictors for a classifier trained with the labels you have. I've done this before, but, depending on the domain characteristics of your problem, it may not be the best approach, but it is certainly a testable one!

|improve this answer|||||
$\endgroup$
0
$\begingroup$

Possible, yes, but why do you want to do this?

Topic modelling is a method of unsupervised learning with all it weaknesses.

With the type of data you sketch you can used methods of supervised learning that will be much more stable, less prone to overfitting, and more reliable in the long run.

|improve this answer|||||
$\endgroup$
  • 1
    $\begingroup$ Supervised Topic Models $\endgroup$ – Emre Sep 25 '15 at 19:43
  • $\begingroup$ @Emre: Interesting paper. Unlike unsupervised LDA, supervised LDA hasn't become popular, and even without trying I have some ideas why this is so. $\endgroup$ – user10169 Oct 6 '15 at 12:49

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.