Questions tagged [lsi]

The tag has no usage guidance.

6 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
2
votes
0answers
18 views

Topic modelling on only 24 documents gives the same “topic” for any K

Description: I have 24 documents, each one of around 2.5K tokens. They are public speeches. My text preprocessing pipeline is a generic one, including punctuation removal, expansion of English ...
2
votes
0answers
129 views

Latent Semantic Indexing False Positive Detection

I am using the Gensim LsiModel. I have a set of documents and fixed set of topics. Some of the documents are already categorized, others are not. The goal is to categorize the uncategorized documents ...
1
vote
2answers
26 views

How to represent a document in test data with the Document-Term Matrix created from the training set?

I build a classifier of documents using the vector representation of each document in the training set (i.e a row in the Document-Term Matrix). Now I need to test the model on the test data. But how ...
1
vote
0answers
22 views

document similarity when the document size less than 30 tokens?

I was solving a problem to compare 3 million, 2018 documents against the 2019 documents. There are three text attributes to be compared from one item against the other. I used Latent Semantic Indexing ...
1
vote
0answers
156 views

What is “energy spectrum” in Latent Semantic Indexing (LSI)?

What is meant by energy spectrum in LSI(Latent Semantic Indexing)? I am doing topic modeling with gensim's LsiModel, and part of the output per chunk is the following: ...
0
votes
0answers
7 views

Can I use LSI (Latent Semantic indexing) to get similar docs for several documents at the same time?

I'm working on a Recommander system in which I'm using LSI to get similarities between videos. I wonder if I can provide to LSI matrix more than one document and get similar docs for all those. In the ...