Questions tagged [topic-model]

A topic model describes text from a large corpus as a probability distribution over topics which are probability distributions over words. There are quantified contributions from all topics to a specific text.

Filter by
Sorted by
Tagged with
1
vote
1answer
10 views

Do weights of keywords for each topic add up to 1 in topic modeling?

I'm trying to ask a general question about topic modeling. When you run a topic modeling (say LDA), you can get outputs for some number of topics with corresponding keywords and their weights. Based ...
0
votes
0answers
24 views

Cluster images labels in some given categories using word embeddings

Given: set of images Labels in string format each one. Also I've given a set of Categories, also in string. ($Images \neq Categories $) Goal: I need to map given labels to given categories to "...
0
votes
1answer
12 views

Addressing polysemy in NLP tasks

Looking for modern algorithms using NN Language Model implementations addressing polysemy in NLP tasks, including text classification, question answering and topic modeling. Transfer/Zero-short ...
1
vote
1answer
15 views

What does updated alpha mean in LDA model?

I'm trying to understand LDA model by reading through implementations of the algorithm. Many implementations update alpha during training iterations with codes like: ...
1
vote
1answer
39 views

Hierarchical dirichlet process results

I am thinking about using hierarchical dirichlet process to model a patent dataset. I've seen that HDP uses a base distribution and assumes that every topic comes from that base distribution. The ...
0
votes
0answers
4 views

Simple approach to assign topic / heading to a text

I have an uncleaned text field something like Apple Juice xxx Newyork .. Store and a assigned topic Juice Centre. What are ...
0
votes
0answers
28 views

How to measure the Optimal-number of Topics & Topic-Coherence score in Orange's LDA Topic-Modeling?

I'm trying to build a suitable "code-free" Topic Model in "Orange Data Mining" software for the experimental part of my Thesis, in order to analyze the themes and trends of ...
0
votes
0answers
4 views

Vector dimensionality seems to be implemented incorrectly

I'm trying to implement a fuzzy topic modeling approach in Python based on a paper, which is accommodated with an R implementation from GitHub. In one of the first steps a document term matrix is ...
0
votes
0answers
12 views

How does LDA model do inference on new documents?

Through Latent Dirichlet Allocation (LDA) one can learn topics from texts. The trained topic model can then be used on unseen data to infer to what extent each of the learned topics are represented in ...
2
votes
1answer
248 views

Automatic topic labelling for topic modelling

I am just curious to know if there is a way to automatically get the lables for the topics in Topic modelling. It would be really helpful if there's any python implementation of it.
1
vote
1answer
2k views

How to map topic to a document after topic modeling is done with LDA

Is there any way I can map generated topic from LDA to the list of documents and identify to which topic it belongs to ? I am interested in clustering documents using unsupervised learning and ...
1
vote
1answer
44 views

Which approach to select category based on keywords

I want to assign a certain category to a group of keywords. So i.e. people can upload images or videos, when they do this they can set keywords for this. These keywords are free to type so words can ...
1
vote
1answer
17 views

LDA topic model has 0-weight topics, is that normal?

While experimenting with different number of topics for the Gensim implementation of LDA, I found that for a high number of topics, the output often consists of topics with all weights equal to zero. ...
1
vote
0answers
8 views

Best measure to indicate quality of LDA model

On my corpora, I am running LDA with different settings (I experiment with different number of topics, different different ngrams and TFIDF or regular BOW). Now, I want to rank these setups to select ...
0
votes
2answers
116 views

Topic models for non-textual data?

I am looking to employ an unsupervised clustering on a dataset where each observation has a mix of textual and non-textual features. For each observation, I combine the features into a single vector ...
1
vote
1answer
41 views

Classify documents using a set of known vocabularies

I have a bunch of documents that I want to classify which ones talk about soccer (unsupervised learning, I do not want to manually label the documents). One way I am thinking about is to go online ...
1
vote
1answer
369 views

Hellinger Distance in Gensim

I have set of documents as follows where each document has set of words that represents the content of it. ...
0
votes
0answers
22 views

Extract keywords from set of similar sentences by using python

I have a list of similar sentences, and I would like to automatically extract top-n important keywords [single word length] from a whole set of those sentences by using python. These sentences are ...
0
votes
1answer
24 views

Which tool is good to collect tweets on 50 keywords over the last 5 years and then analyze them with the LDA algorithm or sentiment analysis?

I want to find tweets from the last 5 years to a topic. For this I decide for 50 Keywords (related to the main topic), where I want to find data on Twitter. I want to find out how the trend on the ...
1
vote
0answers
27 views

Self-supervised learning for automatic labeling of data using LDA and Word2Vec

I am trying to implement this paper A Brand-New Look at You: Predicting Brand Personality in Social Media Networks with Machine Learning for labeling Twitter data of brands with a corresponding brand ...
27
votes
3answers
19k views

What is difference between text classification and topic models?

I know the difference between clustering and classification in machine learning, but I don't understand the difference between text classification and topic modeling for documents. Can I use topic ...
1
vote
1answer
46 views

How to build News Tagging model(s)

I am trying to build a news tagging system. Given a piece of news article, find 5-6 key terms from the news article that best describe the article. Refer to the image below from google news. What are ...
58
votes
6answers
26k views

Latent Dirichlet Allocation vs Hierarchical Dirichlet Process

Latent Dirichlet Allocation (LDA) and Hierarchical Dirichlet Process (HDP) are both topic modeling processes. The major difference is LDA requires the specification of the number of topics, and HDP ...
1
vote
1answer
26 views

How to compare topics generated from topic modeling from different datasets?

I have two datasets of a similar theme. Let's assume Dataset A and Dataset B. Using the top2vec model (https://github.com/ddangelov/Top2Vec) (https://arxiv.org/abs/2008.09470) on each dataset, I came ...
0
votes
1answer
59 views

Get most likely topic per document in pandas dataframe using gensim

I am using gensim LDA to build a topic model for a bunch of documents that I have stored in a pandas data frame. Once the model is built, I can call ...
2
votes
1answer
28 views

Tweet Classification into topics- What to do with data

Good evening, First of all, I want to apologize if the title is misleading. I have a dataset made of around 60000 tweets, their date and time as well as the username. I need to classify them into ...
1
vote
1answer
47 views

Classify tweets by topic [closed]

I am approaching machine learning for the first time because of my studies. I have been given a bunch of tweets and the goal is to classify them per topic. I really have no clue on how this should be ...
1
vote
2answers
444 views

Memory error - Hierarchical Dirichlet Process, HDP gensim

I am running Hierarchical Dirichlet Process, HDP using gensim in Python but as my corpus is too large it is throwing me following error: ...
0
votes
1answer
23 views

Twitter Data-Analyse: What can I do with the data?

I retrieve data to a specific topic from Twitter and did my sentiment analysis on it. I never did anything in NLP, etc. So what else can I do with that? "Main goal" would be to find out if ...
0
votes
0answers
25 views

Use KL divergence to label topics from LDA

I have used sklearn's sklearn.decomposition.LatentDirichletAllocation module to model 10 topics in a set of documents. I have also used the same on a reference text (1 document) and obtained a 1 topic ...
1
vote
0answers
61 views

Trying to use term document matrix as input to orange 3

I have a CSV file that has tokens as columns and documents as rows, where the rest of the cells are ints that represent term frequency. I'm trying to use this as input into Orange 3, but Orange 3 ...
3
votes
0answers
1k views

why the accuracy of LDA model is always changing and also is high

Let’s explain the whole goal firstly, then go through the question. I am using topic modeling like LAtent Dirichlet Allocation and NMF to extract the topic from a collection of documents. My dataset ...
7
votes
4answers
5k views

BERT: it is possible to use it for topic modeling?

I'm struggling to understand which are the full capabilities of BERT: it is possible to make topic modeling of text, like the one we can achieve with LDA?
1
vote
1answer
232 views

TF-IDF for Topic Modeling

Can TF-IDF be used a sole method for Topic Modeling ? (I know there are better methods like LDA , LSA etc) I just want to understand if TF-IDF alone can help us in Topic modeling . If yes , can ...
2
votes
1answer
948 views

Online vs Batch Learning in Latent Dirichlet Allocation using Scikit Learn

Reference I'm looking at the LDA algorithm from Scikit Learn for topic modeling. Can someone tell me how the 'online' method of learning works vs the 'batch' method of learning? Also, what is learning ...
4
votes
1answer
2k views

How can I run Labeled LDA over one textual document?

I have 200K tweets and I already a applied the LDA (Latent Dirichlet Allocation) algorithm using Gensim python library. And now I need to apply over them the labeled/supervised LDA. Can any one help ...
6
votes
4answers
5k views

How to give name to topics created using LDA?

I have categorized 800,000 documents into 500 categories using the Mahout topic modelling. Instead of representing the topic using the top 5/10 words for each topics, I want to infer a generic name ...
1
vote
1answer
19 views

Differerent ways to detect the appropriate number of topics

I implemet the LDA topic modeling in R. One essential parameter is the selection of the number of topics Which of the following ways could it be the most suitable: ...
0
votes
0answers
17 views

How to improve text classification using topic modeling feature vector?

I have a binary text classification problem. I am using the topic model(LDA) trained on Wikipedia to get the feature vectors to classify documents. I have tried Logistic Regression, Random Forest, ...
1
vote
1answer
109 views

Intuition of LDA

Can anyone explain how the LDA-topic model assigns words to topics? I understand the generative property of the LDA model but how does the model recognize that "Labrador" and "dog" are similar words/ ...
0
votes
1answer
47 views

How to identify topic transition in consecutive sentences using Python?

I'm new to data mining. I want to detect topic transition among consecutive sentences. For instance, I have a paragraph (this could be a collection of dozens of sentences, sometimes without ...
0
votes
1answer
38 views

Topic Similarity Measure | Multi-class Text Classification Model

I am trying to build a multi class text-classifier that classifies whether the tweet belongs to one of the categories ( Advise or Science or others ) let the input be any tweet like this , Input : <...
1
vote
1answer
37 views

How to perform topic modelling on query search results

How can I model topics in the results returned by a search engine with higher weightage to documents ranked higher in the result set? The use case that I am looking at involves extracting the most ...
1
vote
1answer
171 views

What does online learning mean in Topic modeling (LDA) - Gensim

I came across this line in the Gensim Documentation- Gensim LDA - "The model can also be updated with new documents for online training." So my assumption on what it means is - 'Once we have a ...
1
vote
2answers
41 views

Reaching 100% accurray in Data Mining

I am currently working with Topic Models, especially LDA, and now I am asking myself if it's possible to reach total accurracy regarding the results. If I insepct the results of my Topic Model, the ...
2
votes
1answer
405 views

What metrics must i use in my data(unstructured) preprocessing research?

i am currently working on preprocessing unstructured data (emails,logs,bug reports and irc chats). i wish to prove preprocessing improves the content quality. are there metrics available to prove ...
3
votes
3answers
1k views

scikit-learn - Should I fit model with TF or TF-IDF?

I am trying to find out the best way to fit different probabilistic models (like Latent Dirichlet Allocation, Non-negative Matrix Factorization, etc) on sklearn (Python). Looking at the example in ...
1
vote
1answer
60 views

how to do topic modeling on very huge data?

When i come to know that gensim is useful library for topic modeling, I tried it on my huge amount of document. It works well only if the dictionary size is to be fix. In my case i have each and every ...
2
votes
0answers
18 views

Topic modelling on only 24 documents gives the same “topic” for any K

Description: I have 24 documents, each one of around 2.5K tokens. They are public speeches. My text preprocessing pipeline is a generic one, including punctuation removal, expansion of English ...