All Questions
Tagged with nltk scikit-learn
10 questions
1
vote
1
answer
107
views
Number of stop words variation in libaries sklearn and nltk
Is there a reason why there is a big variation in the number of stop words? I assumed that there would be a general agreement from English experts how many stop words there could be. And even with ...
3
votes
1
answer
536
views
Is there a way to map words to their synonyms in tfidf?
I have the following code:
...
0
votes
1
answer
443
views
Where does spacy, nltk, prodigy, sklearn fit in the AI project?
Where does tools like spacy, sklearn, prodigy, nltk fit in the below AI project architecture and what are some common alternatives to these:
0
votes
1
answer
226
views
Text PreProcessing not improving accuracy
I was wondering if TfidfVectorizer() from scikit-learn and its methods fit_transform/transform already do language preprocessing like lowercase/lemmatization/removing punctuation. I am using Imdbs ...
1
vote
1
answer
532
views
sentiment analysis nltk python
I'd like to perform sentiment analysis on stock comment using scikit and nltk. I already have about 100 comments on different stocks like "this stock will rock" which I marked as positive (1) or "this ...
0
votes
2
answers
100
views
How to select features for clustering to detect the number of different unique products in a search result?
I am trying to use clustering to determine the number of products in a search of products. So far I am using kmeans clustering. I have run into a problem where I cannot determine good features to use. ...
7
votes
2
answers
2k
views
Combining Machine Learning classifier with NLTK Vader for Sentiment Analysis
As a part of my university project, I am researching/developing a sentiment analysis model wherein I am trying to combine NLTK Vader (SentimentIntensityAnalyzer) results with a Machine Learning ...
5
votes
2
answers
6k
views
NLTK Sklearn Genism Text to Topic
I aint no data scientist/machine learner.
What Im Lookin for
...
-3
votes
1
answer
1k
views
I need to measure Performance : AUC for this code of NLTK and skLearn [closed]
The code below measures precision and recall and F-measure (source). How can I measure AUC?
...
3
votes
1
answer
318
views
Document Categorization Problem
I'm very new to data science in general, and have been tasked with a big challenge.
My organization has a lot of documents that are all sorted on document type (not binary format, but a subjectively ...