Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [sentiment-analysis]

Sentiment analysis refers to categorizing some given data as to what sentiment(s) it expresses. Usually, it refers to extracting sentiment from a text, e.g. tweets or blog posts.

Filter by
Sorted by
Tagged with
71 votes
4 answers
93k views

What is purpose of the [CLS] token and why is its encoding output important?

I am reading this article on how to use BERT by Jay Alammar and I understand things up until: For sentence classification, we’re only only interested in BERT’s output for the [CLS] token, so we ...
user3768495's user avatar
29 votes
1 answer
10k views

NLP - why is "not" a stop word?

I am trying to remove stop words before performing topic modeling. I noticed that some negation words (not, nor, never, none etc..) are usually considered to be stop words. For example, NLTK, spacy ...
E.K.'s user avatar
  • 415
12 votes
5 answers
6k views

How to overcome training example's different lengths when working with Word Embeddings (word2vec)

I'm working on Sentiment Analysis over tweets using word2vec as word representation. I have trained my word2vec model. But when I'm going to train my classifier, I'm facing the issue that every tweet ...
antorqs's user avatar
  • 221
12 votes
2 answers
8k views

Features of word vectors in Word2Vec

I am trying to do sentiment analysis. In order to convert the words to word vectors, I am using Word2Vec model. Suppose I have all the sentences in a list named 'sentences' and I am passing these ...
enterML's user avatar
  • 3,031
10 votes
3 answers
7k views

BPE vs WordPiece Tokenization - when to use / which?

What's the general tradeoff between choosing BPE vs WordPiece Tokenization? When is one preferable to the other? Are there any differences in model performance between the two? I'm looking for a ...
vgoklani's user avatar
  • 238
9 votes
3 answers
6k views

Sentiment Analysis Tutorial

I am trying to understand sentiment analysis and how to apply it using any language (R, Python etc). I would like to know if there is a good place on internet for tutorial that I can follow. I googled,...
KurioZ7's user avatar
  • 285
9 votes
4 answers
23k views

Improving accuracy of Text Classification

I am working on a text classification problem, the objective is to classify news articles to their corresponding categories, but in this case the categories are not very broad like, politics, sports, ...
ac-lap's user avatar
  • 159
9 votes
1 answer
5k views

Extracting individual emails from an email thread

Most of the open source datasets are well formatted i.e each email message is separated well like the enron email dataset. But out in the real world it is highly difficult to separate a top email ...
Greedy Coder's user avatar
8 votes
3 answers
7k views

What is parts of speech technique in sentiment analysis?

In an article, I saw Sentiment Analysis using Parts Of Speech(POS) technique. When I searched I got some paper on POS but I couldn't understand what POS basically is. Though I am new to sentiment ...
SRJ577's user avatar
  • 197
8 votes
5 answers
19k views

Training Dataset for Sentiment Analysis of Movie Reviews

I am currently working on sentiment analysis using Python. I wanted to find whether reviews given for a movie is positive or negative based on sentiment analysis. I have found a training dataset as ...
SRS's user avatar
  • 1,065
8 votes
3 answers
6k views

Twitter Sentiment Analysis: Detecting neutral tweets despite training on only Positive and Negative Classes

I am a newbie when it comes to machine learning. I am trying to get hands on experience by analyzing different supervised learning algorithms using scikit-learn library of python. I am using the ...
tedghosh's user avatar
7 votes
1 answer
3k views

Using Apache Spark to do ML. Keep getting serializing errors

so I'm using Spark to do sentiment analysis, and I keep getting errors with the serializers it uses (I think) to pass python objects around. ...
seashark97's user avatar
7 votes
1 answer
268 views

Understanding of naive bayes: computing the conditional probabilities

For a task on sentiment analysis, suppose we have some classes represented by $c$ and features $i$. We can represent the conditional probability of each class as: $$P(c | w_i) = \frac{P(w_i|c) \cdot ...
user19241256's user avatar
7 votes
2 answers
2k views

Combining Machine Learning classifier with NLTK Vader for Sentiment Analysis

As a part of my university project, I am researching/developing a sentiment analysis model wherein I am trying to combine NLTK Vader (SentimentIntensityAnalyzer) results with a Machine Learning ...
Chetan's user avatar
  • 171
7 votes
1 answer
435 views

On a multi lingual sentiment corpus

I am looking to compile a sentiment corpus for news articles in multiple languages (~100k per lang. for a machine learning experiment) where each article is labeled positive, neutral, or negative. I ...
Chris's user avatar
  • 193
6 votes
6 answers
9k views

Sentiment Analysis model for Spanish

I barely know about Data Analysis tools and techniques, so bare with me if I'm asking something too trivial. I'm looking for a Sentiment Analysis tool to process comments in Spanish. I do know some ...
mcKain's user avatar
  • 161
6 votes
2 answers
671 views

How is it possible for RNN to do sentiment analysis?

I'm wondering how RNN can be used when doing sentiment analysis. It seems that the characteristic of RNN is to remember what appeared in the past and determine the value of the present (future), but I ...
WooseokChoi's user avatar
6 votes
1 answer
6k views

Using Trainable=True in Keras Embedding obtained better performance

It is suggested by the author of Keras [1] to use Trainable=False when using the embedding layer in Keras to prevent the weights from being updated during training. ...
sugab's user avatar
  • 163
6 votes
3 answers
1k views

What is the difference between sentiment analysis (e.g. on Facebook) and Twitter sentiment analysis?

I'm bit confused with the names of sentiment-analysis and twitter-sentiment-analysis.I want to do sentiment analysis for facebook fan page posts.so I decide to use an api but I did not found any api ...
Dilip Bobby's user avatar
6 votes
1 answer
9k views

any efficient way to find surrounding adjective/verbs with respect to the target phrase in python [updated]?

I am doing sentiment analysis on given documents. My goal is to find out the closest or surrounding adjective words with respect to the target phrase in my sentences. I do have an idea how to extract ...
Hamilton's user avatar
  • 163
5 votes
3 answers
3k views

Why using a frozen embedding layer in an LSTM model

I'm studying this LSTM mode: https://www.kaggle.com/paoloripamonti/twitter-sentiment-analysis They use a frozen embedding layer which uses an predefined matrix with for each word a 300 dim vector ...
sg_sg94's user avatar
  • 153
5 votes
3 answers
4k views

Words to numbers faster lookup

I'm training an LSTM for sentiment analysis on a review dataset downloaded from here. The music review dataset contains about 150K data points (reviews of varying length labelled pos or neg). After ...
Alex's user avatar
  • 767
5 votes
1 answer
6k views

NLP - How to perform semantic analysis?

I'd like to perform a textual/sentiment analysis. I was able to analyse samples with 3 labels: (positive, neutral, negative) and I used algorithms such as SVM, ...
GG24's user avatar
  • 153
5 votes
1 answer
3k views

How to add more features in addition to a 100D word vector

I am working on sentiment analysis using tweets text. I am able to build a word vector using Keras text_to_sequence() method with pretrained GloVe embeddings in ...
Ali S's user avatar
  • 51
5 votes
1 answer
653 views

Understand clearly the figure: Illustration of a Convolutional Neural Network (CNN) architecture for sentence classification

I am studying the blog: Understanding Convolutional Neural Networks for NLP. It is very good blog. One thing I can't understand clearly about this blog. As the figure Illustration of a Convolutional ...
tktktk0711's user avatar
5 votes
1 answer
1k views

How do you map phrase IDs to sentence IDs in the Stanford Sentiment Analysis dataset?

I am trying to reproduce results obtained on the Stanford Sentiment Analysis dataset, which contains sentiment annotations for syntactic components of sentences taken from Rotten Tomatoes reviews. ...
W.P. McNeill's user avatar
4 votes
2 answers
8k views

Sentiment retriving from text (Russian)

Does anybody knows python library to retrieve sentiment from Russian text. The dictionary with sentiment parameterization will be ok to. The idea of library something like in GPOMS in article.
MrFroll's user avatar
  • 43
4 votes
3 answers
992 views

How do I assess which sentiment classifier is best for my project?

I wanted to perform Twitter sentiment analysis on Twitter tweets. When I googled it, I found a stanfordNLP code of sentiment class. I used it for finding Twitter sentiment later I came to know ...
Dilip Bobby's user avatar
4 votes
3 answers
750 views

Binary classification and numerical labels

I am trying to create a sentiment analysis model using a dataset that have ~50000 positive tweets that i labeled as 1, ~50000 negative tweets that i have labeled as 0. Also i have acquired ~10000 ...
Antonis's user avatar
  • 53
4 votes
2 answers
1k views

Naive Bayes for SA in Scikit Learn - how does it work

Okay so i scrape data from the web on movie reviews. I also have already got my own 'dictionary' or 'lexicon' with words and their labels (1-poor, 2-ok, 3-good, 4-very good, 5-excellent). SO the ...
Chakra's user avatar
  • 143
4 votes
1 answer
93 views

Range to define emotions

We are capturing emotions as survey responses. We need to assign values for the responses(emotions) for analysis purposes. Is there an optimum range that can be assigned to achieve this? (like from -...
user avatar
4 votes
2 answers
545 views

Using doccano for Aspect Based Sentiment Analysis annotation

Currently looking for a good tool to annotate sentences regarding aspects and their respective sentiment polarities. I'm using SemEval Task 4 as a reference. The following is an example in the ...
Filipe Aleixo's user avatar
4 votes
2 answers
149 views

How to detect if one tweet is agreeing with another

I want to detect tweet text agreement. Suppose someone posts some subjective opinion in twitter. Other users will post reply either agreeing or opposing the original tweet. I want to estimate the ...
Rakib's user avatar
  • 215
4 votes
1 answer
742 views

How to collect tweets by geo-location?

I am extracting tweets on brands for sentiment analysis. I am using twitteR package on R. Is there a specific way by which I can only collect tweets from a location ex NY or Paris or Canada etc. I ...
Dinesh Kumar's user avatar
4 votes
1 answer
73 views

averaging multiple scores on small chunks of data or raw score on single collated data

I am using IBM Watson tool to determine tones (https://tone-analyzer-demo.mybluemix.net/) and personality scores (https://personality-insights-livedemo.mybluemix.net/) on different files containing ...
div's user avatar
  • 41
3 votes
3 answers
2k views

nlp - opinion mining vs sentiment analysis

I have been told that nlp possibly holds the key for allowing researchers to infer the affective state of a person when writing. For instance, by using nlp analysis on online note taking you could ...
ALit's user avatar
  • 33
3 votes
1 answer
1k views

Why use sum and not average for sentiment analysis?

In Sentiment Analysis, I've seen the sentiment of an entire string of words (tweets, paragraphs, sentences, etc.) computed by summing the sentiment of all of the terms in the string. I know there ...
makansij's user avatar
  • 869
3 votes
3 answers
3k views

What is the current state-of-the-art within aspect-based sentiment analysis?

I've been reading Bing Liu's book on Sentiment Analysis. He mentions all of these slightly different approaches seen in research since 2004, but doesn't talk much about efficacy at all. That leaves ...
Simon Gray's user avatar
3 votes
2 answers
2k views

How to identify sentiment of a given word from a sentence [closed]

Use case is like this: Suppose I have a sentence(review data): ...
Avinash's user avatar
  • 131
3 votes
2 answers
75 views

Build a sentiment model from scratch

I would like to know how I can create a sentiment model from scratch. I have my data, list of texts, with no labels about sentiment. ...
V_sqrt's user avatar
  • 295
3 votes
1 answer
450 views

How to implement multi class classifier for a set of sentences?

I'm currently involved in an aspect level sentiment analysis project and using Stanford CoreNLP toolkit to implement the system. My knowledge on these concepts is very limited and I'm seeking your ...
mads's user avatar
  • 131
3 votes
1 answer
42 views

Who is supposed to label my sentiment analysis? Linguistics or psychologist?

I'm starting off my undergraduate research on text classification even though I'm still considered new to this topic. I've collected more than 20K data from Twitter. I've been trying to label the data ...
Faaiz's user avatar
  • 33
3 votes
1 answer
74 views

I can't figure out how to improve accuracy for tweet sentiment

I'm doing a beginning attempt at tweet sentiment analysis (positive, neutral, negative). So far I have cleaned the data and used a BoW to get some feeling of the data (>2.5k tweets). I also made ...
noideawhatimdoing's user avatar
3 votes
1 answer
894 views

prepare email text for nlp (sentiment analysis)

I have text of emails, which also contains disclaimers, phone numbers, email addresses, file attachment names, addresses, greetings etc. At the moment I blindly pass this text through an OOTB ...
cs0815's user avatar
  • 174
3 votes
1 answer
26 views

Are there trained neural networks, that can distinguish a book's author point from what he stands against?

Let's take some specific book to narrow this example. Atlas shrugged by Ayn Rand. When i'll be saying something like "Ayn Rand's ideas", i'll mean only those, which are clearly stated in the book. ...
stkvtflw's user avatar
  • 131
3 votes
2 answers
214 views

Sentiment analysis of tweets (Train model on a labelled dataset and use on some other unlabelled data)

I have a huge amount of tweets on a particular topic say 'ABC' and the data is not labelled. I want to perform multi-class sentiment analysis of these tweets. I tried many unsupervised clustering ...
Doofenshmirtz's user avatar
3 votes
1 answer
409 views

Weighting of words in lexicon based sentiment analysis

I have a a question regarding my current project, i am trying to do a lexicon based sentiment analysis on my data, where i calculate the sentiment score as following: $$ Score = \frac{\sum_{i}{word_i}...
voltage's user avatar
  • 41
3 votes
1 answer
69 views

measuring flip-flop behaviour across several topics

I'm trying to analyze a behavior called "sentiment flipping" of users in a dataset, but I'm not able to step on. Let's suppose that I have two groups of users, say them good and bad users. My ...
Minions's user avatar
  • 252
3 votes
2 answers
137 views

Sentiment Analysis Datasets [closed]

I am looking for sentiment analysis data, mostly customer product review. I found a lot of research places provide large size of datasets, but many of them are outdated. I want to get more up-to-date ...
user2979630's user avatar
2 votes
2 answers
765 views

Differentiate between positive and negative clusters

I have applied k-means clustering on my dataset of Amazon Alexa reviews. ...
Pari Ganjoo's user avatar

1
2 3 4 5