Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [sentiment-analysis]

Sentiment analysis refers to categorizing some given data as to what sentiment(s) it expresses. Usually, it refers to extracting sentiment from a text, e.g. tweets or blog posts.

0
votes
0answers
15 views

Training on heterogeneous dataset for sentiment analysis

I have a dataset of wine reviews, the dataset is consisted of wine reviews(text representation) and other features as score, age, flavors... Wherever the wine is good or not, a score(target) from 0 to ...
0
votes
1answer
37 views

How to label a dataset for Machine Learning?

I have a collection of educational dataset. The dataset consists of a username and their review for the course. I want to analyze the data for sentiment analysis. How can I label the data to train ...
-1
votes
0answers
15 views

How do I go about performing unsupervised topic and opinion extraction from free-text?

I have a few 1-column datasets of free-text taken from 1000-1500 users in a survey. They were asked to write whether they would recommend a certain company/product, and their reason for it. A small ...
0
votes
1answer
32 views

LSTM input and output for sentiment analysis

I'm studying this LSTM network: https://www.kaggle.com/paoloripamonti/twitter-sentiment-analysis ...
0
votes
1answer
44 views

CNN accuracy and loss doesn't change over epochs for sentiment analysis

I am performing text classification as Good [1] or Bad [0]. The texts are preprocessed and converted to Vectors using Google Word2Vec. Further CNN architecture is used for training. I have roughly ...
1
vote
0answers
11 views

What kind of test should I use to determine correlation between the value of a commodity and consumer sentiment?

I’m currently studying data science and am trying to apply my skills to a small project. Basically, I’ve collected data about a commodity’s value over two time periods (30 data points each in 4 week ...
0
votes
0answers
11 views

TDIF toarray() returns an array of zeros

radius = tvec.fit_transform(test_df.Tweet_lemmatized) c = tvec.get_feature_names() print(radius) This returns the correct values, but when I try to convert it to ...
0
votes
1answer
22 views

Sentiment Analysis Datasets

I am looking for sentiment analysis data, mostly customer product review. I found a lot of research places provide large size of datasets, but many of them are outdated. I want to get more up-to-date ...
1
vote
0answers
18 views

Customer Demographic Data

I am looking for two types of data Demographic data Is there a vendor or data source that could provide demographic information of customers who buy a product? It doesn't include personal ...
2
votes
1answer
50 views

prepare email text for nlp (sentiment analysis)

I have text of emails, which also contains disclaimers, phone numbers, email addresses, file attachment names, addresses, greetings etc. At the moment I blindly pass this text through an OOTB ...
1
vote
1answer
82 views

Confidence Score For Trained Sentiment Analyser Model

I have trained a text based sentiment analysis model, using SciKit-learn and custom data. I have the model ready and it works fine in predicting a text to a class (Positive or Negative or Neutral). I ...
0
votes
0answers
83 views

Sentiment analysis with nltk

I'm studying sentimental analysis with python library nltk, following this example: ...
1
vote
1answer
47 views

Weights initialization in Neural Network

I was viewing code for custom neural network for sentiment analysis. It had 3 layers (1 hidden layer). I am more concerned with weight initialization for the layers ...
0
votes
1answer
43 views

Kmeans cluster validation when I have labeled test data

I'm trying to implement the unsupervised k-means algorithm for sentiment analysis of imdb movie dataset created by stanford. The steps that I followed is : 1) Load the comments 2) Apply tokenization ...
-1
votes
1answer
16 views

How dictionary is created when making dictionary-based text classifications? How accuracy of values are determined?

I'm trying to create sentimental analysis of about 1 million twits I've collected from Twitter. I've found a lot of dictionary related to text categorization. The dictionaries I found were rated words ...
1
vote
1answer
54 views

sentiment analysis for multiple entry in one text

I must do sentiment analysis on a set of financial news from s&p500 for given entities (organization names), but the problem is that each news (rows in my dataset) may have more than one entity ...
0
votes
1answer
41 views

long short term memory in sentiment analysis

I am trying to understand how can long short term memory be used in detecting emotions in dialogues. I would like to know if there are some good tutorials for beginners that I can follow. I watched a ...
2
votes
0answers
197 views

Sentiment Analysis Naive Bayes vs Logistic Regression [closed]

I am doing some sentiment analysis on Twitter data, and I wanted to compare a Naive Bayes Classifier and a Logistic Regression classifier as to if their performance is affected by spell checking the ...
7
votes
1answer
162 views

On a multi lingual sentiment corpus

I am looking to compile a sentiment corpus for news articles in multiple languages (~100k per lang. for a machine learning experiment) where each article is labeled positive, neutral, or negative. I ...
5
votes
1answer
424 views

any efficient way to find surrounding adjective/verbs with respect to the target phrase in python [updated]?

I am doing sentiment analysis on given documents. My goal is to find out the closest or surrounding adjective words with respect to the target phrase in my sentences. I do have an idea how to extract ...
0
votes
1answer
24 views

Visualising a stream of emotions

I have a stream of emotions (from some audio recordings) extracted by a speech emotion recogniser. My questions now are how to best display these emotions to the end users? What is the best way to ...
0
votes
1answer
38 views

Sentimental Analysis on Twitter Data [closed]

What are best ways to perform sentimental analysis on Twitter Data which I dont have labels for?
2
votes
3answers
169 views

Why do we have to remove most common words for text analysis?

I am trying to do sentiment analysis the task is to classify racist tweets from other tweets. And I have read many articles and many have mentioned to remove the most common 10 words from the column ...
6
votes
3answers
2k views

What is parts of speech technique in sentiment analysis?

In an article, I saw Sentiment Analysis using Parts Of Speech(POS) technique. When I searched I got some paper on POS but I couldn't understand what POS basically is. Though I am new to sentiment ...
0
votes
1answer
82 views

Integration of Sentiment analysis in CRM

What is the process for integrating sentiment analysis in a CRM? What I am searching for is a system which analyzes the customer comments or reviews using the CRM and finds out the customer sentiment ...
2
votes
0answers
23 views

How do I perform Sentiment Analysis on Tweets in the following pattern:

I have tweets obtained based on matches (football) before the match begins. I have tweets which specify a team will win 3-1 and so on which are easily analyzed using regular expressions. I am facing ...
4
votes
1answer
990 views

NLP - How to perform semantic analysis?

I'd like to perform a textual/sentiment analysis. I was able to analyse samples with 3 labels: (positive, neutral, negative) and I used algorithms such as SVM, ...
1
vote
2answers
91 views

Most Efficient Machine Learning Algorithm for Text Analysis

Looking at Understanding Convolutional Neural Networks for NLP, Convolutional Neural Networks (CNNs) seem to be suitable not only for image recognition, but also for NLP. Are CNNs in general the best ...
0
votes
1answer
152 views

Algorithms for Sentiment Analysis on Entity

I want to make sentiment analysis for an entity which was found, like Google NLP. Entity should have magnitude and score. Please share with me the possible research papers. p/s please not propose ...
1
vote
1answer
79 views

what is the reason behind the bad outputs gained by RNN, LSTM when using GloVe pretrained model in text classification?

the problem is with the results gained for accuracy and f1 afer training our model via pretrained models such as GloVe. when I apply CNN as a classifier, the result are good as follows: ...
1
vote
1answer
477 views

how to input the data set in to a word2vec by keras?

I am new in using word2vec model, as a result, I do not know how I can prepare my dataset as an input for word2vec? I have searched a lot but the datasets in tutorials were in CSV format or just one ...
2
votes
1answer
1k views

Why TF-IDF is working with Sentiment Analysis?

Word2vec looks excellent to me as representation of corpus for sentiment analysis. It has relations between words etc. TF-IDF has only weight of the word how important it is. Results with sentiment ...
1
vote
1answer
294 views

transfer learning with sentiment analysis?

The question is how good and what are some things to keep in mind when sentiment analysis models are tested on different datasets than they are trained on. Say the task is to perform sentiment ...
4
votes
2answers
439 views

Naive Bayes for SA in Scikit Learn - how does it work

Okay so i scrape data from the web on movie reviews. I also have already got my own 'dictionary' or 'lexicon' with words and their labels (1-poor, 2-ok, 3-good, 4-very good, 5-excellent). SO the ...
1
vote
1answer
19 views

how to augument speech sentiment dataset?

I am building an LSTM to recognize if the person is sad, happy, angry or neutral. This is done by feeding-in his the wave of his voice into the network, as a sequence of bytes (each byte is 0-to-255). ...
3
votes
1answer
20 views

Are there trained neural networks, that can distinguish a book's author point from what he stands against?

Let's take some specific book to narrow this example. Atlas shrugged by Ayn Rand. When i'll be saying something like "Ayn Rand's ideas", i'll mean only those, which are clearly stated in the book. ...
1
vote
0answers
22 views

Method of data collection [closed]

I am an undergraduate that is currently working on a project in which I need to collect reviews and comments about mobile phones across several platforms and analyse the data to see if the sentiments ...
1
vote
0answers
41 views

Optimize F-Score only for certain classes, disregard other classes

I have a labeled dataset of product reviews where the label is a rating between 1 and 5 and the review is just text. I use a simple naive Bayes classifier (sklearn) to try to predict a rating given a ...
2
votes
0answers
27 views

Related words extraction in text processing

I'm working on some aspcet based sentiment analysis project applied on some tweets or reviews, so far I've applied all the known preprocessing methods on my training dataset which is an XML file that ...
1
vote
1answer
247 views

How to combine sparse text features with user smile for sentiment classification? [closed]

I am trying to perform sentiment classification task where I have some text and some information about whether the user smiled or not. Now when I use count-vectorizer to convert my text to feature ...
0
votes
2answers
2k views

How does one go about feature extraction for training labelled tweets for sentiment analysis?

I am currently working on a sentiment analysis project where the end goal is to try and predict who wins the Nigerian 2019 presidential election. My goal is to create a model that analyses tweets and ...
1
vote
0answers
56 views

Deciding Initial Weights In A Linear Classifier For Sentiment Analysis

I want to build a simple sentiment analysis classifier using logistic regression. I downloaded a list of positive and negative words from cs.uic.edu. There are more than 6000 words both positive and ...
1
vote
1answer
38 views

What is an aspect in opinion mining?

It's quite a challenging task of aspect extraction in the field of opinion mining if you look at the number of related papers. But what is an aspect in the field of opinion mining?
2
votes
2answers
967 views

How to identify sentiment of a given word from a sentence [closed]

Use case is like this: Suppose I have a sentence(review data): ...
3
votes
1answer
543 views

How to add more features in addition to a 100D word vector

I am working on sentiment analysis using tweets text. I am able to build a word vector using Keras text_to_sequence() method with pretrained GloVe embeddings in ...
7
votes
1answer
170 views

Understanding of naive bayes: computing the conditional probabilities

For a task on sentiment analysis, suppose we have some classes represented by $c$ and features $i$. We can represent the conditional probability of each class as: $$P(c | w_i) = \frac{P(w_i|c) \cdot ...
3
votes
2answers
78 views

How to detect if one tweet is agreeing with another

I want to detect tweet text agreement. Suppose someone posts some subjective opinion in twitter. Other users will post reply either agreeing or opposing the original tweet. I want to estimate the ...
1
vote
1answer
289 views

Naïve Bayes and Training Data

I am creating my own implementation of a Naïve Bayes classifier. While it’s behaviour and functionalities are clear to me, my concerns are on the nature of the training and testing data. I acquired ...
1
vote
2answers
88 views

Sentiment analysis using sources other than the IMDB data

I'm curious as to whether the training data for a sentiment analysis tool needs to be specifically geared toward the domain it's being using in. For example, the IMDB movie review data makes sense if ...
0
votes
1answer
295 views

What do all the column names mean in the SentimentAnalysis package's analyzeSentiment() function in R?

If you used the analyzeSentiment function from SentimentAnalysis in R: ...