Skip to main content
OverflowAI is here! AI power for your Stack Overflow for Teams knowledge community. Learn more
5 votes
Accepted

How does one go about feature extraction for training labelled tweets for sentiment analysis?

Feature Extraction is an important step when dealing with natural languages because the text you've collected isn't in a form understandable by a computer. If you have a tweet that goes something like ...
edthealchemist's user avatar
3 votes
Accepted

T-test against normalised or standardised data gives different results

First, T-test null hypothesis is that there are no differences between means of two samples. And p-value is the probability to observe the data, given that the null hypothesis is correct, so if p-...
Anvar Kurmukov's user avatar
3 votes
Accepted

twitter data analysis?

I believe that the algorithm that you want to use is something called a latent dirichlet allocation (LDA) model. This model is designed to uncover the topics in a corpus of documents. Scikit learn ...
Ryan's user avatar
  • 712
3 votes
Accepted

Twitter Retweet Network Visualization

For answering questions from graph, you should not visualize it. Visualizing graphs is for sake of having an overview on how it looks like in general. There are Graph Visualization techniques that ...
Kasra Manshaei's user avatar
2 votes
Accepted

Sentimental Analysis on Twitter Data

You should look at literature on unsupervised sentiment analysis. The paper by Peter Turney could be a good starting point. Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised ...
paoloeusebi's user avatar
2 votes
Accepted

Twitter tweet classification

You should be reading about text classification with supervised learning technique. You could chose a neural network such as CNN implementation and use it to your data. But you have to first prepare ...
Sangathamilan Ravichandran's user avatar
2 votes

How to replace short words into full words from tweets using python

I have worked on lexicon level token normalization on twitter data, which seems to be very similar to what you are trying to do. In our task, we were not only normalizing short word, but also "welllll"...
user12075's user avatar
  • 2,274
2 votes
Accepted

Doubt on retrieving tweets for sentiment analysis?

First you need to setup the twitter api and get the credentials and add those to the congig.cfg file linked here- https://filebin.net/5a6lfserhqzjg93a/config.cfg?t=dcqh998i Afterwards you can use ...
cap's user avatar
  • 432
2 votes

Creating Dataset for Classification, How much balanced a good dataset should be?

The answer to such wide questions always have the same answer - it depends. Since I don't know the exact ratio of the four classes, I'll mention a few important points that can help you decide how to ...
MetaInformation's user avatar
1 vote

Spam tweets dataset needed

Did you check this ? - nsclab.org/nsclab/resources
Kriti's user avatar
  • 363
1 vote

Twitter data scraping: API vs Advabced Search

On question 1, "am I right about incompleteness of advanced search in providing results?" Yes, this is my recent experience, as of May 4, 2023. My still working API v2 returns over 1,000 ...
ViennaMike's user avatar
1 vote

Twitter data scraping: API vs Advabced Search

I've found snscrape to work like a charm. Github page: https://github.com/JustAnotherArchivist/snscrape Make sure to double-check the rights and intended use, given ...
Tim J's user avatar
  • 376
1 vote

how to filter out and discard irrelevant tweets in simplest way possible

I think simple regex matching is all you need. Pass the tweet into a series of regular expressions that match emojis and hashtags and if nothing remains, discard.
Nikos M.'s user avatar
  • 2,353
1 vote
Accepted

Data type when registering Twitter developer account?

It means will your paper analyse each tweet individually and present the result or it will collect thousands of tweet and calculate some statistics based on them and present the aggregated (mean, ...
SrJ's user avatar
  • 858
1 vote
Accepted

Twitter Data-Analyse: What can I do with the data?

Community analysis implies graph analysis. here is a short list of things you can work on: People often reshares tweets among a certain social group. Minimum-cut method, Girvan–Newman and Modularity ...
Benoit Descamps's user avatar
1 vote
Accepted

Which tool is good to collect tweets on 50 keywords over the last 5 years and then analyze them with the LDA algorithm or sentiment analysis?

As for Algorithmia and monkeylearn, I don't know if you will find much help for those here due the fact that Python and R/RStudio are the predominant 'data science' open source (read: free) platforms. ...
mccurcio's user avatar
  • 223
1 vote
Accepted

Can I download Twitter data via web scraping for research?

Last time I checked it was not allowed to store the contents of the tweets, instead one is supposed to store the tweet id and retrieve the content of the tweet dynamically. Afaik this is because ...
Erwan's user avatar
  • 25.5k
1 vote

Twitter Dataset

Does anyone know where to source such a dataset or something similar for social-network analysis? Yes, directly from Twitter using their API: https://developer.twitter.com/
Erwan's user avatar
  • 25.5k
1 vote

twitter data analysis?

As mentioned by @Ryan the LDA is a way to go but I am not sure it will provide robust results on documents that are fundamentally limited to 140 characters in length. I tried it in the past on ...
Dan Temkin's user avatar
1 vote

How to detect if one tweet is agreeing with another

Sure there can be more complicated approach but if you are dealing with raw tweets, I think problem is twofolds; Topic Discovery You first need to find out what the tweet is talking about. It will ...
won782's user avatar
  • 191
1 vote

How to detect if one tweet is agreeing with another

Not sure there is anything for that, you could check is it a verbatim retweet does it have the same sentiment is the edit distance low Or you can train your own model, where you label (agree) by ...
Dirk N's user avatar
  • 279
1 vote

Best way to tokenize tweet

Tokenization, like all preprocessing, is application specific. It depends on the end goal. The most difficult (and interesting) parts of tweets are usernames, hashtags, URLs, and emoticons. Different ...
Brian Spiering's user avatar
1 vote

Best way to tokenize tweet

Something that has helped me when I have worked with tweets is what is the idea behind using the tweets. There is no standard way of doing it as sometimes things that are irrelevant to tokenizers are ...
Nischal Hp's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible