I am using SVM algorithm for text classification. I need to know where can I find twitter dataset and how can I use it in weka tool or any other tool?
-
1$\begingroup$ The best way to collect data from a website is by building a webcrawler that way you can customize what you take out of the HTML page as you may need it. $\endgroup$– JahKnowsCommented Mar 15, 2017 at 21:52
-
1$\begingroup$ Twitter Provide Api which can be used to collect data from twitter. $\endgroup$– Abhishek VermaCommented Jul 14, 2017 at 4:06
3 Answers
Twitter has rules that limit sharing of complete datasets, instead limiting sharing to the tweet ids (see this discussion and the developer agreement). Tools such as twarc can be used to "rehydrate" the tweet metadata by calling the Twitter api and retrieving the info. The Twitter API has rate limiting which can make this a somewhat slow process.
For a package that works in R, see RTextTools or check out RWeka which bridges the gap between R and Java to use Weka. If using Python, you can also use scikit-learn's svm implementation.
This collection of twitter datasets might help you find the dataset you're looking for. Mainly sentiment analysis datasets, but moderation and classification datasets too.