0
$\begingroup$

I have used tsne to visualise a large dataset and it has produced the following graph. I need help interpreting it, as I have never seen a tsne graph like this before!

I am aware that not much overlapping data is a good thing, but I have rarely seen more than a few clusters. Has something gone wrong here? Or are there just a lot of clusters in this dataset.

Thanks. P

enter image description here

$\endgroup$
  • $\begingroup$ Keep in mind that tSNE isn't the only dimensionality reduction tool out there. Use the algorithm which best fits your data. $\endgroup$ – Alex L Jan 4 '19 at 5:43
  • $\begingroup$ A bit of advice: the t-SNE output depends heavily on the perplexity parameter chosen. I'd recommend always giving the perplexity that the picture was generated at. $\endgroup$ – Ingolifs Jan 30 '19 at 21:54
1
$\begingroup$

t-SNE is notoriously fickle. I would advise you read this short article How to Use t-SNE Effectively before you invest too much time trying to interpret the plots. In case you don't read it, you'll find that your t-SNE plot will change considerably based on your iterations, and perplexity. You'll find that distance between clusters aren't accurate and that cluster sizes aren't accurate too. t-SNE is a cool data reduction too, but often takes multiple runs to get a "good" plot. Laurens van der Maatan even suggest that running multiple iterations and picking the one with the lowest KL-divergence is perfectly okay. This is due to the fact that t-SNE is non-convex so you won't necessarily find a global minimum.

| improve this answer | |
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.