I'm trying to visualize outliers in my data using T-SNE and it seems like the outliers appear as three different clusters. The original data has 7 different columns but I chose to plot the outliers on a two dimensional graph. I expected the outliers to be clustered into one single group but I have three different clusters (red dots) on my graph. Is it normal to see different groups of outliers? For example, the red cluster on the far left side is a group of outliers in terms of Feature A and the red cluster in the middle is another group of outliers in terms of Feature B.
Or does this result suggest T-SNE is not appropriate for my data?