Skip to main content
copyediting
Source Link
Emre
  • 10.5k
  • 1
  • 30
  • 39

Implementing How to equalize the pairwise affinity perplexities when implementing t-SNE: problem when calculating pairwise affinities?

I'm trying to implement the t-SNE method. It's not a very complicated algorithm as it can be described like this:

enter image description here

I found that to compute the pairwise affinities, I have to follow this:

enter image description here

My problem is to computecomputing $\sigma_i$ in this formula. In wikipediathe Wikipedia I found:

The bandwidth of the Gaussian kernels $\sigma_{i}$, is set in such a way that the perplexity of the conditional distribution equals a predefined perplexity using a binary search. As a result, the bandwidth is adapted to the density of the data: smaller values of $\sigma_{i}$ are used in denser parts of the data space.

I don't understand what this realy meanreally means. How can can I calculate $\sigma_i$ given data and perplexity?

Implementing t-SNE: problem when calculating pairwise affinities

I'm trying to implement the t-SNE method. It's not a very complicated algorithm as it can be described like this:

enter image description here

I found that to compute the pairwise affinities, I have to follow this:

enter image description here

My problem is to compute $\sigma_i$ in this formula. In wikipedia I found:

The bandwidth of the Gaussian kernels $\sigma_{i}$, is set in such a way that the perplexity of the conditional distribution equals a predefined perplexity using a binary search. As a result, the bandwidth is adapted to the density of the data: smaller values of $\sigma_{i}$ are used in denser parts of the data space.

I don't understand what this realy mean. How can can I calculate $\sigma_i$ given data and perplexity?

How to equalize the pairwise affinity perplexities when implementing t-SNE?

I'm trying to implement the t-SNE algorithm:

enter image description here

I found that to compute the pairwise affinities, I have to follow this:

enter image description here

My problem is computing $\sigma_i$. In the Wikipedia I found:

The bandwidth of the Gaussian kernels $\sigma_{i}$, is set in such a way that the perplexity of the conditional distribution equals a predefined perplexity using a binary search. As a result, the bandwidth is adapted to the density of the data: smaller values of $\sigma_{i}$ are used in denser parts of the data space.

I don't understand what this really means. How can I calculate $\sigma_i$?

Source Link

Implementing t-SNE: problem when calculating pairwise affinities

I'm trying to implement the t-SNE method. It's not a very complicated algorithm as it can be described like this:

enter image description here

I found that to compute the pairwise affinities, I have to follow this:

enter image description here

My problem is to compute $\sigma_i$ in this formula. In wikipedia I found:

The bandwidth of the Gaussian kernels $\sigma_{i}$, is set in such a way that the perplexity of the conditional distribution equals a predefined perplexity using a binary search. As a result, the bandwidth is adapted to the density of the data: smaller values of $\sigma_{i}$ are used in denser parts of the data space.

I don't understand what this realy mean. How can can I calculate $\sigma_i$ given data and perplexity?