I ran a TF IDF algorithm and the result of predicted similarities using cosine similarity is a log-normal distribution. Is this a feature of the algorithm (e.g., all logit probabilities are log-normal), or might it be a result in my data?
Let’s look at the formula used for the calculation of
You can see a
log with the
The following answer explains this pretty well.
log with idf