# Tag Info

Accepted

### Is there a sensible notion of 'character embeddings'?

Yes, absolutely. First it's important to understand that word embeddings accurately represent the semantics of the word because they are trained on the context of the word, i.e the words close to the ...
• 20.8k

### Why is Word2vec regarded as a neural embedding?

I think you are confused - the reason why Word2Vec is regarded as 'neural' is not due to its loss function, but that it uses neural network to estimate the word embedding ($\vec{u}$ and $\vec{v}$) (...
• 275
Accepted

### Sum vs mean of word-embeddings for sentence similarity

TL;DR You are better off averaging the vectors. Average vs sum Averaging the word vectors is a pretty known approach to get sentence level vectors. Some people may even call that "Sentence2Vec&...
• 3,258
1 vote
Accepted

### Why does averaging word embedding vectors (exctracted from the NN embedding layer) work to represent sentences?

A simple, intuitive explanation- think of each latent dimension as a measure of some (very abstract) quality or property of a word. The value a word's coordinate has in that dimension describes how ...
• 126