Skip to main content
Explained the question further
Source Link
Sakher
  • 118
  • 6

In my NLP task, I use Glove to get each word embedding in a sentence, I getGlove gives 50 float numbers as an embedding for every word in my sentence, howmy corpus is large, and the resulted model is also large to fit my machine, I'm looking for a way to reduce this numbereach word embedding from 50 numbers to something less, maybe one floating number is possible, is there an approach to do that?

Could anyI was thinking about an aggregation method work? Likeapproach,like taking the average. of the 50 numbers, would that work?

I use Glove to get each word embedding in a sentence, I get 50 float numbers for every word, how to reduce this number from 50 to something?

Could any aggregation method work? Like taking the average.

In my NLP task, I use Glove to get each word embedding, Glove gives 50 float numbers as an embedding for every word in my sentence, my corpus is large, and the resulted model is also large to fit my machine, I'm looking for a way to reduce each word embedding from 50 numbers to something less, maybe one floating number is possible, is there an approach to do that?

I was thinking about an aggregation approach,like taking the average of the 50 numbers, would that work?

Source Link
Sakher
  • 118
  • 6

Word Embedding Dimensions Reduction

I use Glove to get each word embedding in a sentence, I get 50 float numbers for every word, how to reduce this number from 50 to something?

Could any aggregation method work? Like taking the average.