I did a lot of Googling but could not find a paper that presents an algorithm which will produce dense feature vectors for short text input. I would be happy to find feature extraction algorithm which would perform at least as good as sparse word unigram and bigram feature vectors.
Currently I am exploring the idea of using LDA (Latent Dirichlet Allocation) but there are problems with processing short text (2-7 words per document).
The task at hand is short text classification. The number of classes for my data ranges from 10 to 20 classes. The classes are fairly well represented and the word unigram and bigram features work well. I would like to compute dense feature vectors for other experiments.
Any pointers to papers, preferrably simple to implement, would be appreciated.