Questions tagged [context-vector]
The context-vector tag has no usage guidance.
6
questions
1
vote
1
answer
56
views
A question about contextual embeddings in the decoder only transformer architecture (gpt)
I am reading up on the decoder only architecture
Relevant excerpts:
We can use any model that maps token sequences into contextual embeddings (e.g., LSTMs, Transformers):
$$\phi : V^L \to R^{d \times ...
- 821
1
vote
1
answer
25
views
word embeddings, what are contextual word embeddings
I m a researcher, a computational linguist and I m working on word embeddings, trying to understand them.
What are contextual embeddings and how could I start working and building on my own?
Thank you ...
1
vote
2
answers
277
views
How to find a vector representation for each descriptor?
Cubes data is well known data for extreme classification. Each picture has a set of descriptor along with it. Total data set has 312 descriptor. You will find list of descriptior in this file.
My ...
- 61
0
votes
0
answers
271
views
How do work around Kmeans value error?
I am working on a social network analysis project. My data comes from twitter. Before I run the analysis, I intend to apply clustering- specifically Kmeans to determine how to seperate tweets in ...
0
votes
1
answer
183
views
Getting context-word pairs for a continuous bag of words model and other confusions
Suppose I have a corpus with documents:
...
- 133
4
votes
4
answers
856
views
word2vec: usefulness of context vectors in classification
I've been working on a NN-based classification system that accepts document vectors as input. I can't really talk about what I'm specifically training the neural net on, so i'm hoping for a more ...
- 268