Questions tagged [context-vector]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
1 answer
56 views

A question about contextual embeddings in the decoder only transformer architecture (gpt)

I am reading up on the decoder only architecture Relevant excerpts: We can use any model that maps token sequences into contextual embeddings (e.g., LSTMs, Transformers): $$\phi : V^L \to R^{d \times ...
figs_and_nuts's user avatar
1 vote
1 answer
25 views

word embeddings, what are contextual word embeddings

I m a researcher, a computational linguist and I m working on word embeddings, trying to understand them. What are contextual embeddings and how could I start working and building on my own? Thank you ...
Christina Valavani's user avatar
1 vote
2 answers
277 views

How to find a vector representation for each descriptor?

Cubes data is well known data for extreme classification. Each picture has a set of descriptor along with it. Total data set has 312 descriptor. You will find list of descriptior in this file. My ...
user19121278's user avatar
0 votes
0 answers
271 views

How do work around Kmeans value error?

I am working on a social network analysis project. My data comes from twitter. Before I run the analysis, I intend to apply clustering- specifically Kmeans to determine how to seperate tweets in ...
Falah Amro's user avatar
0 votes
1 answer
183 views

Getting context-word pairs for a continuous bag of words model and other confusions

Suppose I have a corpus with documents: ...
sangstar's user avatar
  • 133
4 votes
4 answers
856 views

word2vec: usefulness of context vectors in classification

I've been working on a NN-based classification system that accepts document vectors as input. I can't really talk about what I'm specifically training the neural net on, so i'm hoping for a more ...
Ingolifs's user avatar
  • 268