Questions tagged [vector-space-models]

The tag has no usage guidance.

13 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
2
votes
0answers
61 views

Is it acceptable to append information to word embeddings?

Let's say I have my 300 dimensional word embedding trained with Word2Vec and it contains 10,000 word vectors. I have additional data on the 10,000 words in the form of a vector (10,000x1), containing ...
2
votes
2answers
39 views

How to represent a document in test data with the Document-Term Matrix created from the training set?

I build a classifier of documents using the vector representation of each document in the training set (i.e a row in the Document-Term Matrix). Now I need to test the model on the test data. But how ...
2
votes
0answers
4k views

Getting 'ValueError: setting an array element with a sequence.' when attempting to fit mixed-type data

I have already seen this, this and this question, but none of the suggestions seemed to fix my problem (so I have reverted them). I have the following code: ...
1
vote
0answers
19 views

Combine multiple vector fields for approximate nearest neighbor search

I have multiple vector fields in one collection. My use-case is to find similar sentences in similar contexts. The sentences and contexts are encoded to float vectors. Therefore, I have one vector for ...
1
vote
0answers
25 views

Approximate maximum dot product between a vector and set of vectors using only a single vector representation for the latter

If we have a vector $q$ and a set of vectors $D = \{d_1, d_2, ..., d_l\}$ is there a way to create functions $QF$ and $DF$ such that $QF(q)^TDF(D) \approx \max_i(q^Td_i)$ ? Use case: I want to build ...
1
vote
0answers
21 views

How can I model the autocorrelation of objective variables under the situation where we can't observe any actual objective variable in the test phase

I'm trying to model the relationship between the declared value from a subject and stimulus. For example, modeling a relationship between the subject's happiness and strength of stimulus so that we ...
1
vote
0answers
27 views

What is the best technique to transform documents into vectors?

What is the best algorithm between doc2vec and Singular Value Decomposition (SVD) to transform a set of 600 documents of around 1000 words each into vectors ?
1
vote
1answer
54 views

How can I train a model to modify a vector by rewarding the model based on the modified vectors nearest neighbors?

I am experimenting with a document retrieval system in which I have documents represented as vectors. When queries come in, they are turned to vectors by the same method as used for the documents. The ...
0
votes
0answers
17 views

target encoding and weighting

I am working on a project in which I use data of movies and I represent each movie as a vector of length of 15. So there are 15 features ranging from genre to director. Most of the features are ...
0
votes
0answers
25 views

one hot encoding and multi hot encoding together

Hi for a project I am representing movies in a vectoral format. One thing I want to ask is can I use both one hot encoding and multi hot encoding together on my representation. There are limited ...
0
votes
1answer
220 views

How can we use the cosine similarity formula on document feature vector without a direction?

In mathematics, a vector has both magnitude and direction. In data science, for identifying document similarity we convert the document into a feature vector. Then apply cosine angle formula between ...
-1
votes
0answers
11 views

What technique is used to combine multiple vectors (of length n) into a single vector of length k?

I want to use some machine learning/neural network or other mathematical model to get this. The length of resultant vector should be similar to n.
-1
votes
1answer
472 views

How to improve Vector Space Models with semantic similarity?

I try to construct a classic querying system where I find the most probable candidate text for a query by computing cosine similarities of TFIDF vectors of normalized text of possible answers. This ...