Questions tagged [vector-space-models]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
21 views

How to Vectorise data

I have a set of data points that have various attributes (product, geography, unit, date). I then have incoming data with the same attributes. I want to vectorise my data set to find the closeness of ...
Michael's user avatar
1 vote
2 answers
279 views

How to find a vector representation for each descriptor?

Cubes data is well known data for extreme classification. Each picture has a set of descriptor along with it. Total data set has 312 descriptor. You will find list of descriptior in this file. My ...
user19121278's user avatar
0 votes
0 answers
17 views

Is there any interesting application when viewing one-hot vector as unit vector?

From One-hot - Wikipedia: In natural language processing, a one-hot vector is a 1 × N matrix (vector) used to distinguish each word in a vocabulary from every other word in the vocabulary. The vector ...
Ooker's user avatar
  • 101
0 votes
0 answers
36 views

Generate vector database for userdata

I need a point in the right direction for the problem I'm trying to solve: I have a lot of already classified short articles. The articles themselves or a reference to them should be stored in some ...
mathi1651 's user avatar
0 votes
1 answer
19 views

Scoring vectors by "distinctness"

I have a set of vectors in a vector space and I'm looking for some score that measures how "distinct" each vector is from the others. I suppose this is a well-known problem but I have no ...
martinkunev's user avatar
0 votes
2 answers
93 views

Similarity with respect to a specific concept in text embeddings

In text embeddings, cosine similarity is often used to find texts similar to a search query. However, I don't want to find a text that is overall similar, but similar with regards to a specific ...
McLawrence's user avatar
1 vote
1 answer
99 views

How to vectorize newline \n in tensorflow textVectorization layer?

I am working on text generation model and i want to vectorize the newline character '\n' as a word in tensorflow. How DO i do it. I have done this so far. but tensorflow just not consider it. ...
tikendraw's user avatar
  • 135
0 votes
1 answer
31 views

Proof of perpendicular distance of an observation from the Maximal Margin Hyperplane

I was reading about Maximal Margin Classifiers in "Introduction to Statistical Learning" and could not understand how is the perpendicular distance of an observation (which is a vector) from ...
Circuit_Breaker0.7's user avatar
0 votes
1 answer
41 views

Comparing encoders to same input of differnt output size

Let's say I have an input s1 and I pass it to two encoders e1 and e2. They output encodings ...
adityagabbar's user avatar
1 vote
1 answer
120 views

Combine multiple vector fields for approximate nearest neighbor search

I have multiple vector fields in one collection. My use-case is to find similar sentences in similar contexts. The sentences and contexts are encoded to float vectors. Therefore, I have one vector for ...
roemchine's user avatar
2 votes
2 answers
467 views

Dimensionality reduction of vectors with null values

I have vectors of same length where each entry can have the value 0, 1 or null. V = {[0,1,1,1,null,0], [null,1,0,null,0,1], ...} How can I perform a dimensionality ...
2080's user avatar
  • 121
1 vote
0 answers
35 views

Approximate maximum dot product between a vector and set of vectors using only a single vector representation for the latter

If we have a vector $q$ and a set of vectors $D = \{d_1, d_2, ..., d_l\}$ is there a way to create functions $QF$ and $DF$ such that $QF(q)^TDF(D) \approx \max_i(q^Td_i)$ ? Use case: I want to build ...
Curious Ion's user avatar
0 votes
1 answer
104 views

Dummy vectors and performance measurement for vector search Face Recognition

I have about thousands of person face (from celebrity dataset LFW), which each person represented by 512 x 1 vector. I stored it on vector DB to build face searching system using embedded feature (...
YVS1997's user avatar
  • 113
0 votes
1 answer
293 views

how to calculate similarity between users based on movie ratings

Hi I am working on a movie recommendation system and I have to find alikeness between the main user and other users. For example, the main user watched 3 specific movies and rated them as 8,5,7. A ...
OnurTR's user avatar
  • 25
0 votes
1 answer
71 views

Word2Vec: Identifying many-to-one relationships between words

Standard introductory examples in Word2Vec, like king - queen = man - woman and tokyo - japan = london - uk, involve one-to-one ...
Abhimanyu Pallavi Sudhir's user avatar
0 votes
1 answer
163 views

Non-commutative distance formula

I am trying to find a distance formula or a method that can give the non-commutative distance between two points in a feature space. Suppose there are two movies represented in an R^n feature space. ...
Himanshu's user avatar
2 votes
0 answers
167 views

Is it acceptable to append information to word embeddings?

Let's say I have my 300 dimensional word embedding trained with Word2Vec and it contains 10,000 word vectors. I have additional data on the 10,000 words in the form of a vector (10,000x1), containing ...
forgetso's user avatar
  • 121
1 vote
0 answers
23 views

How can I model the autocorrelation of objective variables under the situation where we can't observe any actual objective variable in the test phase

I'm trying to model the relationship between the declared value from a subject and stimulus. For example, modeling a relationship between the subject's happiness and strength of stimulus so that we ...
messefor's user avatar
1 vote
1 answer
48 views

How come same cluster category be separated?

I have these 200 vectors which were clustered using K-means clustering based on keywords weight similarity that was given by TF-IDF (Term Frequency - Inverse Document Frequency). The vectors were ...
Jack Zaki Zakiul Fahmi Jailani's user avatar
2 votes
2 answers
158 views

Is it accurate to say that "K-means clustering the vectors based on keywords weight similarity"?

Long story short, I have 200 vectors as a result of TF-IDF (Term Frequency - Inverse Document Frequency) on thousands of keywords in hundreds of vectors. The total number of unique keywords that I got ...
Jack Zaki Zakiul Fahmi Jailani's user avatar
1 vote
1 answer
107 views

what is the difference between positional vector and attention vector used in transformer model?

what is the difference between positional vector and attention vector used in transformer model ? , i saw a video in youtue and the defintion for positional vector was give as :* "vector that ...
star's user avatar
  • 1,431
1 vote
1 answer
595 views

How can we use the cosine similarity formula on document feature vector without a direction?

In mathematics, a vector has both magnitude and direction. In data science, for identifying document similarity we convert the document into a feature vector. Then apply cosine angle formula between ...
variable's user avatar
  • 187
2 votes
2 answers
121 views

How to represent a document in test data with the Document-Term Matrix created from the training set?

I build a classifier of documents using the vector representation of each document in the training set (i.e a row in the Document-Term Matrix). Now I need to test the model on the test data. But how ...
Paw in Data's user avatar
0 votes
1 answer
56 views

Why is n-grams language independent?

I don't understand how n-grams are language independent. I've read that by using character n-grams of a word than the word itself as dimensions of a vector space model, we can skip the language-...
Bharathi's user avatar
  • 277
4 votes
1 answer
233 views

Can 2 different OOV words get the same vector in FastText?

Since FastText sums up the vectors(order is not considered) of an OOV word's subwords, is it possible for two different OOV words to get the same vector ? If so, then can you give an example?
Atif Hassan's user avatar
2 votes
1 answer
4k views

Getting 'ValueError: setting an array element with a sequence.' when attempting to fit mixed-type data

I have already seen this, this and this question, but none of the suggestions seemed to fix my problem (so I have reverted them). I have the following code: ...
Geza Kerecsenyi's user avatar
1 vote
0 answers
35 views

What is the best technique to transform documents into vectors?

What is the best algorithm between doc2vec and Singular Value Decomposition (SVD) to transform a set of 600 documents of around 1000 words each into vectors ?
Alexis Pister's user avatar
2 votes
2 answers
424 views

ways to represent document by its keyword vectors

I have documents, say for example, D1, D2, D3... Dm. Every Di has its individual components or keywords k1, k2, k3,... kn, where ki is an n-dimensional vector. The number of individual components ...
Van Peer's user avatar
  • 285
1 vote
2 answers
642 views

How to dual encode two sentences to show similarity score

I've been trying to grasp the concept of Google's semantic experiences. By using it, I'm planning to implement a semantic query tool. With universal sentence encoder I can first pre-encode all ...
ShellRox's user avatar
  • 409
1 vote
1 answer
85 views

Can I sum up feature vectors of a user‘s collection?

I want to find items that are similar to items users already have in their collection. Every item has attributes, so I created feature vectors where every element of the vector represents an attribute ...
Lurca's user avatar
  • 113
1 vote
1 answer
80 views

What are the main distribution semantics based algorithms?

I am aware that LSI, RRI and word embeddings are distributional semantics models. However, I am not certain if the below mentioned are also distributional semantic models. Non-Negative Tensor ...
J Cena's user avatar
  • 201
3 votes
1 answer
67 views

How can I train a model to modify a vector by rewarding the model based on the modified vectors nearest neighbors?

I am experimenting with a document retrieval system in which I have documents represented as vectors. When queries come in, they are turned to vectors by the same method as used for the documents. The ...
RossDeVito's user avatar
1 vote
3 answers
1k views

Machine learning - Algorithm suggestion for my problem using NLP

I am looking for a machine learning algorithm for my problem. I have a set of sentences like, ...
pyd's user avatar
  • 111
10 votes
2 answers
5k views

NN embedding layer

Several neural network libraries such as tensorflow and pytorch offer an Embedding layer. Having implemented word2vec in the past, I understand the reasoning behind wanting a lower dimensional ...
cbake's user avatar
  • 101
0 votes
1 answer
769 views

Stacking/Concatenating/Combining two vector space models

I have two vector-space models, with different dimensions. The number of vectors in one model is the same as the number of vectors in the other. I.E: if I have vector representation for a car in one ...
SFD's user avatar
  • 281
3 votes
2 answers
110 views

Collection Of Variable Length Sequences and Descriptions: A Search Problem

I have a tough problem and need some advice: Suppose I have a collection of variable length sequences, many of which are unique -- imagine the moves to a chess game, eg d4 Nf6 c4 g6 Nc3 Bg7 ...
elliptic_kid's user avatar
2 votes
2 answers
1k views

Confusion with cosine similarity

In information retrieval when we calculate the cosine similarity between the query features vector and the document features vector we penalize the unseen words in the query. Example if we have two ...
Bashar Kernel's user avatar
-1 votes
1 answer
510 views

How to improve Vector Space Models with semantic similarity?

I try to construct a classic querying system where I find the most probable candidate text for a query by computing cosine similarities of TFIDF vectors of normalized text of possible answers. This ...
Hendrik's user avatar
  • 8,467