Questions tagged [representation]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
12 views

Mapping two unrelated representation spaces with different distributions, roughly preserving similarities

I've got two embedding / representation spaces which are completely unrelated to begin with, yet I wish to find a (=any) mapping between them. Space A are feature histograms with a somewhat normal ...
nussbaum's user avatar
1 vote
1 answer
2k views

Splitting documents with langchain when a sentence straddles the a page break

I've been following this guide to Langchain: https://learn.deeplearning.ai/langchain-chat-with-your-data/lesson/3/document-splitting It seems like the Langchain document loaders treat each page of a ...
Sinnombre's user avatar
  • 153
0 votes
1 answer
86 views

Deepstack autoencoder

I'm trying to go through the first edition tabular challenge on Kaggle. Obviously my first few trials results did not satisfy me, so I went to see how other people did, and in the post of the first ...
Marek M.'s user avatar
0 votes
0 answers
26 views

How do I represent multiple seconds of video in tensors?

I want to use ResNet-18 for image features at the head of a VAE. If I have 10 seconds of video at 30 frames per second, and if ResNet-18 gives me the features of a single frame as a 512-dimensional ...
Rastapopolis's user avatar
1 vote
1 answer
273 views

Is n-gram a special instance of bag of word? What are their differences?

Is n-gram a special instance of bag of word? What are their differences? From my understanding, n-gram is when replacing the words in bag of words with n-grams, and follow the same procedures to ...
Student's user avatar
  • 411
1 vote
0 answers
41 views

Is normalization of word embeddings important?

I am doing actor-critic reinforcement learning for an environment that is best represented as a "bag-of-words". For this reason, I have opted to use a single body, multi-head approach for ...
Ryan Keathley's user avatar
1 vote
1 answer
20 views

Does feature engineering require absolute accuracy?

Sometimes when I'm studying the datasets, the text field is particularly challenging to handle. For whatever features I want to derive from the text fields, I try to apply some heuristic to ...
Student's user avatar
  • 411
1 vote
0 answers
46 views

Why are wavelet transforms not scale-equivariant?

One can rely on continuous wavelets to build a multi-resolution analysis that is equivariant ("covariant") under the action of a discrete subgroup of translation. When not downsampled, the ...
diegor's user avatar
  • 111
0 votes
1 answer
21 views

Output representation for a neural network to learn grid-based game with multiple units

I have a round based game played on a grid map with multiple units that I would like to control in some fashion using neural network (NN). All of the units are moved at once. Each unit can move in any ...
Druudik's user avatar
  • 101
1 vote
1 answer
2k views

How can i get the vector of word using BERT?

I need to get word-vectors using BERT and got this function that i think it should be the one i need ...
user5520049's user avatar
0 votes
1 answer
33 views

How to represent a "switch"-like behavior in a neural network?

I have three input variables $x_1$, $x_2$ and $d$, where $x_1$ and $x_2$ are numerical variables and $d$ is a dummy variable that takes the value of 1 or 2. How to represent the part of a neural ...
Lei's user avatar
  • 101
0 votes
2 answers
4k views

How to JUST represent words as embeddings by pretrained BERT?

I don't have enough data (i.e. I don't have enough texts) --- have only around 4k words in my dictionary. I need to compare given words, then I need to representate it as embedding. After the ...
taciturno's user avatar
  • 137
2 votes
2 answers
243 views

KNN efficient implementation

The KNN algorithm is very handy and particularly suited to some of my problems, but I can't find any resources on how to implement it in production. As a comparative example, when I use a neural ...
Nathan Jodo's user avatar
3 votes
1 answer
2k views

Difference between NCE-Loss and InfoNCE-Loss

I started looking into word2vec and was wondering what the connection/difference between the NCE-Loss and the infoNCE-Loss is. I get the basic idea of both. I have a hard time deriving one from ...
desch142's user avatar
4 votes
1 answer
5k views

What are latent representations?

I am reading some research papers about graph convolutional neural networks and I have seen the term "latent representations" used a lot. For instance, "the model was able to learn ...
user2362790's user avatar
0 votes
1 answer
283 views

How to reconstruct a scikit-learn predictor for Gradient Boosting Regressor?

I would like to train my datasets in scikit-learn but export the final Gradient Boosting Regressor elsewhere so that I can make predictions directly on another ...
Chong Lip Phang's user avatar
2 votes
1 answer
191 views

What are the Most Dissimilar MNIST Digits?

Using whatever definition of dissimilarity over sets that you'd like, what are the most dissimilar two digits in MNIST? I was thinking that a reasonable approach to answering the question would be to ...
JoeTheShmoe's user avatar
1 vote
2 answers
1k views

Using categorical and continuous variables in Deep Learning

I would like to apply a MLP to some business seller data. I found that the data is a mix of both categorical and continuous features. For what I read it is not advisable to feed a neural network with ...
Lila's user avatar
  • 217
1 vote
1 answer
88 views

Good chromosome representation in a VRPTW genetic algorithm

I have a genetic algorithm for a vehicle routing problem with time windows and I need to implement certain modifications. I am not sure what would be the best chromosome representations. I have tasks ...
Ivva Hamerníková's user avatar
1 vote
1 answer
457 views

Clustering with categorical as well as numerical features

I have dataset consisting of house prices for example. The dataset contains features such as: house size, monthly rent, house colour, location, year the house was built. I wanted to group these all ...
user102751's user avatar
1 vote
0 answers
34 views

Representation sample size- n [closed]

Need help with identifying a representation sample size 'n'. Let's say I have a very large population- infinite number of participants. I am picking the random sample from this infinite population. I ...
Effective Learning's user avatar
4 votes
1 answer
81 views

What does it exactly mean when we say that PCA and LDA are linear methods of learning data representation?

I have been reading on representation learning and I have come across this idea that PCA and LDA are linear methods of data representation, however, auto-encoders provide a non-linear way. Does this ...
Ankita Talwar's user avatar
0 votes
1 answer
93 views

A way to init sentence embedding for unsupervised text clustering, better than glove wordvec?

For unsupervised text clustering, the key thing is the init embedding for text. If we want to use deepcluster for text, the problem for text is how to get the init embedding from deep model. BERT can ...
惊天补扣's user avatar
2 votes
2 answers
244 views

Is it possible to compress a sequence of numbers through an autoencoder?

Specifically: I would like compress a set of coordinates, which map to the locations of 1's in a binary image, and then decode back to the original set. For instance, for a 16x16 image, the input ...
HighVoltage's user avatar
1 vote
1 answer
754 views

Embedding of list of objects

I have a dataset where each sample is a list of ordered items, lets say grocery list , and a label from 6 categories . each list can have up to 120 items but the mean items is 12 items in a list. i ...
Latent's user avatar
  • 293
1 vote
1 answer
625 views

What are the sparse and dense vector ? I cant undestand ,can you explain to me?please.Why do we use for?

I am new to neural networks, embeddings, etc. I am struggling understanding things like sparse representation, embeddings, and especially sparse vectors. Could you explain these to me? Why do we need ...
Tugba Ozkan's user avatar
0 votes
1 answer
32 views

Representing user information

I have a task of representing a users feature matrix , i have features like gender , age etc but I also have a multivalue feature called as "movies watched" which is essentially another table of ...
data101's user avatar
  • 191
1 vote
0 answers
12 views

Standard(s) for data representing measurement times with their interval of validity?

Is there a standard for representing the time interval of a measurement? Any actual measurement is made at a point in time with, perhaps, an interval over which it is considered valid. For example, ...
James Bowery's user avatar
1 vote
2 answers
28 views

Difference between n-dimensional of length m and m-dimensional of length n?

With respect to classifying the MNIST digits I've seen the input representation referred to as both a one-dimensional array of 748 elements and a 784-dimensional vector. Are these perspectives always ...
Paul Carey's user avatar
0 votes
1 answer
385 views

PCA, why variance of eigen values is measure of its utility?

Source - Murphy, 12.3 Heuristic for assessing applicability of PCA. Let the empirical covariance matrix Σ have eigenvalues λ1≥λ2≥···≥λd>0, with mean λ. Explain why the variance of the eigen values, ...
Deep shanky's user avatar
9 votes
2 answers
367 views

Are there any graph embedding algorithms like this already?

I wrote an algorithm for generating node embeddings based on the graph's topology. Most of the explanation is done in the readme file and the examples. The question is: Am I reinventing the wheel? ...
monomonedula's user avatar
0 votes
1 answer
16 views

Membership ratio graph

Does anyone know how the what the kind of graph in this image is called? Each color represents a class and the height of the color, in a particular instant, represents the ratio of elements that ...
Claudio P's user avatar
  • 103
0 votes
2 answers
54 views

Is there any option to represent 160 discrete variables each one with their own color in scatter plot?

I want to know if it is possible to represent with different colours in a scatter plot more than 10 parameters instead of putting others and assigning a colour if the number of parameters overpasses ...
Carlota's user avatar
  • 11
5 votes
1 answer
683 views

What does 'Linear regularities among words' mean?

Context: In the paper "Efficient Estimation of Word Representations in Vector Space" by T. Mikolov et al., the authors make use of the phrase: 'Linear regularities among words'. What does that mean ...
Dawny33's user avatar
  • 8,256
1 vote
0 answers
26 views

Daily-level variables and weekly-level variables at the same model

I am running a model which has NPS (Net Promoter Score) as its target and various predictors among which some CSAT (Customer Satisfaction) data. The rest of the predictors are good to use at daily ...
Outcast's user avatar
  • 1,057
4 votes
1 answer
331 views

Why ELMo's word embedding can represent the word better than glove?

I have read the code of ELMo. Based on my understanding, ELMo first init an word embedding matrix A for all the word and then add LSTM ...
惊天补扣's user avatar
1 vote
1 answer
629 views

How to deal with Optional Input

I'm from the vision world and only worked with pixels from 0-255, ignoring any side effects. My current problem is different, in the way that I cannot rely on the input data. What my problem is: I ...
J. Peters's user avatar
1 vote
1 answer
882 views

faster alternatives to sparse.model.matrix?

I have a large dataset that is entirely categorical. I'm trying to train with it using xgboost, so I must first convert this categorical data to numerical. So far I've been using sparse.model.matrix() ...
Isaac T's user avatar
  • 11
2 votes
1 answer
79 views

Learning Football Player Stats like FIFA's by only the game result [closed]

It is a general question on how to learning representation of one entity but the dataset is mixed with a lot of other entities, which their statis are always waiting to be learnt. The question is ...
palazzo train's user avatar
1 vote
1 answer
935 views

Neural Nets: unordered sets of ordered tuples as features of data

I'm working on a very small scale pet project in which inputs are essentially sets of (x, y) pairs, and are to be classified into categories, using deep learning, specifically using Keras (I know this ...
Alex's user avatar
  • 131
0 votes
1 answer
615 views

How to learn from multiple data sources with different input variables but the same underlying pattern?

I will explain with an example: Let's say you have 2 factories that produce pulp paper. Each have similar processes where the laws of physics give the same outcome. Now let's say this 2 factories ...
juan Isaza's user avatar
8 votes
2 answers
20k views

Why don't tree ensembles require one-hot-encoding?

I know that models such as random forest and boosted trees don't require one-hot encoding for predictor levels, but I don't really get why. If the tree is making a split in the feature space, then isn'...
moefasa's user avatar
  • 83