Questions tagged [representation]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

Can anyone please help me understand what is disentangled hierarchical representation?

I understand that disentangled representations are those in which each dimension represents only one property. For example, say we have pictures of digits where latent space representation Z has Z1 ...
0
votes
0answers
6 views

Output representation for a neural network to learn grid-based game with multiple units

I have a round based game played on a grid map with multiple units that I would like to control in some fashion using neural network (NN). All of the units are moved at once. Each unit can move in any ...
0
votes
1answer
44 views

How can i get the vector of word using BERT?

I need to get word-vectors using BERT and got this function that i think it should be the one i need ...
0
votes
0answers
7 views

Can we consider Meta-features of a datasets as its embeddings?

While reading some works on meta-learning. I had this doubt. Can we consider meta-features of a dataset as it's embedding ? Given the meta-feature is a lower dimensional representation which also try ...
0
votes
0answers
16 views

Understanding fastText

fastText is Facebook's open source software to obtain word embeddings (the original paper). Given a document indexed by $n$ and represented by list of n-gram ...
0
votes
1answer
26 views

How to represent a "switch"-like behavior in a neural network?

I have three input variables $x_1$, $x_2$ and $d$, where $x_1$ and $x_2$ are numerical variables and $d$ is a dummy variable that takes the value of 1 or 2. How to represent the part of a neural ...
0
votes
2answers
898 views

How to JUST represent words as embeddings by pretrained BERT?

I don't have enough data (i.e. I don't have enough texts) --- have only around 4k words in my dictionary. I need to compare given words, then I need to representate it as embedding. After the ...
2
votes
2answers
87 views

KNN efficient implementation

The KNN algorithm is very handy and particularly suited to some of my problems, but I can't find any resources on how to implement it in production. As a comparative example, when I use a neural ...
0
votes
0answers
17 views

How does LDA model do inference on new documents?

Through Latent Dirichlet Allocation (LDA) one can learn topics from texts. The trained topic model can then be used on unseen data to infer to what extent each of the learned topics are represented in ...
2
votes
0answers
161 views

Difference between NCE-Loss and InfoNCE-Loss

I started looking into word2vec and was wondering what the connection/difference between the NCE-Loss and the infoNCE-Loss is. I get the basic idea of both. I have a hard time deriving one from ...
2
votes
1answer
261 views

What are latent representations?

I am reading some research papers about graph convolutional neural networks and I have seen the term "latent representations" used a lot. For instance, "the model was able to learn ...
0
votes
1answer
104 views

How to reconstruct a scikit-learn predictor for Gradient Boosting Regressor?

I would like to train my datasets in scikit-learn but export the final Gradient Boosting Regressor elsewhere so that I can make predictions directly on another ...
2
votes
1answer
38 views

What are the Most Dissimilar MNIST Digits?

Using whatever definition of dissimilarity over sets that you'd like, what are the most dissimilar two digits in MNIST? I was thinking that a reasonable approach to answering the question would be to ...
1
vote
2answers
483 views

Using categorical and continuous variables in Deep Learning

I would like to apply a MLP to some business seller data. I found that the data is a mix of both categorical and continuous features. For what I read it is not advisable to feed a neural network with ...
1
vote
1answer
42 views

Good chromosome representation in a VRPTW genetic algorithm

I have a genetic algorithm for a vehicle routing problem with time windows and I need to implement certain modifications. I am not sure what would be the best chromosome representations. I have tasks ...
1
vote
1answer
150 views

Clustering with categorical as well as numerical features

I have dataset consisting of house prices for example. The dataset contains features such as: house size, monthly rent, house colour, location, year the house was built. I wanted to group these all ...
1
vote
0answers
29 views

Representation sample size- n [closed]

Need help with identifying a representation sample size 'n'. Let's say I have a very large population- infinite number of participants. I am picking the random sample from this infinite population. I ...
3
votes
1answer
53 views

What does it exactly mean when we say that PCA and LDA are linear methods of learning data representation?

I have been reading on representation learning and I have come across this idea that PCA and LDA are linear methods of data representation, however, auto-encoders provide a non-linear way. Does this ...
0
votes
1answer
52 views

A way to init sentence embedding for unsupervised text clustering, better than glove wordvec?

For unsupervised text clustering, the key thing is the init embedding for text. If we want to use deepcluster for text, the problem for text is how to get the init embedding from deep model. BERT can ...
2
votes
2answers
99 views

Is it possible to compress a sequence of numbers through an autoencoder?

Specifically: I would like compress a set of coordinates, which map to the locations of 1's in a binary image, and then decode back to the original set. For instance, for a 16x16 image, the input ...
0
votes
1answer
194 views

Embedding of list of objects

I have a dataset where each sample is a list of ordered items, lets say grocery list , and a label from 6 categories . each list can have up to 120 items but the mean items is 12 items in a list. i ...
0
votes
1answer
218 views

What are the sparse and dense vector ? I cant undestand ,can you explain to me?please.Why do we use for?

I am new to neural networks, embeddings, etc. I am struggling understanding things like sparse representation, embeddings, and especially sparse vectors. Could you explain these to me? Why do we need ...
0
votes
1answer
30 views

Representing user information

I have a task of representing a users feature matrix , i have features like gender , age etc but I also have a multivalue feature called as "movies watched" which is essentially another table of ...
1
vote
0answers
12 views

Standard(s) for data representing measurement times with their interval of validity?

Is there a standard for representing the time interval of a measurement? Any actual measurement is made at a point in time with, perhaps, an interval over which it is considered valid. For example, ...
1
vote
2answers
25 views

Difference between n-dimensional of length m and m-dimensional of length n?

With respect to classifying the MNIST digits I've seen the input representation referred to as both a one-dimensional array of 748 elements and a 784-dimensional vector. Are these perspectives always ...
0
votes
1answer
233 views

PCA, why variance of eigen values is measure of its utility?

Source - Murphy, 12.3 Heuristic for assessing applicability of PCA. Let the empirical covariance matrix Σ have eigenvalues λ1≥λ2≥···≥λd>0, with mean λ. Explain why the variance of the eigen values, ...
8
votes
2answers
222 views

Are there any graph embedding algorithms like this already?

I wrote an algorithm for generating node embeddings based on the graph's topology. Most of the explanation is done in the readme file and the examples. The question is: Am I reinventing the wheel? ...
0
votes
1answer
14 views

Membership ratio graph

Does anyone know how the what the kind of graph in this image is called? Each color represents a class and the height of the color, in a particular instant, represents the ratio of elements that ...
0
votes
2answers
47 views

Is there any option to represent 160 discrete variables each one with their own color in scatter plot?

Good morning, I want to know if it is possible to represent with different colors in scatter plot more than 10 parameters instead of putting others and assign a color if the amount of parameters ...
2
votes
1answer
463 views

What does 'Linear regularities among words' mean?

Context: In the paper "Efficient Estimation of Word Representations in Vector Space" by T. Mikolov et al., the authors make use of the phrase: 'Linear regularities among words'. What does that mean ...
1
vote
0answers
22 views

Daily-level variables and weekly-level variables at the same model

I am running a model which has NPS (Net Promoter Score) as its target and various predictors among which some CSAT (Customer Satisfaction) data. The rest of the predictors are good to use at daily ...
4
votes
1answer
275 views

Why ELMo's word embedding can represent the word better than glove?

I have read the code of ELMo. Based on my understanding, ELMo first init an word embedding matrix A for all the word and then add LSTM ...
1
vote
1answer
260 views

How to deal with Optional Input

I'm from the vision world and only worked with pixels from 0-255, ignoring any side effects. My current problem is different, in the way that I cannot rely on the input data. What my problem is: I ...
1
vote
1answer
688 views

faster alternatives to sparse.model.matrix?

I have a large dataset that is entirely categorical. I'm trying to train with it using xgboost, so I must first convert this categorical data to numerical. So far I've been using sparse.model.matrix() ...
2
votes
1answer
68 views

Learning Football Player Stats like FIFA's by only the game result [closed]

It is a general question on how to learning representation of one entity but the dataset is mixed with a lot of other entities, which their statis are always waiting to be learnt. The question is ...
1
vote
1answer
667 views

Neural Nets: unordered sets of ordered tuples as features of data

I'm working on a very small scale pet project in which inputs are essentially sets of (x, y) pairs, and are to be classified into categories, using deep learning, specifically using Keras (I know this ...
0
votes
1answer
510 views

How to learn from multiple data sources with different input variables but the same underlying pattern?

I will explain with an example: Let's say you have 2 factories that produce pulp paper. Each have similar processes where the laws of physics give the same outcome. Now let's say this 2 factories ...
7
votes
2answers
16k views

Why don't tree ensembles require one-hot-encoding?

I know that models such as random forest and boosted trees don't require one-hot encoding for predictor levels, but I don't really get why. If the tree is making a split in the feature space, then isn'...