Data Science

Questions tagged [unsupervised-learning]

Ask Question

Finding hidden (statistical) structure in unlabelled data, including clustering and feature extraction for dimensionality reduction.

15 questions
Newest
Active
Bountied
Unanswered
Filter by
Sorted by
Tagged with
5
votes
1answer
828 views

Combine two sets of clusters

I have two sets of topics obtained from two different sets of news paper articles. In other words, Cluster_1 = ${x_1, x_2, ..., x_n}$ includes the main topics of 'X' news paper set and Cluster_2 = ${...
1
vote
0answers
31 views

How can realize the evaluation/validation of unsupervised models through unlabeled data?

I'm researching anomaly detection, which is nothing else than outliers detection on a set of time-series web servers access log data or network traffic. Recently I re-faced to following fundamental ...
24
votes
1answer
26k views

Word2Vec vs. Sentence2Vec vs. Doc2Vec

I recently came across the terms Word2Vec, Sentence2Vec and Doc2Vec and kind of confused as I am new to vector semantics. Can someone please elaborate the differences in these methods in simple words. ...
3
votes
3answers
83 views

Better approach to assign values to determine potential fake sentences

I am trying to assign different values for each sentences based on information about the presence of hashtags, upper case letters/words (e.g. HATE) and some others. I created a data frame which ...
5
votes
1answer
1k views

What does it mean by “t-SNE retains the structure of the data”?

I was learning about t-SNE when I was told that t-SNE retains the structure of the data in the embeddings. What exactly does this mean ? How does the algorithm achieve this ? So far I have ...
2
votes
1answer
1k views

Estimating Predictive Uncertainty for unlabeled data

I am trying to estimate the predictive uncertainty for a deep neural network. While I do have a labeled training set, I´m trying to measure uncertainty for some unlabeled production data. This paper ...
6
votes
2answers
7k views

Why will the accuracy of a highly unbalanced dataset reduce after oversampling?

I have created a synthetic dataset, with 20 samples in one class and 100 in the other, thus creating an imbalanced dataset. Now the accuracy of classification of the data before balancing is 80% while ...
4
votes
5answers
5k views

Best approach for this unsupervised clustering problem with categorical data?

I'm a software engineer new to Machine Learning. I've read about basic non-supervised techniques like k-means and hierarchical clustering and now I'm trying to put them into practice with a basic ...
2
votes
1answer
1k views

How hidden layer is made binary in Restricted Boltzmann Machine (RBM)?

In RBM, in the positive phase for updating the hidden layer(which should also be binary), [Acually consider a node of h1 ∈ H(hidden layer vector)] to make h1 a binary number we compute the probability ...
8
votes
1answer
749 views

Ideas for prospect scoring model

I have to think about a model to identify prospects (companies) that have a high chance of being converted into clients, and I'm looking for advice on what kind of model could be of use. The ...
5
votes
1answer
102 views

How do I interpret my result of clustering?

I am working on a clustering problem. I have 11 features. My complete data frame has 70-80% zeros. The data had outliers that I capped at 0.5 and 0.95 percentile. However, I tried k-means (python) on ...
3
votes
1answer
168 views

What value can I gain by doing exploratory data analysis on features (and thus data) before doing clustering?

This might not be a very good question, but I would still ask if it's beneficial to do EDA before running a clustering algorithm? I understand that EDA helps us generate good and helpful insights ...
3
votes
4answers
10k views

is it possible to do feature selection for unsupervised machine learning problems?

I started looking for ways to do feature selection in machine learning. By having a quick look at this post , I made the assumption that feature selection is only manageable for supervised learning ...
2
votes
4answers
80 views

Unsupervised clustering without of Data which is supposed to be on a linear function

When I have a dataset where each datum has x and y, and the (x,y) has a relation of one of <...
1
vote
2answers
30 views

Unsupervised Clustering for n-length word arrays

I have a series of arrays [Apple,Banana,Cherry,Date] [Apple,Fig,Grape] [Banana,Cherry,Date,Elderberry] [Fig,Grape] and I would like to build some clusters that ...