Questions tagged [unsupervised-learning]

Finding hidden (statistical) structure in unlabelled data, including clustering and feature extraction for dimensionality reduction.

Filter by
Sorted by
Tagged with
0
votes
0answers
7 views

Is it wise to include the target labels when a supervised learning problem is tackled as an unsupervised learning problem?

I have a problem which requires both a supervised and unsupervised learning approach. This is because I am trying to find some hidden clusters (if they even exist) beyond the labels of the dataset. ...
0
votes
1answer
21 views

Neural Networks for Unsupervised Learning

Why cannot we use neural networks for unsupervised learning problem. I do know that it can be used using the Kohenon’s Self Organizing Map (KSOM) but is this the only method that we can use or are ...
0
votes
1answer
6 views

Cluster evolution over time

I have a dataset of transactional data with customer ID and I want to segment the dataset into groups using cluster analysis. I'm interested in following the evolution of each cluster over time, but ...
1
vote
1answer
45 views

Risk score from Neural Network classifier (more than 2 categories)

I am trying to use a Neural Network to perform multiclass classification. The classes represent Insurance Risk Level. The most risky level is Level 1, the least risk corresponds to Level 10. The ...
1
vote
1answer
22 views

NER with Unsupervised Learning?

If we treated NER as a classification/prediction problem, how would we handle name entities that weren't in training corpus? For example, "James was born in England." James was labeled as a PERSON ...
0
votes
0answers
18 views

How to evaluate unsupervised KNN?

I'm creating a recommender system using an unsupervised nearest neighbors model to suggest similar publishers for a given publisher, advertiser combination. I'm wondering how to evaluate the model I ...
1
vote
0answers
24 views

How to tune / choose the preference parameter of AffinityPropagation?

I have large dictionary of "pairwise similarity matrixes" that would look like the following: similarity['group1']: ...
0
votes
0answers
24 views

Dataset Image creation suggestions

I am trying to create a dataset where the Text is mixed, e.g. " I love football" can be written as " I l()v3 F00tba11". The idea is that by using Tesseract I can find the pattern to match these two ...
1
vote
1answer
26 views

How to find similar points to a positive set when you don't have any negative set?

The task I'm used to do is the following. A client comes to see me with a set of clients (called positive companies) and he wants me to find other similar prospects. Usually, he also gives me a set of ...
1
vote
1answer
21 views

what arguments should I pass to dbscan or optic in order to divid the data in a specific way

I have thousands of very similar data set that needs to be divided in diagonal way to two groups. for example: and I tried to play with the argument of dbscan and optic as eps and minPoints and even ...
1
vote
1answer
21 views

Unsupervised Clustering for n-length word arrays

I have a series of arrays [Apple,Banana,Cherry,Date] [Apple,Fig,Grape] [Banana,Cherry,Date,Elderberry] [Fig,Grape] and I would like to build some clusters that ...
2
votes
3answers
33 views

Supervised clustering

I'm working on a clustering problem. I have a training set composed of sets of points where the clusters are known and I want to find the good clusters on a testing dataset. It's a kind of supervised ...
1
vote
1answer
17 views

Unsupervised Algorithm for hybrid data [duplicate]

I have a hybrid data that contains 15 categorical data and 4 continuous data. I need to implement a prediction on the data. So as I don't have any labeled data, I need to implement the unsupervised ...
0
votes
0answers
10 views

Pre-trained image recognition model to label new instances of retail products

Can you recommend unsupervised image recognition models that can be loaded/ transfered? My task is to provide labels to images of retail products (the N of classes is unknown and potentially huge (~...
2
votes
0answers
23 views

How to remove noise using morphological filtering

I have two groups of dots that both contain noise between them: The line that separates the two groups in the picture is diagonal in shape. I tried to use morphological filtering on this image to ...
0
votes
0answers
21 views

How to calculate Fuzzy C-Means problem by hand

I figured that this doubt next can interest another students like me and help others also that are trying to understand mathematically the fuzzy c-means mathematical mechanism already that some books ...
2
votes
1answer
25 views

Feature extraction in audio spectrogram

I have audio and its spectrogram of the words in English language. (A spectrogram is a frequency domain representation of a signal) Consider the words: chain, change, chair, chapter. As you can notice,...
-1
votes
1answer
16 views

Are DBSCAN and dbscan from the sklearn.cluster package different?

I'm new to DBSCAN. I was looking at a few examples online and came across a few instances where the following lines were used while importing the dbscan module: <...
0
votes
1answer
31 views

trade offs between number of features with its score

I am running k-mean clustering on ~200000 samples. The dataset has in total 14 features. One feature is id and the rest are categorical. I have been playing with ...
0
votes
0answers
9 views

Using Unsupervised / Supervised Learning for RGB manipulation

I need to teach a model(or any substitute) for automatically adjusting the concentration of R, G, and B values until they make up white colour. i.e, tweak the RGB values (beginning from some arbitrary ...
1
vote
1answer
36 views

Metrics for unsupervised doc2vec model

I have just built a simple doc2vec model using the gensim library, pretty much followed the tutorial located here. The methods provided for checking the quality of the model are very manual and ...
0
votes
1answer
29 views

What machine learning algorithm should I use for specific user configuration?

I have a data-set that contains thousands of employee data, including their role, department (Applications Developer, IT Support, Network Management etc.), and using one-hot encoding all of the ...
0
votes
1answer
24 views

Image clustering with deep learning

I want to cluster image, since varibility intra and inter class of images is huge I think reducing dimensions with a convolutional autoencodeur can be a good tools. Then I apply clustering on the ...
1
vote
1answer
40 views

Is there any method to determine which clustering algorithm to use on a particular dataset?

I'm having a hard time getting kmeans to cluster data effectively. It fails to segment data well even for a simple attribute with 5 categories. I'm aware of DBSCAN, Hierarchical Clustering and GMM. ...
0
votes
1answer
32 views

Clustering (unsupervised learning) for uneven classes

I am looking for an unsupervised method that can see also the points that start to look different from the majority. Which clustering techniques (I use python) can be used for such data sets? I have ...
0
votes
2answers
50 views

Applying and Visualizing k means clustering on a data set that has 9 features

I had a data set of images that I have extracted 9 numerical features that I want to apply k means clustering or hierarchical clustering to. I'm just not sure how to go about it. The tutorials I have ...
0
votes
0answers
235 views

Anomaly detection using k-means clustering in Python

I'm working on an anomaly detection task in Python. Datasets regard a collection of time series coming from a sensor, so data are timestamps and the relative values. In order to find anomalies, I'm ...
1
vote
0answers
21 views

Train CNN-RNN network for multi label video classification with sliding window technique

I’m implementing a model in which a CNN model is used to extract feature sequences from videos , and RNN is used to analyze the generated feature sequences, and output a multi label classification ...
1
vote
2answers
17 views

How to use a deep learning algorithm to cluster image *styles* in an unlabeled data set?

I have a hard problem, and I'd be interested in hearing people's thoughts. I have a set of images depicting a large variety of phenomena, but only a few styles. The images are already labeled by ...
0
votes
1answer
50 views

I have 32k black and white images. Want to do clustering on them

As the title says I'm trying to do clustering on a set of black and white images. These images are all 200x200 with black dots on a white canvas Example pics here (These are not actual photos from the ...
0
votes
1answer
79 views

Clustering with geolocation (lat/long pairs) attributes

I am trying to cluster customer behavior based on where they shop given by lat/long pairs. I also have other numeric attributes such as volume, average amount spent, etc. I am considering using ...
0
votes
0answers
12 views

Extract data from mainly unstructured sets and derive risk metrics out of those

I have the following question (this was a real life example): Q: Extract data from mainly unstructured sets and derive risk metrics out of those. From what you know or imagine about the data ...
4
votes
1answer
339 views

Isolation forest sklearn contamination param

I'm working on an unsupervised anomaly detection task on time series using isolation forest algorithm. I'm developing in Python, more in detail using sklearn. I found out a lot of examples on this, ...
0
votes
0answers
15 views

Design / Choice of Autoencoder to classify temporal pattern in images

Suppose I have a temporal stack of images of shape $m \times n \times k$ where shape of each image is $m \times n$ and $k$ represents the temporal dimension. In this context, I am trying to detect and ...
0
votes
0answers
9 views

Unsupervised CNN - STN

I would like to implement unsupervised CNN to make affine registration. My input : 64x64x1, binary image of square which are warped, translations and rotations. I use normalize Cross Correlation for ...
0
votes
1answer
40 views

Feature selection or Dimension reduction in unsupervised learning

I'm trying to do Embedded clustering using kmeans. This is customer data, so it involves a lot of sentences, so I'm using the universal sentence encoder before clustering. But I should be doing a ...
0
votes
0answers
32 views

Optimizing Market Basket Analysis by limiting threshold

I'm creating a suggestion model through MBA. I observed that in my particular model, that if the min_support was placed as 0, the model would take an insanely long ...
0
votes
1answer
40 views

Clustering with custom criterion (minimum cluster weight)

Edit: following comment from @anony-mousse, I'm changing the question to search for a general clustering approach that matches this criterion (minimum weight per cluster). I am to use a clustering ...
1
vote
1answer
37 views

approach for predicting machine failure using maintenance history

I have been struggling with this problem for a while now and I finally decided to post a question here to get some help. The problem i'm trying to solve is about predictive maintenance. Specifically, ...
1
vote
2answers
67 views

Standardization After PCA for Kmean clustering

I want to apply Kmean for clustering after PCA dimensionality reduction. I have standardized data with StandardScaler before the PCA, then I want to train Kmeans for finding clusters. However, the ...
2
votes
1answer
43 views

Methodology for driving score(behavior)

I am an intern at mobility data company and a Master's candidate in Statistics. I am researching about driving score which is based on a driver's driving habit. We have trip data which contains the ...
1
vote
0answers
43 views
0
votes
0answers
29 views

Unsupervised learning/ clustering for data with multiple categorical variables

Dataset: I have been trying unsupervised clustering algorithms (K-modes & SOM) to cluster the students based on their grades in 3 exams. Should I one-hot encode the data (even though grades are ...
0
votes
0answers
37 views

Map predictions to real text

I have read the paper "Learning to Read by Spelling" by Gutpa et al. They present a method for visual text recognition without using any paired supervisory data. In chapter 4 they describe how to ...
1
vote
4answers
41 views

K-modes clustering: Estimating which features were most impactful on clustering?

I have entirely categorical data (survey results from users), so I've used k-modes clustering to better understand my users. I'm not an expert at clustering methods at all. Is there a way to known ...
0
votes
3answers
156 views

How can Clustering (Unsupervised Learning) be used to improve the accuracy of Linear Regression model (Supervised Learning)

I came through this questions and I failed to find the right answer for it. How can Clustering (Unsupervised Learning) be used to improve the accuracy of Linear Regression model (Supervised Learning)?...
0
votes
0answers
19 views

Can I save an Unsupervised Deep Learning model?

I'm trying to solve some unsupervised problem with Deep Learning but I'm working with a Java Desktop application. I want to use Deeplearning4J for this task. However, I still want to code in python. ...
0
votes
0answers
11 views

semi supervised learning using transfer learning and shared memory

I am reading a paper here and I am not sure I am understanding something. They claim to have 83% unsupervised on CIFAR 10, but they used something that is semi supervised. At the very least, they used ...
0
votes
0answers
16 views

How does t-sne scale work? Is it possible to compare scales of two t-sne plots?

I have used t-sne for two convolutional layers of binary classifier (VGG16 like CNN). I want to compare them, but I am not sure if that is okay as the scales of these two outputs from t-SNE plots can ...
0
votes
3answers
86 views

What kind of learning in this training situation when anomaly detection? Supervised learning,semi-supervised learning or unsupervised learning?

I am doing anomaly detection recently, one of the methods is using AEs model to learn the pattern of normal samples. Determine it as an abnormal sample if it doesn’t match the pattern of normal ...