A message from our CEO about the future of Stack Overflow and Stack Exchange. Read now.

Questions tagged [clustering]

Cluster analysis or clustering is the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to each other than to those in other groups (clusters). It is a main task of exploratory data mining, and a common technique for statistical data analysis, used in many fields, including machine learning, pattern recognition, image analysis, information retrieval etc.

Filter by
Sorted by
Tagged with
1
vote
1answer
20 views

Does K - Means clustering on data reduced using PCA and the original data make any difference?

I am working on clustering and I have 90 features with 13500 data points and after removing the correlated variables which had pearson correlation more than 90% my feature space reduced to 70. Also, ...
1
vote
1answer
35 views

Assistance needed on what machine learning approach to use

👋 I'm currently writing my Master's Thesis on Subjective tagging of sounds and I feel that I've been stuck with the same problem for quite a time now and need assistance to progress. I'll in short ...
2
votes
2answers
31 views

Is k-means with Mahalanobis a valid option for clustering?

I want more info into if k-means with Mahalanobis distance is a mathematically/methodologically correct option for datasets with different variance clusters. The steps are: Create aggregate datasets (...
1
vote
1answer
27 views

Using TSNE to Visualize Clusters in Python

I'm using TSNE to visualize my clusters but the output seems a bit strange. There are supposed to be 3 clusters but instead, there are 4 lines. Is there something wrong with how I'm visualizing them ...
1
vote
0answers
8 views

Estimating minPts in DBSCAN for document layout clustering

I am trying to choose parameters for DBSCAN clustering algorithm, in particular minPts. The Wikipedia article suggests a rule of thumb to derive minPts from the number of dimensions D in the data set....
1
vote
0answers
12 views

News de duplication dataset

I am looking for a news dataset with semantically duplicate news articles tagged. Basically all the news articles which talk about the same story should be grouped. The stories can be worded ...
0
votes
1answer
22 views

comparison of t-SNE and PCA and truncate SVD

How to compare the trucate SVD ,PCA, and T-SNE? What we can say about features if t-SNE and PCA and truncate SVD digaram is in this figure?
4
votes
0answers
27 views

What are practical differences between kernel k-means and spectral clustering?

I've been lately wondering about kernel k-means and spectral clustering algorithms and their differences. I know that spectral clustering is a more broad term and different settings can affect the ...
3
votes
1answer
14 views

Identify members who are likely to switch where they receive drug administration

I have access to medical claim data from a large health insurance company. As some of you may know there is a large delta between the price of drug X depending on where it is administered. My ...
3
votes
4answers
260 views

Clustering algorithm which does not require to tell the number of clusters

I have a dataframe with 2 columns of numerical values. I want to apply a clustering algorithm to put all the entries into the same group, which have a relatively small distance to the other entries. ...
1
vote
1answer
39 views

How to save and load model from unsupervised learning?

[Beginner] Sorry if this is dumb question. I am following the model from this article and below. ...
2
votes
1answer
21 views

How to retrain a K-Modes model based on daily data?

I have read that retraining a model depends highly on what you are trying to achieve. I am conscious that maybe I need to retrain my model daily and after a certain time I have to train the model ...
1
vote
2answers
22 views

Best clustering algorithm to identify clusters and determine the closet cluster each individual response is near?

I have a survey where each question is related to a different 'shopper' type (there are 5 types so 5 questions). Each question is either binary (True/False) or scale based. IE: ...
1
vote
0answers
11 views

Coding a Content Addressable Memory on a GPU

I´m trying to code a CAM or more simply a dictionary storing the pointer of the data accessible by a key. I try to do it with a GPU but all attempts have been inefficient compared on using System....
1
vote
1answer
78 views

Tableau: Clustering based on value-range for map coloring

Is there a possibility to cluster coloring for certain statistical ranges? This is what I have been able to achieve so far.
2
votes
1answer
16 views

Clustering Weekday Weekend Data and Multicollinearity

Hi I have data of weekday and weekend step counts in which I extracted metrics from them such as the wd steps, we steps, standard deviation of wd steps, standard deviation of we steps and so on... <...
4
votes
2answers
109 views

Is it possible to run clustering methods by only knowing the distance between pair of points?

By knowing each data point's coordinate, it is easy to apply them with clustering methods as k-means etc. By if the case is we only know the distances between each pair of data points without knowing ...
2
votes
0answers
29 views

What's the good index to choose number of clusters so that obtained clusters are homogeneous?

I perform a clustering on one-dimensional dataset and I need a way to automatically decide what's the optimal number of clusters from $k \in \{2, 3, 4, 5, 6\}$. The number of observations to cluster ...
2
votes
1answer
27 views

Cluster elements that appear in the same lists

Suppose I have a multitude of sets with (unordered) combinations of elements and I want to determine which elements tend to appear together. For example Given the following sets: ...
6
votes
3answers
96 views

Why spectral clustering results in disjointed cluster?

I'm working on a project where I have to dynamically cluster the position of objects with respect to one coordinate. So I'm essentially dealing with subsequent frames and each frame represents a one-...
1
vote
2answers
30 views

Plots of data using DBSCAN algorithm not making sense

I am using clustering for my data. Since the DBSCAN algorithm will also tell me an estimate of clusters that I can use, I have used DBSCAN. I have tried for the ...
0
votes
1answer
17 views

Are cluster feature and micro-cluster good summury statics for outlier detection in high dimensional data streams?

I'm dealing with outlier detection in data streams. I'm looking for a way to summarize my data and obtain important statistics such as means and variance, etc. I want to know if the cluster features ...
1
vote
1answer
19 views

Is there any good practice to cluster 3D data array?

So I'm not sure what word fits best to describe this data, probably "dimension" would be wrong since it may be used for flat samples with 3 features; but by 3D data I mean some structure in a form of ...
2
votes
2answers
64 views

KMeans clustering for Image Data

I am trying to cluster the sample of Imagenet Dataset using K-Means clustering. In this approach, I have used the below 2 approaches to get the optimal number of clusters. Elbow method From the ...
0
votes
0answers
15 views

clustering changing Label

I have dataset with clustering label (this label is the group of each point) and I want to create such recommendation system or any other model to help the point for changing his group (for example ...
0
votes
0answers
16 views

which algorithm used by sklearn.model_selection.StratifiedShuffleSplit for clustering into n_splits

which algorithm is used by sklearn class StratifiedShuffleSplit for clustering/stratification into n_split. dendrogram looks evident but can anyone suggest any reference. class sklearn....
1
vote
1answer
46 views

Clustering with 0 or Null values

I want to do some clustering for a dataset where I am looking at 10,000 peoples usage of certain electronic devices. I have 11 columns; the first column is simply a URN representing each person in the ...
-1
votes
1answer
21 views

Can a machine learning model be trained on Call Detail Record(CDR) Data to predict user's daily locations?

I have a CDR data for two months and my goal is to extract daily or frequent locations(cell towers) of the user along with the departure and arrival time on those locations. The spatial resolution of ...
0
votes
1answer
27 views

PCA before Affinity Propagation (AP)

I have a large-ish dataset (100k samples, ~100 features), that I am trying to cluster, to an unknown number of clusters. I thought of using PCA first, to reduce dimensionality, since I understand that ...
2
votes
2answers
32 views

Clustering list of list of integers

I have ~100 sets of samples with integer IDs. For example, 3 of them could be: a = [0, 1, 3, 4, 6...] b = [1, 5, 9, 102...] c = [1, 7, 10, 42...] I am looking to ...
1
vote
2answers
38 views

Clustering initialization

I'm running into a problem while working on clustering. I work on data with white Gaussian noise. All of the methods I have come across use some sort of random initialization to set up the mean and ...
1
vote
0answers
19 views

Hierarchical Clustering on transaction data

Problem Statement: Let's say I have buyer transactional data for every product, features are categorical and numeric. I want to cluster purchases that have similar attributes in terms of who's ...
0
votes
0answers
7 views

Finding differences in smooth embedding spaces?

I'm trying to find statistically significant differences between embeddings (by an autoencoder) of different datasets. At first I tried to embed them separately, and cluster them. However, the ...
0
votes
0answers
26 views

Evaluation of multi-label clustering

I am trying to find some evaluation methods for multi-label clustering. I refer to this paper: Kai Tian, Meghan Revelle, and Denys Poshyvanyk: Using Latent Dirichlet Allocation for Automatic ...
0
votes
0answers
26 views

Transform skewed ratio data (value range from 0 to 1) to reduce the skew

I want data clusters. Because my cluster algorithm doesn't work with skewed data I want to change that in advance. I have ratio data, i mean probabilities (values between 0 and 1). But these data are ...
0
votes
1answer
11 views

Topic models for non-textual data?

I am looking to employ an unsupervised clustering on a dataset where each observation has a mix of textual and non-textual features. For each observation, I combine the features into a single vector ...
1
vote
1answer
234 views

How to evaluate the K-Modes Clusters?

K-modes algorithm is available here I want to do clustering of my binary dataset. I need to specify the number of clusters that I need as an output: ...
3
votes
2answers
67 views

KMeans clusterization on documents

Whether correct or not, I'm not able to judge being myself in the early days of the Data Science. However, I have applied a Kmeans on a corpus where some random documents (very short sentences) have ...
2
votes
1answer
29 views

Remove noise by clustering on which step of pre-processing is better?

I am working on a classification task. The dataset is a UCI data set about machine learning with 200 observations and 2 classes. Part of my model includes the following preprocessing steps: remove ...
0
votes
2answers
29 views

How can I improve the results of my clustering

I am working on a project with the idea to cluster the sound waves of key strokes on a computer. So far what I have done was recorded about 50 keystrokes per key (only have done 1 - 10 so far), found ...
0
votes
0answers
9 views

What is an appropriate statistical method for determining correlations between variables with likert scale data?

I am conducting an exploratory analysis with a dataset of about 200 records (all likert scales (numeric)). I aim to determine the correlations between the different variables that the responses ...
0
votes
1answer
54 views

Feature transformation possible at selected features or only at all?

I want to cluster. I have different features for that. Some features have a very small value range (from 0 to 0.8) and some have a very large value range (from 0 to 5 million). I want to use the ...
2
votes
1answer
47 views

Evaluate clustering by using decision tree unsupervised learning

I am trying to evaluate some clustering results that a company did for some data but they used an evaluation method for clustering that i have never seen before. So i would like to ask your opinion ...
0
votes
1answer
41 views

Labels are not given for multiclass classification problem

I have probably a weird question. If you are dealing with a multiclass classification problem, do you always have already determined target output/labels? I have e.g. a huge data set with a lot of ...
2
votes
1answer
39 views

K-Means initialization

K-Means initializes the centroids randomly, but there are other methods to initialize. In this paper, http://ilpubs.stanford.edu:8090/778/1/2006-13.pdf, they propose randomly choosing a data point ...
1
vote
1answer
65 views

will k-means clustering converge to the same results given the same data set?

I did some study on the k-means clustering algorithm. It seems that the only non-deterministic part is the centroid - initialization. Assume I have 10k data points, and a given k. I then initialize ...
1
vote
2answers
88 views

how to handle outliers for clustering algorithms?

I am wondering what's the best way to handle outliers when using non-supervised clustering algorithms? Thanks!
2
votes
3answers
44 views

Aggregate categorical feature by the target

Having a list of triplets {X1,X2,Y} such as : {pennsylvania, fever , malaria} {pennsylvania, headache , malaria} {arizona, ketone smell , flu} {new york, fever , cancer} {ohio, hand pain , ...
0
votes
1answer
11 views

Reduce drug spend using medical claims analytics

I have access to medical claims data from a US health insurance company. I believe there's an opportunity to find some cost savings by switching the site of service from high cost outpatient ...
0
votes
0answers
18 views

Categorial Encoding with different cardinality

I have some user data for his data activities. Some examples of the columns are : Activity : ex. youtbube , viber, whatsapp etc etc. Cardinality > 1000 Region : Area identifier Cardinality > 10000 ...