Questions tagged [clustering]

Cluster analysis or clustering is the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to each other than to those in other groups (clusters). It is a main task of exploratory data mining, and a common technique for statistical data analysis, used in many fields, including machine learning, pattern recognition, image analysis, information retrieval etc.

Filter by
Sorted by
Tagged with
1
vote
1answer
238 views

How to get similar visualization to R fviz_cluster function in Python?

It looks like R has some cool visualization function for clusters that gives output like this: The input is 2D Points and labels for them. How can i get same visualization in Python?
2
votes
2answers
693 views

K-modes implementation in pyspark

I'm looking for an implementation of k-modes in pyspark. I found this and this as implementations. First, I tried implementing k-modes using the first link and faced issues. So I went ahead and tried ...
1
vote
0answers
9 views

Ways of calculating the area of colored regions in a map

Background I am a PHD student trying to improve my data science. One of my research projects, has me tasked with determining the size of the clusters in a colored image of regions. Here is an example ...
1
vote
2answers
35 views

Identifying common keyphrase frequency in large dataset

I have a dataset of profiles which contain freeform text describing the work history of a number of individuals. I would like to attempt to identify frequently used words or groups of words across ...
0
votes
0answers
5 views

Prior identification of active variable during cluster construction [closed]

How to identify the variables that will be discriminant in cluster construction, befor apply the clustering algorithms.
1
vote
0answers
11 views

Clustering similar sequences using hidden markov model

I have several sequences of different lengths. For example, ...
0
votes
1answer
22 views

Inference from text data without label or Target

I have a use case where I have text data entered by an approver while approving of some loan. I have to make some inferences as to what could be the reasons for approval using NLP. How should I go ...
0
votes
0answers
33 views

using silhouette score for each sample of an array with each cluster [closed]

I am attempting to calculate the silhouette index for each xi in an array (X) with each cluster (0,1,2). I take array (X) as an example but my dataset is far bigger. for example, I check the first ...
0
votes
1answer
60 views

External cluster evaluation for a varying number of cluster

There are many external clustering indices like (Adjusted) mutual information, (Adjusted) Rand index, and many more. However, they are not very good at comparing clusterings where the number of ...
0
votes
1answer
460 views

Grouping/clustering similar words python

I have a question regarding grouping of similar words for example I have list of words give below: artificialintelligence Artificial Intelligence AI Machine Learning ML Data Analytics Data & ...
6
votes
1answer
16k views

K-Means vs hierarchical clustering [closed]

When hierarchical clustering is preferred over k means clustering?
0
votes
0answers
20 views

Visualization of transformed features in BERT

So I'm trying the Intent Recognition with BERT using Keras and TensorFlow 2 available at kdnuggets.com and this is the code for the results evaluation. ...
0
votes
0answers
19 views

K-means clustering for east west airline marketing data. Confused in choosing the optimal clusters [closed]

Ques: The file EastWestAirlines contains information on passengers who belong to an airline’s frequent flier program. For each passenger the data include information on their mileage history and on ...
0
votes
0answers
20 views

Customer segmentation with K Modes [closed]

I am performing clustering to identify different customer segments based on: marital status, group type,and the reason for visiting our stores. As you can see in the above image, all of the data is ...
0
votes
1answer
36 views

Speaker clustering/diarization

I am working on the problem of speaker clustering. I am using k-means clustering. The ground truth cluster values and k-mean cluster values do not correspond due to different methods of labelling (...
2
votes
2answers
126 views

Clustering list of list of integers

I have ~100 sets of samples with integer IDs. For example, 3 of them could be: a = [0, 1, 3, 4, 6...] b = [1, 5, 9, 102...] c = [1, 7, 10, 42...] I am looking to ...
3
votes
1answer
123 views

Clustering with 0 or Null values

I want to do some clustering for a dataset where I am looking at 10,000 peoples usage of certain electronic devices. I have 11 columns; the first column is simply a URN representing each person in the ...
1
vote
1answer
20 views

How to apply multiple clustering algorithms to same dataset and make comparison?

I've a dataset and I want to implement K-Means, Fuzzy C Means, Gaussian Mixture Model, Spectral Graph. After that, I want to see the clusters that I get from different methods. What is the proper way ...
0
votes
1answer
36 views

Merging three different customer segmentation systems into one

I have been given a task where I have three existing customer segmentation systems (rule based e.g. if customer spends X in Y amount of time AND whatever then put in top spender segment is one segment,...
1
vote
1answer
397 views

score or cost function for AgglomerativeClustering

I am learning AgglomerativeClustering using sklearn. It is fairly easy to use for example: ...
3
votes
1answer
64 views

Sentiment analysis of tweets (Train model on a labelled dataset and use on some other unlabelled data)

I have a huge amount of tweets on a particular topic say 'ABC' and the data is not labelled. I want to perform multi-class sentiment analysis of these tweets. I tried many unsupervised clustering ...
4
votes
2answers
91 views

KMeans clusterization on documents

Whether correct or not, I'm not able to judge being myself in the early days of the Data Science. However, I have applied a Kmeans on a corpus where some random documents (very short sentences) have ...
1
vote
1answer
194 views

Assigning a new document to a cluster based on keywords extracted and tf-idf

I have about 40 clusters of documents defined by a combination of k-means clustering algorithm and hand curation. For example, some of the clusters given by k-means are too noisy so they have been ...
9
votes
1answer
117 views

Robustness of ML Model in question

While trying to emulate a ML model similar to the one described in this paper, I seemed to eventually get good clustering results on some sample data after a bit of tweaking. By "good" results, I mean ...
0
votes
0answers
34 views

What could be the best approach to determine clusters with lat,long and other features?

I'm working on a project to identify COVID-19 clusters of counties in the United States. My dataset contains county names, lat, long, confirmed cases, active cases, recovered cases, deaths, ...
0
votes
1answer
32 views

Identifying potential customers based on their Rank and Value

I have a dataset which has demographic data available for a list of new customers. the data does'nt include transaction data of the customers. I want to identify the top 100 potential customers among ...
0
votes
1answer
20 views

Clustering without information about identifier

I have a data-set with different products and binary value if it was sold in a store or not. I looks like: ...
0
votes
1answer
38 views

confusing regarding to kmeans clulstering for data correlation

I am trying to think through my process before doing any real coding. However, got really confused easily. Say I have 100 instruments and I know their price movements every day for a year. So I can ...
0
votes
0answers
11 views

how to use the hierarchical coefficients?

I am trying to understand whether I can use hierarchical coefficients obtained on different methods. I got agglomerative coefficients for methods like: "single", "complete", "...
0
votes
1answer
40 views

how to interpret a hierarchical clustering in the heatmap in the picture bellow?

I am trying to interpret the heatmap which was created based on a agglomerative hierarchical clustering. I am not sure what exactly the heatmap does, having in mind that I see on left hand side ...
1
vote
2answers
68 views

Clustering with sets as values

I have gathered a large amount of qualitative data and am now looking to cluster it so as to make sense of it. For this, I am using Biolab's Orange. In my data, specific values may co-occur in a ...
1
vote
1answer
742 views

How can I adjust the legend when visualizing clusters in two dimensions?

How can I change the legend as we can see now the legend has some cluster numbers missing. How can I adjust the legend so that it can show all the cluster numbers (such as Cluster 1, Cluster 2 etc, no ...
2
votes
0answers
30 views

Classification and clustering of Time series data of temperature

I have a time series recorded data of temperature. This is what my data looks like: The change in data represents specific event or a class which I would like to detect when new incoming data. ...
1
vote
1answer
32 views

Heterogeneous clustering with text data

I have a dataset which consists of multiple user ratings. Each rating looks similarly to: ...
0
votes
2answers
24 views

Looking for spatial clusters and anomalies. Is DBSCAN the right tool?

I have a regular 2D grid of data points (X, Y) with each point having a value. I'd like to identify clusters and then anomalies that don't belong to those clusters. I'm trying to understand the best ...
1
vote
1answer
295 views

Conditional clustering

I have a dataset consisting of addresses (points) that have several attributes; one that distinguishes the "sort" of address and one anntribute that contains a numerical value. I want to cluster ...
0
votes
0answers
15 views

Is my data appropriate for Hierarchical Clustering?

I am a newbie in clustering and trying to check whether there are differences in Symptoms (example: cough, sneezing, shortness of breath, etc) reported across different comorbidity groups ( obesity, ...
23
votes
2answers
9k views

How to deal with time series which change in seasonality or other patterns?

Background I'm working on a time series data set of energy meter readings. The length of the series varies by meter - for some I have several years, others only a few months, etc. Many display ...
0
votes
1answer
993 views

How to measure F1 score and NMI for clustering task?

I see the authors of this paper are measuring F1 and NMI scores to measure the clustering quality. However, I don't understand the algorithm of how they actually measure it. See the Evaluation Section....
0
votes
1answer
11 views

Data mining: Clique based clustering to make comparison in social network analysis

I am a very beginner in data mining. I want to work on Clique based clustering method. I want to make a comparison between various datasets for social network analysis or community detection of social ...
1
vote
1answer
20 views

Clusterize Spectrum

I have pandas table which contains data about different observations, each one was measured in different wavlength. These observsations are different than each other in the treatment they have gotten. ...
1
vote
0answers
25 views

Clustering time series data using dynamic time warping

I would like to cluster/group the curves in the attached picture with Python. The data is already normalized and my approach would be to use dtw (dynamic time warping) to calculate the distance and ...
1
vote
1answer
17 views

How to properly train your Self-Organized Map?

I stumbled recently upon the Self-Organized Map, an ANN architecture used to cluster high dimensional data, while simultaneously imposing a neighbourhood structure on it. It's trained through a ...
0
votes
2answers
73 views

Sourcing (discounted) products customers want

Goal: Generate a list of 100 products per vertical (e.g. fashion, electronics) that the teams should source, discount, and list on the website over a specific period. You may assume all customers are ...
1
vote
1answer
46 views

How to find farthest data points from a predefined cluster in a data set with Python?

I have a data set where certain rows are labeled as one class (and interpreted as distinct cluster #1 as such), but other points are either unlabeled or ambiguous. Hence I want to figure out which ...
0
votes
3answers
118 views

Why does changing the cluster number change the plot in Kmeans?

This might be a dumb questions but I can't find the answer to it. I don't have the perfect mathematical understanding of kmeans, so apologies if it is. I'm just wondering why I see a different plot ...
0
votes
1answer
38 views

What is the difference between biclustering and clustering?

After reading the wiki page for biclustering (https://en.m.wikipedia.org/wiki/Biclustering), I am really confused on what is the difference between biclustering and clustering? Any explanation/...
0
votes
1answer
96 views

Clustering (unsupervised learning) for uneven classes

I am looking for an unsupervised method that can see also the points that start to look different from the majority. Which clustering techniques (I use python) can be used for such data sets? I have ...
0
votes
1answer
29 views

model selection in clustering

I am working on a mall customer segmentation dataset (5 features, 200 rows) using clustering. This dataset does not have any ground truth labels. I had a few doubts regarding clustering: Can I use ...
1
vote
3answers
85 views

How to cluster and visualize 3D data in python

I have a 3D dataset of x,y,z points with 2 categories, category A and B. My end goal is to cluster all points in category B into volumes (spheroids/clouds) and find all points of category A close to ...

1
2 3 4 5
21