Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [clustering]

Cluster analysis or clustering is the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to each other than to those in other groups (clusters). It is a main task of exploratory data mining, and a common technique for statistical data analysis, used in many fields, including machine learning, pattern recognition, image analysis, information retrieval etc.

0
votes
0answers
4 views

Clustering text post vectorization by Universal sentence encoder

I have 1000 of datasets within which clustering needs to happen in each of them to find the textual categories. I have vectorized the data using google sentence encoder. What can be the best way to ...
0
votes
2answers
9 views

Mixed types of data for clustering

I have the following types of data for clustering - Numeric, Categorical and Latitude Longitude data for a location in one dataframe in python. I would like to know how can I go about doing clustering ...
-1
votes
1answer
12 views

How can I perform clustering on a list of words and ratings as columns?

I want to perform clustering to give words meaning like good, neutral and bad. My dataset is in the format : ...
1
vote
0answers
10 views

DONUT- Anomaly detection Algorithm ignores the relationship between sliding windows?

I'm trying to understand the paper : https://netman.aiops.org/wp-content/uploads/2018/05/PID5338621.pdf about Robust and Rapid Clustering of KPIs for Large-Scale Anomaly Detection. Clustering is done ...
2
votes
1answer
15 views

Clustering time series based on monotonic similarity

Context I am involved in a task of clustering 1500 time series of 500 observations into a few number of clusters. The time series share all the same observed property at different spatial locations, ...
1
vote
0answers
17 views

How to approach edge detection using GNN on sparse data?

I'm at the beginning of a project and I really wish to try and on the way learn Graph-Neural-Networks. The goal is to find the underlying graph structure of data points, some could be more clustered ...
-1
votes
0answers
23 views

Which clustering method to apply for this data set

I have sound recordings from different kinds of birds, basically chirp sound. These are inherently nonlinear signals. I want to cluster sounds into groups based on the loudness. If the sound for each ...
0
votes
1answer
12 views

Are there known techniques to transform features X classified as C to features Y classified as C'

I don't think the wording of my question is that clear myself, but I don't have any better words suitable for a title (on top of my head at least). I was wondering if given features X that is ...
2
votes
0answers
15 views

Measure of variety within list/cluster

I have a dataset of about 53000 points. It has been clustered twice, based on two sets of unrelated attributes. For the first clustering (clustering 1) I used DBScan, and it ended up with about 700 ...
2
votes
2answers
48 views

Grouping already clustered data (with a pre-defined x and y)

I have an already clustered data set (I wanna keep my x and y), where there's clearly a small group of elements in the middle that don't follow the expected patterns. I can select them manually, but ...
0
votes
1answer
12 views

clustering with heterogeneous (quantitative and qualitative)data?

I'm a Phd student and I have the results of some approaches (algorithms) that I would like to analyze. Data (results) are stored in csv files as follows: - the lines describe each algorithm with its ...
0
votes
1answer
22 views

clustering with k means

I have dataset with two label class (good and bad), I want to apply K Means on my dataset using python, should I use that label dataset or I have to delete the label class column ?
1
vote
0answers
10 views

KShape cluster centers offset?

I am using tslearn KShape to cluster time series data. I am generally happy with the results, as upon inspection, the clusters seem to make sense because of the similarity in shape and magnitude. I ...
-1
votes
2answers
27 views

Similarity measure before and after dimensionality reduction or clustering

I have a dataset with 500 000 samples, each sample contains 30 features. The values of the features are in the range 0.0 to 1.0. ...
1
vote
0answers
30 views

Sliding cross-correlation [closed]

I want to understand Timeseries shape similarity algorithm ( Shape-based distance aka SBD). I can't understand the statistics behind it and why it is better than DTW or other similarity measure. I'm ...
1
vote
2answers
99 views

K-Means clustering - What to do if a cluster has 0 elements?

I'm writing code for k-means clustering. I have around 100000 vectors of size 128x1 (SIFT descriptors). I'm trying different initialization methods such as Forgy and Random Partition. What if suppose, ...
1
vote
1answer
20 views

Should unique vectors (SIFT descriptors) be used in K-Means Clustering?

I'm doing image classification by extracting SIFT features, clustering them and then finding BOVW histogram and classifying. I have around 180 training images from which I'm extracting SIFT ...
0
votes
1answer
15 views

Fuzzy Clustering for Categorical Data

I have a dataset in which each feature is either 0 or 1 (like BBOW). I want to cluster the data such that one point can belong to more than one cluster(soft assignment). I searched about this and I ...
1
vote
1answer
26 views

Find all potential similar documents out of a list of documents using clustering [closed]

I'm working with the quora question pairs csv file which I loaded into a pd dataframe and isolated the qid and question so my questions are in this form : ...
1
vote
2answers
23 views

Clustering with sets as values

I have gathered a large amount of qualitative data and am now looking to cluster it so as to make sense of it. For this, I am using Biolab's Orange. In my data, specific values may co-occur in a ...
1
vote
1answer
23 views

how to extract the Top contributing labels/words in universal-sentence-encoder-large - TransformerModel?

I'm using the universal-sentence-encoder-large (Transformer Model) encoding process for embedding and then using the embedding for Clustering - Basically for unsupervised learning. I want to get the ...
0
votes
1answer
12 views

Any cluster algo can cluster time series datasets based on variation ratio(or quantity)?

I learn machine learning from sciki and read its documents. Clustering cluster groups based on the euclidean distance and filter them by different ways ex: guassian distribution, or mean-shift...etc. ...
0
votes
2answers
36 views

How to use vectors produced by TF-IDF as an input for fuzzy c-means?

I have done text processing with TF-IDF method and as an output got a list of normalized vectors [0, 1] for each document. Such as below: ...
0
votes
1answer
40 views

Chinese restaurant process vs Dirichlet Process

On Wikipedia Dirichlet Process page, regarding the connection between the Chinese restaurant process and the Dirichlet process it's state the following If one associates draws from the base ...
0
votes
0answers
18 views

Graph-based Label Spreading Implementation

I have a graph with a set of nodes as shown below. Graph with some nodes labeled belonging to 2 clusters: Some nodes have a known labels (green or yellow colour) where as the labels of the rest of ...
1
vote
1answer
25 views

A suitable feature vector for images

I have a set of images of various products from different websites. I want to cluster the images based on the product shown in the image. How can I generate a suitable feature vector for an image for ...
0
votes
0answers
18 views

Clustering Series According to their ECDF

I have a dataset containing sales of items coming from different designers. These items have different price distributions according to the designer that made them, there are high priced designers ...
-1
votes
1answer
26 views

What is the difference between market segmentation and customer segmentation?

Market segmentation seems to be the more widespread, both in books and on websites: What are the differences between market segmentation and customer segmentation? Both are basically about clustering ...
0
votes
1answer
32 views

How do I right feature selection for DBSCAN?

I want to use DBSCAN to recognize any clusters within all text elements from the DOM tree of any webpage. For example all menu items shall be clustered separatey to all main content or footer elements....
0
votes
1answer
45 views

k-mean without label [closed]

i m try to apply k-means with Python 3 to my dataset (Amazon review) for classify similar user (from review). I just have a TF and TF-IDF matrix (and i have a row(user) and columns(words) value in ...
1
vote
1answer
32 views

How to plot data points and not centroids using sklearn k-means?

I have issues finding a way to plot data points colored by cluster with k-means. I have a very long list of strings.I managed to plot the centroids but not the data points; ...
0
votes
0answers
14 views

Drug with as many targets as possible through a system biology graph?

I have 4 pandas data frames containing the following data: 1 - affinity_score1: affinity between each couple (Drug-Target) measured using tool1 2 - affinity_score2: affinity between each couple (Drug-...
2
votes
2answers
38 views

Clustering 1-d array with constraints?

I have following kind of 1-d array data to cluster with a few constraints: The array has length from 50 to 300, floating, some of them close to 0 and some far away. Goal: divide the array into n ...
0
votes
1answer
24 views

Assigning a new document to a cluster based on keywords extracted and tf-idf

I have about 40 clusters of documents defined by a combination of k-means clustering algorithm and hand curation. For example, some of the clusters given by k-means are too noisy so they have been ...
1
vote
3answers
64 views

How to create clusters based on sentence similarity?

I have data which looks like following. Data is a group of sentences which are similar, but have few unique words in between like TABLEA, TABLEB etc. ...
2
votes
3answers
45 views

ML algorithm for Music Features

I am a newbie in machine learning topic and I need to create model from music data. It contains features of the songs but it is not labeled. How can I create a model from that ? Do I need to use ...
0
votes
1answer
29 views

How can i use Hellinger Distance on array of different length?

I have to use Hellinger distance to compare arrays that are not of the same length. Is there a way to do it correctly? Put zero in the missing fields of the shorter array doesn't sound that good to me ...
2
votes
2answers
78 views

What clustering algorithm is appropriate for clustering paths?

I have a dataset with vectors in 2-dimensional space that form separate sequences (paths). Full data is presented below: , while a random sample of 5 paths looks like below (please note that ...
0
votes
1answer
45 views

When to stop collecting data?

I have developed an iterative process via which I can collect data in batches. The data are points in a predefined 3D space. I am trying to explore and locate clusters in that 3D space based on my ...
0
votes
1answer
35 views

RGB Image Segmentation using Clustering

I want to apply some segmentation on a dataset for preprocessing purposes. I have tried the "otsu thresholding" approach in order to segment the image. It's a good method, however, I think a ...
-1
votes
1answer
50 views

Finding outliers from multiple files [closed]

I am dealing with a very strange problem. I have a lot of files. I need to show which files are similar and which one has exception/outliers using its data. I can show with unsupervised learning ...
1
vote
1answer
25 views

Can I classify a healthy population into clusters found in an injured population?

Just a bit of context: We are applying Machine Learning algorithms in the field of Human Biomechanics. In a previous project, my colleagues identified three different subgroups in an injured ...
0
votes
0answers
34 views

KMeans clustering with both numerical and categorical data in PySpark

I need to do KMeans clustering using both numerical and categorical data. There is KModes algorithm for clustering using only categorical data and KPrototypes algorithm for clustering using both ...
1
vote
0answers
10 views

Preserving labels in latent space clustering

I generated a latent space from a VAE model for my dataset which consists of images depicting different font styles. The objective is to reduce the dimensionality of this latent space in order to ...
-1
votes
1answer
22 views

Clustering Customers on transactional behavior

Objective: Segment the accounts on their transactional behavior and find the accounts which are more likely to subscribe for loans. Dataset: 1) Account_Number 2-91) Transaction amount ...
0
votes
1answer
29 views

Spectral clustering result interpretation

I cluster a toy data set into three groups with spectral clustering. Please see the code below. affinity='rbf' by default. ...
1
vote
1answer
19 views

Algorithm for purely categorical data

Looking for an algorithm to deal with purely categorical data. It was suggested to me to look into the K-medoids algorithm. Anyone know if there is a K-medoids algorithm R library(package)?
2
votes
1answer
37 views

Is there an oriented clustering algorithm?

I'm looking for a clustering algorithm that will make cluster depending on a orientation. The DBSCAN algorithm cluster points based on a constant radius : https://upload.wikimedia.org/wikipedia/...
0
votes
2answers
126 views

multivariate clustering, dimensionality reduction and data scalling for regression

I have a dataset with approximately 20000 observations consisting of 40 independent and 1 dependent variable. My initial objective is to develop a model that will predict the dependent variable. I ...
0
votes
3answers
26 views

What best/correct algorithm/procedure to cluster a dataset with a lot 0's?

I'm new to statistics so sorry any major lack of knowledge in the topic, just doing a project for graduation. I'm trying to cluster a Health dataset containing Diseases(3456) and Symptoms(25) ...