Questions tagged [clustering]

Cluster analysis or clustering is the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to each other than to those in other groups (clusters). It is a main task of exploratory data mining, and a common technique for statistical data analysis, used in many fields, including machine learning, pattern recognition, image analysis, information retrieval etc.

Filter by
Sorted by
Tagged with
2
votes
3answers
856 views

Clustering algorithm for a distance matrix

I have a similarity matrix between N objects. For each N objects, I have a measure of how similar they are between each others - 0 being identical (the main diagonal) and increasing values as they get ...
0
votes
1answer
37 views

Scikit learn kmeans with custom definition of inertia?

I've coded a small clustering algorithm for time signals using kmeans, which works ok (gives acceptable results). However, kmeans uses the sum of squared differences. I would like to be able to input ...
1
vote
0answers
39 views

Anomaly detection in structured textual data

Pls refer screenshot for sample data. As can be seen most of the fields in data are textual and highly correlated but each row has unique values and hence won't be right to call it categorical. I ...
1
vote
0answers
21 views

recommend new category paths based on factor item matrix and sales of the items

Matrix A be a user item matrix. Upon performing UV decomposition, I have just the V matrix. The matrix A differs every week and I get a new V matrix every week. The matrix U is not kept track of and ...
0
votes
1answer
422 views

Anomaly detection on multidimensional time series

I have relatively little knowledge of unsupervised machine learning. I'm working on a project that aims to find anomalies in a set of n data, measured every ...
2
votes
1answer
39 views

Which algorithm or tool to use to classify as good or bad?

I have a feature vector with different data types, Considering all the data in that feature vector. I have to classify as Good or Bad. Which algorithm should be used to just get the output Good or ...
-1
votes
1answer
25 views

Finding the best “depth” of ICD9 codes with pseudo-hierarchical clustering

Here is a common problem in health care modeling. Did I just invent a new algorithm or has someone already thought of this? The goal is to find the most homogeneous partition of patients by medical ...
1
vote
1answer
34 views

What is the best to identify the proper hierarchy of this data?

So I worked on a hierarchical clustering algorithm to be able to determine which items are most similar, and what attributes are most important. I have two tables: Table 1: contains a bunch of item ...
0
votes
4answers
70 views

After running K-means on 12 features, I get an array containing clusters for each row. What is the next step after this?

So I used the elbow method to identify the optimal number of clusters, i.e. 4 in this case. After running K-means on dataset with 12 features, I get an array with the cluster number each row belongs ...
1
vote
2answers
2k views

KMeans vs. DBSCAN

I am trying to understand some basic clustering techniques. What is the main difference between KMeans and DBSCAN? Can we use both techniques for the same problem?
2
votes
2answers
1k views

How do we interpret the outputs of DBSCAN clustering?

I am starting to learn DBSCAN for clustering but the interpretation part of it seems to be tricky to understand. ...
1
vote
1answer
396 views

Kmean clustering on text data

I have a large raw dataset on crime and I want to cluster the data using k-means, However, I get an Error when I enter this code: ...
5
votes
1answer
654 views

Gaussian Mixture Models as a classifier?

I'm learning the GMM clustering algorithm. I don't understand how it can used as a classifier. Here are my thought: 1) GMM is an unsupervised ML algorithm. At least that's how ...
0
votes
2answers
194 views

Mixed types of data for clustering

I have the following types of data for clustering - Numeric, Categorical and Latitude Longitude data for a location in one dataframe in python. I would like to know how can I go about doing clustering ...
-1
votes
1answer
21 views

How can I perform clustering on a list of words and ratings as columns?

I want to perform clustering to give words meaning like good, neutral and bad. My dataset is in the format : ...
1
vote
1answer
220 views

DONUT- Anomaly detection Algorithm ignores the relationship between sliding windows?

I'm trying to understand the paper : https://netman.aiops.org/wp-content/uploads/2018/05/PID5338621.pdf about Robust and Rapid Clustering of KPIs for Large-Scale Anomaly Detection. Clustering is done ...
2
votes
1answer
86 views

Clustering time series based on monotonic similarity

Context I am involved in a task of clustering 1500 time series of 500 observations into a few number of clusters. The time series share all the same observed property at different spatial locations, ...
1
vote
0answers
41 views

How to approach edge detection using GNN on sparse data?

I'm at the beginning of a project and I really wish to try and on the way learn Graph-Neural-Networks. The goal is to find the underlying graph structure of data points, some could be more clustered ...
1
vote
2answers
41 views

Are there known techniques to transform features X classified as C to features Y classified as C'

I don't think the wording of my question is that clear myself, but I don't have any better words suitable for a title (on top of my head at least). I was wondering if given features X that is ...
2
votes
0answers
25 views

Measure of variety within list/cluster

I have a dataset of about 53000 points. It has been clustered twice, based on two sets of unrelated attributes. For the first clustering (clustering 1) I used DBScan, and it ended up with about 700 ...
2
votes
2answers
142 views

Grouping already clustered data (with a pre-defined x and y)

I have an already clustered data set (I wanna keep my x and y), where there's clearly a small group of elements in the middle that don't follow the expected patterns. I can select them manually, but ...
0
votes
1answer
83 views

clustering with heterogeneous (quantitative and qualitative)data?

I'm a Phd student and I have the results of some approaches (algorithms) that I would like to analyze. Data (results) are stored in csv files as follows: - the lines describe each algorithm with its ...
0
votes
1answer
57 views

clustering with k means

I have dataset with two label class (good and bad), I want to apply K Means on my dataset using python, should I use that label dataset or I have to delete the label class column ?
1
vote
1answer
110 views

KShape cluster centers offset?

I am using tslearn KShape to cluster time series data. I am generally happy with the results, as upon inspection, the clusters seem to make sense because of the similarity in shape and magnitude. I ...
-1
votes
2answers
53 views

Similarity measure before and after dimensionality reduction or clustering

I have a dataset with 500 000 samples, each sample contains 30 features. The values of the features are in the range 0.0 to 1.0. ...
1
vote
0answers
48 views

Sliding cross-correlation [closed]

I want to understand Timeseries shape similarity algorithm ( Shape-based distance aka SBD). I can't understand the statistics behind it and why it is better than DTW or other similarity measure. I'm ...
1
vote
2answers
686 views

K-Means clustering - What to do if a cluster has 0 elements?

I'm writing code for k-means clustering. I have around 100000 vectors of size 128x1 (SIFT descriptors). I'm trying different initialization methods such as Forgy and Random Partition. What if suppose, ...
1
vote
1answer
264 views

Should unique vectors (SIFT descriptors) be used in K-Means Clustering?

I'm doing image classification by extracting SIFT features, clustering them and then finding BOVW histogram and classifying. I have around 180 training images from which I'm extracting SIFT ...
1
vote
1answer
216 views

Fuzzy Clustering for Categorical Data

I have a dataset in which each feature is either 0 or 1 (like BBOW). I want to cluster the data such that one point can belong to more than one cluster(soft assignment). I searched about this and I ...
1
vote
1answer
279 views

Find all potential similar documents out of a list of documents using clustering [closed]

I'm working with the quora question pairs csv file which I loaded into a pd dataframe and isolated the qid and question so my questions are in this form : ...
1
vote
2answers
55 views

Clustering with sets as values

I have gathered a large amount of qualitative data and am now looking to cluster it so as to make sense of it. For this, I am using Biolab's Orange. In my data, specific values may co-occur in a ...
2
votes
0answers
103 views

how to extract the Top contributing labels/words in universal-sentence-encoder-large - TransformerModel?

I'm using the universal-sentence-encoder-large (Transformer Model) encoding process for embedding and then using the embedding for Clustering - Basically for unsupervised learning. I want to get the ...
0
votes
1answer
30 views

Any cluster algo can cluster time series datasets based on variation ratio(or quantity)?

I learn machine learning from sciki and read its documents. Clustering cluster groups based on the euclidean distance and filter them by different ways ex: guassian distribution, or mean-shift...etc. ...
1
vote
2answers
95 views

How to use vectors produced by TF-IDF as an input for fuzzy c-means?

I have done text processing with TF-IDF method and as an output got a list of normalized vectors [0, 1] for each document. Such as below: ...
0
votes
1answer
119 views

Chinese restaurant process vs Dirichlet Process

On Wikipedia Dirichlet Process page, regarding the connection between the Chinese restaurant process and the Dirichlet process it's state the following If one associates draws from the base ...
1
vote
1answer
91 views

A suitable feature vector for images

I have a set of images of various products from different websites. I want to cluster the images based on the product shown in the image. How can I generate a suitable feature vector for an image for ...
-1
votes
1answer
106 views

What is the difference between market segmentation and customer segmentation?

Market segmentation seems to be the more widespread, both in books and on websites: What are the differences between market segmentation and customer segmentation? Both are basically about clustering ...
0
votes
1answer
164 views

How do I right feature selection for DBSCAN?

I want to use DBSCAN to recognize any clusters within all text elements from the DOM tree of any webpage. For example all menu items shall be clustered separatey to all main content or footer elements....
0
votes
1answer
248 views

k-mean without label [closed]

i m try to apply k-means with Python 3 to my dataset (Amazon review) for classify similar user (from review). I just have a TF and TF-IDF matrix (and i have a row(user) and columns(words) value in ...
1
vote
1answer
354 views

How to plot data points and not centroids using sklearn k-means?

I have issues finding a way to plot data points colored by cluster with k-means. I have a very long list of strings.I managed to plot the centroids but not the data points; ...
2
votes
2answers
113 views

Clustering 1-d array with constraints?

I have following kind of 1-d array data to cluster with a few constraints: The array has length from 50 to 300, floating, some of them close to 0 and some far away. Goal: divide the array into n ...
0
votes
1answer
135 views

Assigning a new document to a cluster based on keywords extracted and tf-idf

I have about 40 clusters of documents defined by a combination of k-means clustering algorithm and hand curation. For example, some of the clusters given by k-means are too noisy so they have been ...
1
vote
3answers
297 views

How to create clusters based on sentence similarity?

I have data which looks like following. Data is a group of sentences which are similar, but have few unique words in between like TABLEA, TABLEB etc. ...
2
votes
3answers
106 views

ML algorithm for Music Features

I am a newbie in machine learning topic and I need to create model from music data. It contains features of the songs but it is not labeled. How can I create a model from that ? Do I need to use ...
0
votes
1answer
97 views

How can i use Hellinger Distance on array of different length?

I have to use Hellinger distance to compare arrays that are not the same length. How do you do this correctly? Putting a zero in the missing fields for the shorter array does not sound like the best ...
2
votes
2answers
428 views

What clustering algorithm is appropriate for clustering paths?

I have a dataset with vectors in 2-dimensional space that form separate sequences (paths). Full data is presented below: , while a random sample of 5 paths looks like below (please note that ...
0
votes
1answer
55 views

When to stop collecting data?

I have developed an iterative process via which I can collect data in batches. The data are points in a predefined 3D space. I am trying to explore and locate clusters in that 3D space based on my ...
1
vote
1answer
140 views

RGB Image Segmentation using Clustering

I want to apply some segmentation on a dataset for preprocessing purposes. I have tried the "otsu thresholding" approach in order to segment the image. It's a good method, however, I think a ...
-1
votes
1answer
57 views

Finding outliers from multiple files [closed]

I am dealing with a very strange problem. I have a lot of files. I need to show which files are similar and which one has exception/outliers using its data. I can show with unsupervised learning ...
1
vote
2answers
31 views

Can I classify a healthy population into clusters found in an injured population?

Just a bit of context: We are applying Machine Learning algorithms in the field of Human Biomechanics. In a previous project, my colleagues identified three different subgroups in an injured ...