Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [k-means]

k-means is a family of cluster analysis methods in which you specify the number of clusters you expect. This is as opposed to hierarchical cluster analysis methods.

0
votes
0answers
20 views

Unsupervised approach to News website pages classification in 3 classes

I'm working on a project in which we have to classify web pages, coming from a news website, into 3 main classes: Sections (or Categories), News and Others (like contact pages, "about us" etc.). We ...
0
votes
0answers
14 views

Clustering geodata into same size group with K-means in Python

I have the following sample geo-data which have 100 rows, and I want to cluster those POIs to 10 groups and 10 points in each group, also, if possible data in each group from same areas. ...
0
votes
1answer
45 views

k-mean without label [closed]

i m try to apply k-means with Python 3 to my dataset (Amazon review) for classify similar user (from review). I just have a TF and TF-IDF matrix (and i have a row(user) and columns(words) value in ...
1
vote
1answer
26 views

How to plot data points and not centroids using sklearn k-means?

I have issues finding a way to plot data points colored by cluster with k-means. I have a very long list of strings.I managed to plot the centroids but not the data points; ...
0
votes
0answers
11 views

MeanShift “close-cluster” question

I have tons of experience doing Threat Hunting and now I'm studying how to use Machine Learning to enhance my hunts, and I'm having tons of fun learning Machine Learning. Since I wanted to give it a ...
0
votes
1answer
24 views

Kmeans cluster validation when I have labeled test data

I'm trying to implement the unsupervised k-means algorithm for sentiment analysis of imdb movie dataset created by stanford. The steps that I followed is : 1) Load the comments 2) Apply tokenization ...
1
vote
2answers
20 views

Clustering 1-d array with constraints?

I have following kind of 1-d array data to cluster with a few constraints: The array has length from 50 to 300, floating, some of them close to 0 and some far away. Goal: divide the array into n ...
0
votes
1answer
22 views

How can i use Hellinger Distance on array of different length?

I have to use Hellinger distance to compare arrays that are not of the same length. Is there a way to do it correctly? Put zero in the missing fields of the shorter array doesn't sound that good to me ...
0
votes
1answer
29 views

RGB Image Segmentation using Clustering

I want to apply some segmentation on a dataset for preprocessing purposes. I have tried the "otsu thresholding" approach in order to segment the image. It's a good method, however, I think a ...
0
votes
0answers
20 views

KMeans clustering with both numerical and categorical data in PySpark

I need to do KMeans clustering using both numerical and categorical data. There is KModes algorithm for clustering using only categorical data and KPrototypes algorithm for clustering using both ...
-1
votes
1answer
21 views

Clustering Customers on transactional behavior

Objective: Segment the accounts on their transactional behavior and find the accounts which are more likely to subscribe for loans. Dataset: 1) Account_Number 2-91) Transaction amount ...
1
vote
0answers
12 views

How to preprocessing data of a game [closed]

I have a table of users' scores like this: ...
-1
votes
0answers
19 views

uniform Effect of K-means Clustering

In the following link is discussed the uniform Effect of K-means Clustering: https://www.springer.com/cda/content/document/cda_downloaddocument/9783642298066-c2.pdf?SGWID=0-0-45-1338325-...
0
votes
1answer
283 views

Accuracy for Kmeans clustering

I am looking for accuracy python code for kmeans clustering with no labels. Is there anyone who knows about it? it is ok that is not built-in function. Manually made is also ok
0
votes
3answers
24 views

What best/correct algorithm/procedure to cluster a dataset with a lot 0's?

I'm new to statistics so sorry any major lack of knowledge in the topic, just doing a project for graduation. I'm trying to cluster a Health dataset containing Diseases(3456) and Symptoms(25) ...
-1
votes
0answers
23 views

How do I name clusters in kmeans?

I am working on canvas course data-set. I am trying to cluster similar courses. I have around 15 average metrics like: announcements, Assignments ( graded & non-graded), course sections, ta ...
0
votes
1answer
28 views

confusing regarding to kmeans clulstering for data correlation

I am trying to think through my process before doing any real coding. However, got really confused easily. Say I have 100 instruments and I know their price movements every day for a year. So I can ...
1
vote
1answer
28 views

Theoretical work on validity of restricting movement of Centroid of K-Mean

I recently received a manuscript for review in which author used ~1000 "fake" data points, so that the final centroid of K-mean stays within the required range. Neither me nor the author seems to have ...
1
vote
2answers
48 views

Differences between applying KMeans over PCA and applying PCA over KMeans

Short question: As stated in the title, I'm interested in the differences between applying KMeans over PCA-ed vectors and applying PCA over KMean-ed vectors. Long question: Let's suppose we have a ...
0
votes
2answers
25 views

Confused about how to graph my high dimensional dataset with Kmeans

PLEASE NO SKLEARN ANSWERS So I have a dataset that is very high dimensional, and I am very confused about to convert it into a form that can be used to plot with Kmeans. Here is an example of what my ...
1
vote
0answers
21 views

output of k-mean cluster as collection of tweets

I want to cluster some 1000 tweets using k-mean algorithm. But I don't want the correct output, I just want clustering of tweets. Suppose 1 cluster contain 300 tweets than all the contain of 300 ...
0
votes
0answers
62 views

Using Silhouette Measures and Dunn Index (DI) in WEKA

How do I use Silhouette Measures and Dunn Index (DI) in Weka software to compare clustering approaches in data mining? Actually I have to apply three clustering approaches (K-means, DBSCAN and EM) to ...
0
votes
2answers
570 views

How to create a simple K-Means Cluster Algorithm in Python? [closed]

Hi I am new to Data Science and Python. I want to implement K-Means Cluster Algorithm. I am successfully implemented K-means algorithm on Array of elements. For this I did like # K-Means.py ...
1
vote
0answers
7 views

Scala mllib 2.2.0 k means. Number of runs

As per the documentation here , the runs parameter does nothing. I have looked at the actual scala code for k means and it appears that the ...
0
votes
2answers
35 views

K-means sensitivity to outliers?

I'm studying K-means, and one important drawback of K-means is the lack of robustness to outliers. My question is: are there any cases when the lack of robustness to outliers may be considered not as ...
-1
votes
1answer
36 views

How to use K-Means to detect users anomaly in Access Control

I'm currently working on access control project, Smart Lock to be more spesific. Like the other smart lock system, the system required user's authentication to open the door. I'm using RFID as ...
2
votes
4answers
52 views

i"m confused that how to apply k means in my dataset

I have to detect anomalies from my data-set. The anomaly is about in which area and in which time of network usage(total_activity in my data) drastically improved. Help me to know how to apply k-means ...
1
vote
0answers
24 views

k-means cluster analysis for pitch curves in r [closed]

so I have many pitch curves time normalized. I though of using k-means as tool for automatically cluster these. I have the hypothesis that they correlate to three patterns but I want to go for an ...
2
votes
2answers
53 views

Meaning of axes in a clustering plot

If you have n time series of rainfall measurements every hour (x=time, y=amount of rain), and compute the distance matrix between each pair of time series based on Dynamic Time Warping, and then plot ...
2
votes
0answers
40 views

Clustering credit card accounts based on their balance trajectories

I am trying to cluster credit accounts based on the shape of their balance trajectories over the next 36 months, to identify the different types of shapes possible in the portfolio. Here is how I am ...
3
votes
3answers
56 views

k-means clustering or classification?

Why is choosing the k in the k-means clustering method based on a feature (take a dead or alive patients scenario as an example, k will be 2) considered clustering rather than classification?
-1
votes
2answers
41 views

How to plot High Dimensional supervised K-means on a 2D plot chart

I'm Having a ML problem where my data set contains 80 features labelled into 3 groups (0, 1, -1). I want to plot the data on a 2D surface to see how "close" (similar) data with ...
2
votes
0answers
40 views

How to find coreset of a given dataset in python?

I am trying to implement the core-means algorithm, which is basically k-means using coreset. I have searched up and down but could not find any libraries or modules which could help me with this. ...
1
vote
2answers
36 views

Evaluating clusters (e.g. built by kmean) using Random Forest

I have made clusters for my data set (1.5 million samples and 800 features) using k-mean. I am aware of internal indices for evaluating clusters. However, I was thinking about training a supervised ...
3
votes
1answer
23 views

How to deal with Missing Not at Random Data for k-means clustering?

I am running k-means clustering on a customer dataset. One of the available demographic fields is inferred homevalue, represented as an integer. This field has value 0 when it's inferred that the ...
2
votes
1answer
120 views

Low silhouette coefficient

I am doing a kmeans clustering on a dataset of selling values of articles. Each article has 52 selling values (one per week). I am trying to automatically calculate the optimum amount of clusters ...
1
vote
2answers
41 views

Finding best cluster after running K-Means clustering

I have bunch of text which I want to segregate based on semantic similarity. Running through K-Means, I was able to divide the complete text into different clusters. However, I still need to find ...
2
votes
3answers
122 views

clustering 2-dimensional euclidean vectors - appropriate dissimilarity measure

I've got a set of approx. 50 000 2-dimensional euclidean vectors which are connected with 20 groups, i.e. each group has approx. 2500 2-dimensional euclidean vectors. My data includes endpoints ...
4
votes
2answers
78 views

k-means|| in PySpark

I'm trying to apply k-means$\|$ clustering in PySpark. According to this paper, there is an oversampling factor, $l$, that would affect the model's cost. I couldn't find any parameter regarding ...
3
votes
1answer
490 views

Sklearn: unsupervised knn vs k-means

Sklearn has an unsupervised version of knn and also it provides an implementation of k-means. If I am right, kmeans is done exactly by identifying "neighbors" (at ...
-1
votes
1answer
50 views

How to solve online clustering problem

Suppose we have a clustering problem where data sample is of multi-dimension with a mix of numeric and categorical type. If the ...
1
vote
1answer
125 views

Using PCA to cluster multidimensional data (RFM variables)

So i am performing k-means clustering on RFM variables (Recency, Frequency, Monetary). The RFM variables are in the form of quantiles (1-4). I used PCA and found the PCA components. I then used the ...
1
vote
0answers
21 views

What is the difference between K-Means & Self Organized Maps?

It seems they both perform clustering. They both reduce the dimensionality of the input data and classify further inputs based upon their distance/similarity to the center points. These points then ...
1
vote
2answers
305 views

What approach other than Tf-Idf could I use for text-clustering using K-Means?

I am working on a text-clustering problem. My goal is to create clusters with similar context, similar talk. I have around 40 million posts from social media. To start with I have written clustering ...
3
votes
2answers
66 views

Extracting useful features for k-means clustering

So say suppose I have a data-set with features being either present or not i.e. 0or 1. Now I want to identify the features which ...
0
votes
2answers
255 views

How to cluster histograms or density distributions?

I have exactely no idea of where to start when it come to cluster distribution and find out similar the similar one. is there a package in R that do the job ?
0
votes
1answer
41 views

Clustering with groups in data related to cluster label

I want to predict which device got used in which room. Therefore I've got device and sensor data. My idea was to create a feature vector lie this: ...
3
votes
0answers
41 views

Determine the most important documents for supervised learning

I have somewhat of a general/high level question. Assume I'm doing supervised machine learning on some text data (tweets for example) and categorizing the documents to a certain taxonomy (multi-class ...
3
votes
3answers
66 views

Clarification on K Means Clustering Algorithm and its Analysis

I fail to understand how the circled point is assigned to cluster c2 and not c1. From what I have understood, the points are assigned to the (nearest?) centroid in order to minimise the squared ...
2
votes
1answer
1k views

How to calculate the silhouette coefficient?

Calculate the silhouette coefficient of point Pi from the above image. To apply the given formula, how to know which is a(i) and b(i)?