Questions tagged [clustering]

Cluster analysis or clustering is the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to each other than to those in other groups (clusters). It is a main task of exploratory data mining, and a common technique for statistical data analysis, used in many fields, including machine learning, pattern recognition, image analysis, information retrieval etc.

Filter by
Sorted by
Tagged with
3
votes
1answer
130 views

What kind of classification should I use?

I'm very new to machine learning (and statistics) and I'm struggling with some basics (I'm using R as my primary environment). I have a lexicon with words and all of their forms (in different ...
-1
votes
1answer
958 views

KMeans clustering to help label Multi-class Supervised model

EDITED: Is it accepted practice to be able to use a KMeans clustering algorithm to help label data fed into a supervised model? (Unsupervised --feeds-> supervised)? The reason being, relabeling ...
2
votes
2answers
175 views

Using a K-NN Classification Approach for Time Series Data?

I have a dataset which contains time-series data of water flow over time. I have a flow meter connected to a kitchen faucet, and I am trying to cluster or classify specific water usage events. The ...
2
votes
0answers
588 views

Mixed geospatial and categorical clustering

I'm working on a project that seeks to identify clusters in urban development based on location (in lat/lon) and a categorical variable (what the particular site is zoned for). Ideally, the analysis ...
3
votes
1answer
694 views

Predict a tree structure out of nodes with different features

The Problem Suppose we have a representation of a document's text layout as in the image below: Here, each rectangle represents a chunk of text (one word, an expression or even part of a sentence). ...
0
votes
3answers
585 views

Deciding the number of clusters in K-means clustering of descriptors

I am new to the Machine Learning area and I have a question to ask. But let me first post the problem. Problem: The problem is very simple. I want to classify images as Category-1("Images containing ...
0
votes
2answers
550 views

Clustering of numerical data

I am trying to do clustering in my dataset which has 4 numerical fields. Please find the file attached : http://www.filedropper.com/example_3 I tried with this code: ...
-4
votes
1answer
474 views

Similarity matrix in clustering [closed]

I am coding an algorithm for clustering that is explained in this paper. According to the paper, the algorithm clusters by structural similarity and attribute similarity. In clustering with attribute ...
-6
votes
1answer
481 views

Looking for this supervised Clustering (SCEC/SRIDHCR) algorithm in R

I was posting this on different sites without appropriate answer, so I hope I'm not offending anyone... I am looking for an R package that has the implementation of the 4 supervised clustering ...
0
votes
1answer
95 views

What is stored in heap structure in the following example?

I am planning to use heap structure to find the minimum distance between a set of 2D points and form a cluster.. and after to spend a couple of hours surfing on the internet, I have not still gotten a ...
1
vote
0answers
52 views

Clustering product searches into products

I've been tasked with clustering searches from our website into the different searches for the same product. e.g. such different searches for the same product may be "product name" / "product name 1st ...
2
votes
2answers
4k views

Weights for keywords in a set of documents using Term Frequency and Inverse Document Frequency

I have a set of 270 documents. I have a list of keywords that are spread across these 270 documents. I would like to rank these keywords based on the TR-IDF method. From what I read, this method helps ...
2
votes
0answers
453 views

Implement gaussian mixture model with stochastic variational inference

I am trying to implement Gaussian Mixture model with stochastic variational inference, following this paper. This is the pgm of Gaussian Mixture. According to the paper, the full algorithm of ...
0
votes
1answer
51 views

Built a Heap in Cluster algorithm

Does anyone could explain in details how heap structure works in Cluster Algorithm? I am planning to code CURE in Matlab (Clustering using representatives) but, at first, the paper mentions that all ...
1
vote
1answer
48 views

Help reducing a set of features

I am trying to do some clustering. I have a dataset that is very sparse - with the majority of features only occurring in a single vector. Here is a list of our features: https://gist.github.com/...
0
votes
1answer
1k views

SPARK RDD - Clustering - K-Means

Imagine that I've this dataset (just a sample) A B C 1 23 1000 2 52 5000 3 12 500 4 10 450 I'm trying to assign each row to a clustering based on ...
0
votes
1answer
103 views

Sample selection through clustering

I have a biased set of samples going into a binary classification sklearn pipeline, white and black samples. It is easy for me to fetch as many black samples as required, while whites are a bit ...
1
vote
1answer
118 views

Multitask multivariate regression?

I'm trying to solve a multivariate regression problem similar to PLS regression. The problem can be described as a connectivity analysis problem where we have two regions with unknown unidirectional ...
-1
votes
1answer
3k views

clustering on multiple features and applying k-means

I am completely new to data science and this is a homework assignment so apologies beforehand. I have some raw data on restaurants that contain their categories (e.g. "Pizza", "Italian") and their ...
1
vote
0answers
2k views

Grid Search on Unsupervised Sklearn Clustering?

I am trying to use clustering algorithms in sklearn and am using Silhouette score with cosine similarity as a metric to compare different algorithms. My question is due to the varying hyperparameters ...
8
votes
3answers
8k views

How to get the probability of belonging to clusters for k-means?

I need to get the probability for each point in my data set. The idea is to compute distance matrix (first column contsins distances to first cluster, second column conteins distances to second ...
8
votes
3answers
2k views

How evaluate text clustering?

What metrics can be used for evaluating text clustering models? I used tf-idf + k-means, ...
1
vote
2answers
151 views

How to interpret silouette coefficient?

I'm trying to determine number of clusters for k-means using sklearn.metrics.silhouette_score. I have computed it for range(2,50)...
-2
votes
1answer
531 views

Sentence similarity

Every week I get a group of sentences (~1000) each of them may be similar. Example: metallica hard wired metallica hardwire metallica hardwired metallica hard wire hardwired metallica hardwire ...
0
votes
3answers
2k views

Clustering tendency using hopkin's statistics

As per the references 1. http://www.sthda.com/english/wiki/assessing-clustering-tendency-a-vital-issue-unsupervised-machine-learning 2. http://www.listendata.com/2016/01/cluster-analysis-with-r....
1
vote
1answer
1k views

Silhouette calculation in k-means

I am trying to compute Silhouette with k-means. However I have the value really close to 0 and the clusters are very clearly separated. Do you know where can be the problem? This is the code: ...
2
votes
4answers
4k views

Handling a feature containing multiple values

I have a dataset in following format: Movie ID | Actors | Director | language | ReleaseYear | Genre 1 | Anil Kapoor;Manisha Koirala;Jackie Shroff;Anupam Kher;Danny Denzongpa;Pran | Vidhu Vinod ...
1
vote
0answers
556 views

k-means python implementation: unclear\wrong result

I have implemented two type of clustering in python, using SciPy: one with hierarchical approach, and the other one with k-means. In each cases I have used as input a two dimensional array X (...
1
vote
2answers
621 views

Unsupervised Classification for documents

I'm trying to create a classifier in which there is less "manual" work for the user. For less manual work I mean that there won't be an initial phase of manual labeling of a training set, like in ...
0
votes
1answer
4k views

Cluster tendency using Hopkins statistic implementation in Python

The Hopkins statistic, is a statistic which gives a value which indicates the cluster tendency, in other words: how well the data can be clustered. If the value is between {0.01, ...,0.3}, the data ...
2
votes
1answer
396 views

model with only positive responses

Could any one help me know about different approaches, methods or algorithms to build a model only with positive responses. Let's assume we have a set of customers with a 'positive' behaviour. We ...
1
vote
0answers
46 views

Clustering objects defined by vector

I have a set of objects (98 total). I need to cluster these objects based on their pairwise distance. Each pair contains approximately 2000 values (not consistent). This is what I have done so far. ...
1
vote
1answer
102 views

Music corpus sentence level clustering

I provide an offline library of Music to my users. My goal is to understand what my users are looking for, which means translate raw user searches to: Music Artists, Songs, Albums and then add music ...
0
votes
2answers
367 views

Calculate feature weight vector for one-hot-encoded data frame in R

I have the following data frame with one categorical and two numerical columns: V1 V2 V3 1 A 1 3 2 A 3 5 3 B 3 3 4 C 2 3 I have ...
-1
votes
1answer
62 views

Clustering and regression technics

Have a question, please help me understand it a bit: For example, the firm installs the network equipment in the clients' flats (Wlan, IPTV) and registers it on a certain client. How can be the ...
0
votes
2answers
59 views

Clusters with bounded diamter

In my application, I want to have clusters whose diameters are bounded by some fixed number. Also, the number of clusters in the data is unknown and therefore the clusters must be discovered without a ...
2
votes
3answers
375 views

Clustering big data by reducing data accuracy?

I have 1 million rows with 20 attributes to do hierarchical clustering. When I want to build a distance matrix on this data by dist() in R, it says that it needs 5 ...
1
vote
1answer
377 views

Feeding R agnes object into cutree

I'm using agnes to group terms that frequently appear with one another in a set of documents. I get a dendrogram which verifies that things are working as expected. ...
4
votes
3answers
3k views

k-means clustering data with large number of meaningless values

I am looking to perform k-means on my dataset which contains a large number of 0 values. Edit: the last value you see is different to the others, that is simply the sum of transactions, not related ...
3
votes
1answer
116 views

Transition from clustering to classification?

To date, I have done several ad-hoc text clustering projects which use combinations of topic modeling, k-means, and other algorithms. Basically, the point of these projects was to produce themes for ...
1
vote
1answer
98 views

How to evaluate clusters base on an attribute of the dataset? [duplicate]

I have a data set of persons with attribute job that have 300 different nominal value. attribute job have a lot of noise. I decide to cluster my data base on other attribute (other feature of person) ...
1
vote
2answers
1k views

How to implement clustering on categorical feature vectors in R?

I have a dataset like: ...
0
votes
1answer
321 views

Kmeans: Between class intertia

I'm using KMeans of scikit-learn for clustering of forums. The attribute inertia_ of model gives the within class inertia but how can i get the between class inertia? In other word how can I verify ...
-1
votes
1answer
675 views

what ml algorithms are used for friend suggestions or item recommendations? [closed]

As per my idea unsupervised learning clustering algorithms like k-means, HCA is used for recommendations stuff. I just wanted to know what are advanced algorithms used for this type of work in social ...
1
vote
0answers
480 views

Clustering bitcoin addresses with k-means - how would one prepare input

I am looking to perform clustering on bitcoin addresses within the blockchain. I have generated a graph structure of the blockchain with a source address, destination address, value of transaction, in-...
0
votes
1answer
3k views

How to cluster multiple time-series from one data frame

I have a data.frame which has multiple time series in it, in the following manner: ...
0
votes
1answer
252 views

arima analysis after clustering time series

I have a database of multivariate time series that I want to cluster in order to find natural grouping of features. I am thinking of taking each cluster points and perform an ARIMA analysis on its ...
0
votes
1answer
114 views

How to evaluate clusters base on a label?

I have a data set that has an attribute(A) with 300 different nominal values. Attribute A has a lot of noise. I decide to cluster my data based on other attributes that related to A. I hope to reach ...
4
votes
1answer
2k views

Similarity measure for multivariate time series with heterogeous length and content

I am interested in clustering multivariate N time series of T'values' each(different lengths) using python. Each variable have many trends and values which are simultaneously numeric and nominal. A ...
13
votes
1answer
242 views

Recognize a grammar in a sequence of fuzzy tokens

I have text documents which contain mainly lists of Items. Each Item is a group of several token from different types: FirstName, LastName, BirthDate, PhoneNumber, City, Occupation, etc. A token is a ...