Questions tagged [clustering]

Cluster analysis or clustering is the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to each other than to those in other groups (clusters). It is a main task of exploratory data mining, and a common technique for statistical data analysis, used in many fields, including machine learning, pattern recognition, image analysis, information retrieval etc.

Filter by
Sorted by
Tagged with
0
votes
2answers
40 views

How to tell if the “clusters” I see in my pair plots are statistically significant or occurring by random chance?

I have a data set with one row per subject. Some variables include laboratory parameters for blood chemistry, hematology, etc. I also have some flag variables: any = 1 if the subject experienced an ...
0
votes
3answers
254 views

Spectral clustering with heat kernel weight matrix

I am studying normalized graph cuts, and one of the way to define weight matrix is using heat kernel, which is $W_{ij} = e^{\frac{−∥x_i − x_j∥^2}{σ^2}}$. I want to ask: what's the meaning of sigma? ...
2
votes
1answer
32 views

Identifying documents similar to specific clusters

Through performing clustering on a set of 1,000,000 text documents, I have identified 100 clusters. I am particularly interested in, say, 10 of the clusters. Imagine, I now have an additional set of ...
1
vote
2answers
88 views

Differences between applying KMeans over PCA and applying PCA over KMeans

Short question: As stated in the title, I'm interested in the differences between applying KMeans over PCA-ed vectors and applying PCA over KMean-ed vectors. Long question: Let's suppose we have a ...
1
vote
0answers
182 views

Evaluating fuzzy C-Means clustering

I am new machine learning practitioner. I have run fuzzy c-means algorithm on a multi-label dataset (PPI dataset) on the network using skfuzzy python library. I want to evaluate the performance of the ...
1
vote
1answer
44 views

Recommender system that connect users with each other , should I go for content based or collaborative filtering?

I am trying to build a system where user come on the platform and he chooses a topic(predefined few topics) and then we connect him with any random online user who chooses the same topic. Then they ...
0
votes
1answer
27 views

How to interpret the mean for output clusters for expected-maximization?

I am trying to cluster data using scikit's expectation-maximization. So I created two different data sets from a normal distribution which is I have shown in the graph below. The mean for each of the ...
1
vote
1answer
50 views

Data model and algorithm for recommending “related” interests

On my app, when a user selects an interest (example: ios), I'd like to show related interests (swift, xcode, apple, etc). I have a list of around 700 interests/tags (about 300 of them can be ...
1
vote
0answers
461 views

Code or Package to cluster sequences (or time series) of different lengths based on HMM?

Is there any existing code or packages in Python, R, Java, Matlab, or Scala that implements the sequence clustering algorithms in any of the following 2 papers? 1) 'Clustering Sequences with Hidden ...
1
vote
2answers
17 views

Different types of analysis which can be done with Webdata of users

I have rich customer data for site usage, particularly the web analytics data. Some of the data fields I have are: Product Usage details Geographic details Session data: Capture what all they did ...
0
votes
1answer
52 views

Clustering Customer Data

I dont know if this kind of question is allowed but i kinda hit a wall. I know about some clustering algorithms. I already implemented Fuzzy C-Means and Gaussian Mixture Model, but I dont really know ...
1
vote
0answers
73 views

Time-series clustering Quality Measures

I am clustering time-series datasets which are not labeled (No Ground truth) and I want to measure the quality of the clusters. Could you please suggest any Clustering performance evaluation methods ...
1
vote
1answer
131 views

Conditional clustering

I have a dataset consisting of addresses (points) that have several attributes; one that distinguishes the "sort" of address and one anntribute that contains a numerical value. I want to cluster ...
-1
votes
1answer
115 views

How to use K-Means to detect users anomaly in Access Control

I'm currently working on access control project, Smart Lock to be more spesific. Like the other smart lock system, the system required user's authentication to open the door. I'm using RFID as ...
1
vote
1answer
25 views

Algorithm Suggestions for a Self Project [closed]

So, I am doing a small self project on data analytics. I am collecting the android apps data from the play store sites by web scraping. I am basically trying to collect all possible information ...
1
vote
0answers
27 views

Applicable method for the clustering of time-series consisting of multiple events

I'm currently dealing with a time-series clustering problem at work and I need help with picking/suggesting the right methodology. The problem is similar to clustering of users on a website based on ...
-1
votes
1answer
52 views

Can grid-based clustering method be use for customer segmentation? [closed]

I am trying some clustering methods for customer segmentation and I stumbled upon grid based methods like: STING, MAFIA, WAVE CLUSTER, and CLIQUE. However, from what i've read, most of them are for ...
2
votes
4answers
71 views

i"m confused that how to apply k means in my dataset

I have to detect anomalies from my data-set. The anomaly is about in which area and in which time of network usage(total_activity in my data) drastically improved. Help me to know how to apply k-means ...
1
vote
0answers
132 views

Datasets for Weighted graph clustering with detailed ground truth

I want to compare a new algorithm for clustering nodes of weighted graphs (directed or undirected, both are fine) to some previously proposed algorithms but in order to do the comparison I need more ...
1
vote
0answers
37 views

Build algorithm for Price Prediction/Classification [closed]

lets say I have historical data for prices and some additional information like article, location and maybe text like "higher price in this area due to less competition". Important is, that prices are ...
2
votes
2answers
574 views

Meaning of axes in a clustering plot

If you have n time series of rainfall measurements every hour (x=time, y=amount of rain), and compute the distance matrix between each pair of time series based on Dynamic Time Warping, and then plot ...
3
votes
0answers
77 views

Robustness of ML Model in question

While trying to emulate a ML model similar to the one described in this paper, I seemed to eventually get good clustering results on some sample data after a bit of tweaking. By "good" results, I mean ...
2
votes
1answer
3k views

Finding clusters in multidimensional data

I have a set of data from 3,000 records. There are 5 attributes per individual (labelled A - E). I can use Kendall's W (coefficient of concordance) to determine the concordance between any two records....
1
vote
1answer
107 views

Classification of medical dataset [closed]

I have medical data set with different types of attributes and I have to do the classification based on attributes: there are no class labels in this data set. Suggest to me which algorithm works ...
0
votes
1answer
46 views

How to split temporal sequences to sub-sequences in a meaningful yet unsupervised manner?

I have a biological process that undergoes some cellular event which I am observing. I have a series of events, with different temporal gaps between them. For example ...
2
votes
0answers
126 views

Clustering credit card accounts based on their balance trajectories

I am trying to cluster credit accounts based on the shape of their balance trajectories over the next 36 months, to identify the different types of shapes possible in the portfolio. Here is how I am ...
2
votes
2answers
71 views

Which type of clustering algorithm to use to identify the “same” item in different data sets?

I'm trying to find a solution for a data quality problem - specifically, identifying which items in different data sets are used to represent the same things. As an example, assume that we're a ...
2
votes
0answers
25 views

Computing spectral gap of p-laplacian, p > 2

I'm looking for code allowing computation of the spectral gap of a graph p-laplacian with p > 2, i.e. the second largest eigenvalue. See http://www.ml.uni-saarland.de/code/pSpectralClustering/...
1
vote
1answer
56 views

Predicting Composition of Chemical Compounds

I have a dataset which has names of compounds and their compositions. Like below Sulphuric Acid=>[H,S,O] (Hydrogen, sulphur, oxygen) Oxalic Acid=>[H,C,O] Sodium Oxalate=>[Na,C,O] Potassium Sulphate=>[...
0
votes
1answer
48 views

Topic Segmentation - should it be done in Raw, TfIdf or Semantic Space?

Let's assume we have a collection of documents and wish to perform some unsupervised topic segmentation. As always, we will perform some preprocessing (including tokenization, accent-removal, ...
1
vote
2answers
111 views

Evaluating clusters (e.g. built by kmean) using Random Forest

I have made clusters for my data set (1.5 million samples and 800 features) using k-mean. I am aware of internal indices for evaluating clusters. However, I was thinking about training a supervised ...
1
vote
0answers
39 views

Autoencoder ambivalent about order of input data?

The problem I'm working to solve is this: Given a musician's prerecorded free-form playing. I want to analyze each of the individual notes to determine how "in-rhythm" it is. See the graph in the ...
2
votes
1answer
387 views

Semi Supervised Learning without label propagation

I am trying to cluster some words by affinity. Using Word2Vec I obtained vector representation of every word that I can cluster with a normal unsupervised method. Of these words, though, I know the ...
2
votes
2answers
85 views

Is deduction, genetic programming, PCA, or clustering machine learning according to Tom Mitchells definition?

Tom M. Mitchell defines machine learning as A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P if its performance at tasks in T, ...
4
votes
2answers
47 views

How can I compare classes from clusterings performed on two different data sets?

I have two data sets defined by real valued vectors, and I have performed clustering on both of them. Now I want to compare the classes to see how they map to each other. If I put the data sets ...
2
votes
2answers
368 views

Spectral vs Kmeans

What makes Spectral clustering better than Kmeans clustering? I understand that Kmeans clustering is the final step of Spectral. But why is it that the previous steps involved in Spectral clustering ...
0
votes
1answer
373 views

Grouping/clustering similar words python

I have a question regarding grouping of similar words for example I have list of words give below: artificialintelligence Artificial Intelligence AI Machine Learning ML Data Analytics Data & ...
1
vote
3answers
152 views

What is the best way to visualize the relationship two categorical variables

I am currently working on an ambulance dataset and one of my tasks is to find when a patient was misdiagnosed by the call dispatcher. I have two codes; a dispatch code(what the dispatcher believes is ...
3
votes
1answer
205 views

Anomaly detection using clustering of highly correlated Categorical data

My data has two columns and both are highly correlated e.g. if column1 has value ABC, column2 should be XYZ i.e. ABC-->XYZ. If column2 has anything else its Anomaly. Likewise there are thousands of ...
4
votes
2answers
30 views

Ordering scrambled 1D data sets by continuity

This is a cute little clustering problem that was probably solved a million times over, but I couldn't find a good reference for it. I have 20 1D datasets with 400 entries each. In the picture they ...
2
votes
1answer
588 views

Improve results of a clustering

I'm a beginner and I'm trying to do a clustering of a multi-sentence text, but my results are horrible. Any tips for me to improve my result? ...
-1
votes
2answers
58 views

How to identify clusters after multiple runs?

Suppose I run an unsupervised clustering algorithm. After multiple runs, I find clusters and would like to know if the same cluster was found more than once. For example: I can figure out A-orange, ...
1
vote
2answers
50 views

Identify objects (bus) on the map based on coordinates (lat, lon) [closed]

Let's say I have an android app that frequently sends current GPS location of the user. If person is driving with bus, I can easily get GPS location of the bus and display it on the map and update it ...
1
vote
0answers
52 views

Classifying variable types on a list of variables

I have a list of around 700 variables which I need to perform a variable cleanup on. What complicates things is there are different numeric codes which flag an invalid value and these differ by the ...
0
votes
1answer
29 views

Speaker clustering/diarization

I am working on the problem of speaker clustering. I am using kmeans clustering. The ground truth cluster values and kmean cluster values do not correspond due to different methods of labelling(...
1
vote
1answer
2k views

Can cosine similarity be applied to multidimensional matrices?

I'm trying to find the similarity between two 4D matrices. Because cosine similarity takes the dot product of the input matrices, the result is inevitably a matrix. Is there a way to get a scalar ...
1
vote
1answer
69 views

Clustering 1-gram Strings

I have a big list of mail addresses (around one million) and I want to use/adapt/create an algorithm to find similarities between them (basically to cluster them). All the algorithms I've checked so ...
1
vote
1answer
437 views

Reconstructing original data points from t-SNE output

I have been trying to understand t-SNE for a while now and I have this very basic question on the comparison of PCA and t-SNE, on which I would really appreciate some help. In case of PCA suppose the ...
-1
votes
1answer
37 views

What is the most straightforward way to discover clusters in data? [closed]

I'm planning on extracting a number of word vector distances from a data set, and I want to be able to detect clusters within that set, with an undefined number of clusters that are dynamically ...
0
votes
2answers
394 views

Street address clustering?

I have a huge dataset of addresses. I have another data stream that contains addresses that I need to match against those in the original dataset. As all the addresses are user-provided, matching them ...