Questions tagged [clustering]

Cluster analysis or clustering is the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to each other than to those in other groups (clusters). It is a main task of exploratory data mining, and a common technique for statistical data analysis, used in many fields, including machine learning, pattern recognition, image analysis, information retrieval etc.

Filter by
Sorted by
Tagged with
-1
votes
1answer
676 views

what ml algorithms are used for friend suggestions or item recommendations? [closed]

As per my idea unsupervised learning clustering algorithms like k-means, HCA is used for recommendations stuff. I just wanted to know what are advanced algorithms used for this type of work in social ...
1
vote
0answers
480 views

Clustering bitcoin addresses with k-means - how would one prepare input

I am looking to perform clustering on bitcoin addresses within the blockchain. I have generated a graph structure of the blockchain with a source address, destination address, value of transaction, in-...
0
votes
1answer
3k views

How to cluster multiple time-series from one data frame

I have a data.frame which has multiple time series in it, in the following manner: ...
0
votes
1answer
254 views

arima analysis after clustering time series

I have a database of multivariate time series that I want to cluster in order to find natural grouping of features. I am thinking of taking each cluster points and perform an ARIMA analysis on its ...
0
votes
1answer
114 views

How to evaluate clusters base on a label?

I have a data set that has an attribute(A) with 300 different nominal values. Attribute A has a lot of noise. I decide to cluster my data based on other attributes that related to A. I hope to reach ...
5
votes
1answer
2k views

Similarity measure for multivariate time series with heterogeous length and content

I am interested in clustering multivariate N time series of T'values' each(different lengths) using python. Each variable have many trends and values which are simultaneously numeric and nominal. A ...
13
votes
1answer
243 views

Recognize a grammar in a sequence of fuzzy tokens

I have text documents which contain mainly lists of Items. Each Item is a group of several token from different types: FirstName, LastName, BirthDate, PhoneNumber, City, Occupation, etc. A token is a ...
1
vote
0answers
76 views

What is the best way for cluster sentences using information provided by a POS tagger?

I have a small set of sentences (around 20) and I want to cluster them. Only features I have from every sentence is the output of a POS tagger that I apply to them before. How could I approach this ...
1
vote
3answers
176 views

Looking for an algorithm that correctly clusters visually separable clusters

I have visualized a dataset in 2D after employing PCA. As 2D visualization shows in figure, there is a good separation between points (A, B). Now, I want to use a metric which can separate these ...
2
votes
2answers
417 views

Cluster very many sparse binary vectors

I have a very big set of high-dimensional, but sparse binary vectors. Each vector represents a "one-hot-style" n-gram sequence of words where each index of the words that occur in the n-gram is set to ...
2
votes
3answers
192 views

Cluster analysis as an associative model?

I have a set of data with many samples and many features, but where half of the data is missing one variable (call it A), which is composed of four categories. Based on the half of data which has A, I ...
0
votes
2answers
149 views

News clustering on unlabeled datasets

I currently have a bunch of extracted news articles to perform news classification. However, the articles are unlabeled. There are about 160k articles therefore manually labeling them is impossible. I'...
3
votes
1answer
506 views

Unsupervised binning of non-normal data

For some $8000$ customer profiles, in addition to a data-set, I have two kinds of scores available: Type 1 Score ranges from $0$ to $1$ and gives the prediction ...
2
votes
2answers
6k views

Clustering users based on buying behaviour

I have a set of data which indicates purchase transaction of users (~1 million records). User can have more than 1 purchase across time. Data is spread over 6-7 months. Attributes that I have are ...
4
votes
5answers
3k views

Best approach for this unsupervised clustering problem with categorical data?

I'm a software engineer new to Machine Learning. I've read about basic non-supervised techniques like k-means and hierarchical clustering and now I'm trying to put them into practice with a basic ...
1
vote
0answers
252 views

Outlier Detection

I have a dataset which has two class. It has 13 features. They are values which are sent from 13 sensors. Label is True or False. When I use mad outlier detection, when the label is false(really there ...
2
votes
0answers
488 views

graph database and its clustering

An undirected graph represents a database where nodes of the graph represent tables, edges represent the joiner columns. There are 100 databases( it means, 100 undirected graphs). We have to build ...
0
votes
3answers
479 views

How to identify similar data points?

I am new to machine learning and I am struck at one thing. Please help. I am developing an app to sort images based on user preferences. So initially I have n data points(images) with m features ...
3
votes
0answers
152 views

Clustering with Replicator Neural Network

I'm trying to cluster an unknown set of data with a replicator neural network. The number of clusters is determined by the number of neuron units in the middle layer, multiplied by the number of steps ...
0
votes
1answer
25 views

How to optimize cohort sizes to reduce pair-wise comparisons?

I am making all pairwise comparisons in a dataset. The use-case is collapsing records into a unique ID based on fuzzy names and dates of birth. The size of the database is around 57,000 individuals. ...
0
votes
1answer
74 views

How do I determine the best statistical way for data transformation for standardization (like log, sq root) to remove bias between different datasets?

I'm currently working on applying data science to High Performance Computing cluster, by analyzing the log files generated and trying to see if there is a pattern that leads to a system failure(...
4
votes
2answers
179 views

Choosing data clustering method to visualize data

I'm working with a database about internally displaced persons in Colombia. All data are absolutes values, so I calculate the rate per 1000 people. I started to visualize all data using QGis. I ...
5
votes
1answer
862 views

Clusering based on categorical variables?

I am working on a project and currently experimenting cluster analysis. The dataset is mainly categorical variables and discrete numbers. Please pardon my poor programming skills as I am not very ...
0
votes
1answer
241 views

Clustering based on partial information?

I'm open to suggestions on how to improve the title. My problem is this, but I think it's a more general problem. In my context, I have a lot of data which has location data (Lat/Lon) as well as ...
2
votes
3answers
1k views

Machine Learning with sometimes missing data

I'm trying to do an indoor locationing system based on my RSSI signal on my routers, I'm sniffing my network so I know what's the RSSI of my phone related to my routers antennas (I have 5 antennas all ...
3
votes
3answers
2k views

How cluster a twitter data-set?

I have a twitter data-set and I wanna extract their related topics. So, I decided to classify my Tweets into clusters using an unsupervised machine learning algorithm like k-means. This choice is made ...
0
votes
1answer
1k views

Orange, K-means clustering, memory error

I have a dataset of over 67 000 records, and I'm trying to run a k-means cluster analysis on that. Orange returns a memory error. The data is in an excel file, but I also tried to load it from a csv. ...
2
votes
1answer
159 views

Predicting and clustering at the same time?

I want to build a segmentation to substitute the existing RFM segmentation which is a basic segmentation based on the Recency, Frequency and Monetary values. The new segmentation will be used for two ...
8
votes
2answers
1k views

Fitting lines through large point clouds

I have a large set of points (order of 10k points) formed by particle tracks (movement in the xy plane in time filmed by a camera, so 3d - 256x256px and ca 3k frames in my example set) and noise. ...
3
votes
1answer
658 views

Derivation of Ward's formula for agglomerative clustering

Figure describe formula of ward method for hierarchical or agglomarative clustering i.e. increment of total error after merging two cluster. How did they get $$\frac{n_A\cdot n_B}{n_A+n_B} ||\vec ...
0
votes
1answer
100 views

Choosing the correct learning algorithm

I am kind of new to the data mining subject but i need help to choose a learning algorithm for my application: The problem: identifying that a certain curve or data set belongs to a certain fault in a ...
0
votes
1answer
181 views

Clustering of Temporal Data

I have been trying to find the correlation b/w the following type of temporal data for quite some time. DataSet: ...
1
vote
0answers
147 views

Clustering with restrictions - Silhouette and C index metrics

I am working on clustering with DBSCAN but with a certain constraint: the points inside a cluster have to be not only near in a Euclidean distance way but also near in a geographic distance way. It is ...
0
votes
2answers
284 views

How do I get latent features for a new row of data when doing non-negative matrix factorization?

Background: The basic set-up for non-negative matrix factorization (nmf), is that we take a matrix with non-negative elements, X and find two other non-negative matrices H and T such that $||X - HT|...
1
vote
0answers
46 views

Can cluster analysis of preclassified items gives idea about the classification performance?

Suppose in a classification we have a dataset with many features and their class, we want to select some features using which we can construct a classifier. We perform the cluster evaluation for the ...
3
votes
2answers
3k views

How can we evaluate DBSCAN parameters?

yes, DBSCAN parameters, and in particular the parameter eps (size of the epsilon neighborhood). In the documentation we have a "Look for the knee in the plot". Fine, but it requires a visual analysis....
0
votes
1answer
211 views

NNDSVD to initialize Convex-NMF

I'm working with the Convex Nonnegative Matrix Factorization Algorithm described in Ding, Li, Jordan 2008 ("Convex and Semi-Nonnegative Matrix Factorizations"). Good initialization strategies make ...
1
vote
2answers
54 views

Determining correlated product categories using store purchase history

I have a large dataset that contains product purchase history, like so: ...
0
votes
2answers
6k views

What is the relationship between clustering and association rule mining?

Cluster analysis or clustering is the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to each other than ...
0
votes
3answers
226 views

is this a classification or clustering problem?

Suppose, I am building a hotel recommendation system, that learns user profile based on his/her interaction with the system. I have two classes, "Like" and "Dislike". For example, a user likes 5 "5-...
6
votes
4answers
2k views

Why does OPTICS use the core-distance as a minimum for the reachability distance?

The OPTICS clustering algorithm defines $$\text{core-dist}_{\varepsilon,MinPts}(p)=\begin{cases}\text{UNDEFINED} & \text{if } |N_\varepsilon(p)| < MinPts\\ MinPts\text{-th smallest distance to ...
3
votes
1answer
149 views

How do i cluster binarized categorial data, without knowing the number of clusters?

I have a dataset of categorical data, and I need to cluster it without knowing k. I know algos for clustering data without knowing the number of centroids, like G-mean, but none works for categorial ...
2
votes
1answer
883 views

How do I obtain the weight and variance of a k-means cluster?

I am trying to reproduce the results of this paper, but using python and the HMMlearn library instead of matlab. The paper describes a procedure for using HMM (Hidden Markov Model) in order to predict ...
1
vote
1answer
107 views

Prepping Data For Usage Clustering

Dataset: I'm given the number of minutes individual customers use a product each day and am trying to cluster this data in order to find common usage patterns. My question: How can I format the data ...
2
votes
1answer
244 views

Clustering : handling categorical data, should we pivot and scale?

I'm a SQLServer DBA and in the new version of this tool, there are new features to integrate R scripts and use it easily with the DB objects. That sounds cool. But to use that, we have to know a ...
3
votes
3answers
1k views

Mahalanobis distance between two clusters

I want to calculate the Mahalanobis distance between cluster $a$ and cluster $b$, each consisting from a set of multidimensional points. Assuming no correlation, calculating the distance between a ...
0
votes
2answers
584 views

Hierarchical Clustering customized Linkage function

In my clustering project, I need to customize the linkage function, so that after each cluster merging I can update the inter-cluster distance in my own way. Currently I'm using scikit-learn ...
1
vote
2answers
109 views

Question about graphing the clusters in K means

I've used K means to cluster my data. Before using K means, I had used StandardScaler on my data to standardize the data. Now, I'm wondering how can I show the clusters of the original data. Scikit-...
1
vote
1answer
165 views

Question about the Silhouette number for K means clustering

I have used K means clustering. In order to find the best value for K, I've looked at the changes of inertia value vs K and also changes of average Silhouette number vs K. The graph for inertia seems ...
4
votes
2answers
109 views

clustering plus linear model versus non linear (tree) model

a team has to create models that predict the cost of deploying a machine over time. This is a regression problem. The team is further divided into two groups, A and B. Group A puts lots of ...