Questions tagged [unsupervised-learning]

Finding hidden (statistical) structure in unlabelled data, including clustering and feature extraction for dimensionality reduction.

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

Two problems with the Association Rules widget

I am using the heart disease prediction dataset from UCI but analyzing it with association rules. The target class is set as "diameter narrowing" which means the presence or absence of ...
0
votes
1answer
21 views

Is it possible to implement a Recommender System without having a ratings/previous purchases similar data?

I'm trying to implement a recommender system for a website that hosts a wide variety of softwares and you can search the website to find what you need. The need is to implement a recommender system to ...
0
votes
0answers
4 views

Inverse Autoregressive Spline Flow Implementation

I have to implement an algorithm for a university project, however I can not seem to wrap my head around it. The algorithm should be an inverse autoregressive normalizing flow using splines. It should ...
1
vote
0answers
21 views

How can I apply K means algorithm to detect a pattern? [closed]

I have a dataset: How can I apply kmeans algorithm to find clusters based on "date" column . So that I can retrieve tweeting/retweeting activity every hour and generate a pattern. It would ...
0
votes
0answers
22 views

Which is the best Machine Learning appoach/model when all features are not available for prediction?

I have 50 Features in a Dataset to predict 1 Variable "Units Sold". I am currently using XGBoost model (Supervised Learning) to train all these 50 Features and the accuracy of the model on ...
0
votes
0answers
13 views

target encoding and weighting

I am working on a project in which I use data of movies and I represent each movie as a vector of length of 15. So there are 15 features ranging from genre to director. Most of the features are ...
0
votes
1answer
14 views

Avoiding overfitting in unsupervised ML

I am using a unsupervised pattern matching approach to create a trade strategy. I use the output of the pattern matched results to decide whether to enter a trade or not. For deciding the best pattern ...
0
votes
1answer
10 views

Clustering 2D curves

I have a set of curves in 2D space each expressed as a set of (sampled) data points. Each set has more or less the same number of items - eventually I guess I’ll use binning to make sure the number of ...
0
votes
0answers
11 views

Anomaly Detection in Highly Variable Time-Series Data

I am trying to detect anomalies through a column called count. The data is a time-series data and it is present for every 5 minutes for each day. The dataframe looks like this: ...
1
vote
1answer
16 views

What would cause a Hierarchical Cluster to look like skewed (if this is the right term to use!)?

I am surprised about this hierarchical cluster! For me, it looks somehow abnormal. Or, maybe normal but I am not able to identify why it looks like this. Any idea why data would be clustered in such a ...
1
vote
1answer
38 views

Can we fine-tune a model on the same dataset which it is pretrained on?

So I was reading this paper (about a use case of pretraining then self-training) which got me thinking - suppose I pre-train a model on a particular dataset, then fine-tune it again on the same ...
0
votes
2answers
28 views

How can i decide on which features to use for clustering?

I am clustering on a dataset where each row is a customer and each column is a feature. I have 200 features, this seems like alot for clustering. I plan to experiment with a variety of clustering ...
0
votes
2answers
55 views

How to JUST represent words as embeddings by pretrained BERT?

I don't have enough data (i.e. I don't have enough texts) --- have only around 4k words in my dictionary. I need to compare given words, then I need to representate it as embedding. After the ...
0
votes
1answer
28 views

How to cluster words automatically?

I have a problem where I have a list of n words with truly k different ones (k is unknown) because some may be malformed or contracted. I would like to automatically cluster them. I thought about ...
2
votes
0answers
55 views

Unsupervised document similarity state of the art

I have a set of N documents with lengths ranging from 0 to more than 20000 characters. I want to calculate a similarity score between 0 and 1 between all pairs of documents where a higher number ...
0
votes
2answers
36 views

How to group every data point with HDBSCAN to some group to have no noise?

TASK I am clustering products with about 70 dimensions ex.: price, rating 5/5, product tag(cleaning, toy, food, fruits) I use HDBSCAN to do it GOAL The goal is when users come on our site and I can ...
1
vote
2answers
60 views

When should we choose agglomerative clustering over K-means clustering?

I was working on a clustering based model and I read about hierarchical clustering and K-Means clustering. Under what conditions should I choose agglomerative over K-means clustering?
0
votes
0answers
17 views

Compute similiarty between labels

I have a labeled dataset and I created a duplicate of this dataset and removed the labels and applied K-means clustering with k= the number of labels in the original data set I want to compute ...
0
votes
0answers
19 views

Is there a way to implement nested features in unsupervised models?

Our project has built an unsupervised model that uses data about a number of companies. Some of these companies are public and some are private. The ones that are public have much higher financial ...
0
votes
0answers
7 views

Accuracy of a Cluster in Tableau

I have certain data , in that I have labels and formed a groups , Also with the same data without using any labels I used clustering option that is available on tableau . So, Now I want to check the ...
2
votes
0answers
29 views

unsupervised learning time series datasets

I experiment on building electricity power consumption datasets and try to see relationships of the power consumption with weather data and dummy variables that represent time-of-week. The only thing ...
1
vote
0answers
17 views

What is the best method to *classify* series of data?

I'm working on a project for CCG (such as HearthStone, Yu-Gi-Oh!, etc.) which does classify (or give labels) deck type when user ...
1
vote
0answers
35 views

Cross-Validation for Unsupervised Anomaly Detection with Isolation Forest

I am wondering whether I can perform any kind of Cross-Validation or GridSearchCV for unsupervised learning. The thing is that I have the ground truth labels (but since it is unsupervised I just drop ...
0
votes
0answers
29 views

what is the difference between strong and weak clustering?

What is the difference between strong and weak clustering? and what algorithm is considered as strong and weak clustering? Is fuzzy c-means and bisecting k-means considered as strong clustering? I ...
0
votes
0answers
23 views

Appropriate Approaches for Unsupervised Textual Classification

Let's say I take 1000 dissertations from a variety of different fields, and thereafter extract the top 100 words from each dissertation. What would be the best approach to categorize them into STEM/...
1
vote
1answer
53 views

Anomaly detection on sparse categorical data

I have a big dataset with a column "clientid" and a categorical column "choice". I want to find out what are the clients that have strange combinations of choices (less frequent ...
0
votes
0answers
9 views

Predictive Clustering in R with Mixed Data

Does anyone know of a predictive clustering procedure in R for mixed data types? For example, suppose that I had conducted an unsupervised k-prototypes procedure in order to estimate clusters for ...
0
votes
0answers
27 views

Making Keras RNN to proceed input sequence step by step

I'm currently trying to create a neural network for playing Tetris. I'm using evolutionary algorythms for it's learning, so the behavior that I need to get from the neural network is the following: ...
1
vote
1answer
35 views

Geolocation Based Anomaly Detection in IPs Using Isolation Forest

I'm trying to detect anomalies based on geolocation from IP addresses on a server access log file. I have created two features country and geo_velocity, using the IP address and the timestamp of each ...
-1
votes
1answer
20 views

Detect time pattern in sequence of events

I have a time series with a timestamp and an associated event: Time Event 1 A 2 B 3 C T A I was wondering if there is a technique/method to figure out which events most often precede others in a ...
0
votes
0answers
10 views

List of major ML algorithms with code

Can anyone recommend me any GitHub code repo/s or textbook/s that walks through all the major ML algorithms in great detail with code to get hands-on with? I have a data engineering background and ...
0
votes
0answers
12 views

DCGAN: how do we construct the proposed CNN of the original DCGAN paper?

I am reading the original paper on the Deep Convolutional GAN (link: DCGAN paper) and on the fourth page the authors make a proposition on how to model the generator and discriminator as CNNs. However ...
0
votes
0answers
27 views

Determining the optimal number of cluster and clustering method in hierarchical clustering

I'm working with some patient data and decided to cluster the patients. I came up with a distance metric, created a distance matrix, and performed hierarchical clustering. Now the question is, what ...
0
votes
0answers
11 views

What's the best approach of finding target groups of a product based on it's options?

I have a dataset with booked options of a product and want to find out the specific target groups. For example 'A young family with high income buys the options x,y,z more likely'. In my opinion this ...
1
vote
1answer
27 views

Clustering using both text and numerical features

I have a dataset that contains 2 types of features, one is generated from doc2vec and one is numerical feature. I would like to perform clustering analysis on them. However, due to the size of doc2vec ...
0
votes
0answers
5 views

How to cluster large time series?

I want to perform clustering on a dataset which has a few thousand stock prices time series, each one with daily prices for previous 5 years (a couple thousand days). What would be the best approach ...
0
votes
0answers
16 views

What are some good techniques to decrease the size of Image Embeddings returned by CNN model?

I want to extract features from pre trained ResNet model for over 2M data. Problem? Even with the average pooling applied on the last layer's result, it provides a ...
-1
votes
1answer
39 views

Self Organizing Map (SOM)

How do you use SOM as a supervised learning technique? Which approach can be added to SOM to turn it to supervised learning?
1
vote
0answers
39 views

Help why to apply PCA here

Lets say we have a dataset of 9 dimensional points and I want to apply k-means algorithm. I was studying an example where they apply PCA before fitting the data into the clustering algorithm. The ...
0
votes
0answers
13 views

How do we use a Hierarchical clustering model with DTW again?

I've been trying to cluster time series of shape (1, 400), so 1 row and 400 columns which correspond to 400 timesteps. My train set is of size (1000, 400) so 1000 time series. I have calculated a ...
0
votes
0answers
16 views

Identify similar features from a set of features for a given feature in an unsupervised learning way

Suppose I have a set of 1000 features. Now for a given feature, how to find the similar features from this 1000 features in an unsupervised learning way? In other words, no target/label dataset is ...
2
votes
1answer
25 views

Recommender/Clustering data to support a hypothesis. Is this a valid use-case for unsupervised ML?

I have a dataset where some items have been labelled (categorized into 4 classes [A,B,C,D]). However, there is a vast majority of the dataset which has not been labelled. My hypothesis is that there ...
2
votes
1answer
332 views

Dendrogram: ValueError: The truth value of a Series is ambiguous. Use a.empty, a.bool(), a.item(), a.any() or a.all()

I am trying to plot a Dendrogram to cluster data but this error is stopping me. My datea is here. I first chose columns to work with: ...
2
votes
0answers
49 views

Intuition behind One Class SVM (Scholkopf)

I am trying to understand the intuition behind the idea of finding a hyperplane that separates the training data from the origin in the feature space. Why separation from origin with a hyperplane ...
0
votes
1answer
65 views

how to compare between kmeans and hierarchical clustering results

I am using 2 types of clustering algorithm I apply hierarchical clustering the K-means clustering using python sklearn library Now the results are a little bit different so how can I compare the ...
1
vote
1answer
17 views

Document clustering to merge common labels

I am building a recommendation system and I have to clean up some of the labels that I have. For example of the data df['resolution_modified'].value_counts() Gives ...
1
vote
1answer
34 views

Using GANs to generate synthetic tabular data to improve supervised learning

One topic I see some people trying is using GANs to generate synthetic tabular data for supervised learning. Also as a way to oversample the minority class in a binary classification. For me creating ...
0
votes
0answers
48 views

How can realize the evaluation/validation of unsupervised models through unlabeled data?

I'm researching anomaly detection, which is nothing else than outliers detection on a set of time-series web servers access log data or network traffic. Recently I re-faced to following fundamental ...
0
votes
0answers
14 views

LDA-like algorithm but at the character level?

I have a catalog of products and I'd like to find "topics" in their description. The problem is that you might find in the description things like GraphicsCardVendor10.2 ...
0
votes
0answers
10 views

Using Transcoder Model for language to language conversion

I have a problem statement like Converting deprecated code into a modern version of the same language. I'm currently converting with a custom Rule-based engine. But the modern version of the language ...

1
2 3 4 5
8