Questions tagged [smote]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
2answers
22 views

SMOTE on training data

The SMOTE could only be performed on the training data, so how can we do it using Weka? It means we have to put the training and test data in two separate files and run the SMOTE on the training file, ...
0
votes
0answers
21 views

Using smote for data augmentation of a data set which has no dependent variable

I am trying to use the reconstruction error obtained using an auto encoder to do novelty detection. My data set is of size (4500,55)(Note: this data doesn't have any abnormalities.When an auto-encoder ...
1
vote
0answers
10 views

How to apply oversampling when doing Leave-One-Group-Out cross validation?

I am working on an imbalanced data for classification and I tried to use SMOTE previously to oversampling the training data. However, this time I think I need to use a leave-on group out (LOGO) cross-...
1
vote
1answer
18 views

Noise Elimination with majority vote filtering

I have a dataset with label noise which I wan't to clean with majority/consensus vote filtering. This will mean I will divide the data in K-Folds and train an ensemble model. Than using the ...
1
vote
1answer
24 views

Class balancing of the dataset

While performing the SMOTE for balancing the class data, what should be the proportion of both class? For instance, if we have 100 instances, what (%) should be the Yes class and what should be the No ...
1
vote
0answers
9 views

SMOTE and oversampling with constraints

I'm trying to apply SMOTE to a dataset that has time-constraints. I have information about users visiting a website. For some features, there are time constraints, e.g having the first visit and the ...
1
vote
0answers
17 views

Different result between Rapidminer and Python imblearn

I'm currently working on imbalanced classification problem. However i found different result between SMOTE in rapidminer and SMOTE in imblearn (python). rapidminer SMOTE give 15-20% improvement on ...
2
votes
2answers
105 views

Why class weight is outperforming oversampling?

I am applying both class_weight and oversampling (SMOTE) techniques on a multiclass classification problem and getting better results when using the class_weight technique. Could someone please ...
0
votes
0answers
24 views

ML with imbalanced binary dataset

I have a problem I am trying to solve: - imbalanced dataset with 2 classes - one class dwarfs the other one (923 vs 38) - f1_macro score when the dataset is used as-is to train RandomForestClassifier ...
0
votes
1answer
16 views

Forcing class imbalance to mirror the target data

I'm trying to do binary classification on some data, my source data has a class split of 40% A / 60% B while my target data has a split of 70% A / 30% B. Is it a worthwhile strategy to use SMOTE to ...
0
votes
0answers
31 views

Deep learning(MLP) on multiclass classification. Model learns only one class

I am new to deep learning. I have imbalanced class data. I used one hot encoding and scaling to preprocess my data. I have used adamoptimizer as optimizer function and sparse categorical crossentropy ...
3
votes
1answer
192 views

SVM SMOTE fit_resample() function runs forever with no result

Problem fit_resample(X,y) is taking too long to complete execution for 2million rows. Dataset specifications I have a labeled dataset about network features, ...
1
vote
1answer
210 views

Using SMOTE for Synthetic Data generation to improve performance on unbalanced data

I presently have a dataset with 21392 samples, of which, 16948 belong to the majority class (class A) and the remaining 4444 belong to the minority class (class B). I am presently using SMOTE (...
2
votes
1answer
73 views

Should I oversample my validation data to get better F1 score and PRC?

I am currently working with a dataset that is imbalanced, about 30k rows * 14 features (just for you know), and 99.5% of the data is labeled 0. Since the model is strongly imbalanced I decided to use ...
3
votes
1answer
308 views

PCA, SMOTE and cross validation- how to combine them together?

I was reading a lot recently about PCA and cross validation and it seems that the majority call it malpractice to do PCA before cross validation. I would also like to perform SMOTE, but there is a ...
0
votes
1answer
381 views

solving multi-class imbalance classification using smote and OSS

I am trying to solve multi-class imbalance classification problem for that i am using SMOTE for oversampling and OSS for under-sampling. But I have a doubt as I am working on multi-class so i have to ...
1
vote
0answers
21 views

SMOTE caused my total nrows in train to fall to a very small proportion

I have a highly skewed dataset with minority class in target being just about 4%. I decided to apply SMOTE using library DMwR in R. Here is my target: ...
1
vote
0answers
15 views

SmoteBoost: Should SMOTE be ran individually for each iteration/tree in the boosting?

As per the paper on SmoteBoost, SMOTE is ran for each iteration of the boosting, generating N samples, which are further added to the original training data and the weight distribution of the ...
0
votes
1answer
43 views

Methods for augmenting binary datasets

I have a small (~100 samples) dataset with roughly 20 features which are mostly binary, and a few are numeric (~5). I wanted to use methods for augmenting the training set and see if I can get better ...
1
vote
0answers
118 views

Increase Specificity of a model using SMOTE arguments from DMwR package in R when training data is unbalanced

I'm working on a binary classification problem and training data which I'm using is unbalanced. I used SMOTE function from DMwR ...
0
votes
1answer
30 views

How to make multiple regression perform better for outliers? (without reducing effect of them)

I have a small dataset(about 60 samples) and I need it to predict well for high target values. There are only a few high values and all models I tried perform poorly for these high values. So I ...
1
vote
1answer
101 views

Optimizing decision threshold on model with oversampled/imbalanced data

I'm working on developing a model with a highly imbalanced dataset (0.7% Minority class). To remedy the imbalance, I was going to oversample using algorithms from imbalanced-learn library. I had a ...
2
votes
0answers
73 views

A classification machine learning flow chart implimenting dimentionality reduction, upsampling, and cross validation [closed]

I would like to make a flow chart for an ML classifier and make sure that my thinking is correct. Here is a little about my sample: I have 3 classes and about 160 features. I suspect that some of ...
0
votes
1answer
322 views

Vertical and horizontal lines appearing on large confusion matrix?

I have produced a large heatmap-like confusion matrix and am seeing horizontal and vertical lines on it, so I'm trying to determine: What they mean Why they are there How I can improve on this ...
4
votes
1answer
675 views

How to avoid resampling part of pipeline on test data (imblearn package, SMOTE)

I am using the imblearn package to resample some data before applying other transformation/prediction techniques. Specfically, I am using SMOTE in a slightly unconventional way, as a data ...
2
votes
0answers
195 views

DBSMOTE on Short Text Classification

I am trying to use DBSMOTE(Density-Based Synthetic Oversampling TEqnique) to on a data set of short text--tweets to be specific. This will be used to train a classifier model in a multiclass ...
1
vote
1answer
555 views

Scripting code for class imbalance in Biolabs Orange

I'm trying to manipulate some data in Biolabs Orange, using the built in Python Script widget and information at Biolabs Orange tutorial on scripting. However, I'm struggling with taking the results ...
8
votes
1answer
7k views

How do you apply SMOTE on text classification?

Synthetic Minority Oversampling Technique (SMOTE) is an oversampling technique used in an imbalanced dataset problem. So far I have an idea how to apply it on generic, structured data. But is it ...
1
vote
0answers
167 views

suggestion to implement undersample and oversample

My dataset has the following class distribution ...
2
votes
1answer
904 views

Logic behind SMOTE-NC?

In the SMOTE paper here, the authors present the logic for creating synthetic examples when some of the features are nominal and some are continuous (section 6.1, SMOTE-NC). This example is provided: ...
0
votes
1answer
164 views

How to perform SMOTE-N when there is no majority vote?

In the SMOTE paper, the authors present the logic of creating synthetic examples when all features are nominal (section 6.2, SMOTE-N): To generate new minority class feature vectors, we can create ...
3
votes
2answers
16k views

SMOTE and multi class oversampling

I have read that the SMOTE package is implemented for binary classification. In the case of n classes, it creates additional examples for the smallest class. Can I balance all the classes by running ...
1
vote
0answers
414 views

Can SMOTE be applied over sequence of words (sentences)?

I have a highly unbalanced text classification data. I am trying to over-sample through SMOTE. I have a doubt that applying SMOTE over sequence of word indices will give me valid data points or not (...