Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [classification]

An instance of supervised learning that identifies the category or categories which a new instance of dataset belongs.

Filter by
Sorted by
Tagged with
1 vote
1 answer
15 views

Preserving / fixing class imbalance

Suppose that I have 2 collection $A$ and $B$ of unlabeled animals that are either dogs or cats. The dogs in $A$ and the dogs in $B$ are not necessarily identical, other than the fact that they are ...
yurnero's user avatar
  • 111
0 votes
0 answers
14 views

Fine-tuning pretrained model on 2 tasks with 2 labeled dataset

I am having difficulty using BERT for a sentiment analysis task that handles both aspect-based sentiment analysis (ABSA) and comment sentiment analysis. I know that using two separate classification ...
ndycuong's user avatar
1 vote
1 answer
27 views

Grouping similar classes to improve accuracy, whilst maximising the number of classes

Suppose I have a large number of distinct classes, some of which are related. My model has high classification accuracy for some classes, whilst other classes are hard to predict. How could I group ...
MuhammedYunus's user avatar
0 votes
0 answers
12 views

How to choose segment in Grouped AUC metric?

Background In Binary Classification, AUC is a common metric. However, Group-AUC performs better in some scenario, such as we use AUC grouped by user in recommendation systems. In the below examples, I ...
Travis's user avatar
  • 111
1 vote
1 answer
22 views

Feature Engineering a Recency feature

I have a customer scoring problem I'm working on specifically on predicting conversion and coming up with a probability score on conversion (using xgboost classifier atm). There's a feature I want to ...
MetalicSt33l's user avatar
-1 votes
0 answers
33 views

What two different formulas in SVC minimization problem means?

Im studying a Support Vectors Machine and for soft margin I found minimization problem in form like this: $$\min_{w,b} \frac{1}{2} \|w\|^2 + C \sum_{i=1}^l \xi_i$$ And this this formula seems pretty ...
Almer's user avatar
  • 1
0 votes
0 answers
13 views

Modeling spatial data

I have the following dataset. For every time point (at a frequency of 1 hour), we can construct a graph consisting of 20 nodes representing countries. Each country (node) is characterized by 5 ...
Peter's user avatar
  • 1
0 votes
0 answers
33 views

Determining VCdim for union of subspaces $H_i$ - short question

Consider $\mathcal{H} = \mathcal{H}_1 \cup \mathcal{H}_2 \cup \mathcal{H}_3$, where: $\mathcal{H_1} = \{h_{a} : \mathbb{R} \rightarrow \{0,1\} \ | \ h_{a}(x) = 1_{[x \geq a]}(x) = 1_{[a, +\infty)}(x), ...
Andrei Jarca's user avatar
0 votes
0 answers
10 views

Objective function in Bayesian Hyperparameter Tuning

I have a question that has been going around in my head for a while and I'd like to leverage the wisdom of the crowd for getting a few opinions on it. Let me describe the Problem: I have a relatively ...
Hive5's user avatar
  • 1
0 votes
1 answer
14 views

Should I standardise time series data for deep learning classification?

Say I have time series data for classifying stars using deep learning based on stellar variability, with each time series data measuring the flux of the star overtime. For each star, I have the data ...
Johnathon Smith's user avatar
0 votes
1 answer
33 views

Train/test split of data, stratified based on label, but ensuring no athletes are In both train/test sets

I’m working on a project that uses data from wearable tech for activity classification. However, I’m having trouble deciding on how to do the train/test split. I’m currently doing the split based on ...
Shane O Mahony's user avatar
1 vote
0 answers
21 views

Xgboost custom objective function. How to modify the weights?

I have a custom objective function to xgboost: ...
Gábor B's user avatar
3 votes
0 answers
39 views

Weird behaviour when using RobERTA for text classification

I have a dataset with around 70 classes and the dataset is largely balanced ~150 samples per class. I am finetuning RoBERTA-base for 4 epochs with a ...
user1274878's user avatar
1 vote
1 answer
33 views

Data binning for interval data

I am trying to create a ML model for salary classification into 5 categories (0-90k, 90-120k, 120-180k and so on). The problem is that in my dataset almost all salary data is presented in intervals. ...
pinkkdeerr's user avatar
1 vote
1 answer
34 views

Unordered Set Classification Problem

In my setup I have one feature which is a sparse list representing categories. For example, let's say that we have M categories in the interval ...
dpalma's user avatar
  • 111
1 vote
0 answers
47 views

Multiclass matrix loss function in scikit-learn / xgboost / lightgbm

I have data with 4 classes: $c_1, c_2, c_3, c_4$. I'd like to create a classifier which has different scaling for the loss function per class combination: $$ \begin{bmatrix} 0 & l \left( \hat{c}_{...
Avi T's user avatar
  • 66
0 votes
0 answers
45 views

When is sampling bias acceptable?

Overview: Dataset is small and a bit messy and the task is to classify 5 classes wherein the targets are ordinal. Feature Engineering and Selection, Model Tuning, etc. did not produce acceptable ...
easymoneysniper's user avatar
0 votes
0 answers
8 views

What is the reference time point relative to which the capital-gain and capital-loss features of the UC Irvine Adults dataset are measured?

The Adults dataset available in the UC Irvine Machine Learning Repository is based on the 1994 census data (USA census, I presume). The dataset has two features named ...
Evan Aad's user avatar
  • 175
0 votes
0 answers
12 views

Building a dataset for classification

I'm thinking of building a powershell script classifier using different architectures of neural networks. I have approximately 6k powershell scripts (3k malicious, 3k benign). My questions are: How ...
freaks's user avatar
  • 1
1 vote
0 answers
7 views

Is GroupKFold needed if some samples have some of their feature values equal?

I am given a dataset $D$ of 10k enzyme-substrate complexes having a lock-key relationship, with each sample (complex) being characterized by enzyme features $x_e$ and substrate features $x_s$. That is,...
ado sar's user avatar
  • 191
1 vote
1 answer
33 views

Feature selection in binary classification

I have a dataset with two classes and am interested in learning which features are 'important' for predicting the class. There are a lot of features available and I want to find subset(s) that lead to ...
Shawn's user avatar
  • 35
1 vote
1 answer
20 views

Public Email Classification Dataset but not Spam vs Ham

Context Working to deliver a POC on automated email classification (in customer service context) to tag emails as related to feedback, complain, lost and found etc. The tags are not entirely exclusive,...
Della's user avatar
  • 335
0 votes
0 answers
7 views

What are approaches to identify the meaning of columns in a dataframe based on similarity to known column instances

In my domain we can perform upon to 12 tests on a substance, and record results for each of the tests at different pressures e.g. between 10 and 20 steps between 0 and 6000 psi. for each substance ...
user1199100's user avatar
0 votes
0 answers
12 views

Measures of efficacy for one classification models on the same data set with different numbers of classes?

I am currently doing a university project in supervised learning. The variable to be predicted varies across the integers [0,100] and my supervisor suggested to split this range into different classes ...
Oliver's user avatar
  • 1
0 votes
0 answers
16 views

(Tensorflow) How to speed up initialization of model.fit()?

So I'm working with a rather large dataset (perhaps not really by ML standards - but too big to fit into my computer's RAM at any rate). And so, I train the model by successively loading a subsample ...
Tom P's user avatar
  • 101
0 votes
0 answers
13 views

Need to compare results using Ward's method

So I create clusters like this and StandardScale them ...
Poyo's user avatar
  • 1
0 votes
0 answers
22 views

How to improve Accuracy on dermaMNIST dataset?

Unlike the regular MNIST which gets 97-99% with a fairly basic network, dermaMNIST gets training/validation stuck on 0.69. This tells me the model is underfitting. But, making it bigger seems to have ...
Zwerchhau's user avatar
  • 131
0 votes
1 answer
25 views

Group/cluster semantically similar classes in reports?

I'm fine-tuning BERT models to binary classify reports. For example, a report can be about 'birds' or not about 'birds'. This works really well, but now I want to do multi-label classification, ...
Rob Audenaerde's user avatar
0 votes
0 answers
13 views

How to classify/recognize postage stamp varieties?

As a hobbiest stamp collector, I often run into the need for classifying stamps based on minute differences, such as these: Now, I literally have thousands of them (in ziploc bags) and I am planning ...
René Becker's user avatar
0 votes
0 answers
9 views

Can we calculate Bayes Error rate, if we have a simulated data?

I am going through ISL(Python) and in section 2.2.3 ( Page No. 36), the author writes, "For our simulated data, the Bayes error is 0.133. It is greater than zero, because the classes overlap in ...
Prashant Kumar's user avatar
0 votes
0 answers
28 views

Calculate AUC-ROC and AUC-PRC for an LSTM Model

I have the following simple Bidirectional LSTM model for a binary classification task: ...
thatsroughbuddy's user avatar
0 votes
0 answers
6 views

Speaker Verification models on

I went through different articles of speaker verifications (ECAPA-TDNN, TITANET). They trained on ...
user3668129's user avatar
0 votes
0 answers
22 views

Can someone interpret my Binary Cross Entropy Loss Curve?

I am trying to understand my loss curve using : tf.keras.losses.BinaryCrossentropy() Question 1: Based on my loss curve/accuracy, would it be wise to proceed to feed it into a ensemble learning model ...
Leibon Jarbis's user avatar
0 votes
0 answers
17 views

Training the neural network does not give the expected result

I'm trying to create a pytorch neural network capable of recognizing peaks in 2D graphs. Previously, I was able to get a result close to what I wanted, but it was not ideal and did not give a ...
AlterEGO's user avatar
4 votes
1 answer
207 views

Deal with overlapping classes in classification modeling

I am currently working with a dataset comprising information about crop insurance for soybeans. My ultimate goal with this dataset is to create a classification model capable of predicting whether ...
EduMinsky's user avatar
0 votes
0 answers
11 views

Classification techniques for continuous arrays as inputs and scalar categorical variable as output

a newbie here. If you had any ideas about the following, that would be great. Suppose for a given data set: T’s and Y’s are arrays with T = [0 1 2 3 5 6 7] Y= [4 7 9 3 6 1] So at T=0, Y=4 and so on Z =...
Ash Ketchump's user avatar
0 votes
0 answers
13 views

Implementing Fuzzy Matching and NLP for Transaction Classification

I’m a trainee at a fintech startup, and I’m working on a project that involves classifying transactions using Natural Language Processing (NLP) and fuzzy matching techniques. The main goal is to ...
RAN's user avatar
  • 1
0 votes
0 answers
9 views

Do LSTM, GRU and Transformer models with less layers and units perform better than larger models when classifying short text sequences?

I am working with a Kaggle dataset with short Twitter messages as text input. I made a copy here. When testing LSTMS, GRUs, bi-directional versions of the GRUs, and the Encoder layers of a Transformer ...
Joachim Rives's user avatar
0 votes
0 answers
32 views

Classifying Players as winners or losers

I have a dataset that I curated from a game that I play. There are currently 130 instances (i.e. players) and an innumerable number of features. Experience tells me <10 features would be sufficient....
Shawn's user avatar
  • 35
0 votes
0 answers
8 views

What are the drawbacks of utilizing sample weights in classification tasks?

In classification tasks, especially when dealing with unbalanced data, using sample weights can be beneficial. However, it's not always the default choice in ML libraries like AutoGluon ...
jsn's user avatar
  • 1
0 votes
0 answers
28 views

Similarity Scores between SQL tables

I'm trying to figure out the best way to get started on a project. I have two separate databases, one is a "Template" db and the other is "Content" db. For each table in the ...
Marc J's user avatar
  • 1
0 votes
0 answers
19 views

Rather than build a classification model, Is building an embedding regression model feasible?

Face recognition models like VGG Face are designed to have a classification head on top and then trained to classify face images, but after they are trained the classification head can be removed and ...
Ahmed Gamal's user avatar
0 votes
1 answer
17 views

Data augmentation technique not working correctly

Write a function that can shift an MNIST image in any direction (left, right, up, or down) by one pixel.⁠6 Then, for each image in the training set, create four shifted copies (one per direction) and ...
samsamradas's user avatar
0 votes
0 answers
8 views

Discuss kNN, test/train, random projection, unit vector, vectored matrix, hamming distance, stft, Y=(aAX1:M)

Suggestion Investigation Looking for suggestions or guide for how to setup a clean approach and discussion on how to apply a python suggested way to solve this challenge Looking for suggestions or ...
Data Science Analytics Manager's user avatar
0 votes
0 answers
9 views

Reducing language bias for text classification, transformer model

I am working on a text classification model predicting classes for text. We have languages from many parts of the world and some of our classes are dominated by specific languages. The model we are ...
Carl Rynegardh's user avatar
0 votes
0 answers
41 views

Is this classifier better than a random guess?

I'm working with the SAMHSA Mental Health Client-Level Dataset. I'm trying to train classifiers to predict the disorder given the rest of the columns. There are 14 binary disorder columns (bipolar, ...
Jackson Walters's user avatar
0 votes
0 answers
17 views

How to interpretmulti-class confusion matrix?

I'm looking at the SAMHSA Mental Health Client-Level dataset. I did some t-SNE plots (dropping irrelevant cols, normalizing some, one-hot encoding some) of 500k rows out of 6.5mil. I'm trying to do ...
Jackson Walters's user avatar
1 vote
1 answer
36 views

Find closest color class to an RGB value

I have a module that estimates the color of an object and returns an RGB value in this format: (40, 48, 68) which corresponds to this color: Now I have to classify ...
Mary's user avatar
  • 217
1 vote
1 answer
47 views

Why is my LSTM model not predicting well when predicting labels for a new dataset?

I have a 15 timeseries datasets with 25-30 columns and is labeled by following a complex formula applied on the 25-30 columns. When training, I split the datasets as training datasets and unseen ...
Rushabh Kheni's user avatar
0 votes
0 answers
19 views

PR-AUC vs F1 vs Balanced Accuracy

I'm trying to create a Random Forest Classifier for selecting ~ 700 features. I have a highly imbalanced dataset to select features from. There are significantly fewer positive cases (1%) compared ...
user155775's user avatar

1
2 3 4 5
66