Skip to main content

Questions tagged [classification]

An instance of supervised learning that identifies the category or categories which a new instance of dataset belongs.

912 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
7 votes
2 answers
132 views

Data transformations in hierarchical classification

I am building a hierarchical text classifier using the Local Classifier Per Parent Node (LCPN) approach with the 'siblings' policy as described in the A survey of hierarchical classification across ...
matentzn's user avatar
  • 171
6 votes
2 answers
3k views

How to deal with missing data for Bernoulli Naive Bayes?

I am dealing with a dataset of categorical data that looks like this: ...
Chuck's user avatar
  • 161
6 votes
0 answers
99 views

Classify driver based on time-series sensor data

I want to build a model that can detect which driver is driving now the car based on a dataset that contains 20 driver records for 3600s each driver ( the dataset contains all the car sensors values ...
John Karimov's user avatar
5 votes
1 answer
506 views

Illustrating the dimensionality reduction done by a classification or regression model

Tl;DR: You can predict something, but how do you explain the prediction? EDIT: I have built a website that tries to answer this question with means of embedding / visually clustering data according ...
BenoitParis's user avatar
4 votes
0 answers
85 views

Non-Gaussian like distributions - Classifier of source data fails on target data

I ask you for help on a classification problem (classes are represented by the numbers 0,1 and 2). All features are extracted from time series data (fundamental is sinus shape). I have a source ...
deniz's user avatar
  • 51
4 votes
4 answers
269 views

Decision boundary in a classification task

I have 1000 data points from the bivariate normal distribution $\mathcal{N}$ with mean $(0,0)$ and variance $\sigma_1^2=\sigma_2^2=10$ with the covariances being $0$. Also there are 20 more points ...
thenac's user avatar
  • 141
4 votes
2 answers
606 views

How to choose layer from which to unfreeze image classification model

I'm wondering what steps do you take to decide on the part of the model to unfreeze. Do you do multiple experiments? Since the use of GPU is expensive, you must have some guidelines. Note: I know ...
user's user avatar
  • 71
4 votes
0 answers
2k views

How to train continuous/soft classification model?

The classic classification problem is like finding the function $F:\mathbb{R}^n\mapsto \{0,1\}$. The label set will be [Apple,Banana,Banana,...,Apple]. What if I want to train a function $F:\mathbb{R}...
Icyblade's user avatar
  • 4,336
4 votes
1 answer
825 views

Product classification in hierarchical categories based on multiple parameters and non-standard descriptions

I want to start a machine learning project in my company and a really big pain for spend analysts is to classify the products that buyers order for maintenance, tooling, raw material and such, as the ...
mad_dash2's user avatar
3 votes
0 answers
43 views

Weird behaviour when using RobERTA for text classification

I have a dataset with around 70 classes and the dataset is largely balanced ~150 samples per class. I am finetuning RoBERTA-base for 4 epochs with a ...
user1274878's user avatar
3 votes
1 answer
70 views

Selecting a subset of the population such that the distribution of a certain variable in the subset matches a reference distribution?

I have a large population ($P$) of entries and I am given the distribution of a certain variable ($x_0$) for a specific subset ($S$) of the population. The subset $S$ is not a random sample and hence ...
dan's user avatar
  • 31
3 votes
2 answers
61 views

How to detect whether an entire series is an outlier relative to others?

I have multiple price series of the same asset as follows. Visually, it is obvious that series "A" (the flat line) is an outlier, and series "E" (the line with the zig-zag pattern)...
finstats's user avatar
  • 131
3 votes
3 answers
130 views

Classification when the classification of the previous itens matter

I have a classification problem to solve, that seems to be common but I am struggling to find the name of this task and the best way to model this problem. Suppose I have a series of events that are ...
bratao's user avatar
  • 31
3 votes
2 answers
1k views

Why does my random forest classifier predicts one class more often?

I have a random forest classifier that predicts 0 class about twice as often as class 1. It also predicts class 0 with higher probabilities than class 1. It is not a imbalanced dataset. I tried ...
Ondřej Vitík's user avatar
3 votes
0 answers
537 views

how can i plot probability distribution of my classes in the way below?

All, I would like to plot the following: I have a binary classification problem where I am using xgboost as my 'model' below: ...
Maths12's user avatar
  • 526
3 votes
4 answers
352 views

ML: Classification Model Comparison

Given is a dataset that I need to use for a classification and I want to compare the performance of different classification models. Let's assume, I want to look at logistic regression (with ...
espressionist's user avatar
3 votes
3 answers
175 views

How to decide who to market? Clustering or Decision Tree?

I am working with a dataset that has enough observations and ~ 10 variables, half of the variables are numeric another half of the variables are categorical with 2-3 levels (demographics) one ID ...
Data Enthusiast's user avatar
3 votes
0 answers
40 views

Serializing a trained classification model into a set of actionable insights

I'm looking for ways to convert a trained classification model into a list of insights based on the resulting parameters of the model. To make an example, let's assume we trained a decision tree to ...
ozz1k's user avatar
  • 83
3 votes
1 answer
668 views

Gaussian Naive Bayes (GaussianNB) classifier not working with large number of features

I'm trying to make a partial fitting with GuassianNB here's small snippet of my code ...
Dia Abujaber's user avatar
3 votes
1 answer
122 views

How can I improve the accuracy of my model? (Cab Cancellation Prediction)

I am trying to predict based on several parameters like trip type, car type, source of booking, start time, lead time (start- book) and a few other params whether or not a customer will cancel. From ...
frigidelirium's user avatar
3 votes
1 answer
54 views

Approach to classify blocks of time series

I am wondering if there exists an approach to classify blocks of time series, and not specifically individual time series. If so, can you point me out papers/articles/tutorials where these type of ...
YellowishLight's user avatar
3 votes
2 answers
184 views

Machine learning model with simultaneous function optimization

Consider the following scenario. I am a sculpturer and customers ask me for what price I am willing to provide them with some statues. Their request for sculptures can vary in difficulty, quantity, ...
GdvJ's user avatar
  • 31
3 votes
1 answer
82 views

Facial recognition architecture

Image recognition uses deep learning, and in particular CNNs to train on and recognise faces. Usually, this entails training on lots of data. However, recently, we have seen face recognition being ...
user's user avatar
  • 2,003
3 votes
1 answer
103 views

How to update the posterior belief when we are observing a stream of correlated data from a fixed but unknown data source

I want to build a [probabilistic] model that aims to infer the true value of an unknown categorical variable, $y \in \{1,2,..., K\}$. We have a dataset $(X,y): \mathbb{R}^d\rightarrow \{1,2,..., K\}$ ...
Mo-'s user avatar
  • 1,255
3 votes
0 answers
110 views

Keras model with second to last sigmoid activated Conv1D layer followed by globalMaxPool outputs values outside [0,1]. Why?

I am trying to train a binary classifier. It is a residual network with skip layers etc. but ultimately, the bottom two layers are a 1D convolution with sigmoid activation followed by a global max ...
user3075342's user avatar
3 votes
0 answers
84 views

Neural network cost is constant never changing during training

I am trying to build a binary classifier to predict a pulsar star with Single Hidden layer Neural Network. But the cost on training dataset after almost 100 iterations has no change, following is the ...
Chinmaya B's user avatar
3 votes
0 answers
777 views

Target mean encoding worse than ordinal encoding with GBDT ( XGBoost, CatBoost )

I have a dataset of 23k rows of an unbalanced dataset 85/15 ratio, 10 variables ( 9 of which are categorical ) , i'm using CatBoost and XGBoost for a binary classification. I applied cv (5 iteration ...
Blenz's user avatar
  • 2,084
3 votes
0 answers
430 views

Adjust class weights due to class imbalance and class importance Multi class classification XGBoost

With respect to this question and the answer given by @Esmailian, Would anyone be able to let me know if Class B has a higher importance or the positive class ( i.e. it needs to have a higher ...
Michael Schroter's user avatar
3 votes
0 answers
1k views

Hierarchical classification with multi-class predictor for every parent node

Edit: It turned out that I had an error in my function to compute the combined probabilities (a typo that changed the behavior of my function quite a bit without giving me an error message). Without ...
Amelia Bones's user avatar
3 votes
2 answers
2k views

How to extract and classify data from a column in excel?

I have a column in an Excel sheet that contains a lot of data separated by || delimiters. The data can be classified to some classes like Entity, IFSC codes, ...
Arjun Arora's user avatar
3 votes
0 answers
362 views

Multivariate time Series classification - One class

I need your help with time series classification. I have measurements of different medical parameters for patients captured at every one hour. The output label is whether the patient has Acute Kidney ...
The Great's user avatar
  • 2,575
3 votes
0 answers
147 views

Feature Importance Python

My dataset has around 1000 features and 30k rows. All the feautres have value either 1 or 0. My target variable is Size which 3 classes : Small, Medium and Large. I have around 5k "small" data ...
TigSh's user avatar
  • 243
3 votes
0 answers
3k views

Is regularization only for regression?

I am making a classification model. I understand that the regularization minimizes loss functions. Can i use regularization techniques to minimize loss function in classification if doing so is ...
Siddhi Kiran Bajracharya's user avatar
3 votes
3 answers
109 views

Find recurrent dates in a small set (and get rid of non recurrent ones)

I need help in the analyse of a categorization problem. Given a set of dates (small set: 20 elements maximum), I would like to group dates which are equally distributed (with a tolerance). It can be,...
Damien's user avatar
  • 31
3 votes
0 answers
5k views

Adding multilabel classifier to TensorFlow example

I am starting with the generic TensorFlow example. To classify my data I need to use multiple labels (ideally multiple softmax classifiers) on the final layer, ...
Peter Gerhat's user avatar
3 votes
3 answers
3k views

What's the difference between GridSearchCrossValidation score and score on testset?

I'm doing classification using python. I'm using the class GridSearchCV, this class has the attribute best_score_ defined as "Mean cross-validated score of the best_estimator". With this ...
fabianod's user avatar
  • 141
3 votes
3 answers
264 views

CART algorithm (Classification and regression trees) question

We fit a full classification tree model $T_k$ of given depth $k$ to data using the CART algorithm, and prune the tree by finding $E(k, \alpha) = min_{T\subset Tk} Err(T) + \alpha |T|$. Here, $Err(T)$ ...
crommy's user avatar
  • 197
2 votes
1 answer
32 views

Grouping similar classes to improve accuracy, whilst maximising the number of classes

Suppose I have a large number of distinct classes, some of which are related. My model has high classification accuracy for some classes, whilst other classes are hard to predict. How could I group ...
MuhammedYunus's user avatar
2 votes
0 answers
51 views

Why is cross-entropy increasing with accuracy?

I'm making an implementation of the softmax regression and I'm struggling to understand the nature behind the problem of increasing value of Cross-Entropy: $H(y_i, p_i)=-\sum_{i=1}^C y_i log(p_i)$, ...
JoshJohnson's user avatar
2 votes
2 answers
35 views

How to find entity names in non-grammaratical text?

Given: Bella Pharma Rosuvas 5 Enalapril 10 Domperidone 10 Ned's 24 by 7 PCM 650 Teneligliptin 5 ... Get: ...
R J.'s user avatar
  • 21
2 votes
0 answers
387 views

Your input ran out of data; interrupting training

I am trying to train ResNET50 for dogs and cats classification (Tensorflow2.3) using the following code: ...
root's user avatar
  • 135
2 votes
1 answer
565 views

Threshold tuning with one-vs-rest for multi classification python

I’m currently using a One vs Rest Random forest algorithm for multi class classification problem using Python, and I want to find the optimal threshold for each class, How can I do this with OVR (One-...
Legna's user avatar
  • 21
2 votes
0 answers
20 views

Obtaining threshold based rules for classification problem

Suppose there are X1...Xn numerical variables predicting a target variable Y (0 or 1) Objective: to obtain the best possible thresholds and combinations of X1...Xn that can predict Y Example: (X1>...
Sunit Gautam's user avatar
2 votes
0 answers
11 views

Learning the Average of a 0/1 Dependent Variable

uppose I have a matrix 𝑋 and a dependent vector 𝑦 whose entries are each in {0,1} dependent on the corresponding row of 𝑋 Given this dataset, I'd like to learn a model, so that given some other ...
Ami Tavory's user avatar
  • 1,277
2 votes
0 answers
76 views

sentence type classification

I want to classify the sentences in my dataset as declarative, interrogative, imperative and ...
Mohsen Mahmoodzadeh's user avatar
2 votes
0 answers
63 views

How much ground truth is needed for a classification model?

I have unstructured problem text that needs to be classified into categories(Multinomial classification). Depending on the component, which is a structured element that allows me to segment the data, ...
Ozzie's user avatar
  • 21
2 votes
1 answer
287 views

How do I use wavelet transform for feature extraction correctly?

I'm trying to classify words based on EMG signals using a support vector machine as my model. My dataset includes 15 classes (words) with 230 repetitions and 1000 features each. I already merged all ...
Rose's user avatar
  • 21
2 votes
0 answers
945 views

Sample size for SHAP explainer and range of a SHAP value

I am working on a binary classification with 977 records with 77:23 class proportion. I used random forest model. Based on my attempt to run SHAP package, I got the below plots And I also see that ...
The Great's user avatar
  • 2,575
2 votes
0 answers
54 views

Labelling a dataset for sentiment analysis, which model is the best?

I want to do some sentiment analysis on a large text dataset I scraped. From what I've learned so far, I know that I need to either manually label each text data (positive, negative, neutral) or use a ...
Dan K's user avatar
  • 21
2 votes
1 answer
217 views

ROC_AUC score is higher before tuning n _neighbors for KNN

This is for multiclass classification. Before tuning the n_neighbors for KNN, these were the results: ...
user2807477's user avatar

1
2 3 4 5
19