Questions tagged [multiclass-classification]

126 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
5
votes
2answers
57 views

Data transformations in hierarchical classification

I am building a hierarchical text classifier using the Local Classifier Per Parent Node (LCPN) approach with the 'siblings' policy as described in the A survey of hierarchical classification across ...
4
votes
1answer
167 views

Why does CV yield lower score?

My training accuracy was better than my test accuracy, hence I thought my model was over-fitted and tried Cross-validation. The model further degraded. Is that my input data need to be sanitised ...
4
votes
0answers
68 views

make prediction with a time serie

I want to build a model that can detect which driver is driving now the car based on a dataset that contains 20 driver records for 3600s each driver ( the dataset contains all the car sensors values ...
4
votes
1answer
681 views

AUC computation on multilabel classification

I'm using Tensorflow for an auto-tagging task on audio clips. The problem is actually a multilabel classification problem meaning that each clip can have multiple tags at the same time. Regarding ...
3
votes
0answers
31 views

Unbalanced data set - how to optimize hyperparams via grid search?

I would like to optimize the hyperparameters C and Gamma of an SVC by using grid search for an unbalanced data set. So far I have used class_weights='balanced' and selected the best hyperparameters ...
3
votes
1answer
41 views

User actions sequence classification

I have a training set where each row is a series of user actions on a website (logged in, sent an invoice, etc.) and times deltas in ms between these actions. Each row has a label — a corresponding ...
3
votes
0answers
94 views

Can I turn any binary classification algorithms into multiclass algorithms using softmax and cross-entropy loss?

Softmax + cross-entropy loss for multiclass classification is used in ML algorithms such as softmax regression and (last layer of) neural networks. I wonder if this method could turn any binary ...
3
votes
0answers
310 views

Adjust class weights due to class imbalance and class importance Multi class classification XGBoost

With respect to this question and the answer given by @Esmailian, Would anyone be able to let me know if Class B has a higher importance or the positive class ( i.e. it needs to have a higher ...
3
votes
0answers
367 views

Deep CNN with variable number of classes and “vanishing” data

I am using a deep CNN to predict the class an image belongs to (N classes). However, the number of classes is not stationary. I.e. over the time the network will be used, some new classes may emerge ...
3
votes
1answer
529 views

What does it mean that classes are mutually exlcusive but soft-labels are accepeted?

The Tensorflow's documentation of softmax_cross_entropy_with_logits: Measures the probability error in discrete classification tasks in which the classes are mutually exclusive (each entry is in ...
2
votes
0answers
29 views

Keras deep learning speaker identification model excels during training and then fails predictions

I am attempting to create a 1:N speaker identification model with Keras using a TensorFlow backend. I used the LibriSpeech corpus for training data, and preprocessed the data by first converting each ...
2
votes
1answer
32 views

Multiclass classification task where each class is present only once in the test set

I have a multiclass classification problem where, in the test set, there is only one entry for each possible class. In my particular problem we want to guess the author of a text, and we have 20 ...
2
votes
1answer
20 views

Statistical test using Gmean to compare multiple algorithms on multiple datasets

I am new in this area. I am facing some issues while comparing the algorithms using statistical test. I have following result of Gmean of some classification algorithm. Abalone, Balance-scale, Car, ...
2
votes
1answer
60 views

Co-joining multi-peak histograms

I am analysing a bunch of data files which represent responsiveness of cells to addition of a drug. If a drug is not added, cell responds normally, if it is added, it shows abnormal patterns: , . We ...
2
votes
0answers
22 views

Does object detection do a better job at image classification than image classification

I read in an article that object segmentation can do object detection better than object detection algorithms. I assume this is because there is more detailed information in the annotation images. I ...
2
votes
1answer
151 views

Which model to use for multiclass audio classification?

I am working on a project wherein I want to classify Tabla taalas(patterns) and I didn't find any dataset regarding it. I am recording them myself and I've ~500 data samples recorded. What model shall ...
2
votes
0answers
272 views

Can McNemar's test be applied to evaluate multiclass models?

Full Disclosure: I did a semi-cross post of this question due to low traffic on Cross Validated. Once I get an answer on any of the two questions, I will link the answer back to the respective other. ...
2
votes
0answers
64 views

Is AUC a good metric for evaluating the performance of a multi-class classification?

Considering the definition of AUC (Area Under Curve), is that a reliable performance metric for a multi-class (30-40 classes) classification problem?
2
votes
0answers
456 views

Hierarchical classification with multi-class predictor for every parent node

Edit: It turned out that I had an error in my function to compute the combined probabilities (a typo that changed the behavior of my function quite a bit without giving me an error message). Without ...
2
votes
0answers
32 views

Multiclass classification problem with more prediction classes than real classes

Can I have a multiclass classification problem with more prediction classes than real classes? For example: I want to predict the channel the user is going to watch. The real classes are "user didn't ...
2
votes
0answers
63 views

Unbalanced multi-class : distribution might change as more data come in

I am currently working on a problem of multi-class classification on testing logs data. Basically, I have the context data from tests' execution saved, and want to automate the analysis of the ...
2
votes
0answers
256 views

multi class classification : unbalanced data - good testing results poor prediction results

I have unbalanced dataset with 11 classes where 1 one class is 30% and rest are between 5-12%. I am not a hardcore programmer so I am using the product from https://www.h2o.ai/. I used GBM and DRF ...
2
votes
0answers
199 views

Train a multi-output neural network to learn subset of “valid” response combinations

I'm working on extending a model of human immediate serial recall task performance, originally described in this paper. This model takes a sequence of items, such as digits or phonemes, stores them as ...
2
votes
0answers
2k views

How to set weights in multi-class classification in xgboost for imbalanced data?

From this post, I know you can set scale_pos_weight for an imbalanced dataset. However, for the multi-classification problem in the imbalanced dataset, I don't ...
2
votes
0answers
1k views

why the accuracy of LDA model is always changing and also is high

Let’s explain the whole goal firstly, then go through the question. I am using topic modeling like LAtent Dirichlet Allocation and NMF to extract the topic from a collection of documents. My dataset ...
2
votes
0answers
94 views

How to mitigate the hierarchical error propagation in tree-structured classification

Suppose we have a multi-class classification problem, where the number of classes $K \geq 3$ We use a tree structure of multiple SVMs to divide and conquer the problem, with one example in the figure ...
2
votes
0answers
541 views

Fisher's Iris data set with Caffe

I am trying to use Caffe on the usual Fisher's Iris data set (150 flowers, each having 4 features, and split into 3 classes): if a flower belong to class 1 (setosa), the network output should be [1, ...
1
vote
0answers
9 views

Can we use CNN to effectively learn from a table whose various rows are permuted in the testing dataset, output for each remains same?

I have a set of classes, 37 to be precise. Each class is represented by a feature vector of size [1,10]. A single input sample has the dimensions of ...
1
vote
0answers
34 views

Multi-class Classification with Sigmoid Activation at Output Layer

In multi-class classification (mutually exclusive classes) using Neural Networks (ANN), it is generally advised that we encode our target labels as one-hot, use a softmax layer as the output with the ...
1
vote
0answers
28 views

Is the micro averaged precision/recall/f1 score for multiclass classification always the same?

I was under the impression from this post that in the micro averaging case for multi-class classification, the precision and recall are the same. This is because the number of false negatives and ...
1
vote
1answer
40 views

How to train a machine learning algorithm with multiple labels

I have the following challenge and I very much hope that there is a solution to it. I also suspect that there is a simple approach to it. I just don't see it at the moment. Any help or advice is ...
1
vote
0answers
15 views

Derivative of multi-output Gaussian Process

I am working on a project where I estimate transition and measurements models for a kalman filter using Gaussian Processes. In order to linearize the models I require the Jacobian of the estimated ...
1
vote
0answers
41 views

Do I have to wrap multiclass SVM in OneVsRestClassifier()?

I am using an SVM for mulitclass classification between 3 labels (1,0,-1). I thought this could simply be done by using SVC(decision_function_shape = 'ovr') in my ...
1
vote
1answer
130 views

XGBoost multiclassification interpreting predicted probabilities

Let's consider an example. I have patient level data, their symptoms, reading from various medical tests. Based on that, I have built a binary classifier given patient data to classify if they are ...
1
vote
0answers
267 views

Generate a balanced batch with ImageDataGenerator() and flow_from_directory()

Hi I am new to python and deep learning. I am doing a multiclass classification. My 3-classes dataset is imbalanced, the classes take about 50%, 40%, and 20%. I am trying to generate mini batches with ...
1
vote
0answers
23 views

How to deal with training set that overfits very easily

I have a dataset consisting of 72 one-hot encoded (thus binary) features and 2.5K training examples. With this I am trying to solve a 10-class classification problem. My main problem is that no ...
1
vote
0answers
55 views

is there metric 'multi_logloss' for xgb crassifier?

lgb has the log_loss metric ...
1
vote
0answers
15 views

Multiclass AUC score higher than binary

I just built a random forest classifier and wondered about the results. I have 4 classes: A, B, C and control. When I compare A vs control, B vs control, C vs control I get a lower average AUC score ...
1
vote
1answer
51 views

How to estimate the accuracy on a large dataset?

Given that I have a deep learning model(handover from former colleague). For some reason, the train/dev set was missing. In my situation, I want to classify my dataset into 100 categories. The ...
1
vote
1answer
28 views

multiclass classification

I want to build an ml model, which can when given a text input, can predict predefined tags or labels for the text. I already built one such model, but the problem with that is that it only predicts ...
1
vote
0answers
44 views

Use cross entropy to create decision tree classifier

Are entropy and cross-entropy the same thing as per basic definition? If there is a difference: Decision tree splits take on entropy or Gini index, can we use cross-entropy to split decision trees? ...
1
vote
1answer
844 views

How to calculate accuracy, precision and recall, and F1 score for a keras sequential model?

I want to calculate accuracy, precision and recall, and F1 score for multi-class classification problem. I am using these lines of code mentioned below. ...
1
vote
0answers
41 views

Multi-label classification with missing labels

I have a neural network that generates a vector that represents the class probabilities. Since it is a multilabel classification problem, I'm supposed to train the network using sigmoid + binary cross-...
1
vote
1answer
2k views

Sklearn classification report is not printing the micro avg score for multi class classification model

There are 6 class labels encoded as 0,1,2,3,4,5 While executing classification report score it outputs accuracy,macro avg,weighted avg .The micro average score is missing in the output . Im not ...
1
vote
0answers
40 views

How to identify multiple lines/clusters in a single dataset

I'm currently struggling to wrap my head around how multi-linear regression could be done to find separate sets of linear models in a single data set. I can perform regression on single data set for a ...
1
vote
0answers
38 views

Different result between Rapidminer and Python imblearn

I'm currently working on imbalanced classification problem. However i found different result between SMOTE in rapidminer and SMOTE in imblearn (python). rapidminer SMOTE give 15-20% improvement on ...
1
vote
1answer
38 views

How to handle overfitting in the following classification case

The confusion matrix is as below :- [[ 0 0 5 1 0 0] [ 0 0 19 14 0 0] [ 0 0 217 151 0 0] [ 0 0 84 282 0 0] [ 0 0 6 111 0 0] [ 0 0 0 10 0 0]] ...
1
vote
0answers
100 views

Using Lift charts with multinomial classification model

I’m trying to understand the use of Lift charts with multinomial classification model in the evaluation phase. I can see only one category can be selected to use in ‘x’ axis e.g drugA . What kind of ...
1
vote
1answer
67 views

best approach for CNN training with multiple subcategories and one category

I need to classify pictures into 2 categories: approved and rejected. Rejected category has different type of images which are not allowed (subcategories), for example nude or gore or anime etc. What ...
1
vote
0answers
67 views

Should images with multiple objects of the same class be used as training sample for multi-classes object detection models?

Let's say the model try to detect all the grapes on a branch of grapes. Can I use images of a grape branch with all the grapes labeled as a training sample? Will it affect the quality of the RPN ? Is ...