Questions tagged [multilabel-classification]

Multilabel classification assigns to each sample a set of target labels. This can be thought as predicting properties of a data-point that are not mutually exclusive, such as topics that are relevant for a document. A text might be about any of religion, politics, finance or education at the same time or none of these.

Filter by
Sorted by
Tagged with
1
vote
1answer
243 views

Understanding `get_combination_wise_output_matrix` when investigating a multi-label classification problem

I am currently working on a multi-label classification problem. I am using the scikit-multilearn library (further reading here) I understand that train / test split is important for these types of ...
0
votes
1answer
410 views

Best metric in imbalanced classification for multi-label classification

My test data are imbalanced, i tried to use the precision or the gmean as metrics for a multi-label learning model, but both metrics are not very informative. Is there any way to use for example the ...
1
vote
1answer
360 views

Splitting train and test in multilabel classification to avoid missing data in the train set

I have a dataset (600 rows) composed of two columns: -Summary: which contains the text of a document -Keywords: which contains the keywords that identify that document. ...
0
votes
0answers
233 views

Why the accuracy is high on both training and validation set but very low on test set?

I'm using Tensorflow to train a classifier for image recognition, the model below is built via Keras. The original data is (50000, 3072), and reduced to (50000, 100) with PCA. The explained ratio is ...
-2
votes
2answers
341 views

How to get labels in face recognition in Keras

I am building a facial recognition system. The model is complete but I am having minor issues during prediction. I used the Image data generator to load images from train and test folders and trained ...
0
votes
1answer
26 views

Using Keras how and what do I need to export to use my classifier independently?

I have a basic question that I can't seem to find an answer to. I built and trained with good results (above 90% accuracy) a NLP Log classifier that takes in a UTF-8 payload and classifies it into 32 ...
2
votes
2answers
864 views

What's the difference between multi label classification and fuzzy classification?

Is it just the between academics and practitioners in term usage? Or is theoretical difference of how we consider each sample: as belonging to multiple classes at once or to one fuzzy class? Or ...
1
vote
2answers
42 views

Can an output class be defaulted?

In my use-case of multi-class classification, my data distribution is like below: It might be too silly to ask this (and possibly could be gravely wrong), but is there a provision to default an o/p ...
1
vote
1answer
1k views

Clustering of multi-label data

The dataset consists of 1) a set of objects and 2) a set of labels, which are used to describe the objects. For the moment, for simplicity sake, each label can be marked as either true or false (...
1
vote
0answers
164 views

Multi-class classification as a hypothesis testing problem

I'm diving into the logistic distribution and its applications in classification problem (see my old question for more details about my idea). As discussed in my old post, logistic regression, in ...
3
votes
1answer
506 views

Multilabel classifcation in sklearn with soft (fuzzy) labels

I have a model which is trained in sklearn on a 5-way classification problem, which performs relatively well (there are kNN and SVM versions, and both reproduce a test set with high accuracy). When ...
2
votes
1answer
2k views

Balancing XGboost still skews towards the majority class

I have unbalanced dataset for multiclass classification and I tried to use the class weights option in XGboost and the classifier still tends to favor the majority class. I am not sure if I need to ...
1
vote
1answer
79 views

What are some possible reasons that your multiclass classifier is classifying alll the classes in a single class?

I have unbalanced classes. Group1 N = 140 Group2 N = 35 Group3 N = 30 I ran the code on this data and all the Groups got classified as Group1. I thought that since group1 is the majority group this ...
3
votes
1answer
92 views

How to utilize user feedback due to miss-classification when correct class label is unknown?

Suppose we are developing an app which is supposed to predict a dog's breed by it's picture. We trained a classifier (in my case an MLP) using some dataset and shipped the app to users. Now suppose ...
5
votes
3answers
4k views

How mean and deviation come out with MNIST dataset?

I am a novice at the data science, and I notice some repository state the mean value and deviation in MNIST dataset are ...
3
votes
1answer
998 views

Confusion matrix in multilabel classification of an object in more than one class simultaneously

Regarding a classification problem where for example given an image which depicts a human and we are trying to predict their stance and their behavior. For example Human 1: 'Sitting' and 'Eating' in ...
1
vote
0answers
172 views

Transform a multiclass dataset into a multi-label one

I have a dataset of feature/label pairs. My labels are probabilities of each feature vector to belong to the K classes. Here is an example for K = 3: ...
1
vote
2answers
3k views

LSTM sequence prediction: 3d input to 2d output

I have this LSTM model ...
1
vote
0answers
36 views

LSTM RNN application [closed]

I am a newbie to machine learning. I am figuring out a way to predict student outcomes (pass, fail, drop-out)using LSTM? I have attributes to take into account - gender (M/F), previous grades (Pass, ...
3
votes
1answer
70 views

Is there a way to cluster words based on how similarly they sound?

I have a list of words for a fictional world I've made (don't judge lol). My ultimate goal is to generate more words that sound like them through a markov generator, but for now, I'm trying to build ...
1
vote
0answers
134 views

Tool For Multi-Label Image Classification

I am currently working on a project that requires multi-label image classification. The best way to achieve this seems to be through Binary Relevance. I was intending to use a convolutional neural ...
1
vote
0answers
329 views

Multioutput classification in Keras - how to get multivariate probabilities and deal with unseen classes

I'm struggling to design in Keras a deep neural network for multioutput classification model. The network works in tandem with external logic in a kind of feedback loop: in each iteration the external ...
6
votes
3answers
15k views

How to use sklearn train_test_split to stratify data for multi-label classification?

I am attempting to mirror a machine learning program by Ahmed Besbes, but scaled up for multi-label classification. It seems that any attempt to stratify the data returns the following error: ...
1
vote
0answers
32 views

how to label a tain_data? [closed]

I have one assignment that I have four files 1) train_data.csv: The training file contains two fields (text, id). 2) train_label.csv: The label file contains two fields (id, label). 3) test_data.csv: ...
3
votes
1answer
3k views

Keras decision threshold for Multiple Label prediction

I'm training a Neural Network to predict multiple labels for a given input. My input is a 200 sized vector of integers and the output should be a boolean vector of size 28. My ...
1
vote
1answer
308 views

Multi-label classification for text messages (convert text to numeric vector)

Given a dataset of messages which are labeled with 20 features, I want to predict the value of each feature for a new message. Dataset example: ...
2
votes
2answers
441 views

Transform single-label data set into multi-label data set

I received a data set containing a string of text and a label that categorizes that text into one of 50 categories. I'm hoping to build a model that predicts which category a string of text belongs in....
0
votes
1answer
541 views

Why does averaging a sentence's worth of word vectors work?

I am working on a text classification problem using r8-train-all-terms.txt, r8-test-all-terms.txt from https://www.cs.umb.edu/~smimarog/textmining/datasets/. The goal is to predict the label using a ...
1
vote
0answers
419 views

Unbalanced multi-label multi-class classification

What are common approaches in order to deal with unbalanced multi-label multi-class classification problems in deep learning? Furthermore there is correlation between the labels. I tried two ...
2
votes
1answer
92 views

Multilabel Classification With Ranking [closed]

I have a dataset as below: ...
0
votes
1answer
89 views

Multiple classification algorithms are predicting always exactly with the same scores. Is that normal? If not, what should I suspect?

I have been working on a multilabel classification problem. I am using Python machine learning libraries to implement the classification algorithms. For the cross-validation, I am using repeated K-...
0
votes
1answer
958 views

Forcing a multi-label multi-class tree-based classifier to make more label predictions per document

I'm been experimenting with tree based classifiers for multi-label document classification. All the trees I've created, however, tend to predict only one or two labels per document. Whereas the ...
1
vote
2answers
130 views

Advice on what Machine Learning Algorithms to study for a Job to candidate matching algorithm

I have asked in a few places and this seems to get downvoted for some reason. If this is not the place to ask this then some advice on how and where to ask it would be appreciated. I'm creating a web ...
1
vote
0answers
2k views

Training multi-label classifier with unbalanced samples in Keras

I'm trying to train a keras model that takes in samples, let's say $x_i$ for sample $i$, and predicts multiple independent labels, $\hat{y}_{ij}$, such that $\hat{y}_{ij} = 1$ if the model predicts ...
0
votes
3answers
110 views

Feasibility: train a model to learn how to extract data from documents

I am searching for an approach for solving the following problem: Given I have a large amount of printed and scanned documents. I am already able to detect text and the corresponding bounding boxes ...
0
votes
1answer
313 views

Handle 50,000 classes in OneVsRestClassifier

I'm new to data science and NLP. I'm trying to solve a problem that is having 1 million rows and some 50,000 distinct classes. The dataset has some text column as a predictor and the other one is the ...
1
vote
0answers
155 views

100% classification accuracy

I am trying to perform a multi-class classification where the network is trained to classify objects into 3 categories: cars, pedestrians and miscellaneous. I am using the KITTI Dataset for car ...
1
vote
2answers
101 views

In handwritten digit recognition problem using logistic regression, what changes needed to add another class "Not a Digit"

In handwritten digit recognition problem using logistic regression, normal implementation would forcibly classify even a picture of dog or cat as a digit. To eliminate this, what changes are needed to ...
2
votes
1answer
625 views

Keras multi-label time-series classification considering time-series as an input image vector

I am trying to build a multi-class classifier using Keras. I am not quite sure I have implemented it correctly. Data is like this label time-series variables [0:25728} ...
0
votes
2answers
162 views

How to use Automated Labelling for documents? [closed]

Let's say I have been given 1000 documents and 6 labels from someone. My job is to label each of these 1000 documents into 1 of the 6 labels which are words not numbers. How can I automate or semi-...
0
votes
2answers
6k views

Multi-label classification model in python?

Assume you have the following artificial dataset ...
1
vote
1answer
287 views

Multi-Class Neural Networks | different features

This may be a wrong question or something so feel free to correct me :). I have been studying neural networks for weeks now. I came across the multi-class classification model that uses neural ...
0
votes
1answer
128 views

Binary classificaiton for weather data if its class 1 or class 0 alert

I am working on weather data and it has few features that are independent variables such as severity, severity_id, ...
3
votes
1answer
5k views

How to correctly perform data sampling for train/test split in multi-label dataset?

Problem statement I have a text multi-label classification dataset, and I've found a problem with the dataset sampling. I'm facing two different strategies. The first one consists in preprocessing ...
5
votes
2answers
2k views

How to visualize results/errors of multilabel classifiers?

For multiclass classification you would normally choose a confusion matrix to plot the error of predicted classes against the target classes. What is the best way to visualize errors of multilabel ...
1
vote
1answer
52 views

Merge one label with one information for classification problem or multi-label classification

I want to build a model to support decision making in order to propose or not loan insurance to clients. Because sometimes clients asking loan and loan insurance have less chance to have their loan ...
7
votes
1answer
7k views

Dealing with extreme values in softmax cross entropy?

I am dealing with numerical overflows and underflows with softmax and cross entropy function for multi-class classification using neural networks. Given logits, we can subtract the maximum logit for ...
0
votes
1answer
834 views

Classification models with multi-class allowed for each record

I am training a multi-class classification model. Each record can belong to one or more classes. (actually can I still call it a classification model? or should it ...
1
vote
0answers
211 views

Loss function for Hierarchical Multi-label classification

I am looking to try different loss functions for a hierarchical multi-label classification problem. So far, I have been training different models or submodels (e.g., a simple MLP branch inside a ...
0
votes
1answer
364 views

Skills based recommendation system

Assuming that I have a list of Users with a list of skills: (each value is a different skill) And a list of Tasks with a list of demanded skills: Based on a manual classification that returned: (...