Questions tagged [classification]

An instance of supervised learning that identifies the category or categories which a new instance of dataset belongs.

Filter by
Sorted by
Tagged with
0
votes
1answer
16 views

Which Technique should we use for predicting an integer output?

I'm working on a problem where my target feature of type integer. i.e (n_clicks). In general, if we want to predict categorical target feature then we use classification algorithms and on the other ...
1
vote
2answers
10 views

True positives and true negatives, F1 score: multi class classification

I have 4 classes for an application of classification of animal kingdom: 1 --> invertibrates; 2 --> vertibrates; 3--> mammal; 4 ---> ambhibian. Given a mixture of images the objective is to identify ...
1
vote
0answers
4 views

The effect of imbalanced distribution of data

I read on googles ML website if I have classification dataset with ratio of 90% for one classification and 10% of the data for another classification. In that case I should use exact same percentage ...
1
vote
2answers
31 views

Improving classifcation when some are less represented?

I have a multi-class classification problem. It performs quite well but on the least represented classes it doesn't. Indeed, here is the distribution : And here are the classification results (I took ...
0
votes
0answers
5 views

Nan in target variables Neural Network

Is it possible to train on a dataset with some nan in the target variables? I imagine a sort of loss calculation only for the given target data. Is this Doable in Tensorflow/Keras =?
0
votes
0answers
9 views

Binary classification algorithm

I have a retail customer transactional data set with features such as customer ID, product, date, number of products bought, ZIP code of customers, amount of the transaction. There already exists a ...
0
votes
2answers
26 views

Can tanh be used as an output for a binary classifier?

I am creating a binary classifier in Keras and here;s the code ...
0
votes
1answer
93 views

error while running lasso.py

The following is the error code generated while running lasso.py. Can anybody help in fixing the same. Here is the code: ...
1
vote
1answer
7 views

How to approach this multi label classification problem and what will be its accuracy metric?

I have a dataset for people doing trade in various segments (classes) .I am trying to build a multi-label classifier to predict people trading in various segments (classes). My dataset : ...
1
vote
1answer
14 views

How to train a Machine Learning model for blocked data

I'm concerned with a supervised classification problem for the following type of data. The data consists of $N$ rows (where $N$ is not very large - this is not a big-data problem) and $M$ columns (...
2
votes
1answer
31 views

How to justify the usage of 200 dimensions in word vectors instead of the 300 dimensions?

When employing machine learning methods in NLP, most of studies use 200 or 300 dimensional vectors. 300 dimensional embeddings carry more information and this, therefore, is considered to produce ...
0
votes
1answer
17 views

Binary classification for variable outputs

I am creating a binary classifier in Keras and here's the code ...
1
vote
0answers
21 views

Should scaling be done for mixed data (categorical and numerical)?

My dataset contains 13 attributes consisting of 10 Numerical and 3 Categorical attributes and Target. It has 180 observations ...
0
votes
0answers
17 views

How to handle a data set with large number (about 75%) of binary variables?

I am doing a research right now and want to classify (predict) churns of costumers using machine learning. My data set consists of about 500,000 observations with 20 variables: 15 are binary, 2 ...
1
vote
1answer
63 views

correct setting of eval_set in multiclass classification xgboost python , error is “ Check failed: preds.size() == info.labels_.size()”

i have a multiclass classification problem with 3 classes [-1,0,1] . i'd like to use eval_set in xgboost. but it fails with error: ...
2
votes
1answer
275 views
0
votes
1answer
149 views

Suitable Autoencoder for Activity Recognition dataset Feature Extraction

I have text data representing sensor outputs. Dataset: ...
0
votes
1answer
20 views

Feature addition/ subtraction and SVM model accuracy

I am working on a text classification problem where I would like to improve the accuracy of my model. Presently, I am using SVM with linear SVC and OneVsRestClassifier. The model should correctly ...
1
vote
1answer
13 views

Product classification based on Description of a product in eCommerce website

I am searching for an eCommerce dataset which should have a product category and description for my academic research in Machine learning. Please suggest any public dataset available. ...
1
vote
0answers
26 views

Classify the input set into categories based on pre-defined rule set

I'm trying to solve a problem where there are 2 input files given, Input 1: A set of strings in the format. All the strings start with "A". A-B-C-D A-B-C-3 A-X-Y-Z-4 A-X-5 A-X-P-Q-R A-X-P-Q-S A-M-9-...
2
votes
0answers
13 views

Scikit learn - best model to classify supervised two-feature data?

I'm quite new to scikit learn but I am looking for the best approach to go about classifying some data I've collected where each set contains two measurements made over several points of time, along ...
0
votes
1answer
8 views

Understanding python XGBoost model dump output of a very simple tree

I am trying to understand the model dump output from XGBoost. I would like to step through and see exactly how the model arrived at it's prediction. To simplify I trained a model with 1 tree and 1 max ...
0
votes
1answer
36 views

How to choose our data set wisely?

I have a couple of questions and I was wondering if you could answer them. I have a bunch of images of the cars (side view only). I would like to train a model with those images. My objects of ...
2
votes
3answers
43 views

Is it reliable to use TensorFlow (ML in general) to classify baggage bag tags based on the presence of a green stripe?

The images are identical except for the presence of the stripe on the side. I am trying to use a classify the images into 2 classes: greenStripe, noGreenStripe. I tried to use tensorflow retrain with ...
1
vote
2answers
448 views

extraction information from resume

I have a project in machine learning in which I need to analyze a curriculum vitae. for that I have to write a python program. It uses basic techniques of Natural Language Processing like word ...
0
votes
1answer
22 views

I have data with customer personal information and customer transaction. I cannot figure out how to use the data for training my model?

Customer information attributes: ID Age Gender State etc Customer transaction ID Store ID No of items bought State etc Store info Store ID State Daily revenue Store size etc I want to predict if ...
12
votes
4answers
12k views

Unbalanced multiclass data with XGBoost

I have 3 classes with this distribution: Class 0: 0.1169 Class 1: 0.7668 Class 2: 0.1163 And I am using xgboost for ...
1
vote
0answers
13 views

Big dataset for multi-class classification can't be dasked and split, normal one can't be handled

I have a huge dataframe (550MB), the lending club one available here, and I have to predict the class of the grades. The dask dataframe is : ...
0
votes
3answers
65 views

Rule of thumb for good number of features when dealing with grouped data

I have a classification problem on clinical data where I have multiple samples for each patient. So the samples related to the same patient are somehow dependent from each other. I know that is not ...
2
votes
1answer
27 views

Classifying objects based of a varying number of the same type of feature vector for each object

For a congressional session, I have created a doc2vec model of speeches made. Using the vectors from this model, I have a dataset of each congressperson, their political affiliation, and a list of the ...
0
votes
1answer
10 views

Keras ANN Trained Model's Accuracy change on prediction

I have trained an ANN Binary classifier using Keras. It gives 90% accuracy. After testing when I predict same data again but pass only one class then accuracy decreases to 40%. I have figured out ...
2
votes
1answer
3k views

Using class weights in Keras with multiple binary outputs which are not simply one-hot-encoded

My labels are binary vectors of length 5, e.g., [0, 0, 1, 1, 1]. My label set is very biased, 1-to-50, where the case [0, 0, 0, 0, 0] is very common while all ...
1
vote
1answer
106 views

XGBOOST : model.predict_proba() and model.predict() conflicting behaviour

I have two classes : 1 and 2 The output of model.predict_proba() -> [0.333,0.6667] The output of model.predict() -> 1 This is happening for around 200 test values out of the test data of 10 lac. ...
2
votes
2answers
62 views

Binary classfication vs One-class classification

Why do we need samples of both classes for the training of binary classification algorithms, if one-class algorithms can do the job with only samples from one class? I know that one-class algorithms (...
0
votes
1answer
53 views

Understanding the Gini/AUC metric as out-of-development performance metric

Assume we develop a model for a binary classification task that reaches a certain Gini/AUROC estimate on the validation ( or training ) sample, among others. This is an overall good metric, often used ...
1
vote
0answers
20 views

How to stack classifiers optimized for different score functions?

I have binary classification task (class0 vs class1) and I would like to create a stacked model out of classifiers which are individually optimized for different scorings. For example, let's say Clf_A ...
2
votes
2answers
155 views

How to create an ensemble that gives precedence to a specific classifier

Suppose that in a binary classification task, I have separate classifiers A, B, and C. If I ...
0
votes
0answers
3 views

Transforming target from object array to integer array to use sparse_categorical_crossentropy for class prediction

I want to do a neural network to predict to which loan class does a borower pertains. There are 6 classes [ A, B, C, D, E, F]. I tried to get rid of the NAs and ...
2
votes
0answers
15 views

Keras model with second to last sigmoid activated Conv1D layer followed by globalMaxPool outputs values outside [0,1]. Why?

I am trying to train a binary classifier. It is a residual network with skip layers etc. but ultimately, the bottom two layers are a 1D convolution with sigmoid activation followed by a global max ...
1
vote
1answer
44 views

How to predict the value in KNN?

I am trying to build the KNN algorithm for IRIS dataset. First, I've computed the distance and stored it in 1d array. However, I am really struggling to build the prediction function. Therefore two ...
0
votes
0answers
4 views

How to check if a class segmentation is meaninfull?

Using the Lending Club dataset I have a data frame with the loan characteristics of some borrowers. Here is the distribution of the subgrades: ...
0
votes
1answer
14 views

How can I imporve accuracy for text classification and mapping using SVM?

I am working on a problem where I need to predict the text corresponding to another text in my training data file. For example: if I have value like the software in one of my columns and another ...
20
votes
5answers
22k views

Are decision tree algorithms linear or nonlinear

Recently a friend of mine was asked whether decision tree algorithms are linear or nonlinear algorithms in an interview. I tried to look for answers to this question but couldn't find any satisfactory ...
0
votes
1answer
17 views

Churn Prediction Training Set

I don't understand how to form my dataset from activity(logins etc.) and characteristic(location, age etc.) raw user data. Ultimately, each row of the training set will have N activity features for a ...
3
votes
2answers
51 views

How to represent audio data in a format that can be used for preprocessing and modelling?

I have a project that I am working on currently. The project is to classify audio data. The data is in two folders train and test...
0
votes
1answer
41 views

Adding machine learning classifier at the end of CNN layer

I wanted to use the CNN as feature extractor for my images and then fed these features to some machine learning classifiers such as SVM, decision tree and KNN. However when I was trying with SVM I got ...
1
vote
1answer
49 views

How do I deal with missing values in a data set?

I am trying to build a binary classification model which predicts whether a patient would me infected with a certain disease at the the end of his hospital stay or not. The features that I have are ...
1
vote
0answers
10 views

Use LightGBM or FFM - imbalanced dataset

I have a highly imabalanced dataset but one that is not sparse. In train there are 1328 positives out of 104000. In validation ...
0
votes
1answer
55 views

Can we make two separate models vs one for classification?

Suppose I have a binary classification problem and my data is imbalanced, I can build a classification model using any of the algorithms and use an oversampling or undersampling technique to handle ...
1
vote
2answers
863 views

How to bootstrap the AUC on a data-set with 50,000 entries?

I am learning classification. I do have AUC-ROC curve of the data-set. How should I proceed to bootstrap the AUC? If I do the sampling of the same size as data-set then my AUC value would not be the ...