Questions tagged [classification]

An instance of supervised learning that identifies the category or categories which a new instance of dataset belongs.

Filter by
Sorted by
Tagged with
0
votes
2answers
29 views

Classifier design for website screenshots

I'm working on a project that requires determining if the page representing a hosted file on a third party platform (such as rapidgator or nitroflare) is still up or not. For example, here is a file ...
1
vote
4answers
68 views
+50

scaling images for image classification

I am trying to do image classificaition with a dataset that contains images of different sizes. The images are in a folder called Train, which contains 4 subfolders callsed HAZE,RAINY,SNOWY and SUNNY. ...
1
vote
1answer
11 views

Difference between class_weight and loss_weights in Keras

Keras has parameters class_weight used in fit() function and loss_weights used in ...
0
votes
0answers
15 views

Is there a way to choose obtain an optimal threshold to maximise F1 measure using ROC?

I am trying to choose the best threshold for a binary classification problem that maximises F1 measure. Currently, I am manually calculating the F1 measure at thresholds 0.1-0.9 in steps of 0.1. I am ...
0
votes
0answers
16 views

Why does a class weight fraction improve precision compared to under-sampling approach where precision drops?

I have an imbalanced data where the ratio between positive to negative samples is 1:3 (positive samples are 3 times higher than negative). For my case it is is important to have a higher precision (...
3
votes
2answers
42 views
+50

Splitting a pdf containing batch of scanned documents

My question is primarily: is there any ML research paper about splitting a pdf containing a batch of scanned documents (eg bank statements) into individual documents? I have searched for this but I ...
0
votes
1answer
332 views

Implementation of LDA (Latent Dirichlet Allocation) for classification tasks

Until now I have used LDA only for topic modelling. I would like to know which is the simplest implementation of LDA algorithm for classification tasks.
0
votes
0answers
52 views

Tensorflow model works for classification but not for regression (all predictions equal the output layer bias)

I'm trying to build a model for FX prediction. It's giving some promising results for classifying each period as buy/sell/neutral. When used as a classifier, actual returns are converted to 0, 1, or ...
0
votes
1answer
29 views

Deep learning model gives random results

First I am new to machine learning if it is an obvious question, I am sorry. ...
1
vote
0answers
11 views

How to Predict Employee count of businesses using Keras classifiers

I am trying to predict the amount of employees a business has based on a set of input variables. I am using things like the business's age, transaction details, geographic location, business structure ...
1
vote
0answers
64 views

XGBoost predicting everything as null when sample weights are passed

I am trying to build an Uplift model using observational data. The data is consists of collections calls to customers and my objective is to predict the incremental probability due to the treatment (...
3
votes
1answer
112 views

Extract features from a survey

I need to use the answers from a questionnaire for training a classifier. I discovered that some questions can have nested sub-questions.. Let's say (just an example) that I want to predict whether a ...
1
vote
0answers
5 views

Derivation of Bayes classifier in Murphy's book

I am reading Kevin Murphy's Machine Learning book (MLAPP, 1st printing) and want to know how he got the expression for the Bayes classifier using minimization of the posterior expected loss. He wrote ...
1
vote
0answers
16 views

User actions sequence classification

I have a training set where each row is a series of user actions on a website (logged in, sent an invoice, etc.) and times deltas in ms between these actions. Each row has a label — a corresponding ...
0
votes
0answers
32 views

An interesting task on machine learning [migrated]

There are 5 programs. Each program is a binary classifier, which classifies letters - "Spam" and "Not spam." All classifiers are independent and have an accuracy of 0.6. Suppose that there is a new ...
0
votes
1answer
21 views

Multi-class classification configuration

1) What are the appropriate activation and loss functions for multi-class classification problem? Is it so that: Up to 2 classes $\rightarrow$ Binary classification $\rightarrow$ Activation: Sigmoid ...
0
votes
1answer
306 views

RapidMiner create test partition

i have a big dataset with 2 classes. The 70% of records belong to the first class. It if create a training and test set with the operator "split validation" with stratified sampling i get a test set ...
-1
votes
0answers
8 views

Include date features in binary classification? [closed]

In binary classification and with features above 150, do you recommend dropping 3-5 date valued features?
1
vote
3answers
32 views

group the similar words

array(['Ruby on Rails', 'Ruby', 'AWS DynamoDB', 'Python', 'MySQL', 'Swift', 'Android', 'iOS', 'JavaScript', 'React Native', 'ReactJS', 'TypeScript', 'Vue.js', 'Webpack', 'Amazon Web ...
4
votes
1answer
85 views

How to interpret classification report of scikit-learn?

As you can see, it is about a binary classification with linearSVC. The class 1 has a higher precision than class 0 (+7%), but class 0 has a higher recall than class 1 (+11%). How would you interpret ...
2
votes
3answers
47 views

NLP and one-class classifier building

I have a big dataset containing almost 0.5 billions of tweets. I'm doing some research about how firms are engaged in activism and so far, I have labelled tweets which can be clustered in an activism ...
1
vote
0answers
24 views

Model confusing classes

I'm training a bidirectional lstm with attention on a dataset with text data and six target classes. The F1 score on the test set by class is about 0.7 for four of the classes, and about 0.35 for ...
1
vote
1answer
21 views

Can a recommendation system be used as a binary classifier?

I have a computer-generated music project, and I'd like to classify short passages of music as "good" or "bad" via machine learning. I won't have a large training set. I'll start by generating 500 ...
1
vote
0answers
7 views

How to use “related” and “unrelated” as classes rather than multiple classes?

I have a dataset with about 15 feature columns and about 1000 rows that I'd like to use for supervised training. Every row can be classified as "related" or "unrelated" to another row. About fifteen ...
1
vote
1answer
142 views

Can you reuse observations from your train data in your final test data?

For an employee population, I am trying to determine who among the employees are likely to get injured in the future based on 2 years worth of data. Unlike in most machine learning problems where you ...
0
votes
1answer
78 views

String indices must be integers

I was trying to encode the string values of the feature 'ProductCategory' into integer values but I got this error. Kindly help. And I would also like to ask if label-encoding this feature would not ...
1
vote
1answer
154 views

Accuracy and Loss in MLP

I am trying to explore models for predicting whether the a team will win or lose based on features about the team and their opponent. My training data is 15k samples with 760 numerical features. Each ...
2
votes
2answers
66 views

why an advanced LSTM model produce the same results as a simpler one?

I have implemented the model proposed in this article which is a text classification model that uses sentence representation rather than only word representation to classify texts. ...
0
votes
1answer
58 views

problem submitting classification problem

I am trying to make a submission, so I have a test set without labels and I am tryin to test my classification model on it. In particular, I have also to submit this prediction as a csv. I have the ...
1
vote
1answer
63 views

Why might trees work so much better than boosting classifiers?

I am predicting 10 classes label encoded using scikit-learn with 6 factors, 1.2M cases. DecisionTreeClassifier RandomForestClassifier ExtraTreesClassifier give accuracies (and precision and recall) of ...
2
votes
2answers
25 views

How should multiclass classifier performance be measured when one type of error is preferred over another?

Sorry if this question has been asked before--I am having trouble searching this topic since I'm not sure of my wording. Say you have a classification problem where there are more than two labels ...
2
votes
3answers
3k views

Neural network for Multiple integer output

I have a data set that contains 135 input features and 132 output values to be predicted. The input features are all numeric floating point values and each output value would be an integer between [0,...
0
votes
1answer
188 views

How can I detect anomalies/outliers in my online streaming data on a real-time basis?

Say, I've a huge set of data(infinite in size) consisting of alternating sine wave and step pulses one after the other. What I want from my model is to parse the data sequence wise or point wise and ...
2
votes
1answer
30 views

Predict_proba() probabilities distribution [closed]

I’m trying to calculate probability of class 1. I’m using gradients boosting (catboost classifier) Is it normal to have an equal rate of positive classes in every predict_proba() bucket? e.g.: [...
1
vote
1answer
11 views

Alternative methods of population-level classification

In a recent study, I am generating a series of logistic regression and random forest models to predict some binary outcome. For the sake of understanding, suppose this outcome is the occurrence of ...
0
votes
1answer
36 views

Find suitable locations using Machine Learning

Just for fun, I am currently trying to find suitable locations to deploy new stores. So what I did so far is to take the actual sites of current stores and to assign surrounding variables to it. These ...
3
votes
1answer
165 views

Shifted feature distribution across different datasets

I am trying to validate a classifier using two different training and testing datasets. The feature I am considering is a feature constructed doing the fold-change between two original features, i.e. ...
1
vote
2answers
37 views

Classification: Dealing with unknown class balance in the prediction dataset

I'm working on a classification problem that predicts if a grant application will be accepted. The data I'm training on is from 2005 to 2008. I'de like to predict any time after 2008. The issue I'm ...
0
votes
1answer
746 views

Multiple variable as input and output

I'm trying to predict the possible diagnosis given a consultation reason. I have ID's for all the data. So my data kind of looks like below ...
2
votes
0answers
9 views

How to estimate the marginal distribution of a class with respect to one predictor in a classification task?

I have a dataset with a binary dependent variable $y \in \{0,1\}$ and a set of predictors $x1,x2,..,t$. Here, $t$ is the time in minutes (in 24 hrs, that is $t \in (0,1440)$). I want to estimate the ...
0
votes
1answer
33 views

Problem with sort by and group by in pandas

I have a DataFrame with duplicate id's but have different dates. For Example: ...
0
votes
0answers
29 views

How to improve accuracy of Decision tree in R studio

I am currently conducting a study on the predictive qualities of odds (Regarding Football/Soccer). I have odds from multiple bookies on each of the seasons and leagues within the study ( as below ). ...
3
votes
0answers
20 views

Data transformations in hierarchical classification

I am building a hierarchical text classifier using the Local Classifier Per Parent Node (LCPN) approach with the 'siblings' policy as described in the PDF: E.g. if we have the classes 1.1, 1.2, 2.1, ...
1
vote
0answers
8 views

Why crossvalind and cvpartition results are different?

I did a Test on my data set with "cvpartition" and "crossvalind" functions (in MATLAB) with the same parameters and data set, but why the error results are different and which one is correct? Codes ...
1
vote
0answers
15 views

Balance two crossentropy losses with different number of neurons

I have a model with a few outputs, each output with shape: Shape: (batch_size, labels_1) -> softmax -> ...
1
vote
1answer
34 views

Which classification model to use on large, high-dimensional dataset?

I face a classification task: with several features a target features is to be predicted. I'm working with python. My dataset includes 60 features from which I picked 16 which I think could be ...
0
votes
1answer
27 views

Improve performances of a convolutional neural network

I am doing image classificaition, and to do this I have built the following neural network: ...
1
vote
1answer
32 views

Is there a common strategy to measure if a difference-significance of two areas under two ROC curves

I conduct sound detection experiments with mice. I have a stimulus sound and a "noise" sound that shoukd be ignored. I want to measure how well the mouse ignors the noise (with respect to, say, ...
0
votes
1answer
158 views

Random seed in Machine learning model comparison

I wanna ask very important question about the random population generation gin splitting the dataset in machine learning classification models; For example to more explain, i used seed =1 a,d i got ...
1
vote
1answer
15 views

Classifcation of non-linear regressions based on their shapes

I have a data set of thousands of individual y ~ x relationships that can have varying shapes in their relationships. For example, they can follow an exponential, asymptotic, logistic or hump-shaped (...