Questions tagged [classification]

An instance of supervised learning that identifies the category or categories which a new instance of dataset belongs.

Filter by
Sorted by
Tagged with
0
votes
1answer
19 views

Has this paper used weighted KNN or not?

Please tell me if you see this paper in the link below has used weighted KNN? because they have used weights as the training and testing samples and no formula written. They don't explain the ...
1
vote
0answers
13 views

Does it make sense to use Transformer encoders on top of a pretrained Word2Vec embedding for a classification task?

As the title says. I am dealing with a text classification task, but I do not have the resources to train a BERT word embedding from scratch. I was thinking of using an existing Word2Vec embedding ...
1
vote
0answers
22 views

XGBoost predicting everything as null when sample weights are passed

I am trying to build an Uplift model using observational data. The data is consists of collections calls to customers and my objective is to predict the incremental probability due to the treatment (...
0
votes
0answers
9 views

Day Classification in Time Series - LSTM

I am working on a problem in which i have a daily time series and I have a label for each day. For simplicity, let's say it is a binary classification, so for each day, there's a label (0 or 1) and 1 ...
3
votes
1answer
51 views

What does high variance mean in a binary classification machine learning model?

My understanding of high variance is that the targets are spread widely around. The output values are "all over the place". In a binary classification model, there can only be 2 outcomes. I am at a ...
0
votes
1answer
21 views

Best Machine Learning Approach

I'm looking for some guidance on how best to start on a data analysis project I'm hoping to do. I've got a data set of aprox. 1200 people with various features; and within it a subset of 110 ...
0
votes
0answers
9 views

Loss Function for Sparse Sequence Tagging

I'm currently working on trying to classify words in a sentence using bert. Unfortunately the labels I'm using are relatively sparse compared to the full text. Many sentences are only labelled 'O' ...
2
votes
1answer
92 views

How to correctly set a target for a time series based model?

I need help determining the best way to go about creating the target variable for a machine learning model that is trading a financial instrument (stocks, foreign currencies, crpyto, etc). Below is ...
0
votes
2answers
28 views

Extracting tokens from a document: applying Deep Learning or Classification?

I have a legal document from Law. That document is 4-pages of evidence from the plaintiff. I want to identify the Dates, Addresses and Financial transactions in that document. Can I apply deep ...
2
votes
0answers
49 views

Neural network cost is constant never changing during training

I am trying to build a binary classifier to predict a pulsar star with Single Hidden layer Neural Network. But the cost on training dataset after almost 100 iterations has no change, following is the ...
0
votes
0answers
10 views

NLP: Mapping Penn treebank and Brown corpus, to Universal PoS Tags

I am experimenting with NLP and PoS tagging. I wish to build a large corpus, composed of Penn Treebank and Brown corpus, and possibly even more. Unfortunately, their PoS tags are not compatible. Is ...
2
votes
0answers
72 views

Target mean encoding worse than ordinal encoding with GBDT ( XGBoost, CatBoost )

I have a dataset of 23k rows of an unbalanced dataset 85/15 ratio, 10 variables ( 9 of which are categorical ) , i'm using CatBoost and XGBoost for a binary classification. I applied cv (5 iteration ...
0
votes
4answers
65 views

What is the purpose of standardization in machine learning?

I'm just getting started with learning about K-nearest neighbor and am having a hard time understanding why standardization is required. Reading through, I came across a section saying When ...
4
votes
1answer
89 views

How to extract trees in XGBoost?

I want to extract each tree so that I can feed it with any data, and see the output. ...
1
vote
1answer
40 views

Oversampling only balances the training set, what about the testing set?

In a case of imbalanced data classification, I know that we only oversample the training set (to prevent data leakage from training to testing subsets), but what if there are no positive data points ...
2
votes
1answer
46 views

Gradient Boosted Decision Trees How to Find Prediction of Each Tree?

I'm doing a project. I have a classification problem that I should solve using gradient boosted decision trees. What I want to do is create a matrix that gives prediction of each decision tree for ...
2
votes
0answers
27 views

What is the current state-of-the-art video classification technique?

For a project I am aiming to automise the detection of goals in foosball (a.k.a. 'table football') matches. To do so I now track the ball in every frame using the openCV library in Python. To ...
1
vote
1answer
23 views

How do we decide on the classification algorithm to use with huge training size?

I am solving a questions binary classification problem and the training size for this is huge(291 billion). The data has bloated because of using tfidfvectorizerfor ...
1
vote
0answers
19 views

Weird distribution of neural network outputs

I've faced an unusual behavior during training a neural network. The problem is to predict if a sample of 1st class or 2nd class. (2-class classification). Classes are imbalanced (~ 5 / 95). I use ...
0
votes
1answer
17 views

Binary classification for variable outputs

I am creating a binary classifier in Keras and here's the code ...
0
votes
2answers
27 views

Can tanh be used as an output for a binary classifier?

I am creating a binary classifier in Keras and here;s the code ...
1
vote
0answers
19 views

How To Perform Time Series Data Patterns Classification

I'm fairly new to Python, and I want to create a Machine Learning algorithm that classifies Time Series Data Patterns. The data I will be using comes from an accelerometer-arduino system fashioned ...
1
vote
1answer
13 views

Product classification based on Description of a product in eCommerce website

I am searching for an eCommerce dataset which should have a product category and description for my academic research in Machine learning. Please suggest any public dataset available. ...
0
votes
1answer
20 views

Feature addition/ subtraction and SVM model accuracy

I am working on a text classification problem where I would like to improve the accuracy of my model. Presently, I am using SVM with linear SVC and OneVsRestClassifier. The model should correctly ...
0
votes
0answers
10 views

How can I stack one feature-engineering based model and another one non-feature engineering based model in python?

I have a StackOverflow question answer dataset. ( this is a classification problem ) So , far I have created two different models. Model 1: LightGBM model optimized. Data fed into LightGBM model ...
1
vote
1answer
23 views

Modeling strategy for predicting a day/hour based on my dataset

This is my first time posting here. I'm usually on SO. So I'm not sure if these kind of questions fit into DS stackexchange. I genuinely need opinions on this. What data do I have - ...
0
votes
0answers
9 views

what are possible error analysis approach in tabular data?

I am working on binary classification on tabular data. The dataset is mostly made of categorical data and after fitting the data to a model I found test accuracy to be low. I want to do error analysis ...
0
votes
0answers
10 views

Neural network approaches for classification of time signals

I have 3D images that constitute of 2 spatial dimensions, e.g. (x,y) coordinates, with the 3rd dimension being a time signal. The signal is not periodical, but related to physical properties of medium ...
1
vote
1answer
27 views

ROC curve and optimal threshold

I am doing a practice problem predicting a binary outcome. I have plotted an ROC curve and found the optimal threshold percentage to call future predicted observations a 1. I see that this threshold ...
3
votes
5answers
139 views

Classification training using probabilites and not raw classes (factors)

I have a problem where instead of having classes, i.e. a vector of 0s and 1s, I have the probability of an observation belonging to a class. A vector with 0.1, 0.95, 0.2, 0.3, etc. The obvious ...
0
votes
1answer
16 views

How can I imporve accuracy for text classification and mapping using SVM?

I am working on a problem where I need to predict the text corresponding to another text in my training data file. For example: if I have value like the software in one of my columns and another ...
1
vote
1answer
45 views

How to predict the value in KNN?

I am trying to build the KNN algorithm for IRIS dataset. First, I've computed the distance and stored it in 1d array. However, I am really struggling to build the prediction function. Therefore two ...
0
votes
1answer
28 views

Merging three different customer segmentation systems into one

I have been given a task where I have three existing customer segmentation systems (rule based e.g. if customer spends X in Y amount of time AND whatever then put in top spender segment is one segment,...
0
votes
3answers
63 views

what are effects of working with categorical dataset

I am working on classification problem where the dataset contains 90% of features as categorical. It is binary classification problem, and the class is heavily imbalanced. I performed Smote over ...
2
votes
0answers
29 views

how to work with NLP with other features

My dataset looks like this ...
0
votes
1answer
46 views

Adding machine learning classifier at the end of CNN layer

I wanted to use the CNN as feature extractor for my images and then fed these features to some machine learning classifiers such as SVM, decision tree and KNN. However when I was trying with SVM I got ...
0
votes
1answer
20 views

How do I interpret the given classification report?

The given classification report was obtained from running a Random Forest binary classifier on the test data. There is huge class imbalance in the training data. How do I interpret the given ...
1
vote
1answer
39 views

Probability calibration is worsening my model performance

I'm using RandomForest and XGBoost for binary classification, and my task is to predict probabilities for each class. Since tree-based models are bad with outputting usable probabilities, i imported ...
1
vote
1answer
16 views

Hybrid classification neural network

I have product data and I need to classify products to categories (for example Lenovo laptop to Laptops category, etc.), each product has properties such as: description list with image URLs (...
0
votes
1answer
29 views

What machine learning algorithm should I use for specific user configuration?

I have a data-set that contains thousands of employee data, including their role, department (Applications Developer, IT Support, Network Management etc.), and using one-hot encoding all of the ...
1
vote
1answer
36 views

Multivariate time series prediction with binary target

I have an electronic component whose sensors record temperature, current and voltage values of various sub-elements. These readings are taken at regular intervals of time and I organized them as ...
1
vote
1answer
49 views

How do I deal with missing values in a data set?

I am trying to build a binary classification model which predicts whether a patient would me infected with a certain disease at the the end of his hospital stay or not. The features that I have are ...
0
votes
1answer
37 views

Why doesn't the binary classification log loss formula make it explicit that natural log is being used?

I'm completing a DataCamp course where we are introduced to the log loss formula for binary classification: Two scenarios are given to show how the formula is used. One with p=0.1 and one with p=0.5....
2
votes
0answers
26 views

Using deep-learning on graph data for binary classification

The data: I have certain data that I decided to represent it as a graph (I thought it would suit). So I have the weighted graph data that includes a numeric attribute for each node. (networkx graphs)....
1
vote
1answer
35 views

When I use SHAP for classification problem, it shows an output that is not 0 or 1. How can I overcome this?

I'm using Pima Indians Diabetes Database(https://www.kaggle.com/uciml/pima-indians-diabetes-database). I made predictions using XGboost and I'm trying to analyze the features using SHAP. However ...
0
votes
0answers
9 views

Is there a way to choose obtain an optimal threshold to maximise F1 measure using ROC?

I am trying to choose the best threshold for a binary classification problem that maximises F1 measure. Currently, I am manually analysing the F1 measure at thresholds 0.1-0.9 in steps of 0.1. I am ...
2
votes
2answers
37 views

Probability vs recall for time series classification task

I am working on the time series classification task that focuses on predicting a fault. I framed the problem as a multi-step forecasting problem, where my goal is to predict to the class at ...
2
votes
1answer
49 views

Is it normal that a classifier always wrongly predicts the same samples?

I'm trying to improve the accuracy of a classifier, a random forest one. I built different models with the same hyperparameters but with different random seeds, trained them with the same training ...
0
votes
0answers
25 views

Can i use survival analysis to predict if a person will “die” or not, and then get the survival time if the person does?

I want to determine, given a project, "How long will it take for this project to be successful ?" Therefore, survival analysis seems like a perfect fit in this case (as I do have some projects that ...
1
vote
1answer
40 views

Random Forest Prediction

Let's say I want to classify if the employee will churn or not. In my random forest, I have 6 estimators where 3 of them predict the employee to churn and the other estimators predict the employee to ...