Questions tagged [classification]

An instance of supervised learning that identifies the category or categories which a new instance of dataset belongs.

Filter by
Sorted by
Tagged with
0 votes
0 answers
6 views

Using a fine-tuned model for a different dataset

I have a dataset of different sentences from news articles which I need to classify by their sentiment. For that goal I'm planning to use a fine-tuned model which was fine-tuned on different datasets, ...
user avatar
  • 1
0 votes
0 answers
6 views

All-to-all modeling for structured dataset?

I have a structured dataset with rows as different samples and columns as different attributes of the samples. Interestingly, the attributes are highly inter-correlated (i.e. a complex system). I want ...
user avatar
1 vote
0 answers
15 views

Deriving a binary logistic classifier from a multi class logistic classifier

Given a multi class logisitic classifier $f(x)=argmax(softmax(Ax + \beta))$, and a specific class of interest $y$, is it possible to construct a binary logistic classifier $g(x)=(\sigma(\alpha^T x + b)...
user avatar
1 vote
0 answers
15 views

Can I "fit" a k-nearest neighbors classifier without precomputing anything?

I am currently trying to fit a KNeighborsClassifier (scikit-learn implementation) to about a gigabyte of training data. From every resource I've read online, a k-nearest-neighbors classifier is a &...
user avatar
1 vote
0 answers
16 views

Whether to use LDA or QDA

I'm trying to determine whether it's best to use linear or quadratic discriminant analysis for an analysis that I'm working on. It's my understanding that one of the motivations for using QDA over LDA ...
user avatar
  • 11
0 votes
0 answers
13 views

Can we use an independent t-test as a metric for feature importance?

I have a supervised binary classification problem. I tuned an xgboost model on the training set and achieved a reasonably high accuracy on the test set. Now I want to interpret the results of the ...
user avatar
  • 165
0 votes
0 answers
7 views

In Python, how can I transfer/remove duplicate columns from one dataset, such that the rows and columns of all datasets would be equal?

So I've been trying to improve my Random Decision Tree model for the Titanic Challenge on Kaggle by introducing a Validation Dataset, and now I encounter this roadblock, as shown by the images below: ...
user avatar
0 votes
1 answer
38 views

How can I export the best classifier from my code to a model for real future usage?

...
user avatar
  • 1
4 votes
1 answer
117 views

Can classification model B trained on data labeled by classification model A exceed the performance of model A?

Let's say that I have a small or medium sized dataset of images, say 50,000. I use transfer learning to train a deep learning classification model. Call this model A. Model A is deemed to have good ...
user avatar
  • 141
0 votes
0 answers
19 views

Multi-Label time-series classification with LSTM: large performance decrease for longer periods

I have daily data on event occurences, so for each day I have a vector like [1, 0, 1] indicating that on this day event one and three occured, but event two did not occur. I want to train a model to ...
user avatar
  • 13
0 votes
0 answers
11 views

Label images on-the-fly

I have a code in which it downloads images from Google image according to a query. All those queries are cars (different branch, model and year). Since it is difficult to label each image with a given ...
user avatar
0 votes
0 answers
5 views

How to do multivariate time series classification using C# and either Accord.NET, Encog or ML.NET?

I have a time series based on financial security prices with additional features. I wish to feed this series into some ML construct in order to perform multi-class classification. Most of the ...
user avatar
0 votes
0 answers
15 views

Binary classification from local and global feature selection

I want to train a deep leaning model, consisting of images. My question is which scenariowas chosen to train the model? scenario 1 : I train images local context on Output 1, and I train images clobal ...
user avatar
0 votes
1 answer
26 views

Keras Binary Classification - Maximizing Recall

Let me start by saying my machine learning experience is... dangerous at this stage. I'm still a beginner. I have a binary classification data set of about 100 000 records. 10% of the records are ...
user avatar
  • 109
1 vote
1 answer
22 views

High Performance Classification or Similarity Algorithim for Mixed Data Types?

I have a database holding 10-ish features that describe different breeds of dogs. They are mostly categorical features, but some provide ranges for values. Here's a demo representation of the database,...
user avatar
2 votes
0 answers
7 views

Learning the Average of a 0/1 Dependent Variable

uppose I have a matrix 𝑋 and a dependent vector 𝑦 whose entries are each in {0,1} dependent on the corresponding row of 𝑋 Given this dataset, I'd like to learn a model, so that given some other ...
user avatar
  • 1,147
1 vote
1 answer
24 views

Model Performance on external validation Set really low?

I am using the LGBM model for binary classification. My train and test accuracies are 87% & 82% respectively with cross-validation of 89%. ROC-AUC score of 81%. But when evaluating model ...
user avatar
  • 27
2 votes
1 answer
124 views

class weighted classification

I am working on my multi-class classification project and I have a question: I have three classes in proportion: 50%, 47% and 3%. I decided to use ...
user avatar
  • 41
0 votes
0 answers
9 views

best way to convert labels

I need to convert label Win,Lose,Draw to continous number, thich is the best method to do it? Win=1 , Draw=2, Lose=0 ?
user avatar
0 votes
0 answers
11 views

P value calculation for stacked LSTM model for binary classification

I need to calculate the P-value for a stacked LSTM model. Does that mean that I need to run the model multiple times and consider the null hypothesis that the model's accuracy is almost the same ...
user avatar
0 votes
0 answers
9 views

Statistically increase mean difference between two data sets?

A dataset will be used to train a binary classification model. For better understanding/visualization, the data set was divided into 2: one set with all the rows that result in prediction value of 1 ...
user avatar
  • 1
0 votes
0 answers
13 views

Time series classification using multiples multivariate multi-length timeseries

0 I would like to develop a time series classification algorithm to classify use a of parachute. My data consist of multiple recording files (around 5min at 100hz, length of the recording vary) with a ...
user avatar
0 votes
0 answers
11 views

Federated Learning: some clients with 0% accuracy

Suppose that I am doing a Federated Learning experiment using MNIST. As you know MNIST has 10 classes. Now, Federated Learning is useful especially in cases like hospitals, for collaborations, because ...
user avatar
0 votes
0 answers
8 views

Custom loss for classification of geolocation in Keras

I have a model that predicts geolocation coordinates based on some data. The way I have it set up at the moment is that I clustered my points (2D coordinates) into 100 classes that my model predicts ...
user avatar
0 votes
2 answers
20 views

Classification or Regression approach?

I have a dataset with x variables and the target y (between 0 and 100%, so 0 and 1) My goal os to predict if a sample is in a group of y [0,0.25), [25,50) or [50,100]. And I am wondering if I should ...
user avatar
1 vote
1 answer
18 views

specificity for 3 class

I was reading an answer in qoura to calculate the specificity of a 3 class classifier from a confusion matrix. In the below answer https://www.quora.com/How-do-I-get-specificity-and-sensitivity-from-a-...
user avatar
0 votes
1 answer
17 views

Normalizing data from same variable but different individuals

I'm new to machine learning. I have the following scenario: I have five individuals that are each carrying an accelerometer. That sensor measures movement/acceleration on a scale from 0 to 255, 0 ...
user avatar
0 votes
0 answers
8 views

Naive Bayes TfidfVectorizer predicts everything to one class

I'm trying to run Multinomial Bayes classificator on various balanced data sets and comparing 2 different vectorizers: TfidfVectorizer and CountVectorizer. I have 3 classes: NEG, NEU and POS. I have ...
user avatar
0 votes
1 answer
41 views

Dropping highly correlated features

I am making my classification project and I have this situation after using seaborn heatmap. Column 0 is my target, where I have data with 3 classes. To my knowledge I should remove column highly ...
user avatar
  • 41
1 vote
1 answer
39 views

What's the purpose of statistical analysis ( statistically important features) vs feature elimination in machine learning

I am developing a classification model for covid19 symptoms (after being ill) and I don't understand statistical analysis importance (some parts of it) 1 Firstly: Basically we perform statystical ...
user avatar
  • 113
1 vote
0 answers
17 views

sentence type classification

I want to classify the sentences in my dataset as declarative, interrogative, imperative and ...
user avatar
0 votes
0 answers
9 views

Mixed Data Type Classification / Neighbor Algorithm

Here is a hypothetical simplified dataframe of my problem, which would be low dimensional (20ish features), containing some made-up information about certain dog breeds: Breed Min_Weight Max_Weight ...
user avatar
0 votes
0 answers
6 views

Missclassfication of Hand Generated Signals

I have two types of time series accelerometer data from two kinds of machines - one is very fast (Type A) and another one is relatively slow in terms of number of peaks/movement (Type B). I have tried ...
user avatar
  • 11
0 votes
0 answers
13 views

Model recalibration on different dataset

I have a large dataset approximately 150k rows and 1500 of positive labels on which I can train my model for binary classification. And also I have the other dataset which is smaller and is comprised ...
user avatar
0 votes
0 answers
10 views

How to get significativity for tabular data in machine learning?

Im using fastai to train a network on tabular data (https://docs.fast.ai/tutorial.tabular.html). I have a table with 5 columns, each of these is the specific attribute that describes a galaxy and ...
user avatar
2 votes
2 answers
63 views

Low classification accuracy

I want to do a multi class classification with 6 classes. Whole dataset has 12750 and 56 features samples, so every class has 2125 samples. Before prediction I reduces amount of outliers by ...
user avatar
  • 41
0 votes
0 answers
15 views

Hypothesis test for classification model

I have a model that outputs 0 or 1 for interest/not-interest in a job. I'm doing an A/B/C test comparing two models (treatment groups) and none (control group). ANOVA for hypothesis testing and t-test ...
user avatar
0 votes
0 answers
14 views

Can MARS regression be used for classification?

I am dealing with a data set in which I have to classify between a diseased and a non-diseased individual. I was wondering if it is possible to adapt the MARS regression (Multivariate adaptive ...
user avatar
  • 320
1 vote
0 answers
9 views

Model a classification problem with multiple categorical varialbes as input features only. Diff Model performance

I'm having an input data with 100k rows, 8 input features, I'm trying to predict y (binary 1/0). But all the X are categorical variables(strictly nominal variables, not ordinal). Some with 8 levels, ...
user avatar
  • 11
-1 votes
0 answers
10 views

Pattern Classification technique for small sample size problem in machine learning

Best/ Moderate pattern classification algorithm for multivariate data suffering from small sample size problem (with higher dimension and lower number of trials). E.g. - https://archive.ics.uci.edu/...
user avatar
  • 1
0 votes
0 answers
14 views

find speedup for different number of processes

I am new to data science I need to create code to find speedup compared with the number of processes while using a k-nearest neighbor. which (k=1,2,3,4,5,6,7). this process should be after downloading ...
user avatar
1 vote
0 answers
21 views

Predicting customers for a new product

Hey I am struggling to understand how would I find out from a pool of existing customers, who would purchase a new product I am about to launch. I could think of a few methods but I am not sure if ...
user avatar
0 votes
0 answers
10 views

Python image classification - number classification

I have a project where I want to use an existing ML model to classify images with numbers 1-50. My images will pretty much be white squares with a number in the middle or the corner. When I search for ...
user avatar
  • 1
2 votes
1 answer
17 views

What is custom SVM kernel?

What is custom kernel in the Support Vector Machine. How is it different from Polynomial kernel. How to implement a custom kernel. Can you provide a code to implement a custom kernel.
user avatar
2 votes
0 answers
26 views

How much ground truth is needed for a classification model?

I have unstructured problem text that needs to be classified into categories(Multinomial classification). Depending on the component, which is a structured element that allows me to segment the data, ...
user avatar
  • 21
0 votes
1 answer
37 views

How to compute the Gini index, the entropy and the classification error from a decision tree?

How to find the Gini index, the entropy, and the classification error for each node of the tree in the figure below. Please help me to compute them.
user avatar
  • 21
0 votes
0 answers
17 views

tensorflow predict gives same values for any input

I'm trying to create a classification model for images, using TensorFlow and Keras. For this classification problem, I've created a model like this: ...
user avatar
1 vote
1 answer
22 views

Labelling for churn measurement

I have 3 domains of supplier data (Jan 2017 to Jan 2022) and they are as follows a) Purchase data - Contains all the purchase (of product) data made by the suppliers with us. It contains columns such ...
user avatar
  • 2,129
0 votes
0 answers
23 views

LightGBM predict_proba in thousandths place

Can someone explain to me how my lightgbm classification model's predict_proba() is in thousandths place for the positive class: ...
user avatar
  • 101
0 votes
1 answer
23 views

How to provide Intentional Bias towards recent examples in Text Classification?

I have trained an XGBClassifier to classify text issues to a rightful assignee (simple 50-way classification). The source from where I am fetching the data also provides a datetime object which gives ...
user avatar

1
2 3 4 5
60