Questions tagged [binary-classification]
The binary-classification tag has no usage guidance.
129
questions
0
votes
0
answers
29
views
Model can not fit to 8 datapoints
I have 10 groups of biological experiments, all of size 100. I want to estimate experimental performance (success rate) of each groups of experiments, but have only ran experiments in two groups. My ...
- 103
1
vote
1
answer
25
views
How do I best approach a multiple-target binary classification in Tensorflow/Keras?
I currently have eight features which are either categorical or continuous variables. My targets are many (~1000) binary variables. So far I have attempted skmultilearn and sklearn.multioutput. I ...
0
votes
0
answers
9
views
Why is my Histogram Gradient Boosting Classifier model still producing type II error? How can I reduce the type II error?
Type 2 error and how to hypertune or feature engineer a solution for it
I trial and tested different techniques and kept the structure which made the most sense to me. But still my model confusion ...
0
votes
2
answers
27
views
Binary classification using RNN not going beyond 50% accuracy
I am trying to find out the reason behind why my RNN network won't go beyond 50% for binary classification. My input data is of the shape:
...
0
votes
0
answers
41
views
Competition test set performance much lower than validation set
We are a team of 3 participating in a university competition for a deep learning course. The competition involves a binary image classification task where we have to predict leaf diseases on a (5200, ...
0
votes
0
answers
21
views
Logistic regression with E-net regularization produces different set of weights with each run
I am currently trying to make a model to classify brain tumor patients by incidence of epilepsy using a combination of variables extracted from clinical records, and radiomics features from segmented ...
0
votes
1
answer
76
views
Training ResNet50 model for binary classification
I want to use ResNet50 model to perform binary classification on a dataset spectrogram dataset. In order to do that I had to make a couple of modifications to the model's architecture:
Modified the ...
0
votes
0
answers
22
views
Binary classification using xgboost
Why when adding new features in my ADS for a binary classification using XGBOOST my score and uplift has decreased ? What is the best way to treate categorical features or other features in order that ...
0
votes
1
answer
33
views
Different accuracy scores with sklearn roc_auc_score on same model using sklearn.metrics
Why do these below lines give different outputs while the input is the same?
I need to report these results in paper, but I am unsure which is better and why.
...
- 101
0
votes
3
answers
73
views
Reduce false positives having imbalanced data
I'm using a DNN-48 having the following scenario:
Features: 8 (48 at the end because I generate conditional sequences of 6 elements each)
Classes: Y=0 (90%), Y=1 (10%)
Precision and recall are good ...
- 3
0
votes
0
answers
23
views
Decision making in a binary classification problem
Consider a two-dimensional feature space in which the line $\mathbf{w}.\mathbf{x} + b = 0$, where $ \mathbf{w},\mathbf{x} \in \mathbb{R}^ 2 $ and $b \in \mathbb{R}$, separates linearly separable data ...
0
votes
0
answers
12
views
Predicting Year-End Outcome from Monthly (and Annual) Data
I have data on customers' usage of various product features over time. Each month, a customer can choose to use a feature or not.
I want to create a live system that produces the probability of a user ...
- 13
2
votes
1
answer
30
views
Changing model architecture doesn't impact results
I am currently learning binary classification.
The problem is classifying positive and negative movie reviews.
The dataset is 25,000 reviews with each review represented by 10,000 of the most used ...
- 23
0
votes
2
answers
35
views
Can you obtain classification thresholds for specific features in a Random Forest?
Say I've created a random forest model for binary-classification prediction target of either "Pass" or "Fail" for a group of students based upon numerical features "Hours ...
- 1
0
votes
2
answers
35
views
Is this an unusual distribution for a sigmoid output from a neural network?
Shown here is the histogram of around 130K predictions of my deep neural network that is classifying some financial data. This is on the dev set but a similar distribution is also seen on the train ...
- 103
0
votes
0
answers
60
views
Binary classification metrics for one-hot label encoding in Tensorflow
I run a binary classification using different CNN versions in Tensorflow.
When I label samples from each class using 0 and 1, I select a sigmoid output in the last layer of the CNN, like
...
- 101
0
votes
0
answers
49
views
BCE loss stuck at 0.693 in the beginnng of training and then started to decrease, why?
I'm using a Transformer encoder with a binary cross entropy loss for CTR prediction. The training batch loss is at around 0.693 constantly for the beginning several thousand steps (batches). I'm using ...
- 392
0
votes
1
answer
276
views
Torchmetrics Binary Accuracy and Multiclass Accuracy don't match
in my program I have the problem that for a 2-class classification problem my multiclass accuracy and binary class accuracy don't match.
I have generated a very small sample example where you can see ...
- 3
0
votes
1
answer
12
views
Classification Problematics : Feature Number Variance & Feature Repetition
I have a harsh case study (in my mind).
The problem is I need make binary classification on Quality of Service (good or bad). I have a feedback on quality on groups of devices belonging to company. I ...
- 1
1
vote
1
answer
123
views
precision and recall is zero
Why my model shows metrics like this? While my model was training recall and precision was equal to zero?
I trying to do binary classification of mushrooms [edible, poisonous]. I have CNN model with ...
- 11
0
votes
3
answers
142
views
How to properly do a k-fold cross validation?
I am trying to solve binary classification problem using deep neural networks. I want to compare different approaches (model architectures) and I have no hyperparameters which I want to tune. So my ...
- 13
0
votes
0
answers
11
views
Comparing probability models for alignment
I have a probability model which predicts a probability for a binary classification problem. I am interested in how well the predicted probability aligns with the true probability. For instance, you ...
0
votes
1
answer
59
views
How to reduce the false positives to improve the models performance?
I am currently building a binary classification model to predict order return rates. I used the GradientBoostingClassifier for training the model and also performed hyperparameter tuning using ...
0
votes
1
answer
48
views
Single model or multiple models for predicting at each level in a multi-level classification problem
Given a flat structured data with features that can be considered hierarchical, where each feature is at a different level (e.g., Brand at the top level, Product, Color, and Size at different levels), ...
1
vote
0
answers
18
views
How to calculate threshold values for a simple binary classification model
Consider a binary classification problem with two features. Let's assume that the higher the value of each feature the more likely a datapoint is to be positively classified.
Additionally assume we ...
- 145
0
votes
1
answer
151
views
Why does Logistic Regression perform better than machine learning models in clinical prediction studies
I am developing binary classification models to predict a medical condition in my dataset. My results show that both Logistic Regression and Linear SVM consistently outperformed other ML algorithms (...
- 417
0
votes
0
answers
180
views
Weighting and loss function for multi-dimensional output on ECG neural network in Tensorflow
I am working on a DNN that is training on ecg data with a shape of [None,1,2500] and output shape of [None,12,19] where 19 is a ...
1
vote
1
answer
34
views
How to bias a neural network towards one category in binary classification?
I have a basic sequential neural network built with TensorFlow.
...
0
votes
1
answer
95
views
Decision boundary of an neural network
Starting with a).
For the first unit: 0 * x1 + 1 * x2 + 1 > 0 (0, because the threshold is 0) which is the same as x2+1 > 0.
For the second unit: x1 * 1 + x2 * 0 + 1 > 0 (0, because the ...
- 11
0
votes
1
answer
307
views
Is deep learning high initial validation accuracy a sign of problem?
I have a image classification model with 8400 images of class A and 1800 images of class B. I have used validation_split=0.2 with subsets of ...
- 111
0
votes
0
answers
50
views
Understanding perceptron learning algorithm
I was revisiting perceptron learning algorithm. The wikipedia page gives the algorithm as follows:
Initialize the weights to 0 or a small random value.
For each example $j$ in our training set $D$, ...
- 103
0
votes
0
answers
17
views
High dimensionality one class input
I am currently doing research on anomaly detection and currently I am facing the following problem:
My input data has only one label (anomalies) and the associated data has a very high dimension and ...
0
votes
0
answers
7
views
Approaching multiple records for one observation; radiomics of 2D slices of a 3D object
Background
I am trying to create a model that can predict Type 2 diabetes in a patient based on MRI scans of their thigh muscle. Previous literature has shown that fat deposition in the muscle of ...
0
votes
0
answers
8
views
How to give a column a special weight for any algorithm? (binary option)
I'm dealing with binary option, I'm making a classification model using xgboost, my idea is to predict the posterior candle color by using some data of the 20 previous candles so I made a dataset on ...
0
votes
0
answers
107
views
Classifier calibration leading to worse outcome
I am trying to calibrate some classifiers to output more accurate probabilities. For this, I am using a sigmoid regression as implemented in ...
- 23
1
vote
1
answer
97
views
Probability distribution of probabilities
We can get the prediction probabilities of a binary classifier from sklearn's API using the predict_proba method. Is it reasonable to expect that the shape of a histogram plotted for the prediction ...
- 11
0
votes
1
answer
259
views
VC-dimension of the class of hypotheses that assign label $1$ to exactly $k$ points of some finite domain $\mathcal{X}$
Let $\mathcal{X}$ be a finite domain and $k$ a number such that $k\leq|\mathcal{X}|$. Consider the hypothesis class
$\mathcal{H}:=\big\{h:|\{\mathbf{x}\in\mathcal{X}:h(\mathbf{x})=1\}|=k\bigr\}$;
that ...
- 3
0
votes
0
answers
13
views
How to get the top feature contributors for the differnt classes in the classifiction model?
In classification model , we build models with binary/multi class responses. Is there way to get the top features contributing positively,negatively to each of the classes.( i.e top features helping ...
- 101
0
votes
0
answers
37
views
Binary Classification: My model classfies most data (95%+) as label 1
I am working with ECGs and trying to use a CNN model to perform binary classification. The goal is to classify 30s ECGs to detect a specific disease. I am using CNN and converting ECGs to images (...
- 11
0
votes
0
answers
16
views
Using features extracted from CNN and handcrafted features to perform classification
I have a question in regards to merging features extracted from CNN and handcrafted features.
I have been reading this paper https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9002895/#B33-sensors-22-02467
...
- 11
0
votes
0
answers
64
views
How to quickly create hundreds of binary variables from continuous
I have 342 continuous variables for proteins for which I would like to create a binary variable for a predetermined cut-off. E.g., if the continuous variable "HsCD00076570" has a value > ...
0
votes
1
answer
58
views
Quasi complete separation problem
I have some question related to quasi complete seperation problem on logistic regression algorithm.
So i run the model to predict credit risk and turns out it gave me good prediction score (AUC around ...
- 138
0
votes
0
answers
85
views
Why validation loss curve not decreasing of my ResNet50 model while training loss decresing? How I can improve without using transfer learning?
I am trying to understand my model by diagnosing the learning curve and how I can improve it.
I aim to implement a deep-learning architecture (ResNet50) using a small dataset for binary classification ...
0
votes
0
answers
245
views
Custom loss function for binary classificatio in Keras gets error: No gradients provided for any variable
I have a binary classification problem. However, I don't really care about fp and fn values. What I want to achieve is that the <...
- 43
3
votes
1
answer
57
views
What does precision-recall curve and ROC curve tell us abouth threshold invariance
Consider a binary classification problem.
Intuitively, a value for the area under the curve (for both curves) very close to 1, shows that the curve is almost L-shaped.
Thus, this means that the value ...
- 636
0
votes
1
answer
52
views
Input Tensor Shape for CNN Binary Classification of Time Series Data
I want to predict whether a machine will fail based on the most recent set of measurements taken by on-board sensors. I have several dozen machines, each with a sensor that takes a measurement at ...
0
votes
0
answers
15
views
ANN Input vector representing a network of contests's outcomes between thousands of individuals?
Let's say I have 1000 participants within a tournament, each of the participants having a single ID. One instance of this tournament is a 1 vs 1 contest when one wins and the other loses.
Now let's ...
- 1
0
votes
1
answer
168
views
Mixed effects models for a classification task on panel data
I have a problem where I need to make predictions for a binary target $y$ given a set of features $X$ where $X$ is naturally nested in the form of repeated measurements. The data is meant to describe ...
- 101
1
vote
3
answers
116
views
ROC Curve for model validation
Is there a general approach that the ROC curve can be used for to validate a model? My understanding is that we can use it to compare different threshold values to determine the best, or even see how ...
- 11
1
vote
2
answers
56
views
Classification of data points using vertical lines through visualisations
I am currently doing my master's thesis and at the end of finishing it, but there are some questions raised by my supervisor. I have answered most of the questions, but only one question is remaining ...
- 11