Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [logistic-regression]

Refers generally to statistical procedures that utilize the logistic function, most commonly various forms of logistic regression

1
vote
1answer
13 views

Automatically Remove highly correlated features using Variance Inflation Factor?

I want to be able to automatically remove highly correlated features. I am performing a classification problem using a set of 20-30 features and some may be correlated. Multiple features can be ...
0
votes
0answers
7 views

Logistic Regression Perfect segregation issue

Is it possible that a combination of independent variables are showing a perfect segregation in a binary logistic regression. As I am getting the warning: glm.fit: fitted probabilities numerically 0 ...
0
votes
0answers
16 views

Using logistic Regression with multi_class='multinomial' for binary classification

I have built a binary classifier and I have tested the results with multi_class='multinomial' and multi_class='ovr'. The results are relatively better using multinomial option. I understand that ...
1
vote
0answers
14 views

Penalization term for unfairness

I am reading [1], where the researchers do a logistic regression, but add to the loss function the following penalization term for fairness $ R^{AVD}_{FP}(\theta; S) = \left\lvert \dfrac{\sum\limits_{...
2
votes
2answers
78 views

Interpretation of ROC AUC score

i tried to evaluate 6 models and after plotting , this what i get : So i'm wondering , if those results are "Right" ? Thank's in advance.
0
votes
0answers
7 views

What's the correct way of implementation of cost function and gradient function in logistical regression after regularisation?

This is the cost function of logistic regression: which i could implement correctly, with the code : ...
0
votes
0answers
6 views

What is the method to track Lift values over time when using logistic regression?

I have a series of monthly surveys asking for services perception and I can use logistic regression to build a model every month to predict the probabilities and the associated lift. My question is: ...
1
vote
1answer
30 views

Logistic Regression - ROC curve plots Sensitivity vs Specificity instead of (1-Specificity)

I am new to Machine Learning and have been doing some practice on Logistic Regression. To evaluate the models, I've been trying to create some ROC plots. The package that i used is pROC. The model ...
0
votes
1answer
29 views

Can one use non converged results from Logistic Regression?

I'm running Logistic Regression on a dataset for a classification problem. I used the model on the dataset when it was normalized and I had no problem with it converging. Now, I wanted to see the ...
2
votes
1answer
33 views

Logistic Regression - Coefficients have p-value more than alpha(0.05)

I am very new to the machine learning field and have been practicing logistic regression on few sample data sets. I have built a Model using the logistic regression algorithm. Few of the coefficients ...
0
votes
0answers
20 views

Logistic regression implementation not working

Recently, I have been reading about machine learning of which logistic regression is one. After reading, to test my understanding, I tried to implement LR in Java. When I tried it on Logical OR and ...
0
votes
1answer
26 views

Why does a machine learning model of English can not be directly applied on right to left languages, like Arabic Hindi, and Urdu

I have a Logistic Regression model that works fine when used with an English Dataset. But, when I pass a same format data set in a different language, (Language is URDU which is right to left and UTF-...
0
votes
0answers
14 views

Why does Logistic Regression perform better than Autoencoders when classifying imbalanced data?

The 'shuttle' data can be downloaded from the link here. It is imbalanced data and there are two classes in the target variable. The proportion of the two classes are seven percent. I used Logistic ...
0
votes
0answers
8 views

How to interpret odds ratio test in logistic regression?

I'm a new learner of DS, and I encounter some problems with logisitc regression. Here is my result of regression, it sets a binary event as response variable and race as only factor. But I don't ...
0
votes
0answers
13 views

Neural Networks R package that can learn from logistic regression

I have implemented logistic regression and I know that there are some packages in R that can be helpful in build a neural network taking info (or maybe basing the tuning of the parameters) on the ...
0
votes
1answer
22 views

Using a feature in prediction even if it gets zero as p-value?

I created two binary classification based logistic regression models and I got these results: Model 1: Accuracy: 67.51% AUC: 65.21% Model 2: Accuracy: 67,99% AUC: 65,70% The second ...
0
votes
0answers
10 views

how to classify whole sets data instead of single points

I have many datasets containing these features (characterization transistor): ['VG', 'VD', 'VS', 'ID', 'IS', 'IG', 'absID', 'sqrtID', 'gm2', 'absIG'] I want to divide Good working transistors from ...
1
vote
2answers
48 views

Accuracy of the model

I'm using this dataset and i'm trying to do logistic regression ...
6
votes
2answers
300 views

How to plot logistic regression decision boundary?

I am running logistic regression on a small dataset which looks like this: After implementing gradient descent and the cost function, I am getting a 100% accuracy in the prediction stage, However I ...
1
vote
3answers
25 views

Use text classifier on unseen data

I've trained a few models to classify between two categories of text. Logistic regression was the best. Now how can i test it on unseen data? I tried this: ...
0
votes
0answers
19 views

How to adapt logistic regression model to another population with different profiles?

We created the logistic regression which predicts the probability of churn of our customers. GINI of the model is 60% (based on testing data set). Population Stability Index in all dimensions is less ...
1
vote
2answers
136 views

which metric is better for boosting methods

I work on a dataset of 300 000 samples and I try to make a comparison between logistic regression (with gradients descent) and a LightBoost for binary classification in order to choose the better one. ...
0
votes
1answer
19 views

How to interpreting the exponential coefficent in poisson regression with offset?

I am trying to find the village level risk factors for malaria. Therefore, I ran a poisson model in r with the prevalence of malaria(y) as dependent variable, altitude(x1) and Forestation(x2) as ...
0
votes
0answers
10 views

Convert binary outcome to multiple categorical outcome

I have a dataset containing binary labels Y with values "correct" or "wrong". I want to study the reason of wrong state, based on several conditions made from multiple features. For example I want ...
1
vote
1answer
47 views

What happens to a machine learning technique (specifically Decision Tress and Logistic Regression) if the validation dataset has a new category?

Let's suppose I have a dataset which has a categorical variable and the problem I am solving is a classification one. This categorical variable var has ['A','B','C'] as the possible set of data. ...
1
vote
1answer
16 views

Machine Learning Dataset: Easy enough for fully connected, but not easy enough for logistic regression

I was wondering if someone could direct me to a dataset for a classification task with the following conditions: Multinomial logistic regression alone does not learn a good classifier A series of ...
0
votes
1answer
27 views

Distribution of error values in linear regression vs logistic regression

Why do error values in linear regression have to be normally distributed and why not in logistic regression?
1
vote
3answers
58 views

Why did Logistic regression perform better than svm? [closed]

I have a data set of movies and their subtitles.My task is to classify them based on their ratings-[R,NR,PG,PG-13,G]. I have tried different ML algorithms and found that Logistic regression out ...
0
votes
1answer
22 views
2
votes
2answers
58 views

logistic regression : highly sensitive model

I am a newbie to data science and ML. I am working on a classification problem where the task is to predict loan status (granted/not granted). I am running a logistic regression model on the data. ...
2
votes
1answer
47 views

Normal distribution instead of Logistic distribution for classification

Logistic regression, based on the logistic function $\sigma(x) = \frac{1}{1 + \exp(-x)}$, can be seen as a hypothesis testing problem. Where the reference distribution is the standard Logistic ...
2
votes
1answer
164 views

Data prepration for logistic regression : Value either “not available” or a “year”

I have some data of houses that have been renovated. In my data there is one column (among others) that captures this information. It is either "-1" if there has not been yet any renovation, or the ...
2
votes
3answers
49 views

Are support vector machines and logistic regression equivalent if data is linearly separable?

I understand that SVMs separate data drawing an hyperplane with the biggest margin, but doesn't logistic regression do the same thing if data is linearly separable?
1
vote
1answer
22 views

Logitic Regression cost function - what if ln(0)?

I am building logistic regression from scrap. The simplified cost function I am using is (from machine learning course on coursera): in specific case during learning, one observation in training ...
0
votes
1answer
17 views

Train, test and submission files - what am I supposed to do with all of them?

this might be very beginner's question. I'm working on Kaggle's HomeCredit Default Risk problem which has among others dataset train, test and submission files as can be seen in the link provided. The ...
1
vote
1answer
45 views

Do I need to encode the target variable for sklearn logistic regression

I'm trying to get familiar with the sklearn library, and now I'm trying to implement logistic regression for a dataframe containing numerical and categorical values to predict a binary target variable....
0
votes
1answer
29 views

Deriving new continuous variable out of logistic regression coefficients

I have a set of independent variables X and set of values of dependent variable Y. The task at hand is binary classification, i.e. predict whether debtor will default on his debt (1) or not (0). After ...
0
votes
0answers
10 views

Logit Model Gradient Descent for Back Propagation

How can I implement Back Propagation with Logit Model getting an accuracy of 90% need to propagate backward for future predictions. This is my Python Code:: ...
1
vote
1answer
74 views

Metrics for Evaluating Performance of Logistic Regression

I built a Logistic Regression model and I would like to evaluate the performance of the model. I would like to understand its evaluation metrics. What do the metrics Sensitivity, Specificity, False ...
0
votes
1answer
22 views

Use output of K-Mean for Logistics regression

I've created a binary classifier using K Mean, which predicts fraud and legitimate accounts, 0 and 1. This uses two features, let's say, A and B. Now, I want to use other features like C and D, to ...
1
vote
3answers
50 views

Classifier for large number of labels

I have a merchants dataset with 800,000 samples and 18,000 labels. Each sample is associated with a single label and the labels are independent. An example sample looks like ...
0
votes
1answer
108 views

How to convert binary classifier to multiclass classifier?

I am a biggener student in Machine learning, and I want to ask if is it possible to convert a binary classifier label (y) by applying some condition on column1 to get a third situation. I.e. ...
1
vote
3answers
98 views

How do two perceptrons produce different linear decision boundaries?

I'm trying to visualize how two perceptrons converge to two different decision boundaries (which is ultimately used to create the classifier for the non-linearly separable data). Source: https://tdb-...
2
votes
1answer
34 views

Why is my training accuracy decreasing higher degrees of polynomial features?

I am new to Machine Learning and started solving the Titanic Survivor problem on Kaggle. While solving the problem using Logistic Regression I used various models having polynomial features with ...
0
votes
0answers
20 views

logistic like curve fitting using machine learning

I have a set of points of a function k(x). I am trying to do some curve fitting to find the exact k(x) function. It seems that the data points fit to a logistic like curve only a little shifted and ...
2
votes
1answer
13 views

Predicting Intent to do X with a confidence score or intent percentage score?

I have a data set like: did_purchase action_1_30d action_2_20d action_2_10d .... False 10 20 100 True ....etc ...
1
vote
1answer
34 views

How to turn linear regression into logistical regression

I followed these articles to implement logistic regression. I'm confused however because after training the model and getting the weights for my variables I don't now how to use the one-hot vector ...
2
votes
1answer
101 views

Loss Function for Probability Regression

I'm trying to predict a probability with a neural network, but having trouble figuring out which loss function is best. Cross entropy was my first thought, but other resources always talk about it in ...
0
votes
0answers
46 views

Why am I getting such a low precision after performing oversampling and undersampling?

I am performing fraud analysis on credit card fraud committed dataset. I am performing oversampling by .sample(oversampled_class_size) and undersampling by .sample(undersampled_class_size). I am ...
2
votes
1answer
38 views

How to start building a statistical regression analysis model with multiple categorical/discrete input variables of high dimension in Python

I'm fairly new to data science and ML. I have data of an item going through a release process. I have collected data on various variables such as "product category", "product line", "design country", "...