The 2024 Developer Survey results are live! See the results

Questions tagged [logistic-regression]

Refers generally to statistical procedures that utilize the logistic function, most commonly various forms of logistic regression

186 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4k views

Loss Function for Probability Regression

I am trying to predict a probability with a neural network, but having trouble figuring out which loss function is best. Cross entropy was my first thought, but other resources always talk about it in ...
• 201
551 views

Two steps optimization of a credit card limit

I have a problem similar to what is on the title but not the same. The problem on the title allows me to explain the dynamics of my need. I have to determine what the optimal value is for a variable ...
967 views

How to retrieve results summary from statsmodels GLM with regularization?

I'm trying to fit a GLM to predict continuous variables between 0 and 1 with statsmodels. Because I have more features than data, I need to regularize. ...
171 views

Issues with self-implemented logistic regression

I am trying to self-implement a logistic regression algorithm to do some self-learning but I am having a bit of trouble with achieving similar accuracy to the logistic regression of sklearn. Here is ...
353 views

ML: Classification Model Comparison

Given is a dataset that I need to use for a classification and I want to compare the performance of different classification models. Let's assume, I want to look at logistic regression (with ...
53 views

Why is cross-entropy increasing with accuracy?

I'm making an implementation of the softmax regression and I'm struggling to understand the nature behind the problem of increasing value of Cross-Entropy: $H(y_i, p_i)=-\sum_{i=1}^C y_i log(p_i)$, ...
• 121
30 views

In logistic regression, why not just use the boundary instead of using probabilities to classify?

We know that logistic regression assign probabilities that an object belongs to a binary category, say {0,1}. We also know that if the object is "above" or "below" the boundary, it ...
• 31
133 views

Logistic Regression for prediction

I would like to ask about the theoretical approach of using Logistic Regression for customer data and more specifically Churn Prediction (in BigQuery and Python). I have my customer data for an online ...
• 121
73 views

Effect of log odds on skewed data

Does taking the log of odds bring linearity between the odds of the dependent variable & the independent variables by removing skewness in the data? Is this one reason why we use log of odds in ...
• 317
66 views

How to make logistic regression give some observations more importance/weight?

I have a binary classification problem, with a dataset comprising of several features. When I train LogisticRegression on it, I get large number of false positives ...
• 21
36 views

What is the best Classification Method alternative to Nominal Logistic Regression, if your Response and all Predictor variables are Categorical?

Hy, I need help in choosing the best classification method. My response variable is nominal with "4" categories and five predictor variables, two of them are nominal and three are binary. ...
2k views

Binary classification with imbalanced dataset, about lightgbm output probability distribution

I trained a binary classifier for an imbalanced dataset. I did two experiments: lightgbm classifier, boosting_type='gbdt', objective='cross_entropy', SMOTE upsample After training the lgbm model, I ...
24 views

Determine most important features in diagnostic data

I have a dataset of device diagnostics. I have two tables: one relating each device to failures code. Two devices can share a failure code for example a common chip malfunction. The second table links ...
• 21
30 views

Best Method for Using Experts to Score Qualitative Data

TL;DR: Looking for recommendations or resources on the best method to have subject matter experts score qualitative data to train ML model. Problem: I am working on a problem in the biochemistry ...
• 21
2k views

How to interpret my logistic regression result?

I'm having a hard time to interpret my result of the logistic regression. I have a few question. Firstly, how can I check if a feature is more important to the others, like that there is a real ...
• 157
18 views

Connection between prob output LogisticReg/SVM and ROC

I have the following ROC generated using LPOCV and Logistic regression or SVM (l2 norm). Now, let's say I have a test set containing 10 patients and I get that the probabilities of those patients to ...
4k views

Some of the p-values are NaN - logistic regression

I am trying to do logisitc regression, but have this issue - some of the p values are NaN ...
• 41
242 views

Probability of the recipient to open the email

I am trying to build a model using logistic regression, where my dependent variable is y=1 if the mail was opened, y=0 if it was not. I have data approximately 10 records (10 rows) for every ...
• 41
32 views

Interpretable models apart from Logistic Regression

I am wondering about other interpretable models apart from logistic regression. I am looking for models that can interpret the effect on the target variable by unit change in any feature variable. I ...
• 564
335 views

Logistic Regression Model for categorical features with multiple values in each category

I am working on an insurance use case to build a logistic regression classifier to predict if a policy will lapse or not. The dataset has more than 20 categorical features for a policy. Each ...
• 173
126 views

Is there a representation of the separating hyperplane in t-sne?

I have used t-sne to visualize a set of images which I have used for training a binary classifier. Let us assume that the binary classifier is trained to detect cat(1) vs. no-cat(0). I have used the ...
135 views

Logistic Regression with Tensorflow

Is this the correct Estimator for Logistic Regression in TF 1.10? There used to be a function called: LogisticRegressor which is deprecated In README.md file it ...
• 749
32 views

When should the bias b be updated with weights w and when should it be updated seperately?

It seems in some Machine Learning models, the bias term $b$ is updated just like other weights $w_i, i=1...n$. For example, in Logistic Regression, using SGD, $b \ \text{or} \ w_0$ is updated with: ...
94 views

What Is The Difference Between Additive Natural Cubic Splines and Tensor Product Natural Cubic Splines?

Good day. Taking into account the picture shown, using tensor product is computationally expensive considering the fact that it has higher dimensions. I am just thinking why it is compared both ...
66 views

Is it possible to run logistic regression on data with a few longitudinal parameters?

Currently, I am building a credit rating model based on logistic regression and faced a problem with inserting panel variables in it. Is it possible to do so in logistic regression and if it is, what ...
102 views

What are some machine learning problems that can be attacked with continuous multiobjective optimization?

I am working on continuous vector optimization, and hence continuous multiobjective optimization is a particular case. I am interested in finding applications in machine learning for this problems. Is ...
• 123
353 views

Learning ranking

This is a sort of a follow-up to this newbie question:Suppose I want learn ranking (so, I have a bunch of data points, ranked $1, 2, 3, ...$ Now, one way is to use something like logistic regression ...
• 147
104 views

Type of Test to Determine Correlation in R

I have a dataset of approximately 48,000 rows each one a click of a an article, some of these clicks were also comments. For each article I have the country and subject of the article and name of ...
587 views

Sales Dataset to determine best model for predicting future sales

We have a set of products in which we are trying to determine which products we should continue to sell, and which products to remove from our inventory. The file contains BOTH historical sales data ...
• 29
39 views

Outputting risk groups for a logistic regression model

I have a problem with outputting the terms for a logistic regression model in R. For a given list of independent values, say list l of terms {w,y,z} to determine dependent variable {x}, I want to ...
128 views

Random Forest Class Weighting for Logistic Probabilities

I have a model at work that I am building and am running into some odd outputs from the random forest as it pertains to the probability of response. In my case, the class distributions are very ...
598 views

SAS Nested Likelihood Ratio Test for a Logistic Model

Using SAS Studio (online, student version)... Need to do a "nested likelihood ratio test" for a logistic regression. Entirety of instructions are: "Perform a nested likelihood ratio test comparing ...
• 21
498 views

How to Interpret Multinomial Specification in R's mnlogit package

The mnlogit package in R allows for the fast estimation of multinomial logit models. The specification of forumlas is a bit different from most other regression ...
• 1,919
90 views

I would like to pose a question about how to treat additional holders in the propensity-to-buy models of banking products. Up to now I was only taking into considerations the clients as first holders....
• 81
1 vote
40 views

Analysis of relationship between accuracy and total loss (or cost) during training with logistic loss function and threshold 0.5

I'm trying to understanding the relationship between training accuracy and training loss in classification tasks, specifically using logistic regression. When using logistic loss as the loss function ...
• 155
1 vote
36 views

Why is my predictor value (continuous) perfectly correlated with my logit value (when testing logistic regression model assumptions)?

Question: Why is my predictor value (continuous) perfectly correlated with my logit value (when testing logistic regression model assumptions)? Code: ...
1 vote
147 views

What is ROC curve based on for SVM?

I was studying about the ROC curves for Logistic regression. There is a threshold in this method that determines the classification. By changing this threshold we get different confusion matrices and ...
• 111
1 vote
169 views

scikit learn logistic regression to annotate single cell RNA seq data

I want to use scikit learn logistic regression to train a model on a labelled single cell RNA sample and subsequently apply this model on new unlabelled single cell RNA seq samples to annotate the ...
1 vote
602 views

logistic regression,machine learning

I just started learning ML, so I tried to implement logistic regression on my own in 2 ways (the first code and the second code), but they aren't working, I cross-checked by using sklearn (third code ...
1 vote
33 views

Given a multi class logisitic classifier $f(x)=argmax(softmax(Ax + \beta))$, and a specific class of interest $y$, is it possible to construct a binary logistic classifier $g(x)=(\sigma(\alpha^T x + b)... 1 vote 0 answers 299 views Different results in same logistic regression model from sklearn and same dataset I got this strange behavior when deploying my logistic regression trained in scikit-learn into production. I trained the model on my own machine and stored it in form of ... • 411 1 vote 0 answers 289 views Is it possible to "fine-tune" a pre-trained logistic regression model? Fine tuning is a concept commonly used in deep learning. We may have a pre-trained model and then fine-tune it to our specific task. Does that apply to simple models, such as logistic regression? For ... • 111 1 vote 1 answer 560 views Log odds vs Log probability Log-odds has a linear relationship with the independent variables, which is why log-odds equals a linear equation. What about log of probability? How is it related to the independent variables? Is ... • 317 1 vote 0 answers 97 views Additive model of Logit Log converts values from multiplicative scale to additive scale. What is the advantage of an additive model in logistic regression over a multiplicative model for which we use log? • 317 1 vote 0 answers 36 views Logistic Regression-Log odds calculation example Can someone provide me an example/link of how log odds is calculated in logistic regression (with multiple independent variables)? All the examples I've come across explain log odds calculation with a ... • 317 1 vote 0 answers 43 views Meaning of 'Closed Form' Here's an excerpt from a paper explaining Logistic Regression. What does 'Closed Form' mean in this context? Please explain in simple terms. The definitions online are confusing. Gradient of Log ... • 317 1 vote 1 answer 980 views Difficulties in create a confusion matrix in R for Yes or No I am new to regression and confusion matrix and trying to create a confusion matrix from logistic binary regression model. I am trying to create a confusion matrix from Yes or No values from the ... 1 vote 0 answers 28 views Complete separation of logistic regression I came over problem that might occur in logistic regression. In case dataset is too small to observe events with low probabilities. For example, in the following table we have response set to 0 if$X\...
• 231
1 vote
I am new to ML and data science and am struggling with a simple problem. In my problem, I am given a series of datapoints $X_i$ where $X_i = (x_{i1}, x_{i2})$ with each data point having a label $y_i$ ...