Questions tagged [logistic-regression]
Refers generally to statistical procedures that utilize the logistic function, most commonly various forms of logistic regression
326
questions
0
votes
2answers
50 views
Regression Algorithms in Production
I am interested in predicting if a doctor would prescribe a specific drug and have chosen Logistic Regression as a starting point.
I have a few questions:
Is feature selection the first step to take ...
0
votes
0answers
17 views
How to use logistic regression with decay
I have a dataset with binary outcomes. I use Logistic regression for making the prediction.
example of my data :
...
0
votes
2answers
11 views
Is there any way to use (update) a pre-trained logistic regression model for data with new set of columns?
I am building an insurance recommendation engine. I have used some variables, like demographics, and built the model. Now I have claims data.
Is there a way to include the new data without restarting ...
-3
votes
0answers
17 views
Problem statement suggestions for “Analysis of Flipkart Data”, an online shopping site problem
We are performing the analysis of data of an online shopping site.
Please refer to the dataset mentioned in this link
The fields of the dataset are:
We have been asked to do the following:
Perform ...
1
vote
0answers
7 views
Measuring the similarity between a numeric data matrix and one or more categorical variables?
Given a numeric data matrix $A$ of size $n \times p$, which each row represents an observation along $p$ variables, and a second categorical data matrix $M$ of size $n \times z$, where each row ...
0
votes
1answer
23 views
0
votes
1answer
18 views
AUC ROC Threshold Setting in heavy imbalance
I am doing binary logistic regression on a dataset with very heavy class imbalance. Class 1 is only 1% of data. When I train logistic regressor without class weights I get ROC AUC Score of 0.6269. ...
1
vote
0answers
25 views
Huge cost not converging well with TensorFlow logistic regression
I try to use Logistic Regression for a dataset which contains 15 numeric features and 4238 rows of examples. The calculated cost started at 415.91, and converged when the cost was reduced to 220.119 ...
0
votes
0answers
9 views
Strategy for unrecorded predictors
I'm trying to create a logistic regression model for predicting future admissions based on historic clinical/utilization/demographic information. Although I have three years history available, for ...
1
vote
0answers
28 views
Logistic Regression performing better than SVM with a Gaussian kernel performing better than a linear SVM
I am very new to machine learning.
I am working with a data set, and my algorithm for logistic regression (with lasso regularization) is performing fairly well (~0.8 AUC), my SVM with a Gaussian ...
0
votes
0answers
15 views
Looping over multiple dataframes
I have 3 sets of data that I would like to run a logisitcs regression on and then add the results to the corresponding dataframes. i.e. X1 & y1 predicted results added to df1 on so on.
I've tried ...
1
vote
2answers
38 views
When to use Random Forest
I understand Random Forest models can be used both for classification and regression situations.
Is there a more specific criteria to determine where a random forest model would perform better than ...
0
votes
0answers
24 views
How to Compute Logistic Regression Cost Function?
I'm using MATLAB to calculate the Logistic Regression Cost Function, and I don't get the expected output when I test my code. My steps all seem to be logically correct. Can anyone please help me fix ...
0
votes
0answers
9 views
How to check performance of a model on a test set?
I have transformed my training set (predictor variables) using step_YeoJohnson for satisfying the assumptions of model. But now how do I run my model on test set which is not transformed and has ...
1
vote
1answer
49 views
Automating Logistic Regression
I have $3$ datasets I'd like to run a logistic regression on split into
$X_1, y_1$
$X_2, y_2$
$X_3, y_3$
How can I run a loop so that I can run an automated ...
1
vote
0answers
28 views
Manually changing coefficients of a model
Is there a way to manually change parameters of a model in Orange 3?
I have a dataset and trained a logistic regression model on it. Now, I can alter the coefficients (beta values) of the logistic ...
0
votes
0answers
17 views
Build model to get daily probability of meeting a certain end of period goal
I was hoping for some consultation and direction with how to go about the following:
To give context, I work for an agency that manages advertisements on social media for general motors - ...
2
votes
3answers
63 views
Logistic Regression doesn't predict for the entire test set
I am working through Kaggle's Titanic competition. I am mostly done with my model but the problem is that the logistic regression model does not predict for all of 418 rows in the test set but ...
0
votes
1answer
15 views
In the context of image binary classification, is it necessary to divide dataset into true positive, false positive, true negative, false negative?
I am working through this course. It seems that the professor is not dividing the dataset into true positive, false positive, true negative, and false negative.
In the context of image binary ...
2
votes
2answers
60 views
What is the purpose of Logit function? At what stage of model building process this logit function is used?
We have two prominent functions (or we can say equations) in logistic regression algorithm: 1. Logistic regression function. 2. Logit function.
I would like to know: a. Which of these equation(s) is/...
0
votes
1answer
41 views
Why does the logistic regression cost function need to be the negative of log?
I am going through this course. The professor is talking about the logistic regression cost function:
$$
P(y|x) = \hat y^y (1- \hat y)^{(1-y)}
$$
Taking log on both sides provides:
$$
\begin{align}
...
1
vote
1answer
17 views
Data Structure For Multilevel Analysis
I am little confused about how to structure my specific data for multilevel analysis.
I have 10 categories and each category has some items in them.
The dataset is available for 117 weeks. There is ...
1
vote
1answer
17 views
If categorical variable has some hierarchy, should I just label them or split into dummy variables (One-Hot encode)?
I have a column which has 5 unique categories. There's a hierarchy between these categories (Best > good > OK/Not Sure > Bad > Worst)
In this case, should I label them based on hierarchy like:
...
1
vote
0answers
19 views
Is there a representation of the separating hyperplane in t-sne?
I have used t-sne to visualize a set of images which I have used for training a binary classifier. Let us assume that the binary classifier is trained to detect cat(1) vs. no-cat(0). I have used the ...
1
vote
1answer
37 views
Automatically Remove highly correlated features using Variance Inflation Factor?
I want to be able to automatically remove highly correlated features. I am performing a classification problem using a set of 20-30 features and some may be correlated.
Multiple features can be ...
0
votes
0answers
9 views
Logistic Regression Perfect segregation issue
Is it possible that a combination of independent variables are showing a perfect segregation in a binary logistic regression. As I am getting the warning: glm.fit: fitted probabilities numerically 0 ...
0
votes
0answers
25 views
Using logistic Regression with multi_class='multinomial' for binary classification
I have built a binary classifier and I have tested the results with multi_class='multinomial' and multi_class='ovr'. The results are relatively better using multinomial option. I understand that ...
1
vote
0answers
15 views
Penalization term for unfairness
I am reading [1], where the researchers do a logistic regression, but add to the loss function the following penalization term for fairness
$ R^{AVD}_{FP}(\theta; S) = \left\lvert \dfrac{\sum\limits_{...
2
votes
2answers
89 views
Interpretation of ROC AUC score
i tried to evaluate 6 models and after plotting , this what i get :
So i'm wondering , if those results are "Right" ?
Thank's in advance.
0
votes
0answers
13 views
What's the correct way of implementation of cost function and gradient function in logistical regression after regularisation?
This is the cost function of logistic regression:
which i could implement correctly, with the code :
...
0
votes
0answers
6 views
What is the method to track Lift values over time when using logistic regression?
I have a series of monthly surveys asking for services perception and I can use logistic regression to build a model every month to predict the probabilities and the associated lift. My question is: ...
1
vote
1answer
32 views
Logistic Regression - ROC curve plots Sensitivity vs Specificity instead of (1-Specificity)
I am new to Machine Learning and have been doing some practice on Logistic Regression. To evaluate the models, I've been trying to create some ROC plots.
The package that i used is pROC.
The model ...
0
votes
1answer
32 views
Can one use non converged results from Logistic Regression?
I'm running Logistic Regression on a dataset for a classification problem.
I used the model on the dataset when it was normalized and I had no problem with it converging.
Now, I wanted to see the ...
2
votes
1answer
43 views
Logistic Regression - Coefficients have p-value more than alpha(0.05)
I am very new to the machine learning field and have been practicing logistic regression on few sample data sets.
I have built a Model using the logistic regression algorithm. Few of the coefficients ...
0
votes
0answers
21 views
Logistic regression implementation not working
Recently, I have been reading about machine learning of which logistic regression is one. After reading, to test my understanding, I tried to implement LR in Java. When I tried it on Logical OR and ...
0
votes
2answers
50 views
Why does a machine learning model of English can not be directly applied on right to left languages, like Arabic Hindi, and Urdu
I have a Logistic Regression model that works fine when used with an English Dataset. But, when I pass a same format data set in a different language, (Language is URDU which is right to left and UTF-...
0
votes
0answers
18 views
Why does Logistic Regression perform better than Autoencoders when classifying imbalanced data?
The 'shuttle' data can be downloaded from the link here.
It is imbalanced data and there are two classes in the target variable. The proportion of the two classes are seven percent. I used Logistic ...
0
votes
0answers
9 views
How to interpret odds ratio test in logistic regression?
I'm a new learner of DS, and I encounter some problems with logisitc regression.
Here is my result of regression, it sets a binary event as response variable and race as only factor. But I don't ...
0
votes
0answers
14 views
Neural Networks R package that can learn from logistic regression
I have implemented logistic regression and I know that there are some packages in R that can be helpful in build a neural network taking info (or maybe basing the tuning of the parameters) on the ...
0
votes
1answer
24 views
Using a feature in prediction even if it gets zero as p-value?
I created two binary classification based logistic regression models and I got these results:
Model 1:
Accuracy: 67.51%
AUC: 65.21%
Model 2:
Accuracy: 67,99%
AUC: 65,70%
The second ...
0
votes
0answers
13 views
how to classify whole sets data instead of single points
I have many datasets containing these features (characterization transistor):
['VG', 'VD', 'VS', 'ID', 'IS', 'IG', 'absID', 'sqrtID', 'gm2', 'absIG']
I want to divide Good working transistors from ...
1
vote
2answers
61 views
6
votes
2answers
540 views
How to plot logistic regression decision boundary?
I am running logistic regression on a small dataset which looks like this:
After implementing gradient descent and the cost function, I am getting a 100% accuracy in the prediction stage, However I ...
1
vote
3answers
25 views
Use text classifier on unseen data
I've trained a few models to classify between two categories of text. Logistic regression was the best. Now how can i test it on unseen data?
I tried this:
...
0
votes
0answers
20 views
How to adapt logistic regression model to another population with different profiles?
We created the logistic regression which predicts the probability of churn of our customers. GINI of the model is 60% (based on testing data set). Population Stability Index in all dimensions is less ...
1
vote
2answers
141 views
which metric is better for boosting methods
I work on a dataset of 300 000 samples and I try to make a comparison between logistic regression (with gradients descent) and a LightBoost for binary classification in order to choose the better one.
...
0
votes
1answer
21 views
How to interpreting the exponential coefficent in poisson regression with offset?
I am trying to find the village level risk factors for malaria. Therefore, I ran a poisson model in r with the prevalence of malaria(y) as dependent variable, altitude(x1) and Forestation(x2) as ...
0
votes
0answers
13 views
Convert binary outcome to multiple categorical outcome
I have a dataset containing binary labels Y with values "correct" or "wrong".
I want to study the reason of wrong state, based on several conditions made from multiple features.
For example I want ...
1
vote
1answer
48 views
What happens to a machine learning technique (specifically Decision Tress and Logistic Regression) if the validation dataset has a new category?
Let's suppose I have a dataset which has a categorical variable and the problem I am solving is a classification one.
This categorical variable var has ['A','B','C'] as the possible set of data.
...
1
vote
1answer
16 views
Machine Learning Dataset: Easy enough for fully connected, but not easy enough for logistic regression
I was wondering if someone could direct me to a dataset for a classification task with the following conditions:
Multinomial logistic regression alone does not learn a good classifier
A series of ...
