Questions tagged [logistic-regression]

Refers generally to statistical procedures that utilize the logistic function, most commonly various forms of logistic regression

Filter by
Sorted by
Tagged with
3
votes
1answer
270 views

Determining whether a Machine Learning model is overfitted with regard to the stability of the features

I need to know how would I get to know if I have overfitted my Machine Learning model on the train data. The performance metric I have used is Logistic Loss. Does the stability of the features affect ...
0
votes
0answers
7 views

What is the explanation of discretized log logistic in the following code? Is there any reference regarding this piece of code?

I have taken the following piece of code from the OpenAI code of GitHub from the following link: https://github.com/openai/iaf/blob/master/tf_utils/distributions.py#L28 def discretized_logistic(mean, ...
1
vote
0answers
90 views

What's the order in applying SMOTE transformation in a pipeline?

Here's the thing, I have an imbalanced data and I was thinking about using SMOTE transformation. However, when doing that using a sklearn pipeline, I get an error because of missing values. This is my ...
1
vote
1answer
57 views

Modifying binary classification to Multi-Class Classification (Logistic Regression) [closed]

I am using this code that I found here for logistic regression for binary classification with 2 classes. Git Repo The data that I am testing with is calling for multi-class classification (6 classes). ...
2
votes
1answer
39 views

Issues with self-implemented logistic regression

I am trying to self-implement a logistic regression algorithm to do some self-learning but I am having a bit of trouble with achieving similar accuracy to the logistic regression of sklearn. Here is ...
0
votes
0answers
243 views

SVM is taking too long for hyperparameter tuning

I am running SVM,Logistic Rregression and Random Forest on the credit card dataset. My training dataset has the shape (454491, 30). I performed 5-fold cross validation(which took more than an hour) ...
1
vote
1answer
34 views

Area under the ROC curve approximation

I wanted to compute the Area under the ROC curve for a logistic regression model in the context of binary classification. For that I computed, for a list of thresholds, say 0.1 0.2 ... 0.9, the TPR ...
1
vote
0answers
57 views

How to Fit S shape (Sigmoid Function) in my scatterplot [closed]

How to interpret my chart? I want to get the maximum likelihood in logistic regression with this result (I'm really not sure if this is how it looks like): I am currently using logistic regression to ...
2
votes
3answers
295 views

Train/Test size and bias

I'm running a classifier (logistic regression). The information on my dataset are the following: dataset size= 279 observations (80/20 rule) ...
4
votes
1answer
91 views

How to include categorical fields to enhance a text classification

I would have a question on how to add more categorical fields in a classification problem. My dataset had initially 4 fields: ...
0
votes
0answers
19 views

How to model a non linear distribution using logistic regression

To put us on the same page the goal for a logistic regression is to determine a vector of real numbers which will serve as coefficients producing a linear combination of the feature vector values (...
1
vote
1answer
58 views

Encoding for classifiers

I have some doubts regarding encoding (i am not familiar with tasks like these) categorical variables in order to use them as parameters in a model like logistic regression or SVM. My dataset looks ...
1
vote
1answer
64 views

Logistic Regression from scratch in numpy - Is data normalization needed?

I was trying to implement Logistic Regression from scratch in python to learn better how it works under the hood. In particular I am following this video tutorial from Andrew Ng. This is the dataset I ...
2
votes
2answers
38 views

Predicting financial data (choosing a model)

it is my first time doing something with financial data. I have a dataset with account numbers and some other information about each client (some clients span more than one row since we have info for ...
1
vote
2answers
33 views

Classification report question

I need some help to interpret the 2 classification reports of the same logistic regression. The only difference between them is the size of test_size. Even though my second classification report has a ...
0
votes
0answers
58 views

questions about logistic regression

In the following Linear Regression discussion I didn't understand a few things: So my questions are: In the third slide: What does this probability means $P\left(y_i|x_i\right)$ and accordingly what ...
0
votes
1answer
191 views

What is Happening in the training process when we are fitting a model to the data [closed]

In any prediction task, the process of “fitting” a model to the data observed in the training process can be best described as... Assessing all observations available and then backsolving for the ...
2
votes
2answers
90 views

Feature Importance without Random Forest Feature Importances

Is their an intuitive way of finding feature importances without just using the random forest feature importances method? I have a binary logistic regression problem where I have binary features (1 or ...
0
votes
1answer
271 views

What is the effect of oversampling on logistic regression?

I am building a model to predict if a customer will use a coupon or not for a given campaign. I am using logistic regression for this model. I took 5 previous campaigns and generally for each campaign ...
1
vote
1answer
85 views

Logistic regression vs Random Forest on imbalanced data set

I have an imbalanced data set where positives are just 10% of the whole sample. I am using logistic regression and random forest for classification. While comparing the results of these models, I have ...
5
votes
2answers
122 views

Confused AUC ROC score

I am working on binary classification problem, I try to evaluate the performance of some classification algorithms (LR,Decission Tree , Random forest ...). I am using a cross validation technique (to ...
1
vote
1answer
30 views

What kind of data (in context of trends in data) is Logistic Regression appropriate for? [closed]

I'm not able to visualise what kind of 'trends' I would have to observe in multi-featured data to be able to say 'Logistic Regression would work well here'. For example if I have only 1 feature and if ...
0
votes
1answer
40 views

How do we get the coefficients and intercept in Logistic Regression?

I'm using Codecademy to learn about logistic regression and there are some holes in my understanding of this topic. ...
1
vote
2answers
4k views

Logistic regression does cannot converge without poor model performance

I have a multi-class classification logistic regression model. Using a very basic sklearn pipeline I am taking in cleansed text descriptions of an object and classifying said object into a category. <...
2
votes
1answer
35 views

Dummy variable only for character value in a column (Neglecting float and integers)

My dataset consists of 3000 rows and 50 columns, out of which one column (ESTIMATE_FAMILY_CONTRIBUTION) contains all numerical value(around 2000 different values like 20,30,32....) but got one value ...
1
vote
1answer
56 views

Linear Regression Loss function for Logistic regression

I was attending Andrew Ng Machine learning course on youtube Lecture 6.4 He says what a cost function will look like if we used Linear Regression loss function (least squares) for logistic regression ...
0
votes
1answer
117 views

How to know if classification model is predicting 1 or 0

I have used logistic regression to predict whether customer is good(1) or bad(0). I got the accuracy .80 . How do i know whether model predicted 1 or 0 .Is it related to parameter of model1....
1
vote
1answer
39 views

How is vector A converted to single value scalar in Andrew Ng's course?

In Andrew Ng's deep learning course on Coursera, how is a single scalar value obtained from a flattened image (feature vector)? First there is $w.T$ of shape $(1, n_X)$ which is multiplied by $X$ of ...
0
votes
2answers
24 views

calculating the precision and recall for a specific threshhold

I have a logistic regression model in which I calculate the tpr, fpr and thresholds using the roc_curve. After looking at the accuracy rates for different thresholds, I found the most optimal ...
1
vote
1answer
341 views

How to use unigram and bigram as an feature on SVM or logistic regression [closed]

How to use unigram and bigram as an feature to build an Natural Language Inference model on SVM or logistic regression?on my dataset i have premise, hypotesis and label column. I'm planning to use the ...
2
votes
2answers
499 views

How to handle Overfitting

I am working on machine learning classification problem with two classes (0/1). I would like to build a prediction model. The problem is that I have a small dataSet of ...
0
votes
0answers
168 views

Confidence score over xgboost logistic regression

The probabilities of logistic regression indicate how the certain the model is over predictions. if its 0.93 it means the model is 93% confident the label is 1 and 7% to be 0. or if the probability is ...
0
votes
1answer
43 views

Output model from GLM in R

I had generate in Ra logistic model using glm using binomial as family, but each session that I started in R the variable that I used to store the glm output gives me another output. Why this happen? ...
0
votes
1answer
28 views

Logistic Regression Multi-level Independent variables

im trying to study logistic regression, when i did the target variable with all features, i had the summary showing the p-values as usual, but one for the features has 60 level, another feature has 13 ...
2
votes
1answer
28 views

What supervised machine learning model can be used to generate a scorecard-like result?

A scorecard is typically used in Credit Application. One very common model for developing a credit scorecard is logistic regression since it has well-defined probabilities. Apart from logistic ...
0
votes
0answers
21 views

Logistic loss increasing while training with minibatches using the adam algorithm

I am trying to write my own code to use the adam algorithm for logistic regression. I am pretty sure It is training correctly as when I run it I am able to accurately classify a bunch of toy data that ...
3
votes
4answers
112 views

ML: Classification Model Comparison

Given is a dataset that I need to use for a classification and I want to compare the performance of different classification models. Let's assume, I want to look at logistic regression (with ...
0
votes
0answers
64 views

Including spatial spillover for categorical data in R

I did a regression analysis with categorical data with a glm model approach, which worked fine. I have longitude and latitude coordinates for each observation and I ...
2
votes
1answer
188 views

PCA shows overlapping boundaries, then why SVM performs best

I am trying to understand which model might work for a given problem before trying the models, I find this case against my knowledge. Please guide what I am missing. I am new to Data Science. Here is ...
2
votes
1answer
342 views

How does scaling affect Logistic Regression?

I have searched a lot on the web for this question, but I never seem to find a consistent yet straight forward answer. Simply put, the question is: How exactly does scaling affect logistic regression? ...
0
votes
1answer
35 views

Deciding what type of model to use for predicting the bottom decile of student grades

I have a large dataset which includes 36 variables (in %iles) to describe a student, and then the output is the students grades as a %ile. I am trying to predict, using the 36 variables, whether a ...
1
vote
1answer
83 views

How does imblearn apply the transformations during prediction?

Let's say I have a sklearn pipeline that: Imputes the data Randomly oversamples the minority class ...
2
votes
4answers
149 views

How to improve results in classification problems (SVM, Logistic Regression and MultiNaive Bayes)?

I am new on Machine Learning and building models but a lot of tutorials has given me the chance to learn more about this topic. I am trying to build a predictive model for detecting fake news. The ...
1
vote
1answer
32 views

Confusion matrix doesn't display properly

I am trying to plot a confusion matrix using the Logistic Regression for a multi-class ...
0
votes
0answers
17 views

Event modelling on aggregated data

I have a data that I want to use in event occurrence modeling, however, data was prepared in a way that I have exposure (can be fractional, eg. half of period) and event occurrence in some groups. It ...
0
votes
1answer
252 views

Logistic regression based prediction model using flask(python) to predict if Student will pass or fail. Error [duplicate]

I am trying to create a web application on Python using Flask that predicts if a student is likely to pass or fail using a Kaggle dataset. I changed the dataset a little and want to predict if the ...
0
votes
1answer
80 views

Text classification analysis based on similarity

I have been reading a lot of literature regarding text classification and different approaches/models, especially using Python language, but probably I am still missing something on how to build the ...
0
votes
2answers
53 views

Logistic regression for classification?

I have a dataset with most columns having Boolean values and categorical values. A sample of it is: ...
1
vote
1answer
44 views

Logistic Regression: Is it viable to use data that is outdated?

TLDR: Want to predict who makes the playoffs (1,0), but there are more playoff spots now than there were in the past, is it okay to use that past data? I want to use binary logistic regression on MLB ...
2
votes
1answer
79 views

Regularization for intercept parameter

Why is the regularization parameter not applied to the intercept parameter? From what I have read about the cost functions for Linear and Logistic regression, the regularization parameter (λ) is ...

1
2
3 4 5
11