0
$\begingroup$

I used two different columns from dataset as targets and using logistic regression.

Output for target 1

The model performance for training set
--------------------------------------
RMSE is 8.136996958218045
R2 score is 0.5261727899306442


The model performance for testing set
--------------------------------------
RMSE is 8.11008545942948
R2 score is 0.5156169844890891

Output for target 2

The model performance for training set
--------------------------------------
RMSE is 1.6402023883989456
R2 score is 0.5242729273650613


The model performance for testing set
--------------------------------------
RMSE is 1.4717139217150437

As am splitting data into 85:15 split getting these values as required.Before further proceeding to extract PCA components , I want to be confident that its a good fit.

My question is What to conclude from the given values and is there any pre determind good or bad value for RMSE and R2?

Improve this question
$\endgroup$
6
  • $\begingroup$ The trouble with something like this is that it is tempting to use something like $R^2$ like a letter grade in school, where $0.9$ is an A that makes us happy, and $0.6$ is an F that makes us sad. However, $R^2=0.6$ could be quite excellent performance in some cases, while $R^2=0.9$ could be quite pedestrian in other cases. $\endgroup$
    – Dave
    Aug 15, 2021 at 12:41
  • $\begingroup$ @Dave that mean making any judgment on the basis of R2 could be dicey. $\endgroup$
    – Ruchir Mandora
    Aug 15, 2021 at 13:06
  • $\begingroup$ You just have to put it in context. // Additionally, $R^2$ even loses its usual “proportion of variance explained” interpretation in nonlinear models. It’s as valid of a performance metric as MSE or RMSE (just look at the equation), but it does lose that interpretation in nonlinear models, which I think diminishes its utility. $\endgroup$
    – Dave
    Aug 15, 2021 at 13:11
  • $\begingroup$ @Dave i suppose may be its better to use 'chi-square test' then . $\endgroup$
    – Ruchir Mandora
    Aug 15, 2021 at 13:42
  • $\begingroup$ What would that tell you? // Which chi-squared test do you mean? // I still say that the context is what matters. $\endgroup$
    – Dave
    Aug 15, 2021 at 13:43

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.