I have a small dataset 79 observations in 21 variables. Almost all the variables are categorical variables in the format yes/no or 1/2/3. I would like to predict jointly three of these variables using the others. However, I have a strong class imbalance because for the first variable just 3 out of 79 have a value equal to yes and for the second variable just 4 of 79 and among these 4, 3 are the same observation for which the first variable is yes.

Which kind of model would you use? Have you any suggestion of how to do it in Python or R? What is a good method for dealing with class imbalance without overfitting in this case?

  • 1
    $\begingroup$ Welcome to Data Science! You probably don’t have enough data to do much. $\endgroup$
    – Dave
    Sep 27, 2022 at 18:27
  • $\begingroup$ Yes, sadly I have to agree. Do you know if there is still something that I can try to do? $\endgroup$ Sep 28, 2022 at 7:28


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.