I've got a biological dataset describing genes. The overall idea is that there are thousands of these genes to sort through, so if ML can rank them I can then know which should be going into the lab for functional research first. Currently, I make labels for supervised classification of these genes based on their known biology (so for example some genes interact with drugs related to a disease so I label them as 'most likely to cause the disease' and this goes down until I have a final 4th label of 'unlikely to cause the disease'). The way I make these labels seems impossible to not be biased, since I'm making all the decisions, so I'm wondering if I can compare my decisions with seeing how an unsupervised model would group the data (e.g. I've got 4 labels but if the model finds 5 groups then it shows how far off I am potentially?).

Would it even also be possible to use unsupervised learning to create the labels by itself or would this too be unreliable as you can't know why it's grouping certain genes together? Or would doing this step alone actually make the supervised step redundant anyway?


1 Answer 1

  • Is using unsupervised learning to setup supervised classification reasonable?

Absolutely. This is a common strategy in ML. As you said yourself, using information coming from the data itself has the benefit of being less biased.

  • Would it even also be possible to use unsupervised learning to create the labels?

Technically yes. Though, some clustering techniques require you to specify the number of clusters, which isn't helpful. As you said, if you can cluster data points in a satisfactory manner, you don't need supervised learning anymore. Also, indeed, if your scenario requires you to have an understanding of what differentiates the clusters, you may not be lucky depending on which clusters come out. They are not always interpretable.

What I would suggest would be to turn your classification problem into a regression problem. 1.0 could be most likely to cause the disease, 0.0, least likely. This way, you don't have to worry about how many labels you need in the first place.

  • $\begingroup$ Thank you this is incredibly helpful and clear. Just so I'm sure, it's best with setting 1 and 0 and forgoing any labels I had before - e.g. not having a 'likely' or 'possible' 2nd and 3rd label that I set at 0.75 and 0.5 in the regression? In particular it's the possible label which I currently base on weak biological information and is likely the most biased one I make, so it would be good to remove if setting only 1 and 0 is a reasonable idea. $\endgroup$
    – DN1
    Commented May 22, 2020 at 14:48
  • $\begingroup$ What I meant was using labels over the continuous range between 0 and 1. So you could use 0.5, 0.75 etc. as targets for your regression. The advantage of this is that your outputs will not be restricted to the original targets. $\endgroup$ Commented May 22, 2020 at 15:21

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.