1
$\begingroup$

I have a dataset of patient records but they don't have labels.

I would like to label them and would like to know what are the different approaches available that I can consider to label them.

For ex: I have given two approaches below but is there any other approaches to it?

1) Manual labeling

2) Rule based

3) ..

4) ..

As you all are experienced in data science and AI

Can you please share some approaches that you know and resources that I can refer to learn about them?

$\endgroup$
2
$\begingroup$

1) Manual labeling--- this is not as bad as it sounds. Especially when you apply transfer learning, and for most of the datasets you have a lot of pre-trained models. There are products for that, but also inline python libraries

2) Rule based--- not advisible, since your model will just focus on these if-else rules itself. It would be the the best if these are the rules that are not that visible in the dataset, and the model cant catch it so easily. Which just implies it will than start to learn information in other features that also could be valuable.

3) Pseudo Labeling---- will add confident predicted test data to your training data. Therefore you will reinforce the clear labeled data and use them to help and label/predict other ones. Note, its a potential overfitting method.

4) Unsupervised Approach---- try to find good representation of data. The one thats discriminative enough, than apply clustering algos. If the resulting clusters are clear and different, you can look a couple of samples from every cluster and conclude what are the labels for every sample in your dataset.

| improve this answer | |
$\endgroup$
  • $\begingroup$ Thanks for the response. Upvoted $\endgroup$ – The Great Mar 12 at 1:08
  • $\begingroup$ May I also check with you on whether rule based labeling can be called as semi-supervised approach? $\endgroup$ – The Great Mar 12 at 3:25
  • $\begingroup$ its rather pseuod labeling in my eyes $\endgroup$ – Noah Weber Mar 13 at 15:08
1
$\begingroup$

A decent simple approach is:

| improve this answer | |
$\endgroup$
  • $\begingroup$ Thanks for the response. Upvoted. $\endgroup$ – The Great Mar 11 at 14:11

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.