I am a novice in machine learning and new to NLP. I am looking for ideas on how to solve the below two problems.
I have a dataset with two columns, "Titles" and "Description". Titles column has names of clinical lab tests and description column has description about results of corresponding laboratory test( can be seen below). There many titles specific to a particular lab test.
Title Description
Complete blood test RBC: Normocytic and Normochromic
COMPLETE Blood test\ Platelets: Adequate on the smear
Blood glucose COLOUR - COLOURLESS
Complete blood picture WBC: Total and Differential counts are within normal limits
I have only shared a small part of the data frame.
Problem 1: I have manually grouped the similar looking titles. For example, I have grouped the titles in the above data frame as "Blood Test". Is there a way to use NLP technique to group similar looking titles ( As shown below).
Problem 2: Based on the description, i have manually labeled a particular outcome for a lab test as normal or abnormal. Again i am looking for a way to do this without having to manually label the outcome (As shown below).
Title Description Outcome
Blood Test RBC: Normocytic and Normochromic Normal
Blood Test Platelets: Adequate on the smear Normal
Blood Test COLOUR - COLOURLESS Normal
Blood Test WBC: Total and Differential counts Normal
Any suggestions or resources to help me get started would be appreciated.