0
$\begingroup$

I am using BERT model for sentence similarity task. However my dataset with sentence is very specific and I want to fine tune my model on it first. My dataset is unlabelled. And BERT model that I want to use was trained with natural language inference method (where sentences are labeled as neutral, entailment or contradiction. I found articles about fine tuning BERT model with MLM method, but I don't think that I can apply to my model since it was trained in different way. Is it correct or MLM is applicable for fine tuning model trained with NLI method?

$\endgroup$

0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.