Skip to main content
4 events
when toggle format what by license comment
Mar 27, 2022 at 16:48 comment added Oxbowerce The first model simply returns the last hidden state from the model, the second one returns the scores for each token in the vocabulary.
Mar 26, 2022 at 18:42 vote accept John Smith
Mar 26, 2022 at 18:41 comment added John Smith Thank you so much for your answer. So If I want to finetune the bert model for a classification task which model should I use? From your answer I think these are the same models where if I use the first one (AutoModel.from_pretrained) I must construct the classification layer, while if I use the second one (AutoModelWithLMHead) there is a function for the classification task. Is that right?
Mar 26, 2022 at 17:53 history answered Oxbowerce CC BY-SA 4.0