New answers tagged bert
1
vote
Accepted
How does Bert masked language modelling task make sense if half the time the next sentence is wrong context in the sequence passed through the encoder
First, note that the purpose of next sentence prediction objective is not to contribute to the contextual embeddings part, but to allow other downstream tasks like sentence classification and textual ...
- 23.8k
Top 50 recent answers are included