2
$\begingroup$

is window size and context length of language model one and the same thing?

******** following text is added as question with ONLY above text was not allowed ***** I am trying to understand how GPT model is trained and this question to my mind. I tried to search answer on google but couldn't find an answer thus asking here.

$\endgroup$

1 Answer 1

4
$\begingroup$

Yes, in large language models, window and context length refer to the same thing: the maximum token sequence length that the language model can handle at once.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.