Skip to main content
1 of 2
pjama
  • 256
  • 3
  • 4

Tokenizer for GPT-3 is the same as GPT-2:

https://huggingface.co/docs/transformers/model_doc/gpt2#gpt2tokenizerfast

linked via:

https://beta.openai.com/tokenizer

pjama
  • 256
  • 3
  • 4