2 lines
63 B
Plaintext
2 lines
63 B
Plaintext
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
|
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
|