Replies: 1 comment
-
|
Browser backend operates same as chat.openai.com, API backend is 4096-ish, I think there's a bit of overhead in the request text itself. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
What is the token limit? I was thinking it was 4097 as suggested online, but not sure what the limit is here. Currently, through error and trial, I'm hitting a hard limit at approx. ~3500 tokens. I'm using OpenAI's tokenizer to calculate. Is 3500 correct?
Beta Was this translation helpful? Give feedback.
All reactions