The max tokens of generated answer by ChatGPT is 768？ Is the restricted by proxy or openai?

[jianhai0527]

RT

[acheong08]

For V3, proxy is not used.

[acheong08]

The max tokens should be 4096 - the number of tokens in prompt

[jianhai0527]

yes, I also see that in the api document. However, I got max 768 tokens by V1 method. I am much confused........

[acheong08]

I'll check this out

[acheong08]

I'm not hitting any token limit. It might be that the model was fine tuned to speak less.

[acheong08]

I asked it to count numbers to infinity and it reached the same amount with both manual max_tokens and max_tokens unset