You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
In the config, unclear as to how to set max_submission_tokens (in the preset or in the config?). Also, preset-save and -load do not operate correctly with max_submission_tokens. Possible that max_submission_tokens is not associated with model preset, but then this is not documented.
I think even in runtime, max-submission-tokens doesn't quite work. I am getting KeyError('content') when my token count goes above max-submission-tokens.
Describe the bug
In the config, unclear as to how to set max_submission_tokens (in the preset or in the config?). Also, preset-save and -load do not operate correctly with max_submission_tokens. Possible that max_submission_tokens is not associated with model preset, but then this is not documented.
To Reproduce
1)
Set config file for the preset:
Says
Invalid key
./max-submission-tokens 2000
/preset-save my-preset
/preset-load my-preset
Expected behavior
It should work as expected, loading the customization.
The text was updated successfully, but these errors were encountered: