Replies: 1 comment
-
|
Yes you can set any context value you want. The slider is just for convenience. --contextsize 20000 is perfectly fine |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I'm noticing the ctx is on a fixed slider, and offers 16384 and 24576 but is there an in-between option? I know via Runpod I can run this flag:
--contextsize x
Where x equals the desired context, but can it be an in-between value?
Beta Was this translation helpful? Give feedback.
All reactions