Understanding llama-bench #7195
Answered
by
slaren
aneeshmb02
asked this question in
Q&A
-
I am trying to understand what data(prompts) is being used by the llama-bench tool. |
Beta Was this translation helpful? Give feedback.
Answered by
slaren
May 10, 2024
Replies: 1 comment 4 replies
-
The prompts used by |
Beta Was this translation helpful? Give feedback.
4 replies
Answer selected by
aneeshmb02
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The prompts used by
llama-bench
are randomly generated sequences of tokens. You can configure the length, but not the contents.