support llama3 #478
Labels
enhancement
New feature or request
Comments
reneleonhardt
added a commit
to reneleonhardt/CodeGPT
that referenced
this issue
Apr 19, 2024
carlrobertoh
pushed a commit
that referenced
this issue
Apr 20, 2024
* feat: Support Llama 3 model (#478) * Use new InfillPrompt * Switch to lmstudio-community * Use new Prompt * llama.cpp removed the BOS token ggerganov/llama.cpp@a55d8a9 * Add tests * I would prefer a stream based solution * Add 70B models * Add tests for skipping blank system prompt * Remove InfillPrompt for now
carlrobertoh
pushed a commit
that referenced
this issue
Apr 21, 2024
* feat: Support Llama 3 model (#478) * Use new InfillPrompt * Switch to lmstudio-community * Use new Prompt * llama.cpp removed the BOS token ggerganov/llama.cpp@a55d8a9 * Add tests * I would prefer a stream based solution * Add 70B models * Add tests for skipping blank system prompt * Remove InfillPrompt for now
|
it is there I can download the model but always times out |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the need of your request
No response
Proposed solution
No response
Additional context
https://llama.meta.com/llama3/
https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md
The text was updated successfully, but these errors were encountered: