-
Notifications
You must be signed in to change notification settings - Fork 64
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
JSONDecodeError("Expecting value", s, err.value) from None #45
Comments
You need to point it at the original folder of Meta-Llama-3-8B-Instruct |
It's busy uploading, you can find it here: |
i used download.sh and the key they provide. that was the error i got. I would like to be able to convert for the future reference. Thank you for the converted model. I will post my results with 8x RPi 3b |
I assumed this script would work for all of the LLama3 models, but it does not. Any chance we could get some instruct and or codellama conversion scripts? |
Could you try to run
Btw: in your logs I see |
Yes. The script DOES NOT work with Instruct Models or CodeLLama Models. However, It DOES WORK for 8B, non-instruct, non-code models. |
Could you give more information, what repo, what folder you pointing it at etc? I should probably say it again, it doesn't work with safetensor files, but with .pth files. |
i am downloading models directly from the meta repository. In order to download these models, you need a key mailed to you. I run the download.sh script as provided. when executing the converter script on models that are designed for Instruct/Code, the script fails. https://i.imgur.com/XjvNKLl.png When executing the Tokenizer script for instruct models: |
I downloaded them straight from huggingface |
i'll try this maybe i downloaded something wrong |
I get this when trying to convert llama3-instruct downloaded from the Meta Repo to q40.
The text was updated successfully, but these errors were encountered: