Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[User] Insert summary of your issue or enhancement.. #382

Open
Fcucgvhhhvjv opened this issue Aug 14, 2023 · 3 comments
Open

[User] Insert summary of your issue or enhancement.. #382

Fcucgvhhhvjv opened this issue Aug 14, 2023 · 3 comments

Comments

@Fcucgvhhhvjv
Copy link

Hi , I'm using koboldcpp on Android through termux . I built it with openblas and clblast with make llama_openlas llama_clblast . Whenever I use --useclblast I get error low vram , I've experimented with multiple value for it but I get the same error. Is there a way I can use --useclblast?

@LostRuins
Copy link
Owner

I suspect that it's not actually low ram, but you are using the wrong libraries. Check the termux guide linked in the wiki https://github.com/LostRuins/koboldcpp/wiki

@Fcucgvhhhvjv
Copy link
Author

@LostRuins i followed the same tutorial , but im using the latest code form the github repo . Could it be the issue? I can attach screenshots if u want.

@gustrd
Copy link

gustrd commented May 12, 2024

Some new references that sadly CLBlast in Android is buggy: ggerganov#7016

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants