Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Suggestion: simple one-call function to make stable-diffusion.dll accessible for newbie coders #251

Open
JohnClaw opened this issue May 6, 2024 · 0 comments

Comments

@JohnClaw
Copy link

JohnClaw commented May 6, 2024

Recently i discovered Dllama.dll ( https://github.com/tinyBigGAMES/Dllama ), lib that allows to chat with llm ggufs using only one simple function call. For example, i call it from my AutoIt script like this:

Local $hDLL = DllOpen("Dllama.dll") Local $answer = DllCall($hDLL, "str:cdecl", "Dllama_Simple_Inference", "str", "C:\LLM\gguf\", "str", "models2.json", "str", "llama3:8B:Q6", "boolean", False, "uint", 1024, "int", 27, "str", $question) DllClose($hDLL)

So it's very attractive for novice coders because doesn't require knowledge about advanced coding technics like pointers, structures etc which are used in original llama.dll from llama.cpp repo making it not newbie-friendly.

Could you add such simple function to stable-diffusion.dll, please?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant