Simple API Wrapper #6065
montecarlo26
started this conversation in
Show and tell
Replies: 2 comments
-
Not a bad idea. You could even add Python bindings. nanobind or pybind11. |
Beta Was this translation helpful? Give feedback.
0 replies
-
Maybe related to #5215 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
A wrapper of llamacpp could trivialize instantiating and using a llm directly in C++. I'm referring to something like this:
I have a small example project here which I don't really plan to update at all, just a proof of concept. Anyways, an API wrapper would be nice to have. I don't think such a thing exists, at least that I was able to find.
Beta Was this translation helpful? Give feedback.
All reactions