You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Function calling is a feature supported by many open source models, like Mistral.
Function calling feature would allow developers to use LlamaSharp in a more dynamic way, enabling them to perform complex tasks directly within the LlamaSharp environment.
Are there plans to include function calling / tools in LLamaSharp?
API & Usage
No response
How to implement
No response
The text was updated successfully, but these errors were encountered:
It's pretty easy to hack together your own function calling. I used Hermes-2-Theta-LLama-3-8B and got acceptable results. What would be nice is C# native annotations that translate functions into OpenAI JSON, which the "function calling method" meta seems to have standardized around. Semantic Kernel also provides this feature if you really need it with their "planner" functionality, I chose to roll my own for resource constraint reasons
It's pretty easy to hack together your own function calling. I used Hermes-2-Theta-LLama-3-8B and got acceptable results. What would be nice is C# native annotations that translate functions into OpenAI JSON, which the "function calling method" meta seems to have standardized around.
That's inspiring! May I ask whether you work is open-source? I wonder if I can take a look of your implementation if it's possible. :)
Background & Description
Function calling is a feature supported by many open source models, like Mistral.
Function calling feature would allow developers to use LlamaSharp in a more dynamic way, enabling them to perform complex tasks directly within the LlamaSharp environment.
Are there plans to include function calling / tools in LLamaSharp?
API & Usage
No response
How to implement
No response
The text was updated successfully, but these errors were encountered: