nice! seems to work pretty well. Is function calling available as a part of continued conversation? right now if you ask a question that invokes a tool call, that tool call replaces the output of the LLM instead of using the answer in its response

The text generated by function calls is beyond the capabilities of the LLM. Including it in session conversation will only cause interference.

Note: the functions is bound to role other than session. It's recommended to use temporary roles during the session.

Another factor to consider is the unpredictable variety of text generated by external tools. The text can be empty (for example, if the tool simply opens another application), dynamic (like a progress bar), or unexpectedly large. It is inappropriate to include such output in a conversation.

AIChat now fully supports the function calling feature. It can retrieve information from functions and pass it back to the LLM for further processing. @tkanarsky

@sigoden in the current implementation the functions are called later in the conversation even though they were already called with the same parameters. Is this required in some scenario?
For most functions, and as in a natural conversation, I think caching previous tool input/output and making that part of the conversation history makes more sense.

AIChat save the question and final result in the session. The intermediate data returned by the function call has an uncertain format and variable size, not as valuable as you think.

Cache makes no sense, how do you know when the cache should be invalidated?
Don’t fall into the trap of over-optimization. @gilcu3

AIChat save the question and final result in the session. The intermediate data returned by the function call has an uncertain format and variable size, not as valuable as you think.

Cache makes no sense, how do you know when the cache should be invalidated? Don’t fall into the trap of over-optimization. @gilcu3

In my testing I got the impression that the tool was not storing the results in the session. If that's not the case then should be fine :) And yes I agree there is no need to over-optimize :)

If the LLM doesn't support parallel function calling, it will cause an infinite loop:

Call get_current_weather --location 'London, England'
Call get_current_weather --location 'Paris, France'
Call get_current_weather --location 'London, UK'
Call get_current_weather --location 'Paris, France'

Is this what you're talking about? @gilcu3

Despite multiple requests, they are counted as a single round-trip message. we can and need to reuse function call results.

Aichat can now reuse tool call results. LLMs that don't support parallel function calls now work.

Is this what you're talking about? @gilcu3

What I observed was thr LLM making a function call that was superfluous, because the answer was already mentioned in the conversation before. This infinite loop is/was a different issue.

@sigoden you're the GOAT!! Thank you for the implementation!