You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
MD_JSON mode still performs poorly for local models
we should make the system prompts more aggressive in asking for json
we should be more aggresstive with parsing out the text perhaps by reading out everything and asking it to return ```json
this can still be done to handle streaming etc.
The text was updated successfully, but these errors were encountered:
MD_JSON mode still performs poorly for local models
this can still be done to handle streaming etc.
The text was updated successfully, but these errors were encountered: