We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
JAVA发起流式请求 接口是否是一次性全部返回 Iterator? 如果不是 我怎么提前终止他生成 这部分的 tokens怎么计算
No response
The text was updated successfully, but these errors were encountered:
目前暂时不支持手动终止,不过可以考虑使用stop传入停止词,当输出遇到停止词时,会终止生成(后续不计费)
stop
Sorry, something went wrong.
你好,我有个疑惑,SSE Iterator 是阻塞的,后面考虑变异步吗
@zfhlm 您好,目前暂不支持,但未来有计划支持async。
No branches or pull requests
Issue you'd like to raise.
JAVA发起流式请求 接口是否是一次性全部返回 Iterator? 如果不是 我怎么提前终止他生成 这部分的 tokens怎么计算
Suggestion:
No response
The text was updated successfully, but these errors were encountered: