Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: 完善 OpenAI vision 相关接口,并将 gpt-4-turbo 从临时方案切换过去 #1707

Open
awwaawwa opened this issue Apr 13, 2024 · 3 comments

Comments

@awwaawwa
Copy link
Contributor

Class | 类型

大语言模型

Feature Request | 功能请求

根据 #1698 (comment) ,当前 OpenAI vision 模型相关接口实现存在以下几点问题:

  1. predict_no_ui_long_connection 暂未实现(或许没有必要?暂时应该是没有插件需要用vision能力吧)
  2. predict 强制要求上传图片
  3. predict 仅支持单轮对话

有必要完善相关接口并将 gpt-4-turbo 从临时方案切换过去。

@awwaawwa
Copy link
Contributor Author

4o也出来了,本 issue 是否应扩展为:完善 OpenAI 多模态相关接口,并预留 audio 相关接口?

@tzcskys
Copy link

tzcskys commented May 15, 2024

+1,“GPT-4o is 50% cheaper than GPT-4 Turbo”,“It has better vision capabilities and improved support for non-English languages ”,没有audio等其他接口可以后续慢慢考虑,但API价格降低50%以及更好的非英语(如中文)的支持会带来很大的提升。

@awwaawwa
Copy link
Contributor Author

awwaawwa commented May 15, 2024

目前 gpt-4o 的初步支持已在 #1760 合入主线

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants