Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Azure OpenAI does not provide server-side option #2487

Closed
BrandonStudio opened this issue May 14, 2024 · 13 comments · Fixed by #2519
Closed

[Bug] Azure OpenAI does not provide server-side option #2487

BrandonStudio opened this issue May 14, 2024 · 13 comments · Fixed by #2519
Labels
🐛 Bug Something isn't working | 缺陷 released

Comments

@BrandonStudio
Copy link
Contributor

💻 Operating System

Windows

📦 Environment

Vercel / Zeabur / Sealos

🌐 Browser

Edge

🐛 Bug Description

While OpenAI and Anthropic can send requests on server side, Azure OpenAI does not provide such option.

🚦 Expected Behavior

Provide "Send from server" option for Azure OpenAI

📷 Recurrence Steps

No response

📝 Additional Information

No response

@BrandonStudio BrandonStudio added the 🐛 Bug Something isn't working | 缺陷 label May 14, 2024
@lobehubbot
Copy link
Member

👀 @BrandonStudio

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事,并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

@arvinxx
Copy link
Contributor

arvinxx commented May 15, 2024

send from client?

@BrandonStudio
Copy link
Contributor Author

send from client?

I can now see the request direct to the API endpoint in the broswer console, where CORS error is reported.

@arvinxx
Copy link
Contributor

arvinxx commented May 15, 2024

I think the request is sent in server by default. It maybe some issue with it. @cy948 Could you please help to check it?

@cy948
Copy link
Contributor

cy948 commented May 15, 2024

send from client?

I can now see the request direct to the API endpoint in the broswer console, where CORS error is reported.

Could you show me the request url?

@cy948
Copy link
Contributor

cy948 commented May 15, 2024

Could u please help us test whether the bug would produce on the fix preview? For security reason, please use a temporarily key to test. Fix detail in #2519

@BrandonStudio
Copy link
Contributor Author

please use a temporarily key to test.

Azure OpenAI does not provide a temp key

@BrandonStudio
Copy link
Contributor Author

Could u please help us test whether the bug would produce on the fix preview?

In the fix preview, the request is sent to the backend, which avoid CORS error.
However, this does not provide the option to switch between client request and server request.

@cy948
Copy link
Contributor

cy948 commented May 16, 2024

In the fix preview, the request is sent to the backend, which avoid CORS error. However, this does not provide the option to switch between client request and server request.

Cause the request sent from client will produce CORS error, we consider disable "client request" feature for azure provider. So it would not show the options to swich between client request and server request.

@BrandonStudio
Copy link
Contributor Author

Cause the request sent from client will produce CORS error

I believe sending directly to original Azure endpoint (*.openai.azure.com) does not meed CORS error. I met CORS error because I was sending to Cloudflare AI Gateway. Are you sure about that?

@cy948
Copy link
Contributor

cy948 commented May 17, 2024

I believe sending directly to original Azure endpoint (*.openai.azure.com) does not meed CORS error. I met CORS error because I was sending to Cloudflare AI Gateway. Are you sure about that?

idk. So we decide to show the option for the "client request" feature in the preview and keep it disable at default.

@lobehubbot
Copy link
Member

@BrandonStudio

This issue is closed, If you have any questions, you can comment and reply.
此问题已经关闭。如果您有任何问题,可以留言并回复。

@lobehubbot
Copy link
Member

🎉 This issue has been resolved in version 0.160.6 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐛 Bug Something isn't working | 缺陷 released
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

4 participants