New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request] Add support for OpenAI compatible API server #20

Open

Extremys opened this issue May 7, 2024 · 1 comment

Extremys commented May 7, 2024

Hello @Blaizzy, it would be so great to have a similar OpenAI Compatible server like in https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/SERVER.md but supporting also image modality, what do you think?

Owner

Blaizzy commented May 7, 2024 •

edited

Thanks, that's a really good idea.

I'm already working on it and should be available soon, but it's still a private repo.

Let me know if you want to help and I will add you there.

It will support multimodal inputs and much more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment