Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Question] Can MLC quantize multimodal models? #2349

Open
LJ-Hao opened this issue May 16, 2024 · 2 comments
Open

[Question] Can MLC quantize multimodal models? #2349

LJ-Hao opened this issue May 16, 2024 · 2 comments
Labels
question Question about the usage

Comments

@LJ-Hao
Copy link

LJ-Hao commented May 16, 2024

❓ General Questions

Can MLC quantize multimodal models? Give me an example, please.
@LJ-Hao LJ-Hao added the question Question about the usage label May 16, 2024
@WangFengtu1996
Copy link

+1

@AkulRT
Copy link

AkulRT commented May 24, 2024

I'm pretty sure the MiniCPM models are available in quantized forms.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Question about the usage
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@WangFengtu1996 @LJ-Hao @AkulRT