Skip to content

Issues: EricLBuehler/mistral.rs

Model Wishlist
#156 opened Apr 16, 2024 by EricLBuehler
Open 22
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

11 Open 79 Closed
11 Open 79 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Quantized Phi3: Features to add models Additions to model or architectures
#277 opened May 9, 2024 by EricLBuehler
2 tasks
Memory Optimization for low memory machines
#275 opened May 9, 2024 by chenwanqq
4
New multiplexing scheduler new feature New feature or request
#273 opened May 8, 2024 by EricLBuehler
distribute with cargo dist?
#263 opened May 3, 2024 by ashleygwilliams
2
LoRA swapping at runtime models Additions to model or architectures new feature New feature or request
#259 opened May 1, 2024 by BHX2
9
Add C api and provide shared and static libraries. new feature New feature or request
#258 opened May 1, 2024 by maximus2600
Batched & chunked prefill models Additions to model or architectures new feature New feature or request
#216 opened Apr 26, 2024 by lucasavila00
2
2
Model Wishlist models Additions to model or architectures
#156 opened Apr 16, 2024 by EricLBuehler
10 tasks
22
Quantized Mistral: Prompt processing slower than llama.cpp
#153 opened Apr 16, 2024 by lucasavila00
43
Need parallel linears backend Backend work paged-attention
#50 opened Apr 1, 2024 by EricLBuehler
3 tasks
4
Add topk scalings, topk softmax scalings for X-LoRA models Additions to model or architectures new feature New feature or request
#48 opened Mar 30, 2024 by EricLBuehler
1
ProTip! no:milestone will show everything without a milestone.