Issues: InternLM/lmdeploy
[Benchmark] benchmarks on different cuda architecture with mo...
#815
opened Dec 11, 2023 by
lvhan028
Open
6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[Bug] Long context: Decoding performance degradation
#1608
opened May 17, 2024 by
DayDayupupupup
1 of 2 tasks
[Bug] 服务在接受到一些截断的图像base64编码后,线程退出,导致服务异常,此时服务没有停止,但是新的post请求无法进来
#1602
opened May 16, 2024 by
LRHstudy
1 of 2 tasks
[Bug] Unrecognized configuration class when quantizing llava
#1601
opened May 16, 2024 by
zjysteven
2 tasks done
AsyncEngine 的 stream_infer 函数增加手动传入session_id,实现多次调用 stream_infer 时的并行推理[Feature]
#1590
opened May 14, 2024 by
NagatoYuki0943
[Bug] change h_input_length_buf_ before synchronization
#1584
opened May 11, 2024 by
mengmeexix
2 tasks done
[Feature] Support for LLaVA-NeXT Qwen1.5-110, Qwen1.5-72B, LLaMA3-8B
awaiting response
#1583
opened May 11, 2024 by
Iven2132
[Feature] 是否支持enc-dec类型模型中decoder的persistent batch
awaiting response
#1581
opened May 10, 2024 by
Oldpan
[Bug] 使用docker部署internlm/internlm-xcomposer-vl-7b和internlm/internlm-xcomposer2-vl-7b均报错
#1577
opened May 10, 2024 by
ye7love7
2 tasks done
[Bug] Error deploying HuggingFace model llava-v1.6-mistral-7b with lmdeploy: Unrecognized model type llava_mistral
awaiting response
#1573
opened May 10, 2024 by
enogalaxies
1 of 2 tasks
[Docs] Can we have an up-to-date version of the persistent batching gif?
#1564
opened May 9, 2024 by
youkaichao
Previous Next
ProTip!
no:milestone will show everything without a milestone.