Skip to content

Issues: PygmalionAI/aphrodite-engine

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

47 Open 65 Closed
47 Open 65 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Usage]: OOM crash following Offline Inference setup
#494 opened Jun 1, 2024 by eedmond
[Bug]: SnowStorm-v1.15-4x8B: Watchdog caught collective operation timeout: WorkNCCL(SeqNum=1, OpType=BROADCAST, NumelIn=128, NumelOut=128, Timeout(ms)=600000) bug Something isn't working
#493 opened May 31, 2024 by josephrocca
[Feature]: An alternative to max_tokens which defaults to minimum(max_tokens, remaining_tokens)
#492 opened May 30, 2024 by josephrocca
[Bug]: /metrics Endpoint Returns 404 bug Something isn't working
#491 opened May 29, 2024 by adsf0427
[Misc]: INT8 kv quant seems removed.
#488 opened May 28, 2024 by sorasoras
[Feature]: WARNING: Model is quantized. Forcing float16 datatype
#487 opened May 28, 2024 by sorasoras
2
[Usage]: Higher Context Length.
#486 opened May 28, 2024 by Abulhanan
2
[Bug]: Moe's no longer working bug Something isn't working
#484 opened May 27, 2024 by puppetm4st3r
1
[Installation]: Docker runs out of CPU swap size on 8 GPUs. How to lower swap_space to be less than 4GB per GPU?
#483 opened May 26, 2024 by elabz
1
[Bug]: Cannot load Mixtral GGUF model? bug Something isn't working
#482 opened May 26, 2024 by Nero10578
13
[New Model]: Phi3ForCausalLM
#478 opened May 24, 2024 by sparsh35
[Bug]: Running aphrodite throws ImportError bug Something isn't working
#477 opened May 22, 2024 by reuank
2
[Feature]: request for support DeepseekV2ForCausalLM.
#476 opened May 22, 2024 by kk3dmax
[Bug]: Int8 k/v cache calibrate don't work with QWen model? bug Something isn't working
#475 opened May 20, 2024 by bash99
[Bug]: torch._dynamo.exc.BackendCompilerFailed with command-r-plus bug Something isn't working
#472 opened May 17, 2024 by heungson
3
[Bug]: Cannot load 70b exl2 5bpw model across 4 GPUs. bug Something isn't working
#471 opened May 14, 2024 by Ph0rk0z
7
[Bug]: Flash attention cannot be used on v0.5.3 bug Something isn't working
#468 opened May 12, 2024 by Nero10578
7
[Feature]: Exllamav2 Q4 cache
#463 opened May 9, 2024 by Anthonyg5005
2
[Bug]: LoRA broken when TP>1 bug Something isn't working
#460 opened May 8, 2024 by kubernetes-bad
[Usage]: Please provide the environment variable that closes the KoboldAI Lite page.
#445 opened Apr 30, 2024 by online2311
[Bug]: bug Something isn't working
#435 opened Apr 26, 2024 by someoneexistsontheinternet
@AlpinDale
1
[Feature]: Provide configuration via env vars or a configuration file
#425 opened Apr 22, 2024 by alexandreteles
@AlpinDale
[Feature]: Support hqq quantize method.
#418 opened Apr 17, 2024 by Minami-su
[Bug]: gguf loading failed. config.json? bug Something isn't working
#417 opened Apr 17, 2024 by juud79
4
[Feature]: Is there a reason CUDA 6.1 is the minimum? Would CUDA 6.0 on the P100 not work?
#413 opened Apr 16, 2024 by Nero10578
1
8
ProTip! Exclude everything labeled bug with -label:bug.