New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问有在 V100-32G 的GPU上进行测试的finetune的脚本吗？ #146

Open

Qinger27 opened this issue May 6, 2024 · 1 comment

Qinger27 commented May 6, 2024

V100 不支持 flash-attn，想问下有没有不通过 flash-attn的脚本呢？以及用 internvl-v1.5 进行测试时，使用8卡还是报错 OOM的问题，请问怎么解决？迫切期待您的回复～

Member

czczup commented May 8, 2024

您好，V100可以参考这个回答：#144

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment