Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow for specify coda device in perplexity evaluation #568

Open
manuelbrack opened this issue Apr 8, 2024 · 0 comments
Open

Allow for specify coda device in perplexity evaluation #568

manuelbrack opened this issue Apr 8, 2024 · 0 comments

Comments

@manuelbrack
Copy link

The current implementation of perplexity.compute does not allow to provide a specific coda device (e.g. cuda:1 instead of just cuda.

assert device in ["gpu", "cpu", "cuda"], "device should be either gpu or cpu."

Should probably be changed to something along the lines of:

assert device in ["gpu", "cpu", "cuda"] or re.search(r'^cuda:[0-9]+$', device), "device should be either gpu or cpu." 
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant