Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for AMD GPUs via ROCm #1

Open
icodeforyou-dot-net opened this issue Apr 2, 2024 · 1 comment
Open

Add support for AMD GPUs via ROCm #1

icodeforyou-dot-net opened this issue Apr 2, 2024 · 1 comment

Comments

@icodeforyou-dot-net
Copy link

icodeforyou-dot-net commented Apr 2, 2024

I was wondering if we could add support for AMD GPUs running ROCm in the near future? I could help and could test it on two different AMD cards.

I think in order to get there, we might have to do the following:

  • Provide all the ROCm related packages.

    Probably best to do this in another environment than the default one right now. I was wondering how we avoid duplicating most of the code here? (My Nix greatness is rather limited I have to say)

  • Set some environment variables, so that ROCm knows which GPU architecture we are using. This is particularly important in order to get this running on GPUs that are not officially supported by ROCm, but work nonetheless (which is basically all RDNA3, RDNA2 consumer and workstation GPUs, and also a significant number of RDNA-based GPUs).

    Since users will have different GPUs, is there a (possibly hacky) way to pick this up dynamically from the environment?

@icodeforyou-dot-net
Copy link
Author

I think we're getting there...!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant