Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conda installation instructions #250

Closed
danielhanchen opened this issue Mar 15, 2024 · 5 comments
Closed

Conda installation instructions #250

danielhanchen opened this issue Mar 15, 2024 · 5 comments

Comments

@danielhanchen
Copy link
Contributor

danielhanchen commented Mar 15, 2024

Xformers only supports torch 2.2.0 and not torch 2.2.1:
UPDATE Xformers supports 2.2.1!!

Replace conda with mamba if you have it. Much much faster.

conda create --name unsloth_env python=3.10
conda activate unsloth_env

conda install pytorch cudatoolkit torchvision torchaudio pytorch-cuda=<12.1/11.8> -c pytorch -c nvidia

conda install xformers -c xformers

pip install bitsandbytes

pip install "unsloth[conda] @ git+https://github.com/unslothai/unsloth.git"
@abhayjain0x
Copy link

image

i followed the steps here but getting this error . h100

@GritLs
Copy link

GritLs commented Apr 30, 2024

Why is the Python version in my Conda environment 3.10, but I get an error saying my Python version is incompatible?
ERROR: Package 'unsloth' requires a different Python: 3.8.10 not in '>=3.9'
image

@erwe324
Copy link

erwe324 commented Apr 30, 2024

I hope you would have used this command only

conda create --name unsloth_env python=3.10

If possible try to create another env

@GritLs
Copy link

GritLs commented Apr 30, 2024

@erwe324 thx for your suggestion. I created a new environment and followed the installation steps in the official tutorial, but I still encountered the same issue. Are there any other solutions? Thank you!

@erwe324
Copy link

erwe324 commented Apr 30, 2024

This should not be happening since after activation a conda env uses its own copy of python....

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants