Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Weight mismatch with SD 2.1 #61

Open
ifeherva opened this issue Jan 12, 2024 · 1 comment
Open

Weight mismatch with SD 2.1 #61

ifeherva opened this issue Jan 12, 2024 · 1 comment

Comments

@ifeherva
Copy link

If I understand the approach correctly the in blocks of SD 2.1 were frozen during training.

Yet, when I compare the weights between the checkpoint shared here vs the SD 2.1 on huggingface the weights, don't match. What am I missing?

For example the keys I am comparing from the 2 state dicts:

Anydoor checkpoint: model.diffusion_model.input_blocks.0.0.weight
vs.
SD 2.1 loaded as UNet2DConditionModel: conv_in.weight

@ifeherva
Copy link
Author

I figured out what was happening, the link in the README points to SD-v2.1 however you used SD-2.1-base. I recommend to update the README :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant