Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unblinking #184

Open
MtYCNN opened this issue Apr 22, 2024 · 3 comments
Open

Unblinking #184

MtYCNN opened this issue Apr 22, 2024 · 3 comments

Comments

@MtYCNN
Copy link

MtYCNN commented Apr 22, 2024

After using your new version of code, I found that no matter how you train it, you won't blink and will keep staring. Is there any way to solve this problem?
No matter how big eye_blink_dim is set, it hasn't changed.
please

@abinggo
Copy link

abinggo commented Apr 23, 2024

Hi, I'm having the same problem, but I've trained out that my eyes stay closed and won't open. However, I suspect that one of the modules didn't match during training 1, and there was an error size mismatch for blink_encoder.1.weight, I solved the error by skipping, but the trained character's eyes are closed!

@YifuDeng
Copy link

same question

@louis-she
Copy link

image

You can see that the default blink dim in head and torso config is not the same, and that's why blink_encoder.1.weight not match. change torso from 4 to 2 will load the weights.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants