Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Results Stage1 KIT Dataset #50

Open
AlessioSam opened this issue Aug 25, 2023 · 3 comments
Open

Results Stage1 KIT Dataset #50

AlessioSam opened this issue Aug 25, 2023 · 3 comments

Comments

@AlessioSam
Copy link

Hi,
thank you for your work, I find it brilliant and really useful for future developments in this field!

Regarding the HumanML3D dataset, the results are easily replicable.
However when trying to train the model on the KIT dataset I am having trouble getting your results, similar to issue #44.

  • I changed as you rightly said in a previous issue (Training configuration on KIT dataset #13) some lines in the config ('humanml' -> 'kit'), leaving the field JOINT_TYPE: 'humanml3d' unchanged.
  • I have repeatedly checked that I have downloaded the correct dataset and dependencies.

In stage1, what happens is that the model seems not to learn to reconstruct joints and features.

Is it possible to have your checkpoint so I can check that indeed the dataset is not corrupted? Or if you have any other advice (hyperparameters, ...)

After 20k epochs I have:
FID: 26.7
R_precision_top_1: 0.199
AVE_mean_pose: 2145
AVE_mean_joints: 79551

In contrast, the metrics for GT are correct.

Looking forward to your reply!
Thanks,
Alessio
sampieri@diag.uniroma1.it

@weleen
Copy link

weleen commented Oct 26, 2023

@AlessioSam I have the same problem, have you solved it?

@ChenFengYe
Copy link
Owner

@weleen @AlessioSam Hi Weleen and AlessioSam, could you provide more details about this implementation?
The FID metric shows that this training is broken.
Is there anything about loss?

@weleen
Copy link

weleen commented Oct 27, 2023

@ChenFengYe
image
This is my test results.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants