Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Discrepancy in mAP Results between Provided Model and Self-Trained Model on YTVIS2019 Validation Set #16

Open
SkyKingL opened this issue Feb 14, 2024 · 0 comments

Comments

@SkyKingL
Copy link

SkyKingL commented Feb 14, 2024

Hello,

I've been experimenting with your VIS model and I've encountered an issue that I hope you can help me clarify.

I trained the model on a server equipped with eight V100-32GB GPUs using the mfvis_nococo/scripts/train_8gpu_mask2former_r50_video.sh script, without any modifications to the parameters. The test results I obtained on the YTVIS2019 validation set are as follows:
微信图片_20240215034541
For comparison, I also tested the trained weight you provided on the same YTVIS2019 validation set and obtained these results:
微信图片_20240215034541
As you can see, there is a minor difference in the mAP scores. I was unable to achieve the mAP=42.5 as reported in your documentation. Could you please provide some insight as to why this discrepancy might be occurring?

I appreciate your time and look forward to your response. Thank you.

@SkyKingL SkyKingL changed the title Why can't I successfully get the effect of mAP=42.5 as yours? Discrepancy in mAP Results between Provided Model and Self-Trained Model on YTVIS2019 Validation Set Feb 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant