Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Guidance Needed for Selecting Best Epoch/Weights in Pix2Pix Training #225

Open
yagobilel opened this issue Feb 23, 2024 · 1 comment
Open

Comments

@yagobilel
Copy link

yagobilel commented Feb 23, 2024

Hello,

I've been training a Pix2Pix model for an image-to-image translation task and have reached a point where I need some advice on selecting the best epoch/weights based on the training metrics. My main goal is to achieve high-quality image generation that closely matches the target domain while maintaining a good balance in the adversarial training process.

Here are the types of metrics I'm observing at various epochs (example from epoch 1):
(epoch: 1, iters: 8000, time: 0.019, data: 0.003) G_GAN: 3.125 G_L1: 25.956 D_real: 0.038 D_fake: 0.073

I understand that lower G_GAN, G_GAN_Feat, and G_VGG values are desirable as they indicate that the generator is effectively fooling the discriminator and generating images that are close in feature and perceptual quality to the target images. However, I'm unsure how to balance these metrics optimally and what to consider an acceptable range for D_real and D_fake to ensure the discriminator is functioning effectively without overpowering the generator.

Questions:

1-How should I interpret the balance between G_GAN, G_GAN_Feat, and G_VGG losses in selecting the best epoch for my model?
2-What are the ideal ranges or balance for D_real and D_fake losses to ensure effective learning without causing the discriminator to overpower the generator or vice versa?
3-Beyond the numeric metrics, what visual quality aspects should I prioritize in the generated images when manually reviewing them for selecting the best model weights?
4-Are there any community recommendations or best practices for monitoring and deciding on the best epoch/weights in Pix2Pix or similar GAN-based models?
Any insights, recommendations, or references to relevant resources would be greatly appreciated. Thank you for your time and assistance.

Best regards,

@ALISAXXW
Copy link

ALISAXXW commented Feb 23, 2024 via email

@yagobilel yagobilel changed the title Guidance Needed for Selecting Best Epoch/Weights in Pix2PixHD Training Guidance Needed for Selecting Best Epoch/Weights in Pix2Pix Training Feb 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants