Guide : Upscaler database + Comparison

[glucauze]

Here are two sources of information that I find really interesting on upscaling:

• An upscaler database
• A really well written guide and some comparisons.

Getting good results is a process of testing and trying different methods.

The 003_realSR_BSRGAN_DFOWMFC_s64w8_SwinIR-L_x4_GAN model seems to yield good results in a reasonable amount of time for post-processing. Combined with the GPU options in version 1.2.1 (not yet released), the processing becomes really fast.

[glucauze]

From my testing in postprocessing

Prompt: portrait of a man
Steps: 20 | Seed: 2461472201 | Sampler: UniPC | CFG scale: 6 | Size: 512x512 | Parser: Full parser | Model: dreamshaper_8 | Model hash: 879db523c3 | Version: 6427316 | Pipeline: Original | Operations: txt2img

• Orig Image (before swap)

• No post-processing or global-postprocessing (reference) :

• No post-processing + CodeFormer in Global postprocessing :

Post-processing only (no global post-processing), all done with sharpen, color correction and buggy improved mask (affected by color correction in these examples, will be fixed) :

• TGHQFace8x_500k + GFPGAN (very ugly with codeformer)

• 4x_RealisticRescaler_100000_G + GFPGAN :

• SwinIR_4x + Codeformer (slower)

• 003_realSR_BSRGAN_DFOWMFC_s64w8_SwinIR-L_x4_GAN + Codeformer (slower)

• LDSR + CodeFormer (very slow)

Post-Processing example settings :

[glucauze]

Improved mask comparison (working version)

Without :

With :

[ColinFrake]

I downloaded 003_realSR_BSRGAN_DFOWMFC_s64w8_SwinIR-L_x4_GAN model, where should I put this file? Thank you very much!

[glucauze]

It depends on the model but most of them go to /models/ESRGAN (whey they are based on ESRGAN which is the case here)

[agarzon]

I tend to use 4x-UltraSharp for everything, am I doing wrong? I'm 100% into realistic portraits, 0% anime, cartoon or 3d renderings.

[glucauze]

No it only depends on the subject and your personal preferences. You can get good results with this upscaler.

In the code I've done (in post-processing & advanced mask option), the upscaling of the face is done with a factor of 4 before face restore and merging the swapped face with the original image. We go from a 128x128 image with little definition to 512x512. Some upscalers, which generally work very well, may not be ideal for this application. That's why you need to test different solutions and choose the one that seems best for you.

For the global post processing, it's up to your liking. It will upscale the whole image.

[agarzon]

Thanks.

My personal chooses for realistic upscalers are so far 4x-UltraSharp and 4x_NMKD-Siax_200k (yes they are slow), if anyone knows something better please let us know 😇

I have a question for you: I was looking in the config.json and the ui-config.json but I did not find a way to set the Upscaler scale, let's say I want all my productions to be x1.5 permanently

So far I did not find where to set that as default value, I have to change it each time manually in the Global Post-Processing tab

Do you know how? thanks a bunch

[glucauze]

Yes it's normal. I'll try to change the option for the scale

[Creepybits]

I keep getting the following error after downloading the upscaler from your link.

Failed loading SwinIR model C:\AI Stuff\A1111\stable-diffusion-webui\models\SwinIR\003_realSR_BSRGAN_DFO_s64w8_SwinIR-M_x2_GAN.pth: 'params_ema'

It shows up in the list without any issues though.