It is recommended to add support for fp16 model to save memory

[junne14105]

https://huggingface.co/IDM-VTON-F16
The previous 12 g model memory requirements can be changed to 5 g model size. Will also allow and use better! What do you think?

[TemryL]

hey! the link seems to be broken...
the current implementation is already loading the model in torch.float16, I will have on how to load in 8bits

[junne14105]

https://huggingface.co/camenduru/IDM-VTON-F16 I tried it before and I didn't support it. That's why I'm asking.

[junne14105]

[TemryL]

Are you running on MPS accelerator?

[junne14105]

intel x86 Macos 14.5 Beta(23F5074a) I would like to know how to use and add fp8 models and effects on your side! fp16 I give up

[deepfree2023]

This VRAM usage info might be useful:

From:
yisol/IDM-VTON#47