Load hybrid-clip in open_clip

[code-ishwar]

Is there a way to load a checkpoint from hybrid-clip?
I have trained a model on clip-italian. Now I want to finetune using open_clip for stability reasons.

I tried this, but have issues.

[rwightman]

@code-ishwar it can be converted, but keys are different and some layers might be organized a bit differently so needs to be remapped. I'm not aware of any plug and play code going this direction... leaving as discussions in case someone else does