Contributing SigLIP to mlx-examples

[suvadityamuk]

Hello!

I'm new to the MLX ecosystem, and I came across the fact that there is a valid CLIP implementation available in the repository. Keeping in mind that SigLIP has the same structure as that of CLIP (as per the HF implementation available), I was wondering if there would be any interest for converting the SigLIP weights to a MLX-compatible format?

Many community modelling efforts to create MLLMs have been consistently choosing SigLIP over the original CLIP model due to better performance.

Happy to discuss and understand if there are any nuances I may have overlooked, or should keep in mind. Thank you so much!
(and thank you so much for MLX, such a life-saver for folks doing ML dev on Apple Silicon!)

Thoughts? @awni

[awni]

Definitely! If they run out of the box with the MLX Clip example from Hugging Face that would be awesome.

You can upload them to the HF MLX Community (https://huggingface.co/mlx-community/) or to your own HF space. Either is ok!

[x4080]

@suvadityamuk how do you convert siglip to mlx ? I tried using
python convert.py --hf-repo google/siglip-base-patch16-224
and not success, merges.txt not found or something