I wish there was a function to search for available models in koboldcpp.

[kbuwel]

Faraday has a function to display and download available models, but koboldcpp only has a function
to load models directly.
It would be nice to have a function to search for available models.

[LostRuins]

It's quite easy since almost any GGUF file will work. You can find them on huggingface. https://huggingface.co/

Just search GGUF

[kbuwel]

I know the gguf model works.
However, it is cumbersome to find which gguf file I want.

[Woisek]

I know the gguf model works. However, it is cumbersome to find which gguf file I want.

And you think this changes if you change the program with which you search for ... ? 🤪

[henk717]

I have been considering solving this in a different way where we use our WIP website to link to popular models. That way we dont introduce a dependency on Huggingface.