add Msty provider

[ashokgelal]

This is the app: https://msty.app

[netlify]

✅ Deploy Preview for continuedev canceled.

Name	Link
🔨 Latest commit	aaf6d63
🔍 Latest deploy log	https://app.netlify.com/sites/continuedev/deploys/65f9854cbc4e8d0008945e91

[sestinj]

@ashokgelal thanks for the PR! I want to make sure I understand how Msty works before merging: is it using Ollama under the hood, or does it just match its API format? Any reason why not OpenAI? And I assume from the code here that 10000 is the default port?

[ashokgelal]

It is using Ollama under the hood but maintain its own version (we check compatibility issue with the models we support, for an example) and it is also very opaque to users, if you will, as the don't have to worry about installing Ollama as we'll do that for them.
Not OpenAI because we do support local models (not sure if I interpreted your question about that correctly).

10000 is the default port but if that port is reserved by some other apps, then Msty pickup next available port.

[sestinj]

@ashokgelal all makes sense! With the OpenAI question I was just wondering why not use the OpenAI API format, since it seems most people are moving toward that, including Ollama.

Would it be easy for you to switch the base branch of this PR from main to preview, and then I'll probably just make a few tweaks?

[ashokgelal]

I just switched the base branch to preview. Feel free to make any necessary tweaks and please let me know if you need anything from my side.

[tgaff]

Hi, I'm suggesting some grammar/sentence-structure changes to improve readability.

I did also note that there's a fair bit of what might be considered mild-advertising in some of the text. e.g. "Msty is the simplest way to get started" ... "No fussing around, one-click and you are up and running."
In my opinion that's subjective, and the text would be more succinct if it were cleaned up but I've refrained from suggesting changes around that. (I'm not a maintainer and I have no horse in this race, just a few minutes spare time to read a PR today. I'll also be giving Msty a try in the next few days 😃)