How can I "define" many LLM providers (with their creds) and then use them accordingly?

[younes-io]

For now, it's hard to switch between LLM providers. Every time I have to switch from one LLM provider to another, I need to get the API key and copy/paste manually, then put the URL of the other LLM provider, etc.

This is not very efficient, I think. It would be great to have a way to set up many LLM providers and their models, then switch between them using a drop down list. This also will make it easier for masks. Today, a mask with an LLM that belongs to an LLM provider that's not my "current" LLM, will fail; I have to switch manually to make it work.

So, I believe the definition of LLM/LLM provider should be done in the setup, and then each conversation/mask should use the credentials defined with the LLM provider details required to call the LLM.

Any thoughts?