-
Notifications
You must be signed in to change notification settings - Fork 97
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
May I know once I want to make a LLM by BaseAPIModel
, where could I input the url_base?
#159
Comments
BaseAPIModel
, where could I input the url_base?BaseAPIModel
, where could I input the url_base?
What is the model you use? The |
Thanks for your reply. But I want say that when we use API to deploy our model, that means the device in our hand may with no enough calculate resouces to run a LLM, such as without a Nvidia GPU. And |
Actually even if your local device does have GPU, you can install |
If you truly do not want to install
which copy from lmdeploy. The class only use |
I just find you pull a PR for this, thanks for your contribution |
Thanks for your advice. But |
I cannot find where can I input my url of my LLM on cloud. I should make one just like you do in
GPTAPI
, shoudn't I?So why this
class
called BaseAPIModel?The text was updated successfully, but these errors were encountered: