Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

configuration confusion and error on ws #1

Open
hksk opened this issue Jul 27, 2023 · 2 comments
Open

configuration confusion and error on ws #1

hksk opened this issue Jul 27, 2023 · 2 comments

Comments

@hksk
Copy link

hksk commented Jul 27, 2023

Hi guys, I just trying to run this and I got few errors:

  1. the docs here have a reference to config.json, but I only find a config.py
  2. after configure , the config.py and the extension. I got this error:
INFO:     ('192.168.0.54', 52286) - "WebSocket /ide/ws" 403
INFO:     connection failed (403 Forbidden)
INFO:     connection closed
INFO:     ('192.168.0.54', 52287) - "WebSocket /ide/ws" 403
INFO:     connection failed (403 Forbidden)
INFO:     connection closed
INFO:     ('192.168.0.54', 52288) - "WebSocket /ide/ws" 403
INFO:     connection failed (403 Forbidden)
INFO:     connection closed

btw im running the model:
python3 -m llama_cpp.server --model models/wizardLM-7B.ggmlv3.q4_0.bin --host 0.0.0.0

because the server are running in other computer.

thanks for your project, seems great!

@longyee
Copy link

longyee commented Jul 31, 2023

@hksk you probably connected to a wrong server. the settings in your continue vscode extension should be configured to use the continue server (which starts when your continue vscode extension starts), not ggml-server (llama_cpp.server). something like this:

continue vscose extension -> continue server (0.0.0.0:65432) -> ggml-server (localhost:8000)

(assume the continue server and ggml-server are in the same machine, if not, ggml-server need to start with 0.0.0.0:8000)

@sestinj
Copy link
Contributor

sestinj commented Aug 10, 2023

@longyee What you've said is correct, and @hksk sorry for not seeing this earlier. We had just changed up the config file format at the time, but you can now open up ~/.continue/config.py by typing the slash command '/config'. And then the updated instructions should all be available at https://continue.dev/docs/customization

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants