Pinned

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 19.6k 2.6k

2. oobabooga/text-generation-webui oobabooga/text-generation-webui Public

   A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

   Python 37k 4.9k

3. llm-vscode-inference-server llm-vscode-inference-server Public

   An endpoint server for efficiently serving quantized open-source LLMs for code.

   Python 44 6

4. huggingface/llm-vscode huggingface/llm-vscode Public

   LLM powered development for VSCode

   TypeScript 1.1k 120