llama-cpp-python(llama.cpp)で実行するGGUF形式のLLM用の簡易Webインタフェースです。
-
Updated
May 12, 2024 - Python
llama-cpp-python(llama.cpp)で実行するGGUF形式のLLM用の簡易Webインタフェースです。
solo connector core built on ctransformers
Finetuning the Mistral7b on custom dataset
Convert & quantize HuggingFace models using llama.cpp on premises
A Genshin Impact Question Answer Project supported by Qwen1.5-14B-Chat
PowerShell automation to download large language models (LLMs) from Git repositories and quantize them with llama.cpp into the GGUF format.
Kaalaman AI is an open source web app that use GPT-Generated Unified Format (GGUF)
Everything you need to run RAG locally without OpenAI or any other paid services. Completely opensource techstack.
Add a description, image, and links to the gguf topic page so that developers can more easily learn about it.
To associate your repository with the gguf topic, visit your repo's landing page and select "manage topics."