#

llama-cpp-python

Here are 24 public repositories matching this topic...

biniou

Woolverine94 / biniou

a self-hosted webui for 30+ generative ai

Updated Jun 9, 2024
Python

ossirytk / llama-cpp-chat-memory

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

chatbot spacy ner llama-cpp langchain-python chromadb chainlit llama2 llama-cpp-python gguf

Updated Jun 8, 2024
Python

jasonacox / TinyLLM

Setup and run a local LLM and Chatbot using consumer grade hardware.

chatbot artificial-intelligence openai rag large-language-models llm vllm retrieval-augmented-generation llama-cpp-python

Updated Jun 8, 2024
JavaScript

KT313 / assistant_base

A custom framework for easy use of LLMs, VLMs, etc. supporting various modes and settings via web-ui

web-ui transformers inference torch agents vlm img2txt txt2txt llm llms llama-cpp llm-inference llama-cpp-python vlms

Updated Jun 9, 2024
Python

yueying-teng / generate-language-image-instruction-following-data

mistral multimodal-learning llm langchain llava vllm llama-cpp-python instruction-following-data

Updated Jun 5, 2024
Python

svjack / Genshin-Impact-RAG

A Genshin Impact Question Answer Project supported by Qwen1.5-14B-Chat

prompt embeddings llama embedding rag genshin-impact llm llama-cpp qwen llama-cpp-python gguf qwen1-5 qwen14b

Updated Jun 4, 2024
Python

svjack / Genshin-Impact-Character-Chat

Genshin Impact Character Chat Models tuned by Lora on LLM

game chatbot transformers roleplay webui gradio mistral roleplaying-game genshin-impact llm sharegpt llama-cpp vllm qwen llama-cpp-python qwen1-5

Updated Jun 3, 2024
Python

svjack / CodeActAgent-Gradio

UnOfficial Gradio Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.

Updated Jun 3, 2024
Jupyter Notebook

unixwzrd / oobabooga-macOS

Optimizing performance, building and installing packages required for oobabooga, AI and Data Science on Apple Silicon GPU. The goal is to optimize wherever possible, from the ground up.

macos journal numpy pytorch blas oobabooga llama-cpp-python

Updated Jun 2, 2024
Python

Renatoelho / llama-cpp-local

Llama.cpp é uma biblioteca desenvolvida em C++ para a implementação eficiente de grandes modelos de linguagem, como o LLaMA da Meta. Otimizada para rodar em diversas plataformas, incluindo dispositivos com recursos limitados, oferece performance, velocidade de inferência e uso eficiente da memória, essenciais para a execução de grandes. modelos

python shell-script ia llms llama2 llama-cpp-python llama3

Updated Jun 2, 2024
Python

SincoMao / RAG_Client

"Interact with your documents using the power of GPT, 100% privately, no data leaks" - This is a customized Windows RAG client based on Zylon's open source privateGPT.

rag huggingface-transformers llama-index llama-cpp-python

Updated May 31, 2024
Python

Aesthisia / LLMinator

Gradio based tool to run opensource LLM models directly from Huggingface

python streaming opensource cpu chatbot cuda openai gradio huggingface model-conversion websockets-chat llm safetensors langchain llamacpp llm-inference ollama llama-cpp-python gguf

Updated May 31, 2024
Python

erfanzar / AgentX

AgentX is an Open-source library that help people use LLMs on their own computers or help them to serve LLMs as easy as possible that support multi-backends like PyTorch, llama.cpp, Ollama and EasyDeL

nlp machine-learning jax llama-cpp ollama llama-cpp-python easydel

Updated May 24, 2024
Python

woheller69 / LLAMA_TK_CHAT

Simple chat interface for local AI using llama-cpp-python and llama-cpp-agent

gui llm-inference llama-cpp-python llama-cpp-agent

Updated May 21, 2024
Python

MagnusS0 / HuginnHears

Huginn Hears is a local app that transcribes and summarizes your meetings in Norwegian and English, using state-of-the-art models and open-source libraries. No cloud needed, run everything offline.

norwegian speech-to-text langchain llamacpp faster-whisper local-llm llama-cpp-python

Updated May 19, 2024
Python

noir55 / gguf_simple_webui

llama-cpp-python(llama.cpp)で実行するGGUF形式のLLM用の簡易Webインタフェースです。

webui llm llama-cpp-python gguf

Updated May 12, 2024
Python

nick-konovalchuk / christian-compass

This is a Christian Apologetic chatbot prototype.

rag weaviate streamlit sentence-transformers llama-cpp-python

Updated May 12, 2024
Python

darshpanchal / llm-server

Serving open source models of your choice in as a docker container using llama-cpp-python's OpenAI compatible server

server openai llm llama-cpp-python

Updated Apr 7, 2024
Dockerfile

BorjaOteroFerreira / IALab-Suite

Tool for test diferents large language models without code.

api-rest chat-application flask-api inference-api large-language-models llm local-inference llamacpp llm-inference llama2 llama-cpp-python llama2-7b mixtral-8x7b

Updated Mar 12, 2024
Python

abhie7 / MINed-Hacakthon

MINeD Hackathon 2024 - Project

ai langchain llama-cpp-python llama2-13b

Updated Mar 2, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the llama-cpp-python topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llama-cpp-python topic, visit your repo's landing page and select "manage topics."