exllama
Here are 14 public repositories matching this topic...
LLM telegram bot
-
Updated
Mar 19, 2024 - Python
A.L.I.C.E (Artificial Labile Intelligence Cybernated Existence). A REST API of A.I companion for creating more complex system
-
Updated
Dec 3, 2023 - Python
Run gguf LLM models in Latest Version TextGen-webui
-
Updated
May 9, 2024 - Jupyter Notebook
JavaScript WebSocket API for ExLlamav2
-
Updated
May 13, 2024 - JavaScript
A Python script designed to streamline the process of quantizing models to exllamav2 format
-
Updated
May 17, 2024 - Python
A constrained generation filter for local LLMs that makes them quote properly from a source document
-
Updated
May 14, 2024 - Python
Improve this page
Add a description, image, and links to the exllama topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the exllama topic, visit your repo's landing page and select "manage topics."