ggerganov llama.cpp Show And Tell · Discussions · GitHub

Sort by: Latest activity

Categories

Community guidelines

Show and tell Discussions

Show off something you've made

Pinned to Show and tell

You must be logged in to vote

llama.cpp port to pure Golang

gotzmann started Apr 12, 2023 in Show and tell

3

Discussions

You must be logged in to vote

Tutorial: How to convert HuggingFace model to GGUF format

samos123 started Sep 1, 2023 in Show and tell

76
You must be logged in to vote

Performance of llama.cpp on Apple Silicon M-series
performance Speed related topics need feedback Testing and feedback with results are needed
ggerganov started Nov 22, 2023 in Show and tell

117
You must be logged in to vote

Performance of llama.cpp on Apple Silicon A-series

ggerganov started Dec 17, 2023 in Show and tell

33
You must be logged in to vote

Python GUI to interface with llama.cpp (based on llama-cpp-python) (Meltdown)

madprops started Mar 6, 2024 in Show and tell

0
You must be logged in to vote

Autoscaling Llama.cpp server clusters in GPU spot instances.

jboero started Apr 19, 2024 in Show and tell

6
You must be logged in to vote

Langchain chatbot with chroma vector storage memory

ossirytk started Nov 5, 2023 in Show and tell

9
You must be logged in to vote

How to use the gguf-split / Model sharding demo
split GGUF split model sharding
phymbert started Mar 31, 2024 in Show and tell

22
You must be logged in to vote

LLM inference in Delphi & making censored models uncensored and vice versa.

jarroddavis68 started Apr 15, 2024 in Show and tell

0
You must be logged in to vote

Blind testing different quants: initial results + I need your help!

Artefact2 started Mar 9, 2024 in Show and tell

29
You must be logged in to vote

Run LLMs FASTER on Intel Graphics (ARC etc.)

tarunmcom started Mar 31, 2024 in Show and tell

0
You must be logged in to vote

Performance difference between Ryzen 3700X and Ryzen 5950X

JohannesGaessler started Feb 8, 2024 in Show and tell

8
You must be logged in to vote

Simple API Wrapper

montecarlo26 started Mar 14, 2024 in Show and tell

2
You must be logged in to vote

iPad App

ocrickard started Apr 8, 2023 in Show and tell

13
You must be logged in to vote

Inference and embeddings directly on web browser with wasm

ngxson started Mar 14, 2024 in Show and tell

5
You must be logged in to vote

Presentation on llama.cpp on 22.02.24 at LIPS

JohannesGaessler started Feb 17, 2024 in Show and tell

5
You must be logged in to vote

Using llama.cpp with AWS instances

ggerganov started Nov 26, 2023 in Show and tell

21
You must be logged in to vote

Semantic Emoji Finder thanks to BERT support

astrowonk started Feb 28, 2024 in Show and tell

1
You must be logged in to vote

Running on an A100 node

ggerganov started Sep 27, 2023 in Show and tell

9
You must be logged in to vote

Performance 3x better when use performance core only on Intel gen 12th cpu

delock started Mar 28, 2023 in Show and tell

21
You must be logged in to vote

1bit+ quantizing idea

Swight1423 started Jan 28, 2024 in Show and tell

1
You must be logged in to vote

I made a PHP integration with llama.cpp server

mcharytoniuk started Jan 18, 2024 in Show and tell

0
You must be logged in to vote

Better quantized models for Mixtral-8x7b

ikawrakow started Jan 6, 2024 in Show and tell

6
You must be logged in to vote

Llama.cpp support in ModelFusion library (JS/TS)

lgrammel started Aug 4, 2023 in Show and tell

1
You must be logged in to vote

I made a janky-ish bash script that gives a LLM live access to a shell, calculator, notepad, time etc

skidd-level-100 started Jan 2, 2024 in Show and tell

2