JustLM

Super easy to use library for doing LLaMA/GPT-J/MPT stuff!

Overview

This library implements an easy to use interface to LLaMa, GPT-J and MPT, with optional Python bindings.

Context scrolling is automatic and supports a top window bar.

Additionally, "pooling" is implemented to support keeping x inference instances in RAM and automatically moving least recently used ones to disk, ready for retrieval.

Documentation

Literally, just read the 2 header files in include/! The interface couldn't be simpler.

Credits

Thanks to Georgi Gerganov (ggerganov) for having written ggml and llama.cpp C libraries, which are both extremely important parts of this project! Also thanks to Nomic AI for having heavily helped me drive this project forward.

Name		Name	Last commit message	Last commit date
Latest commit History 152 Commits
gptj		gptj
include		include
llama.cpp-alibi @ 03ceb39		llama.cpp-alibi @ 03ceb39
llama.cpp-mainline @ b9f4795		llama.cpp-mainline @ b9f4795
mpt		mpt
.gitignore		.gitignore
.gitmodules		.gitmodules
CMakeLists.txt		CMakeLists.txt
LICENSE		LICENSE
README.md		README.md
dlhandle.hpp		dlhandle.hpp
g4a_common.cpp		g4a_common.cpp
g4a_common.hpp		g4a_common.hpp
gptj.cpp		gptj.cpp
justlm.cpp		justlm.cpp
justlm_gptj.hpp		justlm_gptj.hpp
justlm_llama.hpp		justlm_llama.hpp
justlm_mpt.hpp		justlm_mpt.hpp
justlm_pool.cpp		justlm_pool.cpp
llama.cpp		llama.cpp
llama.cpp.cmake		llama.cpp.cmake
mpt.cpp		mpt.cpp
msvc_compat_unistd.h		msvc_compat_unistd.h
pybind.cpp		pybind.cpp

License

niansa/libjustlm

Folders and files

Latest commit

History

Repository files navigation

JustLM

Overview

Documentation

Credits

About

Topics

Resources

License

Stars

Watchers

Forks

Sponsor this project

Languages