Skip to content

A minimalist Docker project to get started with Node, llama-node and Express. Ready to be used in a Hugging Face Space.

License

Notifications You must be signed in to change notification settings

jbilcke-hf/template-node-llama-express

Repository files navigation

title emoji colorFrom colorTo sdk pinned app_port
Template Node Llama Express
🏗️
gray
blue
docker
false
7860

A minimalist Docker Space to help people getting started with Node, Express, node-llama and TypeScript

Installation

Prerequisites

Downloading the model

Building and run without Docker

You need to downloaded yourself airoboros-13b-gpt4.ggmlv3.q4_0.bin in the ./models/ folder. If you plan to change the model, then edit the modelPath in `/src/index.mts`` acconrdingly.

nvm use
npm i
npm run start

Then open the generator by passing a prompt in the query parameters:

http://localhost:7860?prompt=a webpage recipe for making chocolate chip cookies

Building and running with Docker

Note: the model will be downloaded by Docker, see the last lines in the Dockerfile.

npm run docker

This script is a shortcut executing the following commands:

docker build -t template-node-llama-express .
docker run -it -p 7860:7860 template-node-llama-express

About

A minimalist Docker project to get started with Node, llama-node and Express. Ready to be used in a Hugging Face Space.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published