OCI Images for Open-Source Large Language Models (LLMs)

Catalog of multi-architecture OCI images for popular free and/or open-source Large Language Models, built and published weekly.

🦙 Ollama

Images are built weekly based on the latest version of Ollama and the specific models. They are published with three tags: latest, sha, and timestamp.

• ghcr.io/thomasvitale/ollama-bakllava
• ghcr.io/thomasvitale/ollama-llama2
• ghcr.io/thomasvitale/ollama-llama3
• ghcr.io/thomasvitale/ollama-llava
• ghcr.io/thomasvitale/ollama-mistral
• ghcr.io/thomasvitale/ollama-orca-mini
• ghcr.io/thomasvitale/ollama-phi
• ghcr.io/thomasvitale/ollama-phi3

🔐 Signatures and Attestations

All OCI images published in this project are signed with Sigstore.

Using the cosign CLI, you can display the supply chain security related artifacts for each image. Use the specific digest you'd like to verify.

cosign tree ghcr.io/thomasvitale/ollama-llama3

The result:

📦 Supply Chain Security Related artifacts for an image: ghcr.io/thomasvitale/ollama-llama3
└── 🔐 Signatures for an image tag: ghcr.io/thomasvitale/ollama-llama3:sha256-0d23dd91730d369befa3542bf44e2c1b86d9679b3d42f2fca0b206b028fe8f65.sig
   └── 🍒 sha256:e71beb9f6d24d788d77962d9b3bbc7740fa0c6d071f23bb926f10defa2c58cfa

You can verify the signature and its claims:

cosign verify \
   --certificate-identity-regexp https://github.com/ThomasVitale \
   --certificate-oidc-issuer https://token.actions.githubusercontent.com \
   ghcr.io/thomasvitale/ollama-llama3 | jq

You can also verify the SLSA attestation as follows:

gh attestation verify oci://ghcr.io/thomasvitale/ollama-llama3 -R ThomasVitale/llm-images

🌟 Examples

These images are used for running LLMs in development and testing using Testcontainers or Docker Compose. You can find examples of usage in Spring AI and LangChain4j.

🛡️  Security

The security process for reporting vulnerabilities is described in SECURITY.md.

🖊️  License

This project is licensed under the Apache License 2.0. See LICENSE for more information. Ollama is licensed under the MIT License. Each model is licensed individually. You can find more information in the Ollama model library.