Pinned

1. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++

2. llm.c llm.c Public

   Forked from karpathy/llm.c

   LLM training in simple, raw C/CUDA

   Cuda

3. RingAttention RingAttention Public

   Forked from lhao499/RingAttention

   Transformers with Arbitrarily Large Context

   Python

4. triton triton Public

   Forked from triton-lang/triton

   Development repository for the Triton language and compiler

   C++

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

   Python

6. Open-Sora Open-Sora Public

   Forked from hpcaitech/Open-Sora

   Open-Sora: Democratizing Efficient Video Production for All

   Python