Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 35.8k 8.8k

2. ovg-project/kvcached ovg-project/kvcached Public

   Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

   Python 1.4k 158

3. llm-arch-reviewer llm-arch-reviewer Public

   Interactive architecture diagrams for LLM inference, with profile data overlaid (DeepSeek-V4, ...)

   Python 1 1

4. ai-dynamo/dynamo ai-dynamo/dynamo Public

   A Datacenter Scale Distributed Inference Serving Framework

   Rust 8k 1.6k