Pinned Loading

1. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 127k 22.8k

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 91k 21.7k

3. vllm-project/vllm-omni vllm-project/vllm-omni Public

   A framework for efficient model inference with omni-modality models

   Python 6.7k 1.6k

4. ollama/ollama ollama/ollama Public

   Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

   Go 180k 17.7k