Popular repositories Loading

1. llama-balancer llama-balancer Public

   simple implements llama.cpp/llama-server load balancer

   Python 3

2. ggml ggml Public

   Forked from ggml-org/ggml

   Tensor library for machine learning

   C++

3. llama-swap llama-swap Public

   Forked from mostlygeek/llama-swap

   Model swapping for llama.cpp (or any local OpenAI API compatible server)

   Go

4. portable-cmd portable-cmd Public

   portable-cmd.bat is a Windows batch file that automatically downloads and sets up portable development tools. Git and uv are enabled by default (Python is managed with uv add, not pip; uv sync runs…

   Batchfile

5. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++