Popular repositories Loading

1. NHPKD NHPKD Public

   code will coming soon

   Python

2. test test Public

   Python

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. neural-compressor neural-compressor Public

   Forked from intel/neural-compressor

   SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

   Python

5. llm-compressor llm-compressor Public

   Forked from vllm-project/llm-compressor

   Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

   Python

6. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++