面向 8×RTX 4090（SM89）的 DeepSeek-V4-Flash-0731 MXFP4 SGLang 实验分支
-
Updated
Nov 2, 2026 - Python
#
sm89
Here are 9 public repositories matching this topic...
4K video super-resolution on a 24 GB RTX 4090 — a free, local ComfyUI FlashVSR node (VIDEO in, VIDEO out) plus a Triton/FP8 operator pack at ~1.3×. No CUDA build, every number backed by benchmark JSONs.
pytorch triton cuda-kernels quantization 4k video-super-resolution inference-optimization fp8 comfyui video-upscaler wan21 rtx-4090 comfyui-custom-nodes flashvsr sm89
-
Updated
Sep 28, 2026 - Python
QSA HiSparse as an SGLang plugin: 256K CPU KV offload and text/image host prefix reuse for Qwen Sparse Attention on unmodified SGLang
qsa cpu-offload tensor-parallelism sparse-attention long-context fp8 gpu-inference llm-inference qwen sglang qwen3 rtx-4090 cuda-graphs sm89 256k-context hisparse rtx-4090-48gb 4090-48gb dual-rtx-4090 kv-cache-offloading
-
Updated
Oct 20, 2026 - Python
Run DeepSeek-V4-Flash with 1M-token context on pre-Hopper NVIDIA GPUs (sm_89) — a vLLM 0.26.0 overlay replacing all SM90+ DeepGEMM/FlashMLA operators with Triton/TileLang/Marlin kernels + CPU-KV-pool (pinned host memory via CUDA UVA).
-
Updated
Oct 23, 2026 - Python
Feeding the Tensor Cores: a dense FP16 GEMM for NVIDIA Ada (sm_89) at 96.5% of cuBLAS, and what it teaches about how each GPU generation handles async copy and Tensor Core issue.
-
Updated
Aug 3, 2026 - Cuda
RTX 4090 / Ada SM89-focused NInfer-all fork: CUDA 13.4 builds, device calibration, GGUF IQ3_S profiling, DFlash2/MTP tuning and reproducible benchmarks.
windows benchmarking cuda cuda-kernels mtp gpu-optimization ada-lovelace llm-inference gguf speculative-decoding rtx4090 qwen3 sm89 dflash2 ninfer iq3-s
-
Updated
Nov 2, 2026 - C++
SMO.H3 Studio 的 SelfLift Spark 运行环境分发仓库（SM89 / SM120 运行包与环境清单）
-
Updated
Oct 31, 2026 - PowerShell
Port NInfer, a single-GPU CUDA inference engine, to the NVIDIA L20 (Ada sm_89, 92 SMs, 48 GB): patch set, build tooling, and measured results
-
Updated
Sep 20, 2026 - PowerShell
Add this topic to your repo
To associate your repository with the sm89 topic, visit your repo's landing page and select "manage topics."