Skip to content

feat: optional startup tuning (STARTUP_MODE, CUDA_GRAPH_SIZES, QUANT, CACHE_DIR) - #19

Draft
planetf1 wants to merge 2 commits into
mainfrom
feat/startup-tuning-options
Draft

feat: optional startup tuning (STARTUP_MODE, CUDA_GRAPH_SIZES, QUANT, CACHE_DIR)#19
planetf1 wants to merge 2 commits into
mainfrom
feat/startup-tuning-options

fix: drop QUANT, both fp8 paths fail against granite-switch aLoRA ada…

8d3533f
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
build-and-install
succeeded Nov 10, 2026 in 22s