feat(server): add --idle-unload-ms and pre-load memory guard - #306

Merged

0xShug0 merged 7 commits into

0xShug0:mainfrom

gqf2008:feat/server-memory-guard

Aug 26, 2026

Commits on Aug 25, 2026

feat(server): add --idle-unload-ms to auto-unload idle models
gqf2008
committed
1f70f9a
feat(server): refuse model load when host/GPU memory is insufficient
gqf2008
committed
454f099
fix(server): address code review for idle unload and memory guard
gqf2008
committed
d345331
ci(server): add cross-platform build+test matrix for memory guard
gqf2008
committed
5a0c1c4
ci(server): fix macOS build step to not run the nproc variant
gqf2008
committed
8d9d677

Commits on Aug 26, 2026