[ROADMAP] 2026 Q4 #52

Overall Goal

1. Improve open-source project infrastructure
2. Fix existing bugs and stabilize service/API
3. Add quantifiable regression tests
4. Support new feature integration, such as KV cache, streaming inference, and distributed inference

🧠 New Model Integrations

• Cosmos3 @Uxito-Ada
• Mage
• TaoMate
• Wan-Animate-2
• RelayVSR

New Feature Support

• Chunk Batching @Kaimary
• Multi-instance KV cache with fp8 or fp4 quant @Uxito-Ada
• Disaggregated Inference
• Multi-instance server support
• improve sheduler and server with rust refactor

⚡ Performance & Kernels

• NVF4 for world model @Uxito-Ada
• NPU support [FEATURE] Run Wan2.2 pipelines on Ascend NPU #41