Skip to content

Async serving: ROUTER socket, predict thread and latest-wins request queue - #34

Open
khanhnd61-vr wants to merge 1 commit into
mainfrom
feat/async-inference
Open

Async serving: ROUTER socket, predict thread and latest-wins request queue#34
khanhnd61-vr wants to merge 1 commit into
mainfrom
feat/async-inference

Commits

  1. Commits on Oct 3, 2026