Skip to content

Async serving: ROUTER socket, predict thread and latest-wins request queue - #34

Open
khanhnd61-vr wants to merge 1 commit into
mainfrom
feat/async-inference
Open

Async serving: ROUTER socket, predict thread and latest-wins request queue#34
khanhnd61-vr wants to merge 1 commit into
mainfrom
feat/async-inference

feat(server): async serving with a ROUTER socket, predict thread and …

42b7ed8
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
py-tooling
succeeded Oct 3, 2026 in 6s