Skip to content

feat(rocm): fp8 KV cache prefill fast path via SharedK kernel - #2361

Open
ghazni101 wants to merge 2 commits into
mudler:mainfrom
ghazni101:row/fp8-prefill-fastpath
Open

feat(rocm): fp8 KV cache prefill fast path via SharedK kernel#2361
ghazni101 wants to merge 2 commits into
mudler:mainfrom
ghazni101:row/fp8-prefill-fastpath