Skip to content

server: Support logprobs with speculative decoding - #27196

Open
pnb wants to merge 3 commits into
ggml-org:masterfrom
pnb:spec_logprobs
Open

server: Support logprobs with speculative decoding#27196
pnb wants to merge 3 commits into
ggml-org:masterfrom
pnb:spec_logprobs