Skip to content

fix: record and check model identity on serialized KV caches - #2302

Open
jeojdi1 wants to merge 2 commits into
MemTensor:mainfrom
jeojdi1:fix/kv-cache-carries-no-model-identity
Open

fix: record and check model identity on serialized KV caches#2302
jeojdi1 wants to merge 2 commits into
MemTensor:mainfrom
jeojdi1:fix/kv-cache-carries-no-model-identity

test: hoist pickle import to module level

56fe586
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs