Skip to content

Add layer-wise KV-cache AutoQuant with forward KL - #2211

Draft
meenchen wants to merge 8 commits into
mainfrom
agent/kv-cache-autoquant-pr
Draft

Add layer-wise KV-cache AutoQuant with forward KL#2211
meenchen wants to merge 8 commits into
mainfrom
agent/kv-cache-autoquant-pr

fix: validate KV-cache AutoQuant candidates

faa1f95
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 20, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO