%PDF-1.5 % 1 0 obj > endobj 2 0 obj > endobj 3 0 obj > stream <alt><li xml:lang="x-default">Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference</li></alt>

  • Yuan Feng
  • Junlin Lv
  • Yukun Cao
  • Xike Xie
  • S. Kevin Zhou
  • http://creativecommons.org/licenses/by/4.0/
  • cs.CL
  • cs.AI
  • endstream endobj 4 0 obj > endobj 5 0 obj > endobj 6 0 obj > endobj 7 0 obj > endobj 8 0 obj > endobj 9 0 obj > endobj 10 0 obj > endobj 11 0 obj > endobj 12 0 obj > endobj 13 0 obj > endobj 14 0 obj > endobj 15 0 obj > endobj 16 0 obj > endobj 17 0 obj > endobj 18 0 obj > endobj 19 0 obj > /Border [ 0 0 1 ] /C [ 0 1 1 ] /H /I /Rect [ 142.869 337.639 296.506 348.761 ] /Subtype /Link /Type /Annot >> endobj 20 0 obj > /Border [ 0 0 1 ] /C [ 0 1 0 ] /H /I /Rect [ 493.343 270.555 500.317 279.302 ] /Subtype /Link /Type /Annot >> endobj 21 0 obj > /Border [ 0 0 1 ] /C [ 0 1 0 ] /H /I /Rect [ 213.885 259.646 220.859 268.393 ] /Subtype /Link /Type /Annot >> endobj 22 0 obj > /Border [ 0 0 1 ] /C [ 0 1 0 ] /H /I /Rect [ 313.233 259.546 320.206 268.393 ] /Subtype /Link /Type /Annot >> endobj 23 0 obj > /Border [ 0 0 1 ] /C [ 0 1 0 ] /H /I /Rect [ 243.394 237.827 250.368 246.574 ] /Subtype /Link /Type /Annot >> endobj 24 0 obj > /Border [ 0 0 1 ] /C [ 0 1 0 ] /H /I /Rect [ 349.139 237.728 356.113 246.574 ] /Subtype /Link /Type /Annot >> endobj 25 0 obj > /Border [ 0 0 1 ] /C [ 0 1 0 ] /H /I /Rect [ 452.421 237.728 459.395 246.574 ] /Subtype /Link /Type /Annot >> endobj 26 0 obj > /BS > /NM (fitz-L0) /Rect [ 12 223.23999 32 568.76 ] /Subtype /Link >> endobj 27 0 obj > stream x+