%PDF-1.7 % 1 0 obj > endobj 2 0 obj > endobj 3 0 obj > stream <alt><li xml:lang="x-default">Why Do Some Inputs Break Low-Bit LLM Quantization?</li></alt>

  • Ting-Yun Chang
  • Muru Zhang
  • Jesse Thomason
  • Robin Jia
  • http://creativecommons.org/licenses/by-nc-nd/4.0/
  • cs.LG
  • cs.AI
  • endstream endobj 4 0 obj > endobj 5 0 obj > endobj 6 0 obj > endobj 7 0 obj > endobj 8 0 obj > endobj 9 0 obj > endobj 10 0 obj > endobj 11 0 obj > endobj 12 0 obj > endobj 13 0 obj > endobj 14 0 obj > endobj 15 0 obj > endobj 16 0 obj > endobj 17 0 obj > endobj 18 0 obj > endobj 19 0 obj > endobj 20 0 obj > endobj 21 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 241.866 296.034 288.712 307.785 ] /Subtype /Link /Type /Annot >> endobj 22 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 69.87 283.27 94.117 294.235 ] /Subtype /Link /Type /Annot >> endobj 23 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 99.512 283.27 164.17 294.235 ] /Subtype /Link /Type /Annot >> endobj 24 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 169.253 283.27 193.5 294.235 ] /Subtype /Link /Type /Annot >> endobj 25 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 198.894 283.27 258.612 294.235 ] /Subtype /Link /Type /Annot >> endobj 26 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 263.695 283.27 287.942 294.235 ] /Subtype /Link /Type /Annot >> endobj 27 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 69.87 268.936 97.392 280.686 ] /Subtype /Link /Type /Annot >> endobj 28 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 100.795 268.936 124.169 280.686 ] /Subtype /Link /Type /Annot >> endobj 29 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 110.478 201.19 170.499 212.94 ] /Subtype /Link /Type /Annot >> endobj 30 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 174.81 201.19 199.057 212.94 ] /Subtype /Link /Type /Annot >> endobj 31 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 203.68 201.19 259.384 212.94 ] /Subtype /Link /Type /Annot >> endobj 32 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 263.695 201.19 287.942 212.94 ] /Subtype /Link /Type /Annot >> endobj 33 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 69.87 187.64 114.456 199.391 ] /Subtype /Link /Type /Annot >> endobj 34 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 117.661 187.64 141.036 199.391 ] /Subtype /Link /Type /Annot >> endobj 35 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 144.54 187.64 185.719 199.391 ] /Subtype /Link /Type /Annot >> endobj 36 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 188.925 187.64 212.299 199.391 ] /Subtype /Link /Type /Annot >> endobj 37 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 163.24 133.853 216.875 145.194 ] /Subtype /Link /Type /Annot >> endobj 38 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 220.337 133.853 244.148 145.194 ] /Subtype /Link /Type /Annot >> endobj 39 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 124.455 119.894 239.267 131.645 ] /Subtype /Link /Type /Annot >> endobj 40 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 243.6 119.894 267.084 131.645 ] /Subtype /Link /Type /Annot >> endobj 41 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 152.45 92.796 210.65 104.547 ] /Subtype /Link /Type /Annot >> endobj 42 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 391.102 594.116 456.948 605.867 ] /Subtype /Link /Type /Annot >> endobj 43 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 460.401 594.116 484.19 605.867 ] /Subtype /Link /Type /Annot >> endobj 44 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 395.622 567.018 443.436 578.768 ] /Subtype /Link /Type /Annot >> endobj 45 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 446.947 567.018 471.129 578.768 ] /Subtype /Link /Type /Annot >> endobj 46 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 474.95 567.018 523.996 578.768 ] /Subtype /Link /Type /Annot >> endobj 47 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 305.146 553.878 329.393 565.219 ] /Subtype /Link /Type /Annot >> endobj 48 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 334.709 553.878 408.492 565.219 ] /Subtype /Link /Type /Annot >> endobj 49 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 413.497 553.878 437.744 565.219 ] /Subtype /Link /Type /Annot >> endobj 50 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 443.061 553.878 490.26 565.219 ] /Subtype /Link /Type /Annot >> endobj 51 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 495.266 553.878 519.513 565.219 ] /Subtype /Link /Type /Annot >> endobj 52 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 486.319 336.682 527.315 348.432 ] /Subtype /Link /Type /Annot >> endobj 53 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 308.396 323.132 332.076 334.883 ] /Subtype /Link /Type /Annot >> endobj 54 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 363.711 119.894 455.662 131.645 ] /Subtype /Link /Type /Annot >> endobj 55 0 obj > /Border [ 0 0 0 ] /C [ 0 1 0 ] /H /I /Rect [ 459.403 119.894 483.65 131.645 ] /Subtype /Link /Type /Annot >> endobj 56 0 obj > /BS > /NM (fitz-L0) /Rect [ 12 247.07501 32 594.815 ] /Subtype /Link >> endobj 57 0 obj > stream x+