%PDF-1.7 % 1 0 obj > endobj 2 0 obj > endobj 3 0 obj > stream <alt><li xml:lang="x-default">LLMQ: Efficient Lower-Precision Pretraining for Consumer GPUs</li></alt>

  • Erik Schultheis
  • Dan Alistarh
  • http://arxiv.org/licenses/nonexclusive-distrib/1.0/
  • cs.DC
  • cs.LG
  • endstream endobj 4 0 obj > endobj 5 0 obj > endobj 6 0 obj > endobj 7 0 obj > endobj 8 0 obj > endobj 9 0 obj > endobj 10 0 obj > endobj 11 0 obj > endobj 12 0 obj > endobj 13 0 obj > endobj 14 0 obj > endobj 15 0 obj > endobj 16 0 obj > endobj 17 0 obj > endobj 18 0 obj > /Border [ 0 0 1 ] /C [ 0 1 1 ] /H /I /Rect [ 135.589 447.585 315.869 458.707 ] /Subtype /Link /Type /Annot >> endobj 19 0 obj > /Border [ 0 0 1 ] /C [ 1 0 0 ] /H /I /Rect [ 392.475 267.139 399.449 278.446 ] /Subtype /Link /Type /Annot >> endobj 20 0 obj > /BS > /NM (fitz-L0) /Rect [ 12 220.46997 32 571.53 ] /Subtype /Link >> endobj 21 0 obj > stream x+