Code

Switch backend to use llm-compressor#33

Code

Open

mgoin wants to merge 9 commits intomainneuralmagic/AutoFP8:mainfrom use-llm-compressorneuralmagic/AutoFP8:use-llm-compressorCopy head branch name to clipboard

+184-586

Commits

Commits on Jul 18, 2024

• Switch backend with llm-compressor

  mgoin

  committed
  e286fa9

  Copy full SHA for e286fa9

• Remove quantize

  mgoin

  committed
  6d508ae

  Copy full SHA for 6d508ae

• Fix test

  mgoin

  committed
  bbf352f

  Copy full SHA for bbf352f

• Add to requirements

  mgoin

  committed
  ab3dad3

  Copy full SHA for ab3dad3

• Update example

  mgoin

  committed
  be6eef2

  Copy full SHA for be6eef2

• Fix requirement

  mgoin

  committed
  b4f830d

  Copy full SHA for b4f830d

• Fix test

  mgoin

  committed
  af8f5a0

  Copy full SHA for af8f5a0

• Test

  mgoin

  committed
  3063398

  Copy full SHA for 3063398

Commits on Jul 19, 2024

• Add support for dynamic activation

  mgoin

  committed
  3f683f8

  Copy full SHA for 3f683f8