Code

[ Examples ] E2E Examples#5

Code

Merged

robertgshaw2-redhat merged 30 commits intomainvllm-project/llm-compressor:mainfrom rs/examplesvllm-project/llm-compressor:rs/examplesCopy head branch name to clipboardJul 2, 2024

+733-501

Commits

Commits on Jun 24, 2024

• added examples

  robertgshaw2-redhat

  committed
  a8c3ad8

  Copy full SHA for a8c3ad8

• updated examples

  robertgshaw2-redhat

  committed
  539d31a

  Copy full SHA for 539d31a

• set to 32 samples for testing

  robertgshaw2-redhat

  committed
  6f298a7

  Copy full SHA for 6f298a7

Commits on Jun 25, 2024

• fix

  robertgshaw2-redhat

  committed
  cfc1ec0

  Copy full SHA for cfc1ec0

• Update llama7b_quantize_sparse_cnn.py

  robertgshaw2-redhat

  authored
  82e8910

  Copy full SHA for 82e8910

• Merge branch 'main' into rs/examples

  robertgshaw2-redhat

  committed
  62f8011

  Copy full SHA for 62f8011

• tweak W8A8

  robertgshaw2-redhat

  committed
  af0be23

  Copy full SHA for af0be23

Commits on Jun 26, 2024

• firx w4a16

  robertgshaw2-redhat

  committed
  931c504

  Copy full SHA for 931c504

Commits on Jun 27, 2024

• added example

  robertgshaw2-redhat

  committed
  e12b65e

  Copy full SHA for e12b65e

• tweak fp8 example

  

  Robert Shaw

  committed
  982e3ee

  Copy full SHA for 982e3ee

• remove changes

  

  Robert Shaw

  committed
  5971dce

  Copy full SHA for 5971dce

• fix

  

  Robert Shaw

  committed
  438b01e

  Copy full SHA for 438b01e

• update examples to use tokenized data

  

  Robert Shaw

  committed
  8822f3c

  Copy full SHA for 8822f3c

• save

  

  Robert Shaw

  committed
  a6bcb90

  Copy full SHA for a6bcb90

Commits on Jul 2, 2024

• Merge branch 'main' into rs/examples

  robertgshaw2-redhat

  committed
  466cdb6

  Copy full SHA for 466cdb6

• fp8 example end to end

  robertgshaw2-redhat

  committed
  f430e43

  Copy full SHA for f430e43

• tweak README

  robertgshaw2-redhat

  committed
  b0eaf12

  Copy full SHA for b0eaf12

• rename title

  robertgshaw2-redhat

  committed
  a020ebe

  Copy full SHA for a020ebe

• update title

  robertgshaw2-redhat

  committed
  7c58ff4

  Copy full SHA for 7c58ff4

• finished example

  robertgshaw2-redhat

  committed
  556eca2

  Copy full SHA for 556eca2

• refactored directory structure

  robertgshaw2-redhat

  committed
  39f2ef0

  Copy full SHA for 39f2ef0

• nits

  robertgshaw2-redhat

  committed
  284a0f0

  Copy full SHA for 284a0f0

• restructure w4a16

  robertgshaw2-redhat

  committed
  2da06f9

  Copy full SHA for 2da06f9

• fixed w4a16

  robertgshaw2-redhat

  committed
  367fb0f

  Copy full SHA for 367fb0f

• added w8a8-int8 example

  robertgshaw2-redhat

  committed
  956e1a4

  Copy full SHA for 956e1a4

• finalized example

  robertgshaw2-redhat

  committed
  5911c45

  Copy full SHA for 5911c45

• added back example

  robertgshaw2-redhat

  committed
  3d4d03b

  Copy full SHA for 3d4d03b

• stash

  robertgshaw2-redhat

  committed
  d600009

  Copy full SHA for d600009

• format

  robertgshaw2-redhat

  committed
  708f288

  Copy full SHA for 708f288

• Update examples/quantization_w4a16/README.md

  Show description for 59ea79e
  

  robertgshaw2-redhat

  and

  mgoin

  authored
  59ea79e

  Copy full SHA for 59ea79e