From ddd05f49f934448e3e6f8098b0724cebdbc9ff6a Mon Sep 17 00:00:00 2001 From: Michael Goin Date: Fri, 7 Jun 2024 18:06:54 -0400 Subject: [PATCH] Update README.md Co-authored-by: Tyler Michael Smith --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 38144a3..8b1b434 100644 --- a/README.md +++ b/README.md @@ -86,7 +86,7 @@ Each quantized layer in the state_dict will have: If the config has `"activation_scheme": "static"`: ``` model.layers.0.mlp.down_proj.weight < F8_E4M3 -model.layers.0.mlp.down_proj.input_scale < F32 +model.layers.0.mlp.down_proj.input_scale < F32 model.layers.0.mlp.down_proj.weight_scale < F32 ``` If config has `"activation_scheme": "dynamic"`: