pytorch
/

SmolLM3-3B-INT8-INT4

Text Generation

optimum-executorch

Model card Files Files and versions

metascroy commited on Jul 25, 2025

Commit

96711ff

·

verified ·

1 Parent(s): 3f61c4f

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -35,8 +35,8 @@ optimum-cli export executorch \
   --recipe xnnpack \
   --use_custom_sdpa \
   --use_custom_kv_cache \
-  --qlinear \
-  --qembedding \
   --output_dir ./smollm3_3b
 ```

   --recipe xnnpack \
   --use_custom_sdpa \
   --use_custom_kv_cache \
+  --qlinear 8da4w \
+  --qembedding 8w \
   --output_dir ./smollm3_3b
 ```