File tree Expand file tree Collapse file tree 2 files changed +4
-1
lines changed Expand file tree Collapse file tree 2 files changed +4
-1
lines changed Original file line number Diff line number Diff line change 1313 "use_hf_rope" : true ,
1414 "attention_qkv_bias" : false ,
1515 "use_qk_norm" : true ,
16- "qk_norm_before_repo " : true
16+ "qk_norm_before_rope " : true
1717}
Original file line number Diff line number Diff line change @@ -25,6 +25,7 @@ python -m examples.models.llama.export_llama \
2525 -X \
2626 --xnnpack-extended-ops \
2727 -qmode 8da4w \
28+ --metadata '{"get_bos_id": 151644, "get_eos_ids":[151645]}' \
2829 --output_name="qwen3-0_6b.pte" \
2930 --verbose
3031```
@@ -40,6 +41,7 @@ python -m examples.models.llama.export_llama \
4041 -X \
4142 --xnnpack-extended-ops \
4243 -qmode 8da4w \
44+ --metadata '{"get_bos_id": 151644, "get_eos_ids":[151645]}' \
4345 --output_name="qwen3-1_7b.pte" \
4446 --verbose
4547```
@@ -55,6 +57,7 @@ python -m examples.models.llama.export_llama \
5557 -X \
5658 --xnnpack-extended-ops \
5759 -qmode 8da4w \
60+ --metadata '{"get_bos_id": 151644, "get_eos_ids":[151645]}' \
5861 --output_name="qwen3-4b.pte" \
5962 --verbose
6063```
You can’t perform that action at this time.
0 commit comments