Skip to content

Arm backend: Add SmolLM2-135M to CI model testing #14722

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Oct 17, 2025
Merged

Arm backend: Add SmolLM2-135M to CI model testing #14722

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
73833af
Arm backend: Add SmolLM2-135M to CI model testing
Sebastian-Larsson Sep 30, 2025
cb4cdc5
Merge branch 'main' into smollm2
Sebastian-Larsson Oct 13, 2025
91ef893
Merge branch 'main' into smollm2
zingo Oct 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflows/trunk.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -290,6 +290,7 @@ jobs:
- test_arm_baremetal: test_models_ethos-u85
- test_arm_baremetal: test_smaller_stories_llama
- test_arm_baremetal: test_memory_allocation
- test_arm_baremetal: test_model_smollm2-135M
fail-fast: false
with:
runner: linux.2xlarge.memory
Expand Down
13 changes: 13 additions & 0 deletions backends/arm/test/test_arm_baremetal.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -340,6 +340,19 @@ test_full_vkml() { # All End to End model tests
echo "${TEST_SUITE_NAME}: PASS"
}

test_model_smollm2-135M() {
echo "${TEST_SUITE_NAME}: Test SmolLM2-135M on Ethos-U85"

# Build common libs once
python3 backends/arm/test/test_model.py --test_output=arm_test/test_model --build_libs

python3 backends/arm/test/test_model.py --test_output=arm_test/test_model --target=ethos-u85-128 --model=smollm2 --extra_flags="-DEXECUTORCH_SELECT_OPS_LIST=dim_order_ops::_to_dim_order_copy.out"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

curious why do we need dim_order_copy (i.e. why do we have a graph break)..

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did you guys run it on a real hardware? what's the TPS looks like?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No this was not run on real hardware.


echo "${TEST_SUITE_NAME}: PASS"


}

test_smaller_stories_llama() {
echo "${TEST_SUITE_NAME}: Test smaller_stories_llama"

Expand Down
Loading