Export LLMs with Optimum docs

[jackzhxng]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15062

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 11 New Failures, 1 Unrelated Failure

As of commit b0a0276 with merge base 5246168 ():

NEW FAILURES - The following jobs have failed:

• pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
  RuntimeError: Command docker exec -t b28cb2a84bfd7de058b6345d7b996a14e495dc961fac91d3205b4729a19d274b /exec failed with exit code 1
• pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
  RuntimeError: Command docker exec -t adac4ddb3762bd99b12e965dced79e77b09b67fc01e8ff05610bac46aaa99e5d /exec failed with exit code 1
• pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
  RuntimeError: Command docker exec -t 8115d487d6439f4835d0173ae6f15b4c3905962c4b8621c8352631e78c025332 /exec failed with exit code 1
• pull / test-samsung-models-linux / linux-job (gh)
  RuntimeError: Command docker exec -t aec960f18abae0718833c4f0d5f70ca00ac46a5eaae6e08ef09af0591f7ed946 /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
  RuntimeError: Command docker exec -t 85372d8a6b3910e1c324b7f4044120824c7399c2507e7fe3c8f3e7a21149bea2 /exec failed with exit code 1
• Test CUDA Builds / export-voxtral-cuda-artifact / linux-job (gh)
  RuntimeError: Command docker exec -t cf69867aba7ae2511cfa860c53b52d7fd98f0a5d8ef8abe9829a1cd94e4cb4e5 /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (add_mul) / linux-job (gh)
  RuntimeError: Command docker exec -t 188b48e283c2f73f990097392e5f4093a5727576fd501c2bcdc2c16bd0494272 /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (add) / linux-job (gh)
  RuntimeError: Command docker exec -t a0eaaf2c89657fd204f2b638089acbeacaafd7273d6d0150ed245d95ef64b46f /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (conv1d) / linux-job (gh)
  RuntimeError: Model conv1d is not a valid name. Available models are ['mul', 'linear', 'add', 'add_mul', 'softmax', 'dl3', 'edsr', 'emformer_transcribe', 'emformer_predict', 'emformer_join', 'llama2', 'llama', 'llama3_2_vision_encoder', 'lstm', 'mobilebert', 'mv2', 'mv2_untrained', 'mv3', 'vit', 'w2l', 'ic3', 'ic4', 'resnet18', 'resnet50', 'llava', 'efficient_sam', 'qwen2_5_1_5b', 'phi_4_mini', 'smollm2'].
• Test CUDA Builds / test-models-cuda (linear) / linux-job (gh)
  RuntimeError: Command docker exec -t 9fcb1c59facdf73ac7cf8198eae659627ffa7fe448f784ff37923117d6043225 /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (resnet18) / linux-job (gh)
  RuntimeError: Command docker exec -t aaf0cf22399c57b9a0fa9624f537f5ea41ddf6e8866124004333a6b95eefec06 /exec failed with exit code 1

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[larryliu0820]

Please add here or somewhere obvious that optimum-executorch is undergoing active development so proceed with caution.

[jackzhxng]

I thinks it is stable enough to not need to add this, additionally I don't see what the benefit of saying this is

[larryliu0820]

Voxtral?

[larryliu0820]

Also would be good to mention export_llm supports different backends other than xnnpack.

[jackzhxng]

Both have limited non-cpu support atm though

[larryliu0820]

@kimishpatel can you take a look?

[mergennachin]

I don't like that it re-installs executorch torch and torchao

Can we provide an option to build with no-isolation mode>

[jackzhxng]

Will make separate PR

[mergennachin]

I think you can do .html

[jackzhxng]

Wdym?