Qualcomm AI Engine Direct - Enable more HF LLM Model

[winskuo-quic]

Summary

Enable more hf llm models that is also tested on Optimum-ExecuTorch.

Specs used: SM8750, QNN2.37, 16a8w, context_len=128

Model (--decoder_model)	Token/Sec	Use --enable_spinquant_r3?	Sample Prompt
llama3_2-1b	29	✅ Yes	"Simply put, the theory of relativity states that"
qwen2_5-0_5b	130	✅ Yes	"My favourite condiment is "
qwen3-0_6b	70	✅ Yes	"Give me a short introduction to large language model."
smollm2_135m	254	❌ No	"My favourite condiment is "
granite-3_3-2b	17	❌ No	"Take a current environmental issue and work backward to devise an innovative prevention strategy"

Sample Script
python examples/qualcomm/oss_scripts/hf_causal_lm.py --ptq 16a8w --prompt "My favourite condiment is " --soc_model SM8750 --device $DEVICE_ID --build_folder build-android/ --decoder_model qwen2_5-0_5b --enable_spinquant_r3

Test plan

python backends/qualcomm/tests/test_qnn_delegate.py TestExampleLLMScript.test_hf_causal_lm --device $DEVICE_ID --soc_model SM8750 --build_folder build-android --executorch_root . --artifact_dir ./hf_qwen

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/20587

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 2 Unrelated Failures, 1 Unclassified Failure

As of commit ecb473c with merge base 05b977d ():

NEW FAILURES - The following jobs have failed:

• pull / unittest / linux / linux-job (gh)
  RuntimeError: Command docker exec -t ced5de143e4abf9568b946e5243ac7d7bedc45cf32918804c2f3c169e491d24c /exec failed with exit code 1
• pull / unittest-editable / linux / linux-job (gh)
  RuntimeError: Command docker exec -t 462bc0beda045b377016b24792ed2d00b79acba9cc4f6603cb46fb9b8dae0179 /exec failed with exit code 1

UNCLASSIFIED FAILURE - DrCI could not classify the following job because the workflow did not run on the merge base. The failure may be pre-existing on trunk or introduced by this PR:

• pull / test-arm-backend-public-api-backward-compatibility / linux-job (gh) (this job did not run on the merge base, so DrCI cannot tell whether the failure is pre-existing)
  RuntimeError: Command docker exec -t bc6429cce2a6d3b8a6889a41d007300aeaab7ab2eb95dfe9fbde01606b50d810 /exec failed with exit code 127

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• pull / unittest / macos / macos-job (gh) (similar failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

BROKEN TRUNK - The following job failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / unittest-editable / macos / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[psiddh]

Looks like there is a linter issue