Support qwen phi gemma whisper

[neuropilot-captain]

Summary

1. Added AoT support for qwen2, qwen2.5, qwen3, gemma2, gemma3, phi3, phi4, whisper
2. Added runner support for qwen, gemma2, phi3

TODO

1. Add runner support for gemma3, phi4 and whisper.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14110

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 8 New Failures, 1 Cancelled Job, 3 Pending, 3 Unrelated Failures

As of commit a8ccdb6 with merge base 4d6209b ():

NEW FAILURES - The following jobs have failed:

• Build Windows Wheels / pytorch/executorch / build-wheel-py3_10-cpu (gh)
  RuntimeError: Failed to install QNN SDK. Please check the logs above.
• Build Windows Wheels / pytorch/executorch / upload / upload-wheel-py3_10-cpu (gh)
  Unable to download artifact(s): Artifact not found for name: pytorch_executorch__3.10_cpu_x64
• pull / test-llava-runner-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 35c1ad7b9a618e2184ed6fccbe20927fda43d77cc0e76e98084f7a6c33e71a32 /exec failed with exit code 139
• pull / test-moshi-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 5309ceaa488c28814d0d87ea5eaca335583508212c6421059a6d8241021e3cce /exec failed with exit code 1
• pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
  RuntimeError: Command docker exec -t c43fdcaac4202d5d995713c797f28629c330396660de90504c924d67d394e7e5 /exec failed with exit code 127
• pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
  RuntimeError: Command docker exec -t ac57a77d3acf854a5e725b6cdb3900c9fd00591bedc3b6463823a61b1f4fd5f8 /exec failed with exit code 127
• pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
  RuntimeError: Command docker exec -t 729bb2b988ea1c5efae1addf913e4dc44e9ee390fd29164b47cde9cdc0ef24f0 /exec failed with exit code 127
• pull / test-samsung-models-linux / linux-job (gh)
  RuntimeError: Command docker exec -t be7277fb72403b96f6beb05f558916c905a6b1112dd27c1301b6e8fc4fb2ab8c /exec failed with exit code 23

CANCELLED JOB - The following job was cancelled. Please retry:

• Lint / link-check / lint-xrefs / linux-job (gh)
  ##[error]The operation was canceled.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• pull / test-setup-linux-gcc / linux-job (gh) (similar failure)
  ##[error]The operation was canceled.

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / test-binary-size-linux-gcc / linux-job (gh) (trunk failure)
  ##[error]The operation was canceled.
• pull / test-openvino-linux / linux-job (gh) (trunk failure)
  ##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[cccclai]

Thanks! Can you fix the lint error?

[neuropilot-captain]

Hi could you please suggest how to deal with the lint-urls and lint-xrefs errors? For lint-urls the highlighted urls are example urls in the comment section, so should be ignorable. For lint-xrefs we are not sure what the error is. Thanks!

[cccclai]

Here is the patch

diff --git a/examples/mediatek/aot_utils/llm_utils/tokenizers_/tokenization_utils_base.py b/examples/mediatek/aot_utils/llm_utils/tokenizers_/tokenization_utils_base.py
index 14126e5bc4..f617887b13 100644
--- a/examples/mediatek/aot_utils/llm_utils/tokenizers_/tokenization_utils_base.py
+++ b/examples/mediatek/aot_utils/llm_utils/tokenizers_/tokenization_utils_base.py
@@ -1932,7 +1932,7 @@ class PreTrainedTokenizerBase(SpecialTokensMixin):
                 Will be removed in v5 of Transformers.
             proxies (`Dict[str, str]`, *optional*):
                 A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128',
-                'http://hostname': 'foo.bar:4012'}`. The proxies are used on each request.
+                'http://hostname': 'foo.bar:4012'}`. The proxies are used on each request. @lint-ignore
             token (`str` or *bool*, *optional*):
                 The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated
                 when running `huggingface-cli login` (stored in `~/.huggingface`).
diff --git a/examples/mediatek/aot_utils/llm_utils/tokenizers_/utils.py b/examples/mediatek/aot_utils/llm_utils/tokenizers_/utils.py
index 8a80d5d6f6..a137e2c982 100644
--- a/examples/mediatek/aot_utils/llm_utils/tokenizers_/utils.py
+++ b/examples/mediatek/aot_utils/llm_utils/tokenizers_/utils.py
@@ -392,7 +392,7 @@ def cached_file(
             Will be removed in v5 of Transformers.
         proxies (`Dict[str, str]`, *optional*):
             A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128',
-            'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request.
+            'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. @lint-ignore
         token (`str` or *bool*, *optional*):
             The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated
             when running `huggingface-cli login` (stored in `~/.huggingface`).

You can run ./scripts/lint_urls.sh inside executorch folder and repro the result