[ET Device Support] Schema changes: device info on Tensor and buffer-level device array

[Gasoonjia]

Stack from ghstack (oldest at bottom):

• [ET Device Support] DeviceAllocator interface and DeviceAllocatorRegistry #17535
• [ET Device Support] TensorImpl carries device info #17534
• -> [ET Device Support] Schema changes: device info on Tensor and buffer-level device array #17533

This diff adds device placement information to the ExecuTorch schema to support representing tensor-level device type information, which will be the basic requirement for the following tensor_parser updates.

This is part of the Phase 1 implementation to make ET device type work E2E without user-specified device placement.

Design doc: https://docs.google.com/document/d/1lwd9BlohmwkN5EEvRulO_b-XnZBwv1nMb5l2K3jfuwA/edit?tab=t.0#heading=h.o6anuvkix4bu

Differential Revision: D93635657

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/17533

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 35 New Failures, 15 Unrelated Failures

As of commit 9584c1c with merge base fc3239c ():

NEW FAILURES - The following jobs have failed:

• pull / test-binary-size-linux-gcc / linux-job (gh)
  RuntimeError: Command docker exec -t 5070a0fd6abb094167726550b9c9d41e58e298dd9f316807ae9691c37346f659 /exec failed with exit code 1
• pull / test-parakeet-xnnpack-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 3d0433e18d497b488a3640a1f89c26961f8425bd0111e728008ab1fddd7dcdaf /exec failed with exit code 1
• pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
  RuntimeError: Command docker exec -t c39560edde1673392a378ecb0c42c9bdccda1c8001635ebe1b25959a49c4ed25 /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-deps (test_pytest_ops_tosa) / linux-job (gh)
  RuntimeError: Command docker exec -t 94b2b6c3897ba6c40095c61c31a1899723194cb4b2fa5289830690c7e57b4afe /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (google, gemma-3-4b-it, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t ae158fa4e9b4c6ddb55cf9b3f722683eeb09ba11d5d2bd24e85825bb51814c3c /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (google, gemma-3-4b-it, quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t 8fd77ff85d43c8e4a10b9fc576123a306470820d18f3607520010de2521eecba /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t df921bd00b0e6718bfb75820252e34d3d08d137ef31cb6364d6a67293503a9ed /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t 79cd2b6a4bfb891fe6eb8886c0db4a5a3f801a2143bbf3abacbf4b00c488af1a /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / linux-job (gh)
  RuntimeError: Command docker exec -t 27ab8f966a9ccbc620a8b58e4501f516d415aaea790ce46adb3fb7d0a38a860f /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (nvidia, parakeet-tdt, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t 76745b633a5c260c4eb6d41e55c7acab1d4d8d3f5d0bf73e9c50efddf46b9285 /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (nvidia, parakeet-tdt, quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t 69f74ae5f95992f66aa069fa2451245abc967dc44b9b78121a01a98f9e3d9004 /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (nvidia, parakeet-tdt, quantized-int4-weight-only) / linux-job (gh)
  RuntimeError: Command docker exec -t 83ad0ea694b7f41b88cf867b7413af9ca946408523dc20c5b507da969282b5f2 /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t 6566809658e75b2c377eb137beaa18b0707bbf2321632f0a31653f76264e9c42 /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t 1354cdcb896e0ddd7ffd83f6d28a79dbb3463d494e2adf2f537a1a2675e66f80 /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, quantized-int4-weight-only) / linux-job (gh)
  RuntimeError: Command docker exec -t a45c07b81d5759fd8cfc1aa8236784bf46677cc46a979bbc7ce67b5c292371c4 /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t 4423730e2472d64a630524b2dd6552b84a21098cf89816c92f2d70c769c82d33 /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t 284d18830423767d7e539be60752f7ca939ba753aefd6225a1980297cb3f552c /exec failed with exit code 1
• Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, quantized-int4-weight-only) / linux-job (gh)
  RuntimeError: Command docker exec -t a9051b4cfa9cbf0a58d43478d783c6c2dc0d5057db7a379c853c36015fb3953e /exec failed with exit code 1
• Test CUDA Builds / test-executorch-cuda-build-12.6 / linux-job (gh)
  RuntimeError: Command docker exec -t c65144a174ebbaa5774fc7bfa9aa6aa33abcf5417dfec9f2f1b1c874a8b6271f /exec failed with exit code 1
• Test CUDA Builds / test-executorch-cuda-build-12.8 / linux-job (gh)
  RuntimeError: Command docker exec -t 3975801e2c14f637fb4aa62eeb510d18335dcab554fef87c1e62a8ab421bcdd7 /exec failed with exit code 1
• Test CUDA Builds / test-executorch-cuda-build-12.9 / linux-job (gh)
  RuntimeError: Command docker exec -t 74d10a8851ee7af16b89f8f74406fbaa5bc87e727481ec942abefc9f4be1e23c /exec failed with exit code 1
• Test CUDA Builds / test-executorch-cuda-build-13.0 / linux-job (gh)
  RuntimeError: Command docker exec -t 40a44a4f7b7ab0e33fcce212ba1861fc5a43959deec5e158bdabdd509b00a521 /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (add_mul) / linux-job (gh)
  RuntimeError: Command docker exec -t 50a440754bd8c3caa20fa85a0420ec0757bb9928f68e9b7a771e63e87bac8a57 /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (add) / linux-job (gh)
  RuntimeError: Command docker exec -t d3458033399ff42f45c396fd8682a73d09da68768093473e403021e2cf44b77c /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (conv1d) / linux-job (gh)
  RuntimeError: Command docker exec -t b7e83380b94ce74a9eebf66f00cf744fac5fd6de67f49a82a97d4e8a271e756a /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (linear) / linux-job (gh)
  RuntimeError: Command docker exec -t 3315ecf488f20b942bb89cdedd4ad3eeaccc7b2c5ca1f50e22c8a262abef03da /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (mv2) / linux-job (gh)
  RuntimeError: Command docker exec -t 7cbcc085a059f88e7d46df1922ac01267f9594ffd027416d5ab1b861a49ad12c /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (mv3) / linux-job (gh)
  RuntimeError: Command docker exec -t 2c0b1504762185502ea936ea5834a53c5ece15bd79ac216dad5a95b1fe4060a7 /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (resnet18) / linux-job (gh)
  RuntimeError: Command docker exec -t d3e9c4ec4ea149ce9514780227c7bc570bb980b92ea82ba94eb61c00769b686c /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (sdpa) / linux-job (gh)
  RuntimeError: Command docker exec -t 0834def5b9c967d004127d1ebd733bfba21bf1c4496d5d4d3522710610436cb0 /exec failed with exit code 1
• Test CUDA Builds / unittest-cuda / linux-job (gh)
  RuntimeError: Command docker exec -t 60879ea6719ece31849296552dc4203a9a98a2eb86270a0bfb31b6ceb8ebe09b /exec failed with exit code 1
• Test CUDA Windows Export / export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-3B-2507, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t dfe8efd647eed072ea1af4223b8f61d0309dc662d2ebe3d650ad92b0000d2ef6 /exec failed with exit code 1
• Test CUDA Windows Export / export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / linux-job (gh)
  RuntimeError: Command docker exec -t a79858bfce5ee2fe404d9f3e55ab6645e4d553a007266cabe4a715ea6b7659b3 /exec failed with exit code 1
• Test CUDA Windows Export / export-model-cuda-windows-artifact (nvidia, parakeet-tdt, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t 541de43f54aa6a93cf71934f80a4cb4f444aa29988ec9eaa0b609a9330ed795f /exec failed with exit code 1
• Test CUDA Windows Export / export-model-cuda-windows-artifact (nvidia, parakeet-tdt, quantized-int4-weight-only) / linux-job (gh)
  RuntimeError: Command docker exec -t 3545772219fbf6b07f2a7f8131d1ef38ddd23e9c6dd06c366b294e155f27b60b /exec failed with exit code 1

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / test-coreml-bc-macos (macos-m1-stable) / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• pull / test-coreml-bc-macos (macos-m2-stable) / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• pull / unittest / windows / windows-job (gh) (trunk failure)
  Process completed with exit code 1.
• pull / unittest-editable / windows / windows-job (gh) (trunk failure)
  Process completed with exit code 1.
• Test CUDA Builds / check-all-cuda-builds (gh) (trunk failure)
  Process completed with exit code 1.
• Test Metal Backend / export-model-metal-artifact (mistralai, Voxtral-Mini-3B-2507, non-quantized) / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• Test Metal Backend / export-model-metal-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-metal) / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• Test Metal Backend / export-model-metal-artifact (nvidia, parakeet-tdt, non-quantized) / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• Test Metal Backend / export-model-metal-artifact (nvidia, parakeet-tdt, quantized-int4-metal) / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• Test Metal Backend / export-model-metal-artifact (openai, whisper-large-v3-turbo, non-quantized) / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• Test Metal Backend / export-model-metal-artifact (openai, whisper-large-v3-turbo, quantized-int4-metal) / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• Test Metal Backend / export-model-metal-artifact (openai, whisper-small, non-quantized) / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• Test Metal Backend / export-model-metal-artifact (openai, whisper-small, quantized-int4-metal) / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• Test Metal Backend / test-executorch-metal-build / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• Test Metal Backend / test-metal-backend-modules / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[lucylq]

nit: is it worth adding a 'DeviceInfo' dataclass/flatbuffers table if we may expect more device-related data?

[JacobSzwejbka]

Review automatically exported from Phabricator review in Meta.