Pass one NDM to backend init

[lucylq]

Stack from ghstack (oldest at bottom):

• -> Pass one NDM to backend init #10528
• Support named_data in flat_tensor #10527

Take external NDM if it exists, otherwise internal.

Note: by default, xnnpack uses the named_data_map. Constants are not stored with the delegated blob anymore.

Differential Revision: D73679710

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/10528

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 61 New Failures

As of commit 2c6d0f8 with merge base c5dd476 ():

NEW FAILURES - The following jobs have failed:

• Check Labels / Check labels (gh)
  RuntimeError: Error checking labels: PR does not have required labels
• pull / android / build-llm-demo / linux-job (gh)
  RuntimeError: Command docker exec -t 3abf643f2621090c082b982e2504d5a487f2f80b1710c3dd331069f124f59e25 /exec failed with exit code 132
• pull / test-custom-ops-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 0a70e3b83a94afe55bae81ea7752e362081165cc89fc98e296b83786635c1d6a /exec failed with exit code 132
• pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 2f057fc499ee9685395cab344f1b07be8daf6dc9e094f6fbd0d56c8c8b06e1db /exec failed with exit code 132
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 09ca5e1f3843fa589d8429e70167a7f1579f1790522fda675d4546b0f20c3a07 /exec failed with exit code 132
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
  RuntimeError: Command docker exec -t c3d2dd4ee4d92ed70f8b9b9653f2946d3a33eceeef47f0b26ddec002c8b0c094 /exec failed with exit code 139
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
  RuntimeError: Command docker exec -t cf1bb605272fd9a5017ee82fc1b2ac2e48919defdc38fa2c9c825b3293adaf4d /exec failed with exit code 132
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
  RuntimeError: Command docker exec -t 724dbf6ff6e18b926e8086fe6cd0f22d36e43c7bc255ff4c2d1423f545a8996c /exec failed with exit code 139
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t b87eca47c355d89de17fcdce084184f8d7e1dc396f9280968bd8cc1fd31fbdd9 /exec failed with exit code 132
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
  RuntimeError: Command docker exec -t 46ce430557f12180d6e5368598a365c45cb101f8081af49452ccc6fe0e700b2d /exec failed with exit code 139
• pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 185e046445a1ce4f989fe353340b7df5cb75e0d708aba53d7b229e2a6c3fad07 /exec failed with exit code 132
• pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t cef50af92902e358baa5e5721e1f315d059edf3e54955cd99e41a735ab964634 /exec failed with exit code 132
• pull / test-llava-runner-linux / linux-job (gh)
  RuntimeError: Command docker exec -t cb1c79f50210699999db1270ba8c4d17ab982d855bac2b29111c3cb9e9d47b95 /exec failed with exit code 132
• pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 982863baa83ed66a73f7886410e19374f9105da096e897222f66b4fd189d39f0 /exec failed with exit code 139
• pull / test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t dd85a9338859ee54ffbeea15456093cbefe8295a813c2d90e029b59545072cef /exec failed with exit code 132
• pull / test-models-linux (add, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 1f1c69b9685ccc57bd64d19206ef127bd95c13fcbfaffd92bd5520ac608e6913 /exec failed with exit code 139
• pull / test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t a6b0a4bb6700b7d20c12a29e68b71cc702b8f6d36ff407d18410edd1f32c0340 /exec failed with exit code 132
• pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 64fd2015d1e808071e2e22d51f5113b6b3fcfb51fc6a14b736e4d70801c00882 /exec failed with exit code 139
• pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t c5342d4dbca17ab54dcfa66c268a61cfc45b57a0c8ec1e7c6692e93b1017c85f /exec failed with exit code 132
• pull / test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 4970602ebdf4b5101bcc0b75d021d748c4c06956603ce8406621b8efb495b20a /exec failed with exit code 139
• pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 4dff82feca0ea40d25ec6df3a8b427bf0dc331dd55a75707f58c0edcbb1d9f6e /exec failed with exit code 132
• pull / test-models-linux (ic3, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 8f994c5271b47c815c186e44c1d72b99507a690e9481dd2e29960e59cf3d4183 /exec failed with exit code 139
• pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 84475e3b007ca1c0d555029aa60eb5b9bd8e8ef1ee100225a0e8b1b7e09fadd0 /exec failed with exit code 132
• pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 264bbb723f1218e8a45648a25e7c691f329b5512b00fe6feb2e4131975916a35 /exec failed with exit code 139
• pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 9254a99e0a2daaa7046b5e8ee502cb6e003811c755e1bf53fd8483347d186367 /exec failed with exit code 132
• pull / test-models-linux (linear, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t a83ad9faab977a86bed89f5e53c79aa3cfc950d639fa0649eceb4abd679730f3 /exec failed with exit code 139
• pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 9f064642ed338dc8819720479ca1a329a6dd83618703dea037df753c826e995b /exec failed with exit code 132
• pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t a32100f4e244f8b2a96b7b8b68888d629965e4e0e69996f36b56f32af12df3ee /exec failed with exit code 139
• pull / test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t d442e68c3d13975a20982ba63e4d6bb55ae1bf8835fcb7bc90961e64084cf0c9 /exec failed with exit code 139
• pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t f2c4483b8597ab24597d3c179174a8c62342fd2f02abfaaf0e9409407d53e92c /exec failed with exit code 132
• pull / test-models-linux (mv2, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t f30a08b2aa8bf3ece105c6659a5fbda72a081afd96fc3a25cbc629b4778f850a /exec failed with exit code 139
• pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 30e1de2915e3cf3c24a13ecda87eb661f0f2878b1df170a417f98633baa17cb7 /exec failed with exit code 132
• pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t dc2dcac5afc7c7655f6399dfe81c613fa940f770f4b9735ec990580624015d1b /exec failed with exit code 139
• pull / test-models-linux (resnet18, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 963b0e842f40a80ce0303231866d7536998c904040a409ea6ba42044d039ff22 /exec failed with exit code 139
• pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 4aa78799ff2590c2cab9c88a537fa8177f73e7e4a5625a79cf1b59ae2eefa928 /exec failed with exit code 132
• pull / test-models-linux (resnet50, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 10474d0787ccb8b9420d227373ef8acd54f54f7eb0f472f85b088db63feab7a3 /exec failed with exit code 139
• pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 44c49ea00cb949d679aa3a874d01779592b83ffe2c4b391f6e89501458e806b3 /exec failed with exit code 132
• pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 58c6801c08714fccbe8a17c9e167a5b1acca8e0bdfa0dd59d2b92c6465eac642 /exec failed with exit code 139
• pull / test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 3232b194ffceec2cdf312becabdeadcdd815580a7034efd881f097096db958a2 /exec failed with exit code 139
• pull / test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 27aacf4257fde1027ee218d1a5a759f174abe01a348cad6544e04ca2e0324cf1 /exec failed with exit code 139
• pull / test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
  RuntimeError: Command docker exec -t e6ab1783745dccafe0b6b50de2a8c5b7daf9cdc026b18cb34c718c060b7db8e8 /exec failed with exit code 139
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 3d480a6d573460efa9e84c8c731d96c5926c52cb7c5864366561df6b9b8da013 /exec failed with exit code 139
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t e13bd818b91e632bad505a62b944726929d6f15c55b8b3fcb16ec130fb77327a /exec failed with exit code 132
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  RuntimeError: Command docker exec -t ea75eb0fea075a81d4ca0c6c5430c94e423611b81c7d2584fb9b22f3f5989e23 /exec failed with exit code 139
• pull / test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 4f9e72d73ad1a781bb028df6160dfa0c1d5c8ee232a994006986abee6c4f0d92 /exec failed with exit code 139
• pull / test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 64867a96e3ac356b305f06041b429ebd79c8f1d7add65a5281b3a01c74883f00 /exec failed with exit code 139
• pull / test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
  RuntimeError: Command docker exec -t f8639af85f8d1e99734aaeb6e5eeeb02bd64efa7c24226f045053fb72bdbc154 /exec failed with exit code 139
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 21fce7cc7d0c8d00e26bb4fdf685e3340ca61a75c53c3c0b619800cc4e68de7f /exec failed with exit code 139
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t d86bd91dfd0fac388a9f3393e30d985ab8f0178841f23a6b93e7e756b4aa7274 /exec failed with exit code 132
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  RuntimeError: Command docker exec -t 2aa9713f56cab764edf1a45640ceeb4ac0f2d4a5ea2bc35d3837a02100b5f212 /exec failed with exit code 139
• pull / test-moshi-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 6b593180e879e6f3911a28b5a1fe4c7afb5dcc9334c091d31dc8c65e597979fa /exec failed with exit code 132
• pull / test-openvino-linux / linux-job (gh)
  RuntimeError: Command docker exec -t dd9fad4e15e2b064744cefa069b0f284d05752c7a5a8cfa5c197878226fd6300 /exec failed with exit code 139
• pull / test-phi-3-mini-runner-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 9696f4665633b58080757a1fe3050d54e085d28245a82ce8f8f0779bb03181c4 /exec failed with exit code 132
• pull / test-quantized-aot-lib-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 36a325ac5731280eff0497050486c08bfc5de070fce361614041db1bcba42ac0 /exec failed with exit code 132
• pull / test-selective-build-linux / linux-job (gh)
  RuntimeError: Command docker exec -t d3e048a448f81ca0c2177e58d61ea597109c8eb06993201ac62e64e0e02a417b /exec failed with exit code 132
• pull / test-setup-linux-gcc / linux-job (gh)
  RuntimeError: Command docker exec -t 00ed22e32839a3df4066d0e5436688370546ff9f275bd1b2d7dc1b22f9051d7d /exec failed with exit code 139
• pull / test-static-llama-qnn-linux / linux-job (gh)
  test_llama_stories_110m
• pull / unittest / linux / linux-job (gh)
  exir/tests/test_memory_format_ops_pass.py::TestMemoryFormatOpsPass::test_mobilenet_v3
• pull / unittest / macos / macos-job (gh)
  backends/xnnpack/test/ops/test_conv1d.py::TestConv1d::test_fp32_conv1d_batchnorm_seq
• pull / unittest-editable / linux / linux-job (gh)
  extension/llm/modules/test/test_attention.py::AttentionTest::test_attention_executorch
• pull / unittest-editable / macos / macos-job (gh)
  backends/xnnpack/test/ops/test_conv1d.py::TestConv1d::test_fp32_conv1d

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D73679710

[github-actions]

This PR needs a release notes: label

If your changes are user facing and intended to be a part of release notes, please use a label starting with release notes:.

If not, please add the topic: not user facing label.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "topic: not user facing"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D73679710

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D73679710

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D73679710

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D73679710