(T3K) T3000 model perf tests #1425
tapspatelt3000-model-perf-tests.yaml
on: schedule
build-artifact-profiler
/
...
/
check-docker-images
8s
build-artifact
/
...
/
check-docker-images
9s
build-artifact-profiler
/
...
/
🐳️ Build image
0s
build-artifact-profiler
/
🛠️ Build Release ubuntu 20.04
3m 37s
Matrix: t3000-model-perf-tests / t3000-model-perf-tests
Annotations
7 errors, 25 warnings, and 17 notices
|
t3000-model-perf-tests / t3k CNN resnet50 model perf tests
Process completed with exit code 1.
|
|
t3000-model-perf-tests / t3k LLM falcon7b model perf tests
Process completed with exit code 1.
|
|
t3000-model-perf-tests / t3k LLM falcon7b model perf tests:
models/demos/falcon7b_common/tests/test_perf_falcon.py#L307
TestParametrized.test_perf_t3000_bare_metal[wormhole_b0-True-prefill_seq256-falcon_7b]
IndexError: unordered_map::at: key not found
|
|
t3000-model-perf-tests / t3k LLM falcon7b model perf tests:
models/demos/falcon7b_common/tests/test_perf_falcon.py#L307
TestParametrized.test_perf_t3000_bare_metal[wormhole_b0-True-prefill_seq256_async-falcon_7b]
IndexError: unordered_map::at: key not found
|
|
t3000-model-perf-tests / t3k LLM falcon7b model perf tests
Process completed with exit code 1.
|
|
t3000-model-perf-tests / t3k LLM mixtral model perf tests
Process completed with exit code 1.
|
|
t3000-model-perf-tests / t3k LLM mixtral model perf tests
Process completed with exit code 1.
|
|
hugepages-service-not-found-startup
Hugepages service not found. Using old rc.local method
|
|
t3000-model-perf-tests / t3k LLM falcon40b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon40b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon40b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon40b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon40b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon40b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon40b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon40b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon40b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon40b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k CNN resnet50 model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k CNN resnet50 model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k CNN resnet50 model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k CNN resnet50 model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k CNN resnet50 model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k CNN resnet50 model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k CNN resnet50 model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k CNN resnet50 model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon7b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon7b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon7b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon7b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon7b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
t3000-model-perf-tests / t3k LLM falcon7b model perf tests:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
disk-usage-after-startup
Disk usage is 52 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
hugepages-setup-success-startup
Hugepages is now setup.
|
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
TTMetal_build_any
|
185 MB |
|
|
TTMetal_build_any_profiler
|
190 MB |
|
|
packages-ubuntu-20.04-amd64-Release-x86_64-linux-clang-17-libcpp
|
89.3 MB |
|
|
packages-ubuntu-20.04-amd64-Release-x86_64-linux-clang-17-libcpp_profiler
|
89.4 MB |
|
|
perf-report-csv--wormhole_b0--bare-metal
|
2.33 KB |
|
|
perf-report-csv-CNN-wormhole_b0-resnet50-bare-metal
|
522 Bytes |
|
|
perf-report-csv-LLM-wormhole_b0-falcon40b-bare-metal
|
657 Bytes |
|
|
perf-report-csv-LLM-wormhole_b0-llama2-70b-bare-metal
|
410 Bytes |
|