Skip to content

Commit

Permalink
Set HF_HOME folder (#242)
Browse files Browse the repository at this point in the history
### Ticket
N/A

### Problem description
Loading models from Hugging face can be slow for large models, we want
to use shared volume to optimize loding HF models.

### What's changed
Added volume mount for docker containers
/mnt/dockercache:/mnt/dockercache
Set Huggingface cache folder HF_HOME=/mnt/dockercache/huggingface
With this HF models cache will be on a shared volume, used by
tt-forge-fe, tt-torch and tt-xla runners.

### Checklist
- [x] New/Existing tests provide coverage for changes
  • Loading branch information
vmilosevic authored Feb 7, 2025
1 parent 85a2bee commit 9ee5247
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions .github/workflows/build-and-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -165,6 +165,7 @@ jobs:
- /etc/udev/rules.d:/etc/udev/rules.d
- /lib/modules:/lib/modules
- /opt/tt_metal_infra/provisioning/provisioning_env:/opt/tt_metal_infra/provisioning/provisioning_env
- /mnt/dockercache:/mnt/dockercache

steps:
- uses: actions/checkout@v4
Expand Down Expand Up @@ -236,6 +237,8 @@ jobs:
cd ../..
- name: Run tests
env:
HF_HOME: /mnt/dockercache/huggingface
shell: bash
run: |
export LD_LIBRARY_PATH="/opt/ttmlir-toolchain/lib/:${{ steps.strings.outputs.install-output-dir }}/lib:${LD_LIBRARY_PATH}"
Expand Down

0 comments on commit 9ee5247

Please sign in to comment.