Skip to content

Commit 8e9d1b0

Browse files
authoredJan 26, 2025··
Merge pull request #37 from dreadnode/docs/ads-add-timeout-to-automodel-loader
docs: timeout example for automodel loader
2 parents d897c17 + 9a28fe0 commit 8e9d1b0

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed
 

‎docs/loaders.md

+7
Original file line numberDiff line numberDiff line change
@@ -49,6 +49,13 @@ To perform tokenizer and model initialization without loading weights:
4949
dyana trace --model /path/to/model --low-memory
5050
```
5151

52+
To increase the execution timeout of the trace in seconds. [default: 60]
53+
> This is a common fix for errors related to `* timeout: timeout reached, killing container` for larger models.
54+
55+
```bash
56+
dyana trace --model /path/to/model --timeout 120
57+
```
58+
5259
![AutoModel Loader](assets/loader-automodel.png)
5360

5461
### LoRA

0 commit comments

Comments
 (0)
Please sign in to comment.