Skip to content

Commit

Permalink
Update config.md
Browse files Browse the repository at this point in the history
  • Loading branch information
iamarunbrahma authored Jan 24, 2025
1 parent 66a8c1d commit 48480ac
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/config.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,11 +7,11 @@ Pass these configuration settings to `ollama_config` parameter while initializin
| **Custom Configuration** | **Description** |
|:---------:|:-----------:|
| OLLAMA_NUM_PARALLEL | Number of parallel requests to Ollama server |
| OLLAMA_REQUEST_TIMEOUT | Timeout for requests to Ollama server (by default, it's set to 240.0) |
| OLLAMA_REQUEST_TIMEOUT | Timeout for requests to the Ollama server (by default, it's set to 240.0) |
| OLLAMA_NUM_GPU | Number of GPUs to use if available |
| OLLAMA_NUM_THREAD | Number of CPU threads to use |
| OLLAMA_KEEP_ALIVE | Keep-alive timeout for the Ollama server (by default, it's set to -1) |
| OLLAMA_HOST | Host URL for the Ollama server (by default, it's set to http://localhost:11434 |
| OLLAMA_HOST | Host URL for the Ollama server (by default, it's set to http://localhost:11434 ) |
| OLLAMA_GPU_LAYERS | Number of layers to use if GPU is available |


Expand Down

0 comments on commit 48480ac

Please sign in to comment.