We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 356de85 commit 5739b5bCopy full SHA for 5739b5b
docs/source/backends/llamacpp.md
@@ -83,7 +83,7 @@ docker run \
83
-e "HF_TOKEN=$HF_TOKEN" \
84
-v "$HOME/models:/app/models" \
85
tgi-llamacpp \
86
- --n-gpu-layers 99
+ --n-gpu-layers 99 \
87
--model-id "Qwen/Qwen2.5-3B-Instruct"
88
```
89
0 commit comments