Skip to content

Commit 4071ae1

Browse files
committed
Revert "Linux nvidia GPU option"
This reverts commit 76f0318.
1 parent 76f0318 commit 4071ae1

1 file changed

Lines changed: 0 additions & 13 deletions

File tree

readme.md

Lines changed: 0 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -38,19 +38,6 @@ No need to install Ollama manually, it will run in a container as
3838
part of the stack when running with the Linux profile: run `docker compose --profile linux up`.
3939
Make sure to set the `OLLAMA_BASE_URL=http://llm:11434` in the `.env` file when using Ollama docker container.
4040

41-
If run into issues that your Nvidia GPU is not used under Linux (despite using the profile), ensure that you have `nvidia-container-toolkit` installed.
42-
And add this to the `llm` service.
43-
44-
```yaml
45-
deploy:
46-
resources:
47-
reservations:
48-
devices:
49-
- driver: nvidia
50-
count: all
51-
capabilities: [gpu]
52-
```
53-
5441
**Windows**
5542
Not supported by Ollama, so Windows users need to generate a OpenAI API key and configure the stack to use `gpt-3.5` or `gpt-4` in the `.env` file.
5643
# Develop

0 commit comments

Comments
 (0)