Skip to content

Commit

Permalink
feat: add deepseek-r1-8b
Browse files Browse the repository at this point in the history
  • Loading branch information
lgdd committed Jan 31, 2025
1 parent 4b829fc commit 37b9e7e
Show file tree
Hide file tree
Showing 2 changed files with 12 additions and 1 deletion.
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,8 @@

A Docker Compose to run a local ChatGPT-like application using [Ollama](https://github.com/ollama/ollama), [Open WebUI](https://github.com/open-webui/open-webui) & [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1).

> *Added [DeepSeek-R1-Distill-Llama-8B](https://ollama.com/library/deepseek-r1) to try out and compare.*
## Usage

Simply run:
Expand All @@ -17,6 +19,8 @@ The [ollama-models-pull](docker-compose.yml#L30-L36) service will trigger an API
{"status":"removing any unused layers"}
{"status":"success"}
```
> It will do the same for the distilled DeepSeek model.
> To verify the list of downloaded models, you can call Ollama on `http://localhost:11434/api/tags`.
The models are stored in a [volume](docker-compose.yml#L7-L8) to avoid downloading them at each restart of Ollama.
Expand Down
9 changes: 8 additions & 1 deletion docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -28,13 +28,20 @@ services:
- open_webui_data:/app/backend/data
extra_hosts:
- host.docker.internal:host-gateway
ollama-models-pull:
ollama-pull--mistral:
image: curlimages/curl:8.6.0
command: >-
http://ollama:11434/api/pull -d '{"name": "mistral"}'
depends_on:
ollama:
condition: service_healthy
ollama-pull--deepseek-r1-8b:
image: curlimages/curl:8.6.0
command: >-
http://ollama:11434/api/pull -d '{"name": "deepseek-r1:8b"}'
depends_on:
ollama:
condition: service_healthy
volumes:
ollama_data:
open_webui_data:

0 comments on commit 37b9e7e

Please sign in to comment.