Skip to content

Commit

Permalink
chore: update mistral model
Browse files Browse the repository at this point in the history
  • Loading branch information
lgdd committed Feb 2, 2025
1 parent 37b9e7e commit 26ee598
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 7 deletions.
8 changes: 2 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
# ChatOllama

A Docker Compose to run a local ChatGPT-like application using [Ollama](https://github.com/ollama/ollama), [Open WebUI](https://github.com/open-webui/open-webui) & [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1).

> *Added [DeepSeek-R1-Distill-Llama-8B](https://ollama.com/library/deepseek-r1) to try out and compare.*
A Docker Compose to run a local ChatGPT-like application using [Ollama](https://github.com/ollama/ollama), [Open WebUI](https://github.com/open-webui/open-webui) with 2 models by default to try out: [Mistral NeMo](https://ollama.com/library/mistral-nemo) & [DeepSeek-R1-Distill-Llama-8B](https://ollama.com/library/deepseek-r1).

## Usage

Expand All @@ -11,16 +9,14 @@ Simply run:
```shell
docker compose up
```
The [ollama-models-pull](docker-compose.yml#L30-L36) service will trigger an API call to Ollama to pull the mistral model (~4GB) and shutdown when it's done. You should see the progress in the logs of that service which should end with:
The `ollama-pull--*` services will trigger an API call to Ollama to pull the associated models and shutdown when it's done. You should see the progress in the logs of that service which should end with:

```
{"status":"verifying sha256 digest"}
{"status":"writing manifest"}
{"status":"removing any unused layers"}
{"status":"success"}
```
> It will do the same for the distilled DeepSeek model.
> To verify the list of downloaded models, you can call Ollama on `http://localhost:11434/api/tags`.
The models are stored in a [volume](docker-compose.yml#L7-L8) to avoid downloading them at each restart of Ollama.
Expand Down
2 changes: 1 addition & 1 deletion docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ services:
ollama-pull--mistral:
image: curlimages/curl:8.6.0
command: >-
http://ollama:11434/api/pull -d '{"name": "mistral"}'
http://ollama:11434/api/pull -d '{"name": "mistral-nemo"}'
depends_on:
ollama:
condition: service_healthy
Expand Down

0 comments on commit 26ee598

Please sign in to comment.