Skip to content

Commit

Permalink
Removed vllm dependency and updated readme
Browse files Browse the repository at this point in the history
  • Loading branch information
matthewcoole committed Oct 21, 2024
1 parent dbfb2bc commit 501df1a
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 2 deletions.
5 changes: 5 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,23 +3,28 @@ This repository contains a reproducible workflow setup using [DVC](https://dvc.o

## Requirements
- [Ollama](https://ollama.com/download) ([`llama3.1`](https://ollama.com/library/llama3.1) and [`mistral-nemo`](https://ollama.com/library/mistral-nemo) models)
- [Python 3.9+](https://www.python.org/downloads/)

## Getting started
### Setup
First create a new virtual environment and install the required dependencies:
```shell
python -m venv .venv
source .venv/bin/activate
pip install .
```
### Configuration
Next setup your local DVC configuration with your [Jasmin object store access key](https://help.jasmin.ac.uk/docs/short-term-project-storage/using-the-jasmin-object-store/#creating-an-access-key-and-secret):
```shell
dvc remote modify --local jasmin access_key_id '<ACCES_KEY_ID>'
dvc remote modify --local jasmin secret_access_key '<KEY_SECRET>'
```
### Getting the data
Pull the data from the object store using DVC:
```shell
dvc pull
```
### Working with the pipeline
You should now be ready to re-run the pipeline:
```shell
dvc repro
Expand Down
3 changes: 1 addition & 2 deletions pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,6 @@ dependencies = [
"kaleido",
"dvc",
"dvc[s3]",
"vllm",
"bitsandbytes",
"haystack-ai",
"accelerate",
Expand Down Expand Up @@ -37,4 +36,4 @@ jupyter = [
py-modules = []

[tool.mypy]
files = ["scripts"]
files = ["scripts"]

0 comments on commit 501df1a

Please sign in to comment.