Code

Pipelines#9

Code

Merged

matthewcoole merged 31 commits intomainNERC-CEH/llm-eval:mainfrom pipelinesNERC-CEH/llm-eval:pipelinesCopy head branch name to clipboardOct 29, 2024

+1,138-94

Commits

Commits on Oct 9, 2024

• Set up basic dvc pipeline

  matthewcoole

  committed
  9e94347

  Copy full SHA for 9e94347

• Removed hf token

  matthewcoole

  committed
  3bfa70a

  Copy full SHA for 3bfa70a

Commits on Oct 10, 2024

• Added dvc lock file

  matthewcoole

  committed
  0907700

  Copy full SHA for 0907700

• Changed embedding json name

  matthewcoole

  committed
  7d89512

  Copy full SHA for 7d89512

Commits on Oct 11, 2024

• Cleaned pipeline

  matthewcoole

  committed
  2e99516

  Copy full SHA for 2e99516

• Resolved merge conflicts

  matthewcoole

  committed
  4e11bd5

  Copy full SHA for 4e11bd5

• Cleaned scripts and added additional metadata field

  matthewcoole

  committed
  739f8fc

  Copy full SHA for 739f8fc

• Removed modules from project file

  matthewcoole

  committed
  8148da1

  Copy full SHA for 8148da1

• Fixed bug so all metadata fields are extracted

  matthewcoole

  committed
  2ec86cd

  Copy full SHA for 2ec86cd

• Added chunking to dvc pipeline

  matthewcoole

  committed
  24cad77

  Copy full SHA for 24cad77

Commits on Oct 15, 2024

• Added pipeline step for embeddings and parameter options

  matthewcoole

  committed
  4071052

  Copy full SHA for 4071052

Commits on Oct 16, 2024

• Added chroma upload to pipeline

  matthewcoole

  committed
  ec183d3

  Copy full SHA for ec183d3

• Added script for running rag pipeline on eval datasets

  matthewcoole

  committed
  aaa3a93

  Copy full SHA for aaa3a93

Commits on Oct 17, 2024

• Added dummy steps to pipeline

  matthewcoole

  committed
  f9b9b3e

  Copy full SHA for f9b9b3e

• Added evaluation script to pipeline

  matthewcoole

  committed
  419e83f

  Copy full SHA for 419e83f

• Updated readme

  matthewcoole

  committed
  d119b00

  Copy full SHA for d119b00

• Added metrics file to dvc config

  matthewcoole

  committed
  ccd4e3c

  Copy full SHA for ccd4e3c

Commits on Oct 18, 2024

• Added ruff, mypy and cleaned scripts

  matthewcoole

  committed
  4f7ab43

  Copy full SHA for 4f7ab43

• Added script to download supporting docs

  matthewcoole

  committed
  9705b61

  Copy full SHA for 9705b61

• Reformatted code with ruff

  matthewcoole

  committed
  68e17ac

  Copy full SHA for 68e17ac

• Caught exception when supporitng docs not available

  matthewcoole

  committed
  be38526

  Copy full SHA for be38526

Commits on Oct 21, 2024

• Testing dag diagram in mermaid format

  matthewcoole

  committed
  e9b504f

  Copy full SHA for e9b504f

• Updated readme /w mermaid format dag

  matthewcoole

  committed
  dbfb2bc

  Copy full SHA for dbfb2bc

• Removed vllm dependency and updated readme

  matthewcoole

  committed
  501df1a

  Copy full SHA for 501df1a

Commits on Oct 25, 2024

• Froze dependencies to try and fix gh action

  matthewcoole

  committed
  731544a

  Copy full SHA for 731544a

• Merged readme changes

  matthewcoole

  committed
  9944b4f

  Copy full SHA for 9944b4f

• Fixed gh actions pipeline

  matthewcoole

  committed
  6846999

  Copy full SHA for 6846999

• re-added ruff

  matthewcoole

  committed
  6a2f0b4

  Copy full SHA for 6a2f0b4

• red-added pymodule setup

  matthewcoole

  committed
  aa29224

  Copy full SHA for aa29224

• Update pyproject.toml

  matthewcoole

  authored
  5d04301

  Copy full SHA for 5d04301

Commits on Oct 29, 2024

• Merge from main

  matthewcoole

  committed
  25962c6

  Copy full SHA for 25962c6