Code

Bump TGI version to v3.0.0#135

Code

Merged

tengomucho merged 6 commits intomainhuggingface/optimum-tpu:mainfrom update-tgi-3.0.0huggingface/optimum-tpu:update-tgi-3.0.0Copy head branch name to clipboardJan 6, 2025

+125-32

Commits

Commits on Dec 19, 2024

• chore(ci): remove TGI_VERSION argument from workflow

  Show description for 85b87f0
  tengomucho

  committed
  85b87f0

  Copy full SHA for 85b87f0

Commits on Dec 20, 2024

• feat(TGI): update to v3.0.0

  Show description for 5da1d12
  tengomucho

  committed
  5da1d12

  Copy full SHA for 5da1d12

• fix(tgi): add merge_lora kwarg to download_weights

  tengomucho

  committed
  b9e461b

  Copy full SHA for b9e461b

• fix(tgi): return the correct FinishReason on stop string

  tengomucho

  committed
  2d2f1fe

  Copy full SHA for 2d2f1fe

• fix(tgi): set max_batch_prefill_tokens

  Show description for cda63dd
  tengomucho

  committed
  cda63dd

  Copy full SHA for cda63dd

Commits on Jan 6, 2025

• review(docker): unset MAX_INPUT_LENGTH when set

  tengomucho

  committed
  21d5a1c

  Copy full SHA for 21d5a1c