Skip to content

Commit

Permalink
WIP quick ci test
Browse files Browse the repository at this point in the history
  • Loading branch information
tengomucho committed Sep 11, 2024
1 parent b25e973 commit ff1b371
Showing 1 changed file with 4 additions and 14 deletions.
18 changes: 4 additions & 14 deletions .github/workflows/test-pytorch-xla-tpu-tgi.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,7 @@ name: Optimum TPU / Test TGI on TPU

on:
push:
branches: [ main ]
paths:
- "text-generation-inference/**"
branches: [ quick-ci-test ]
pull_request:
branches: [ main ]
paths:
Expand All @@ -28,16 +26,8 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Build and test TGI server
- name: quick test
run: |
HF_TOKEN=${{ secrets.HF_TOKEN_OPTIMUM_TPU_CI }} make tgi_test
python -m pip install huggingface_hub
HF_TOKEN=${{ secrets.HF_TOKEN_OPTIMUM_TPU_CI }} python -c "from huggingface_hub import snapshot_download; snapshot_download(repo_id='google/gemma-2b', allow_patterns=['*.json','model*.safetensors'])"
# Use a different step to test the Jetstream Pytorch version, to avoid conflicts with torch-xla[tpu]
- name: Install and test TGI server (Jetstream Pytorch)
run: |
pip install -U .[jetstream-pt] \
-f https://storage.googleapis.com/jax-releases/jax_nightly_releases.html \
-f https://storage.googleapis.com/jax-releases/jaxlib_nightly_releases.html \
-f https://storage.googleapis.com/libtpu-releases/index.html
JETSTREAM_PT=1 HF_TOKEN=${{ secrets.HF_TOKEN_OPTIMUM_TPU_CI }} python -m \
pytest -sv text-generation-inference/tests -k jetstream

0 comments on commit ff1b371

Please sign in to comment.