Skip to content
Optimum TPU / Test TGI on TPU

Add static KV cache and test on Gemma-2B #19

Sign in to view logs

Add static KV cache and test on Gemma-2B

Add static KV cache and test on Gemma-2B #19

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Run TGI tests
4m 29s
Run TGI tests
4s
Run TGI tests
6m 24s
10m 57s