Inference speed
#437
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
Hi, I was able to run the CogAgent demo on an A100. Each inference takes about 40 seconds. The same input/output would take about 5 seconds on your demo site. Could you share what machine spec you have to run the demo site?
Beta Was this translation helpful? Give feedback.
All reactions