Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(client): support dynamic host URLs and upgrade ONNXRuntime #18

Merged
merged 4 commits into from
Nov 29, 2024

Conversation

CuriousDolphin
Copy link
Member

Update Focoos: support for str host URLs and ONNXRuntime dependency update
example:

from focoos import Focoos,PROD_API_URL, DEV_API_URL, LOCAL_API_URL
import os

focoos = Focoos(host_url=LOCAL_API_URL)

Description:
• Modified the client to accept any string as input for the host URL, allowing more flexible endpoint configuration.
• Upgraded onnxruntime to 1.20.1 which removes overhead caused by the warmup process, improving inference startup time.

Copy link

@CuriousDolphin CuriousDolphin changed the title feat(client): update onnxruntime and allow str host url feat(client): support dynamic host URLs and upgrade ONNXRuntime Nov 29, 2024
@CuriousDolphin CuriousDolphin merged commit 5e26911 into main Nov 29, 2024
1 check passed
@CuriousDolphin CuriousDolphin deleted the fix/more-flexible-host-url branch November 29, 2024 12:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant