Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
assistant: Use GPT 4 tokenizer for
o3-mini
(#24068)
Sorry to dump an unsolicited PR for a hot feature! I'm sure someone else was taking a look at this. I noticed that token counting was disabled and I was getting error logs of the form `[2025-01-31T22:59:01-05:00 ERROR assistant_context_editor] No tokenizer found for model o3-mini` when using the new model. To fix the issue, this PR registers the `gpt-4` tokenizer for this model. Release Notes: - openai: Fixed Assistant token counts for `o3-mini` models
- Loading branch information