support ollama num_ctx options #758
bb8boy
started this conversation in
Feature Requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Ollama's call uses Openai compatible API, because this API interface has a maximum context of 2K restrictions, resulting in abnormal use. You need to change to the use of Ollama's own API (non -compatible Openai) call. This interface supports the context size settings (num_ctx). You can also use the official Python library
ollama valid-parameters-and-values
Beta Was this translation helpful? Give feedback.
All reactions