Feature Request: Support prefill for Claude #543
nissa-seru
started this conversation in
Feature Requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Prefill enables pre-population of the first part of the model's input, such that the model will continue responding as if it wrote the prefilled content. This enables chain-of-thought and other techniques to be used with very high compliance. For example, providing a psuedo-XML schema such as:
and prefilling with:
works extremely well and is considerably more compact than most chain-of-thought prompting techniques.
Beta Was this translation helpful? Give feedback.
All reactions