Add chat-level setting for the maximum output tokens of a response #692
AlexVPopov
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hey @crmne, would you accept a PR for setting the max tokens with something like
with_max_output_tokens. Strictly speaking, this is an API parameter, but every major provider has this (under a different name):Would it make sense to abstract this?
Beta Was this translation helpful? Give feedback.
All reactions