What's the proper way to use ChatCompletion in stream mode? #464
Unanswered
DEAN-Cherry
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
According to the doc, it says you should use
CreateCompletionAsStreamto have streaming. However, there is a boolean property inChatCompletionCreateRequest. I got confused that what is the proper way to use stream mode. There are 4 kinds of combination to use it, likeCreateCompletion+Stream=trueandCreateCompletionAsStream+Stream=tureAnd I found that when uses
CreateCompletionAsStreambothDelta.ContentandMessage.Contentare available. What's the different? And which should be used in stream mode?support content
The definition of

ChatCompletionCreateRequestI also find this definition in

ChatChoiceResponse. So dose it mean we can use whateverDeltaorMessagein code?Beta Was this translation helpful? Give feedback.
All reactions