You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Need to add support for streaming. You can specify streamlining as a parameter in the ChatRequest class, and it is defined as:
// Default: false
// Whether to stream back partial progress. If set, tokens will be sent as data-only server-sent events
// as they become available, with the stream terminated by a data: [DONE] message. Otherwise, the server will
// hold the request open until the timeout or until completion, with the response containing the full
// result as JSON.
Stream = false,
The best way to implement it would be to add a check to the ChatAsync() method, and if the ChatRequest Stream is set to false, default to the standard HTTPClient PostAsync call. If true, then setup a stream.
The text was updated successfully, but these errors were encountered:
Need to add support for streaming. You can specify streamlining as a parameter in the ChatRequest class, and it is defined as:
The best way to implement it would be to add a check to the ChatAsync() method, and if the ChatRequest Stream is set to false, default to the standard HTTPClient PostAsync call. If true, then setup a stream.
The text was updated successfully, but these errors were encountered: