Single stream limit across the app #57
Labels
No labels
needs/docs
needs/research
needs/upstream
type/bug
type/external
type/feature
type/refactor
urgency
high
urgency
immediate
urgency
low
urgency
medium
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set
Reference
ScottyLabs/cmugpt-surface#57
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
While any response is streaming, the composer is disabled everywhere, including other chats and a new chat, so you can't start a second conversation until the current answer finishes. The server has no such limit, since each streaming request is independent. Related to #55.
We want to be able to open a new chat or switch to another one and send a message while a response is still streaming elsewhere. Each chat should show only its own response, and chats with a response in progress should be marked in the sidebar. Within one chat, a new message should still wait until the current response finishes or is stopped. You can refer to ChatGPT for the desired behavior.