Long responses stream in bursts #59

New issue

Open

opened 2026-09-26 16:47:30 +00:00 by Jc-965 · 0 comments

Jc-965 commented

2026-09-26 16:47:30 +00:00

Member

Long responses stream smoothly at first and then slow to arriving a sentence or more at a time. Most of this comes from the agent (see in agent), but the client also re-renders the whole response, math included, on every update and re-scrolls each time, and both get more expensive as the answer grows.

We want long responses to stream at a steady pace from start to finish on desktop and mobile, with no visible slowdown as the answer grows.

Long responses stream smoothly at first and then slow to arriving a sentence or more at a time. Most of this comes from the agent (see in [agent](https://git.cmu.dev/ScottyLabs/cmugpt-agent/issues/24#issue-3545)), but the client also re-renders the whole response, math included, on every update and re-scrolls each time, and both get more expensive as the answer grows. We want long responses to stream at a steady pace from start to finish on desktop and mobile, with no visible slowdown as the answer grows.