ScottyLabs/cmugpt-agent

Watch

Moderation runs serially before each turn #25

New issue

Open

opened 2026-09-26 16:46:00 +00:00 by Jc-965 · 0 comments

Jc-965 commented

2026-09-26 16:46:00 +00:00

Member

Every message goes to OpenAI's moderation check first, and nothing else starts until the answer comes back, so that whole round trip is added to the wait before the first word appears. The first message in a chat also gets checked a second time when the chat title is generated.

We want moderation to stop adding to the wait before the first word, while still guaranteeing that a flagged message never gets through, and each message should only be checked once.

Every message goes to OpenAI's moderation check first, and nothing else starts until the answer comes back, so that whole round trip is added to the wait before the first word appears. The first message in a chat also gets checked a second time when the chat title is generated. We want moderation to stop adding to the wait before the first word, while still guaranteeing that a flagged message never gets through, and each message should only be checked once.

krishsax added this to the (deleted) project

2026-09-26 19:06:50 +00:00

krishsax removed this from the (deleted) project

2026-09-26 19:07:10 +00:00

krishsax added this to the Agent project

2026-09-26 19:07:38 +00:00

Sign in to join this conversation.

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference

ScottyLabs/cmugpt-agent#25

No description provided.