feat: persistent memory, moderation, token budgets, and model-driven maps #16

Merged

Jc-965 merged 26 commits from memory-moderation-optimization into main 2026-08-13 17:45:29 +00:00

Conversation 1 Commits 26 Files changed 23 +4552 -478

Jc-965 commented 2026-08-13 04:19:58 +00:00

Member

Copy link

Summary

Combines the three open feature branches into one change (supersedes #13, #14, #15).

• Adds persistent per-user memory on pgvector with remember and forget tools, multi-fact forgetting with a confirmation flow for ambiguous requests, recall injected as conversation context, background fact learning after each turn, and REST endpoints for listing, deleting, and clearing a user's memories
• Screens every incoming message and finished reply through OpenAI's free moderation endpoint, returning CaPS/988 campus resources for self-harm signals and a brief refusal for other flagged categories, with flagged replies redacted retroactively in the done payload
• Adds one-time chat title generation from a chat's first message on a flash-class model with reasoning disabled, titling flagged messages "New chat"
• Lets the model decide the campus map by calling a local maps_show_map tool, validated deterministically against the building catalog with query inference as the fallback, and scrubs false lookup-failure claims from map answers
• Detects MCP tool failures structurally from the tool message status instead of matching result text, and hides transport errors from the model
• Enforces per-user daily token budgets returning 429 when exhausted, records measured usage per model pass, narrows bound tools to the query, condenses tool descriptions, compacts the system prompt, caches MCP tool discovery, and caps history and tool-result sizes
• Rejects oversized request bodies by header and answers flagrant injection phrasing with a canned refusal before any tokens are spent

## Summary Combines the three open feature branches into one change (supersedes #13, #14, #15). - Adds persistent per-user memory on pgvector with remember and forget tools, multi-fact forgetting with a confirmation flow for ambiguous requests, recall injected as conversation context, background fact learning after each turn, and REST endpoints for listing, deleting, and clearing a user's memories - Screens every incoming message and finished reply through OpenAI's free moderation endpoint, returning CaPS/988 campus resources for self-harm signals and a brief refusal for other flagged categories, with flagged replies redacted retroactively in the done payload - Adds one-time chat title generation from a chat's first message on a flash-class model with reasoning disabled, titling flagged messages "New chat" - Lets the model decide the campus map by calling a local maps_show_map tool, validated deterministically against the building catalog with query inference as the fallback, and scrubs false lookup-failure claims from map answers - Detects MCP tool failures structurally from the tool message status instead of matching result text, and hides transport errors from the model - Enforces per-user daily token budgets returning 429 when exhausted, records measured usage per model pass, narrows bound tools to the query, condenses tool descriptions, compacts the system prompt, caches MCP tool discovery, and caps history and tool-result sizes - Rejects oversized request bodies by header and answers flagrant injection phrasing with a canned refusal before any tokens are spent

Jc-965 added 21 commits 2026-08-13 04:19:58 +00:00

feat: initial persistent per-user memory implementation 3c82b58600

fix: secure and harden persistent user memory dfefadd732

feat: persist authenticated user memories with pgvector 19d6b8b6bb

chore: pre-PR cleanup for persistent user memory e1e67661be

Merge remote-tracking branch 'origin/main' into persistent-user-memory 1469bcbec2

fix: harden persistent memory and update comments 28a7146e2e

fix: release force-tool latch after memory rounds, scan history in tool gate 3d824aa59c

refactor: drop phantom legacy memory surface and dead config fd2df1bca0

feat: let the model decide the campus map via maps_show_map 30234c5e5b

feat: cut per-turn input tokens and add daily per-user token budget b23c0a8446

feat: enforce safety in code and further improve token optimization 5dd98ae0d1

fix: improve caps and remove global limit 48f25d5b3e

docs: improve comment flow b1afe89a66

fix: removed leaked reasoning delimiters 9a17e07d2b

fix: improve map tool-failure handling and map comments 36ba164c6d

docs: improve comments for persistent memory 8074ca92bc

feat: make memory forgetting more robust 7e390baac4

feat: add chat title generation endpoint 13dba7a277

feat: moderate user messages and agent replies 27dc1c6122

Merge remote-tracking branch 'origin/cmumaps-improvements' into persistent-user-memory 9f2214c36e

Merge remote-tracking branch 'origin/optimization-token-limit' into persistent-user-memory 2ee505d85d

scottylabs-bot commented 2026-08-13 04:20:23 +00:00

Owner

Copy link

Kennel Deployments

Torn down at 2026-08-13 17:45:31 UTC.

<!-- kennel-deployment --> ### Kennel Deployments Torn down at 2026-08-13 17:45:31 UTC.

Jc-965 added 1 commit 2026-08-13 14:47:11 +00:00

fix: replace non-ascii chars and tighten score type for ci a89da3ea47

Jc-965 added 1 commit 2026-08-13 16:21:39 +00:00

Merge remote-tracking branch 'origin/main' into memory-moderation-optimization a7a2dff537

Jc-965 added 1 commit 2026-08-13 16:58:12 +00:00

chore: drop unused ty ignore comments in map tool 11436b5368

Jc-965 added 1 commit 2026-08-13 17:09:39 +00:00

fix: keep memory ci tests offline 7e8a59754e

Jc-965 added 1 commit 2026-08-13 17:42:41 +00:00

fix: keep memory ci tests offline and update map prompt b8783a8689

Jc-965 merged commit 7114603d5e into main 2026-08-13 17:45:29 +00:00

Jc-965 referenced this pull request from a commit 2026-08-13 17:45:30 +00:00

Merge pull request 'feat: persistent memory, moderation, token budgets, and model-driven maps' (#16) from memory-moderation-optimization into main

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels

  

needs/docs

Must have documentation written

  

needs/research

Discuss the ideal implementation with the tech lead

  

needs/upstream

Needs a contribution to an upstream project

  

type/bug

Something not working as intended

  

type/external

Lives outside of code

  

type/feature

New functionality

  

type/refactor

Improving existing code

  

urgency

high

This is currently causing issues

  

urgency

immediate

This is making a project or feature unusable

  

urgency

low

This can happen whenever

  

urgency

medium

This is expected to cause issues soon

No labels

needs/docs

needs/research

needs/upstream

type/bug

type/external

type/feature

type/refactor

urgency

high

urgency

immediate

urgency

low

urgency

medium

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

2 participants

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference

ScottyLabs/cmugpt-agent!16

No description provided.