Skip to content

Compact agent-facing session responses#73

Draft
nightlessbaron wants to merge 17 commits into
prodfrom
agent/compact-session-agent-responses
Draft

Compact agent-facing session responses#73
nightlessbaron wants to merge 17 commits into
prodfrom
agent/compact-session-agent-responses

Conversation

@nightlessbaron

Copy link
Copy Markdown

Summary

  • omit large per-choice token metadata from responses returned to Harbor
  • retain the original full response in Miles session records
  • keep /merged reconstruction and pretokenized session behavior intact

Dependency

This is stacked on #66 and temporarily includes #66 in the prod diff. Rebase onto prod after #66 lands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants