Skip to content

docs(reference): add the protocol fidelity matrix - #490

Merged
Destynova2 merged 2 commits into
mainfrom
docs/protocol-fidelity-matrix
Aug 4, 2026
Merged

docs(reference): add the protocol fidelity matrix#490
Destynova2 merged 2 commits into
mainfrom
docs/protocol-fidelity-matrix

Conversation

@Destynova2

Copy link
Copy Markdown
Contributor

The concrete artifact from the fidelity sweep: a per-path × per-dimension table
of what grob preserves, translates, cannot carry (API-limited), or intentionally
drops between the Anthropic canonical format and each provider wire format.

Makes each loss explicit rather than silent — the analysis's core critique is
that a translation loss looks like HTTP 200. Records this cycle's fixes and
flags the unverified rows honestly.

Findings

Content Anthropic OpenAI Chat Responses (Codex) Gemini
Text / image (message) native ✅ (#476)
Tool call native
Tool-result image native API-limited #488 API-limited (unverified)
Provider error structured upstream_error (#489) same same

The Responses tool-result-image fix (#488) was verified live; the Chat/Gemini
equivalents are API-shaped losses (string-only tool content) marked unverified
because grob has no standing test credential for those backends.

Feeds the per-release conformance-suite work (#484).

🤖 Generated with Claude Code

Output of the fidelity sweep prompted by the competitive analysis: a per-path ×
per-dimension table of what grob preserves, transforms, cannot carry (API-limited)
or intentionally drops when translating between the Anthropic canonical format
and each provider wire format.

Makes the losses explicit rather than silent — the analysis's core critique of
gateways is that a translation loss looks like HTTP 200. Records the fixes landed
this cycle (#476 message images, #488 tool-result images on Responses, #465
reasoning continuity, #489 structured upstream errors) and flags the unverified
rows (Chat/Gemini tool-result images) honestly, since grob has no standing test
credential for those backends.

Feeds the per-release conformance-suite work (#484).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@Destynova2
Destynova2 enabled auto-merge (squash) July 28, 2026 21:09
@Destynova2
Destynova2 merged commit 88a329e into main Aug 4, 2026
28 checks passed
@Destynova2
Destynova2 deleted the docs/protocol-fidelity-matrix branch August 4, 2026 18:47
Destynova2 added a commit that referenced this pull request Aug 4, 2026
## 🤖 New release

* `grob`: 0.36.85 -> 0.36.86

<details><summary><i><b>Changelog</b></i></summary><p>

<blockquote>

##
[0.36.86](v0.36.85...v0.36.86)
- 2026-08-04

### Fixed

- *(policies)* enforce decision token expiry and audience
([#500](#500))
- harden critical architecture boundaries
([#493](#493))

### Other

- *(design)* validate the OCR-to-DLP hypothesis against the real engine
([#499](#499))
- *(design)* measure L2 watermark robustness, correct layer table
([#498](#498))
- *(design)* measure TrustMark cost and pHash robustness contract
([#497](#497))
- *(design)* correct c2pa cost with real measurements, reorder media
plan ([#496](#496))
- *(design)* image/video DLP, content provenance, and agent control
plane ([#495](#495))
- *(reference)* add the protocol fidelity matrix
([#490](#490))
</blockquote>


</p></details>

---
This PR was generated with
[release-plz](https://github.com/release-plz/release-plz/).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant