witness
A recording cache for model APIs that cuts inference spend and resumes crashed runs
- Area
- Agent infrastructure
- Language
- Rust
- License
- MIT
- Latest
- v0.3.0
- Plate
- No. 08 of 14
witness is a single-binary, API-compatible proxy that sits between your agents and a model API, and agents change only the base URL. Repeat deterministic calls are served from the record instead of re-paying inference, and a crashed run can be replayed with zero model calls. The same record is a tamper-evident, signed, Merkle-committed audit trail, so it is already running as evidence before anyone asks a question.
How it works
- 01
Agents point their base URL at witness serve, which forwards to the model API and stores every request and response by BLAKE3 content hash.
- 02
Each call is appended to a hash-chained journal, so any edit, deletion or reorder breaks the chain and witness verify finds it.
- 03
Identical reusable requests are answered from the record, and witness replay serves a whole recorded run with no upstream calls.
What it does
- Repeat deterministic calls are served from the record instead of re-paying inference
- Whole runs replay from the record with zero upstream calls, so crashed runs resume
- Hash-chained journal with Merkle commitments, inclusion proofs and anchoring to a public transparency log
- Ed25519 signed identity and narrowing-only delegations enforced at the network boundary
- Records MCP tool calls and shell commands by what they changed, in the same chain; fleet peer cache and Prometheus and OpenTelemetry export
More from the bench
All projectsfaultline
A live architecture map that stops agents crossing the boundaries you drew
AgentReplay
Turn a failed agent run into a replayable test that blocks the same mistake in CI
guardian
Reviews every agent action before it runs, in ~400ms at about $0.00001 each