Skip to content

Benchmark: every result as the outcome it gives you, beside the setup it beat - #41

Merged
chrisjleal merged 1 commit into
mainfrom
docs/benchmark-page
Nov 2, 2026
Merged

chrisjleal merged 1 commit into
mainfrom
docs/benchmark-page

Conversation

@chrisjleal

Copy link
Copy Markdown
Contributor

The Evidence page becomes Benchmark: one outcome table up front, each result beside the setup it was measured against, run dates and method asides out of the body, and how each result was measured in one reviewer section. The mid-job revocation row now matches production (refused in flight, nothing commits). /evidence, /benchmarks and /use-cases/authority-at-dispatch redirect to /benchmark. Markdown and OpenAPI validation pass; rendered locally on desktop and mobile with every chart loading.

🤖 Generated with Claude Code

… it beat

The Evidence page is now Benchmark. It opens on one table of outcomes, each against the setup
teams run today: 48 of 48 governance scenarios, every out-of-permission action stopped before it
runs, 0 of 6 data-theft attempts out of a hijacked agent, 150 of 150 forged records caught,
$0.024 against $0.078 per handed-off result, reuse 750 times faster than redoing the work, 42
times fewer tokens for agent memory, a 3.1 times lower worst-case research spend, and one
identity check reused by 100 apps for $1.75 against $150. Run dates and per-section method
asides are gone from the body; how each result was measured sits in one section for reviewers.
A permission revoked mid-job now reads as production behaves: the call in flight is refused with
its reason and nothing commits. The offline check points at the latest signed records.
/evidence, /benchmarks and /use-cases/authority-at-dispatch open it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@chrisjleal
chrisjleal merged commit ca3376b into main Nov 2, 2026
2 checks passed
@chrisjleal
chrisjleal deleted the docs/benchmark-page branch November 2, 2026 02:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant