Step by step — same bug, two agent workflows
CI verified — no LLM
40/40 fixtures pass40 fixtures · 9 feature-build · 4 repair-plan loop · check-json ~170–260 tok vs TS paste · 78–92% less context.
bun run proof:agent-repair
Full CI suite: bun test tests/agent-repair-sufficiency.test.ts tests/agent-repair-multistep.test.ts && bun run benchmark:agent-repair
Live model benchmark
Point 100% · TS 100%May 22, 2026, 3:16 AM · gpt-4.1, claude-opus-4-6, claude-sonnet-4-6 on 13 fixtures (36 single-shot, 4 CI-only loop). Success = point check passes.
Latest proof run: 78/78 API runs pass point check.
- Claude Opus 4.6Point 13/13 · TS 13/13
- Claude Sonnet 4.6Point 13/13 · TS 13/13
- GPT-4.1Point 13/13 · TS 13/13
Pick a CI fixture below. Each column shows what the agent sees at every step, how many tokens that step costs, and whether we prove it in CI or illustrate it from typical chat pastes.
