651511d1e3
* test(#4670): add failing-first coverage for the bounded commit-claim window * fix(#4670): bound the commit-claim window to the plan's own history The reconciliation measured plan_head_before..HEAD — a window that grows with every later plan's task and SUMMARY commits plus execute-phase's own phase-completion commit — so an honest plan flagged commit_claim_mismatch as soon as anything landed after it (real project: claims 3/5/2 measured 20/10/5). The executor now also records plan_head_after (HEAD at its measurement moment, after the last task commit, before the SUMMARY commit), and verify-work reconciles exactly against plan_head_before..plan_head_after with a merge-base ancestry check; SUMMARYs without the anchor fall back to the legacy warning path instead of an unsound BLOCKER. Both #3968 failure modes (claimed commits never made; task commits lost) still block, driven by the issue's own fixture scenarios. Emitted-Drift-Ack-Growth: verify-work.md — reconciliation gains the bounded window and legacy fallback (#4670) Emitted-Drift-Ack-Growth: gsd-executor.md — plan_head_after anchor documented in the measurement protocol (#4670) * fix(#4670): name the history-rewrite case and keep the executor under its cap Review findings: the BLOCKER enumeration named only the two #3968 causes, so an honest plan whose recorded window was rewritten afterwards (rebase, amend, cherry-pick) got a mislabeled diagnosis — the clause now names that case with the manual-recount remedy. The executor's growth crossed the LARGE-tier hard cap (49152), so the plan_head_after documentation is compressed to the minimal capture + frontmatter write (verify-work.md carries the semantics), the #2751 PROSE_ALLOWLIST entry is re-pointed at the shifted line (#4670 moved it from 823 to 825), the compact-content baseline is regenerated, and the changeset records the two un-established edges (shared-base waves, subrepo ledgers). Emitted-Drift-Ack-Growth: gsd-executor.md — plan_head_after anchor documented in the measurement protocol (#4670) * docs(#4670): backfill changeset PR number * docs(#4670): backfill changeset PR number --------- Co-authored-by: sim <sim@local>
47 lines
1.1 KiB
JSON
47 lines
1.1 KiB
JSON
{
|
|
"schema_version": 1,
|
|
"generated_by": "scripts/benchmark-compact-content.cjs",
|
|
"tokenizer": {
|
|
"name": "gpt-tokenizer",
|
|
"version": "4.0.0"
|
|
},
|
|
"label": "PROXY-TOKENIZER DELTA — gpt-tokenizer is a stand-in; Anthropic publishes no tokenizer for Claude 3+. The on/off COMPARISON is exact under this pinned tokenizer; absolute counts are not Claude's real token counts.",
|
|
"splits": {
|
|
"complete-milestone": {
|
|
"offTokens": 13200,
|
|
"onTokens": 8360,
|
|
"reductionPct": 36.67
|
|
},
|
|
"docs-update": {
|
|
"offTokens": 14230,
|
|
"onTokens": 11880,
|
|
"reductionPct": 16.51
|
|
},
|
|
"execute-phase": {
|
|
"offTokens": 26259,
|
|
"onTokens": 23969,
|
|
"reductionPct": 8.72
|
|
},
|
|
"new-project": {
|
|
"offTokens": 14308,
|
|
"onTokens": 12364,
|
|
"reductionPct": 13.59
|
|
},
|
|
"plan-phase": {
|
|
"offTokens": 27641,
|
|
"onTokens": 24351,
|
|
"reductionPct": 11.9
|
|
},
|
|
"verify-work": {
|
|
"offTokens": 13235,
|
|
"onTokens": 11262,
|
|
"reductionPct": 14.91
|
|
}
|
|
},
|
|
"aggregate": {
|
|
"offTokens": 108873,
|
|
"onTokens": 92186,
|
|
"reductionPct": 15.33
|
|
}
|
|
}
|