7b50026075
Some checks failed
Validate Branch Name / PR mergeability (pull_request) Successful in 24s
Changeset Required / PR mergeability (pull_request) Successful in 10s
Default Flip Documentation / PR mergeability (pull_request) Successful in 9s
Dependabot Auto-Merge / auto-merge (pull_request) Has been skipped
Docs Required / PR mergeability (pull_request) Successful in 10s
Mutation Testing / PR mergeability (pull_request) Successful in 10s
Security Scan / PR mergeability (pull_request) Successful in 10s
Tests / PR mergeability (pull_request) Successful in 10s
Tests / Base branch health (pull_request) Successful in 11s
Tests / Detect test scope (pull_request) Successful in 16s
PR Target Validator / validate-target (pull_request_target) Successful in 14s
Validate Branch Name / check-branch (pull_request) Successful in 9s
Changeset Required / changeset-lint (pull_request) Successful in 27s
Default Flip Documentation / default-flip-documentation (pull_request) Successful in 27s
Docs Required / docs-lint (pull_request) Successful in 6m35s
Mutation Testing / Detect changed covered modules (pull_request) Successful in 20s
Security Scan / security (pull_request) Successful in 6m31s
Tests / lint-tests (pull_request) Failing after 1m56s
Tests / plugin-validate (pull_request) Successful in 1m2s
Tests / test (ubuntu-latest, 24, shard 1/3) (pull_request) Failing after 20s
Tests / test (ubuntu-latest, 24, shard 2/3) (pull_request) Failing after 19s
Tests / test (ubuntu-latest, 24, shard 3/3) (pull_request) Failing after 18s
Tests / test (ubuntu-latest, 24) (pull_request) Failing after 19s
Tests / test (inert CI) (pull_request) Has been skipped
Tests / QA loop walk (smell ratchet) (pull_request) Failing after 20s
Mutation Testing / Stryker (${{ matrix.name }}) (pull_request) Has been skipped
Tests / Coverage gate (merged shards) (pull_request) Has been skipped
Tests / Publish emitted-baseline artifact (pull_request) Has been skipped
Mutation Testing / Stryker mutation score (changed files only) (pull_request) Has been skipped
Branch Cleanup / Delete merged PR branch (pull_request) Failing after 10s
Branch Cleanup / Weekly orphaned branch sweep (pull_request) Has been skipped
Tests / conformance test (macos-latest, 24) (pull_request) Has been cancelled
Tests / conformance test (windows-latest, 24, shard 1/3) (pull_request) Has been cancelled
Tests / conformance test (windows-latest, 24, shard 2/3) (pull_request) Has been cancelled
Tests / conformance test (windows-latest, 24, shard 3/3) (pull_request) Has been cancelled
Tests / Required tests (pull_request) Has been cancelled
verify-work now calls verification.canonicalize-uat instead of hand-rolling the status flip, and progress's Route V.stale re-verifies in place. The flip's behavior is covered in tests/uat-evidence.test.cjs; these tests keep the workflow's side of the contract. Refreshes the compact-content benchmark baseline for the moved bytes.
47 lines
1.1 KiB
JSON
47 lines
1.1 KiB
JSON
{
|
|
"schema_version": 1,
|
|
"generated_by": "scripts/benchmark-compact-content.cjs",
|
|
"tokenizer": {
|
|
"name": "gpt-tokenizer",
|
|
"version": "4.0.0"
|
|
},
|
|
"label": "PROXY-TOKENIZER DELTA — gpt-tokenizer is a stand-in; Anthropic publishes no tokenizer for Claude 3+. The on/off COMPARISON is exact under this pinned tokenizer; absolute counts are not Claude's real token counts.",
|
|
"splits": {
|
|
"complete-milestone": {
|
|
"offTokens": 12833,
|
|
"onTokens": 8176,
|
|
"reductionPct": 36.29
|
|
},
|
|
"docs-update": {
|
|
"offTokens": 14036,
|
|
"onTokens": 11687,
|
|
"reductionPct": 16.74
|
|
},
|
|
"execute-phase": {
|
|
"offTokens": 25132,
|
|
"onTokens": 23026,
|
|
"reductionPct": 8.38
|
|
},
|
|
"new-project": {
|
|
"offTokens": 14038,
|
|
"onTokens": 12099,
|
|
"reductionPct": 13.81
|
|
},
|
|
"plan-phase": {
|
|
"offTokens": 28087,
|
|
"onTokens": 24981,
|
|
"reductionPct": 11.06
|
|
},
|
|
"verify-work": {
|
|
"offTokens": 13136,
|
|
"onTokens": 11167,
|
|
"reductionPct": 14.99
|
|
}
|
|
},
|
|
"aggregate": {
|
|
"offTokens": 107262,
|
|
"onTokens": 91136,
|
|
"reductionPct": 15.03
|
|
}
|
|
}
|