18995380ce
* feat(verify-phase): honest verifier — abstain (insufficient_spec) on non-inferable backstop truths (#1154) Carry the edge-probe's existing `backstop` (non-inferable) tier through the plan-phase projection as a structured flat-scalar marker instead of a prose parenthetical, and make verify-phase abstain -> human_needed (never silent-pass) on a backstop truth it cannot confirm with explicit evidence. Truth-axis mirror of #644's prohibition judgment-tier (ADR-550 D4). Engine (deterministic, CI-tested per ADR-550 D5 — never the LLM verdict): - src/probe-core.cts: truthStatement/truthVerification normalizers, projectTruths (conservative serializer), dispositionForUnverifiableTruth (backstop+no-evidence -> unverified/flagged/insufficient_spec; backstop+evidence -> green; inferable -> green, the over-abstention guard). - src/roadmap.cts: coerceTruthToString now reads `statement` first so an object-form backstop truth is surfaced, not dropped (Hyrum backward-compat for truth-readers). Workflow/agent/docs: plan-phase emits the structured marker (flat scalar, ADR-550 #1278); verify-phase + gsd-verifier add the abstain arm; new references/honest-verifier.md; FEATURES/COMMANDS document insufficient_spec; ADR-550 amended (truth-axis D4 mirror). Decisions adopted (trek-e review): insufficient_spec feeds existing human_needed with a distinguishable reason (no new VERIFIER_STATUS); changeset Changed; round-trip parity test; abstain-on-unconfirmed-backstop regression test red-first. Implementation notes (deviations from the issue's proposed file list, verified live): - frontmatter.cts needs no change — its flat parser already round-trips object-form truths. - verify.cts needs no change — it grades artifacts/key_links structurally; truths are LLM-graded at the workflow layer, so consumption lives there + the deterministic helper. - No CJS<->SDK hand-sync — the SDK seam was retired (ADR-0174); src/*.cts is sole source. Regenerated artifacts: golden-install-parity fixtures, INVENTORY-MANIFEST, size baselines. * chore(#1154): add changeset (Changed) for honest verifier User-facing changelog fragment for #1738. Typed `Changed` (not `Added`) per trek-e review condition 3 — the verify behavior shifts for backstop-bearing specs (a confident silent `passed` becomes `human_needed`), which is user-visible even though the schema marker is additive. * docs(#1154): score-formula also excludes abstained insufficient_spec truths (review nit-1) trek-e review nit: the verify-phase score sentence said PRESENT_BEHAVIOR_UNVERIFIED truths were "the only ones excluded" from verified_truths. Post-#1154 an abstained `insufficient_spec` backstop truth is also excluded (it is not ✓ VERIFIED and routes to human_needed). Behavior was already correct; this tightens the wording. Regenerated golden-install-parity fixtures + workflow-size baseline for the touched verify-phase.md. (Nit-2 — a dedicated insufficient_spec_items frontmatter list — is intentionally not taken: the current design is ADR-550-D4-conformant, the abstain cause rides as a distinguishable report reason, and adding it would exceed the approved scope.) --------- Co-authored-by: Tom Boucher <trekkie@nomorestars.com>
92 lines
2.3 KiB
JSON
92 lines
2.3 KiB
JSON
{
|
|
"add-backlog.md": 7132,
|
|
"add-phase.md": 7203,
|
|
"add-tests.md": 16901,
|
|
"add-todo.md": 8952,
|
|
"ai-integration-phase.md": 14761,
|
|
"analyze-dependencies.md": 3887,
|
|
"audit-fix.md": 10988,
|
|
"audit-milestone.md": 17637,
|
|
"audit-uat.md": 7425,
|
|
"autonomous.md": 42747,
|
|
"check-todos.md": 9431,
|
|
"cleanup.md": 9897,
|
|
"code-review-fix.md": 23890,
|
|
"code-review.md": 31602,
|
|
"complete-milestone.md": 31134,
|
|
"debug.md": 13505,
|
|
"diagnose-issues.md": 12820,
|
|
"discovery-phase.md": 8651,
|
|
"discuss-phase-assumptions.md": 26984,
|
|
"discuss-phase-power.md": 11273,
|
|
"discuss-phase.md": 31990,
|
|
"do.md": 10068,
|
|
"docs-update.md": 55662,
|
|
"edit-phase.md": 12883,
|
|
"eval-review.md": 9923,
|
|
"execute-phase.md": 93517,
|
|
"execute-plan.md": 32611,
|
|
"explore.md": 10497,
|
|
"extract-learnings.md": 12849,
|
|
"fast.md": 4149,
|
|
"forensics.md": 12463,
|
|
"graduation.md": 11578,
|
|
"health.md": 11824,
|
|
"help.md": 1722,
|
|
"import.md": 14604,
|
|
"inbox.md": 14407,
|
|
"ingest-docs.md": 18336,
|
|
"insert-phase.md": 8943,
|
|
"list-phase-assumptions.md": 4305,
|
|
"list-seeds.md": 6943,
|
|
"list-workspaces.md": 5655,
|
|
"manager.md": 27258,
|
|
"map-codebase.md": 20789,
|
|
"milestone-summary.md": 11774,
|
|
"mvp-phase.md": 13582,
|
|
"new-milestone.md": 32422,
|
|
"new-project.md": 66138,
|
|
"new-workspace.md": 11254,
|
|
"next.md": 20094,
|
|
"node-repair.md": 4173,
|
|
"note.md": 6563,
|
|
"pause-work.md": 14397,
|
|
"plan-milestone-gaps.md": 11765,
|
|
"plan-phase.md": 94459,
|
|
"plan-review-convergence.md": 23468,
|
|
"plant-seed.md": 11741,
|
|
"pr-branch.md": 15919,
|
|
"profile-user.md": 21202,
|
|
"progress.md": 30555,
|
|
"quick.md": 49139,
|
|
"reapply-patches.md": 20393,
|
|
"remove-phase.md": 8469,
|
|
"remove-workspace.md": 7507,
|
|
"resume-project.md": 17226,
|
|
"review.md": 40539,
|
|
"scan.md": 7688,
|
|
"secure-phase.md": 13476,
|
|
"session-report.md": 4044,
|
|
"settings-advanced.md": 39666,
|
|
"settings-integrations.md": 15848,
|
|
"settings.md": 33413,
|
|
"ship.md": 24647,
|
|
"sketch-wrap-up.md": 14223,
|
|
"sketch.md": 19960,
|
|
"spec-phase.md": 31752,
|
|
"spike-wrap-up.md": 15092,
|
|
"spike.md": 24517,
|
|
"stats.md": 6718,
|
|
"sync-skills.md": 6125,
|
|
"thread.md": 12464,
|
|
"transition.md": 22016,
|
|
"ui-phase.md": 15477,
|
|
"ui-review.md": 11172,
|
|
"ultraplan-phase.md": 10468,
|
|
"undo.md": 10431,
|
|
"update.md": 21053,
|
|
"validate-phase.md": 10745,
|
|
"verify-phase.md": 40728,
|
|
"verify-work.md": 35212
|
|
}
|