1a46109b97
* feat(#1579): deterministic gsd-tools query eval.score verb Split C of #1573 (pure code, lowest risk). Adds an eval.score query verb (coverage*0.6 + infra*0.4; bands 80/60/40) mirroring the verify.* chain; gsd-eval-auditor consumes it instead of doing weighted arithmetic in-prompt. Non-breaking — additive only. arXiv: 2601.15130 (Plausibility Trap/DPDM), 2507.10281 (Table Agent), 2508.15754 (TIR). * fix(#1579): address review — domain guard, property test, glossary, SKIP_ROOT, inventory/baseline - C3 input-domain: reject out-of-domain eval.score (require 0<=covered<=total; was emitting overall_score>100 / negatives) - C1 property test: add tests/eval.property.test.cjs (fast-check) — determinism, band monotonicity, [0,100] bounds, never-throws - C2 glossary: CONTEXT.md "Eval Scoring Module" entry (source-of-truth path + interface) - C4: add `eval` to SKIP_ROOT_RESOLUTION (pure arithmetic; no .planning/ access) - inventory: register generated eval.cjs/eval-command-router.cjs (INVENTORY-MANIFEST.json + INVENTORY.md rows) - size: regen agent-size baseline for gsd-eval-auditor (reused gsd_run shim + eval.score step) - eslint: ignore generated eval*.cjs (ADR-457 bin/lib migration coverage) * fix(#1579): register eval family in alias-drift gates Add EVAL_COMMAND_ALIASES/EVAL_SUBCOMMANDS to scripts/check-alias-drift.cjs families and to familyArrayKeys in the manifest-coverage test, so the eval family lands under the same drift guard as every sibling family (state/verify/init/phase/phases/validate/roadmap). Addresses trek-e review. check:alias-drift ok; feat-3251 coverage 9/9; eval suites 10/10. * docs(#1579): use half-open verdict band ranges in CLI-TOOLS overall_score is fractional and thresholds are >=80/>=60/>=40, so a score in [79,80) is correctly NEEDS WORK despite the old '60-79' label. Relabel bands as 60-<80 / 40-<60 / 0-<40 to match the code. Addresses trek-e nit. * fix(#1579): validate eval.score CLI inputs Reject unknown infra tokens and fractional counts, and pin the 80-point verdict boundary including rounding-before-banding behavior.
37 lines
1.1 KiB
JSON
37 lines
1.1 KiB
JSON
{
|
|
"gsd-advisor-researcher.md": 4603,
|
|
"gsd-ai-researcher.md": 5911,
|
|
"gsd-assumptions-analyzer.md": 4556,
|
|
"gsd-code-fixer.md": 36506,
|
|
"gsd-code-reviewer.md": 16780,
|
|
"gsd-codebase-mapper.md": 21395,
|
|
"gsd-debug-session-manager.md": 14159,
|
|
"gsd-debugger.md": 51220,
|
|
"gsd-doc-classifier.md": 7689,
|
|
"gsd-doc-synthesizer.md": 9782,
|
|
"gsd-doc-verifier.md": 12403,
|
|
"gsd-doc-writer.md": 38834,
|
|
"gsd-domain-researcher.md": 6998,
|
|
"gsd-eval-auditor.md": 12362,
|
|
"gsd-eval-planner.md": 7008,
|
|
"gsd-executor.md": 43343,
|
|
"gsd-framework-selector.md": 6778,
|
|
"gsd-integration-checker.md": 15148,
|
|
"gsd-intel-updater.md": 18122,
|
|
"gsd-mempalace-curator.md": 4160,
|
|
"gsd-nyquist-auditor.md": 7255,
|
|
"gsd-pattern-mapper.md": 12487,
|
|
"gsd-phase-researcher.md": 40698,
|
|
"gsd-plan-checker.md": 44646,
|
|
"gsd-planner.md": 48023,
|
|
"gsd-project-researcher.md": 22074,
|
|
"gsd-research-synthesizer.md": 13713,
|
|
"gsd-roadmapper.md": 22183,
|
|
"gsd-security-auditor.md": 8891,
|
|
"gsd-ui-auditor.md": 17159,
|
|
"gsd-ui-checker.md": 11088,
|
|
"gsd-ui-researcher.md": 19332,
|
|
"gsd-user-profiler.md": 8516,
|
|
"gsd-verifier.md": 48859
|
|
}
|