Phase 1 of #3464. Removes the `// allow-test-rule:` marker from 22 test files where it is provably vestigial, and tightens the ratchet ceiling in scripts/lint-allow-test-rule-refs.ceiling.json from 305 to 285. Eligibility is decided by two independent AST discriminators, both conservative (any doubt => keep): (a) Read-target type. Every readFileSync/readFile call in the file resolves statically to a prose/config extension (.md/.json/.yml/.yaml/.toml/.txt), or the file performs no reads at all. Any read of a source extension (.cjs/.js/.mjs/.ts/.cts/.mts/.jsx/.tsx), any dynamic/unresolvable path, and any other extension all disqualify the file. (b) Marker context. Every `allow-test-rule:` occurrence is a genuine comment node, never string- or template-literal payload. A marker that lives inside a RuleTester `code:` fixture is test DATA, not a suppression directive; stripping it corrupts the test. tests/eslint-rules.test.cjs is the one such fixture host and is deliberately untouched. An earlier attempt at this phase classified markers by "strip it and see if local/no-source-grep still passes" and was reverted in full before commit. That oracle is unsound: the rule only fires on a literal .cjs/.js/.ts path containing a quoted bin/lib/gsd-core/src segment, tracked one hop from the binding, so files that genuinely source-grep real JavaScript pass it silently -- tests/no-unbounded-spawn-allowlist.test.cjs (reads test sources through a listTestFiles() walk) and tests/claude-imperative-reference.test.cjs (matches bin/install.js through an intermediate variable) both cleared it while being real source-greps. The rule's implementation is narrower than its intent, so it cannot adjudicate whether an exemption is load-bearing. Scope is limited to comment deletions: the diff over the test tree is 100% line removals with zero insertions, and no executable line is altered. On the ceiling value. The measured count at this HEAD is 283, so 285 leaves 2 slack -- deliberate, and well inside the documented grace band of 3. Pinning the ceiling to the exact count makes this change effectively unmergeable: any concurrent PR that lands one marker-bearing test file re-reds it. That race fired twice while preparing this branch (once mid-rebase taking the count 304->305 on next, once between rebase and the verification run taking it 282->283), and it is the same race that broke next in #3461. A ceiling of actual+2 preserves a merge window while still ratcheting 305 -> 285. Known limit, disclosed rather than papered over: this clears 22 of 303 markers and does not reach #3464's trend-to-zero goal. Most of the remaining markers sit on dynamic-path reads, commonly a hoisted `const p = path.join(tmpDir, 'STATE.md')` whose target is prose but is unresolvable to this classifier. A stricter one-hop const resolution would flip an estimated 95 more; that is deliberately left to a follow-up so it can be reviewed on its own evidence. Marker discovery reads bytes rather than shelling out to grep: tests/security-prompt-injection.security.test.cjs carries a literal NUL byte (an intentional injection fixture) that makes grep treat it as binary and skip it, which is why the true marked-file count is 303 and not the 302 a shell scan reports. Closes #3465 Co-authored-by: sim <sim@local> Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
144 lines
9.7 KiB
JSON
144 lines
9.7 KiB
JSON
[
|
|
"tests/agent-classification-parity.test.cjs :: source-text-is-the-product",
|
|
"tests/agent-frontmatter.test.cjs :: source-text-is-the-product",
|
|
"tests/agent-required-reading-consistency.test.cjs :: source-text-is-the-product",
|
|
"tests/agent-skills-awareness.test.cjs :: source-text-is-the-product",
|
|
"tests/ai-evals.test.cjs :: source-text-is-the-product",
|
|
"tests/analyze-dependencies.test.cjs :: source-text-is-the-product",
|
|
"tests/anti-pattern-enforcement.test.cjs :: source-text-is-the-product",
|
|
"tests/ask-user-questions-fallback.test.cjs :: source-text-is-the-product",
|
|
"tests/audit-fix-command.test.cjs :: source-text-is-the-product",
|
|
"tests/autonomous-allowed-tools.test.cjs :: source-text-is-the-product",
|
|
"tests/autonomous-converge.test.cjs :: source-text-is-the-product",
|
|
"tests/autonomous-decomposition.test.cjs :: source-text-is-the-product",
|
|
"tests/autonomous-interactive.test.cjs :: source-text-is-the-product",
|
|
"tests/autonomous-to-flag.test.cjs :: source-text-is-the-product",
|
|
"tests/chain-flag-plan-phase.test.cjs :: source-text-is-the-product",
|
|
"tests/changeset-cli.test.cjs :: source-text-is-the-product",
|
|
"tests/check-update-config-dir.test.cjs :: structural-regression-guard",
|
|
"tests/claude-md.test.cjs :: source-text-is-the-product",
|
|
"tests/cleanup-branch-pruning.test.cjs :: source-text-is-the-product",
|
|
"tests/cline-install.test.cjs :: source-text-is-the-product",
|
|
"tests/cline-support.test.cjs :: source-text-is-the-product",
|
|
"tests/code-review-agent-skills.test.cjs :: source-text-is-the-product",
|
|
"tests/code-review-command.test.cjs :: source-text-is-the-product",
|
|
"tests/code-review-pipeline-regression.test.cjs :: source-text-is-the-product",
|
|
"tests/code-review.test.cjs :: source-text-is-the-product",
|
|
"tests/codebuddy-install.test.cjs :: source-text-is-the-product",
|
|
"tests/codex-config.test.cjs :: source-text-is-the-product",
|
|
"tests/command-contract.test.cjs :: source-text-is-the-product",
|
|
"tests/commands.test.cjs :: source-text-is-the-product",
|
|
"tests/config-field-docs.test.cjs :: docs-parity",
|
|
"tests/context-enrichment.test.cjs :: source-text-is-the-product",
|
|
"tests/contributor-standards.test.cjs :: source-text-is-the-product",
|
|
"tests/copilot-install.test.cjs :: integration-test-input",
|
|
"tests/cursor-hooks.test.cjs :: source-text-is-the-product",
|
|
"tests/cursor-reviewer.test.cjs :: source-text-is-the-product",
|
|
"tests/debug-session-management.test.cjs :: source-text-is-the-product",
|
|
"tests/discuss-checkpoint.test.cjs :: source-text-is-the-product",
|
|
"tests/discuss-mode.test.cjs :: structural-implementation-guard",
|
|
"tests/discuss-phase-power.test.cjs :: source-text-is-the-product",
|
|
"tests/docs-parity-live-registry.test.cjs :: source-text-is-the-product",
|
|
"tests/drift-detection.test.cjs :: source-text-is-the-product",
|
|
"tests/edge-probe-docs-fixtures.test.cjs :: source-text-is-the-product",
|
|
"tests/edge-probe-planner-contract.test.cjs :: source-text-is-the-product",
|
|
"tests/edge-probe-spec-phase-contract.test.cjs :: source-text-is-the-product",
|
|
"tests/edit-phase.test.cjs :: source-text-is-the-product",
|
|
"tests/eslint-rules.test.cjs :: <source-grep reason> must still error",
|
|
"tests/eslint-rules.test.cjs :: pending migration",
|
|
"tests/eslint-rules.test.cjs :: source-text-is-the-product",
|
|
"tests/execute-phase-active-flags.test.cjs :: source-text-is-the-product",
|
|
"tests/execute-phase-step-5-5-deviation-doc.test.cjs :: source-text-is-the-product",
|
|
"tests/execute-phase-wave.test.cjs :: source-text-is-the-product",
|
|
"tests/execute-phase-worktree-artifacts.test.cjs :: source-text-is-the-product",
|
|
"tests/explore-command.test.cjs :: source-text-is-the-product",
|
|
"tests/extract-learnings.test.cjs :: source-text-is-the-product",
|
|
"tests/forensics.test.cjs :: source-text-is-the-product",
|
|
"tests/frontmatter-cli.test.cjs :: source-text-is-the-product",
|
|
"tests/gates-taxonomy.test.cjs :: source-text-is-the-product",
|
|
"tests/git-base-branch.test.cjs :: source-text-is-the-product",
|
|
"tests/gsd-check-update-worker-platform-gate.test.cjs :: structural-regression-guard",
|
|
"tests/gsd-researcher-app-aware.test.cjs :: source-text-is-the-product",
|
|
"tests/gsd-researcher-flow-diagram.test.cjs :: source-text-is-the-product",
|
|
"tests/gsd-settings-advanced.test.cjs :: source-text-is-the-product",
|
|
"tests/hermes-skills-migration.test.cjs :: source-text-is-the-product",
|
|
"tests/import-command.test.cjs :: source-text-is-the-product",
|
|
"tests/ingest-docs.test.cjs :: source-text-is-the-product",
|
|
"tests/inline-plan-threshold.test.cjs :: source-text-is-the-product",
|
|
"tests/install-minimal-hooks.test.cjs :: source-text-is-the-product",
|
|
"tests/install-nested-layout.test.cjs :: source-text-is-the-product",
|
|
"tests/install-runtime-artifacts.test.cjs :: source-text-is-the-product",
|
|
"tests/install.test.cjs :: source-text-is-the-product",
|
|
"tests/intel.test.cjs :: source-text-is-the-product",
|
|
"tests/inventory-headings-countfree.test.cjs :: source-text-is-the-product",
|
|
"tests/ios-scaffold-safety.test.cjs :: source-text-is-the-product",
|
|
"tests/locking-bugs-1909-1916-1925-1927.test.cjs :: architectural-invariant",
|
|
"tests/mcp-tool-inheritance.test.cjs :: source-text-is-the-product",
|
|
"tests/milestone-summary.test.cjs :: source-text-is-the-product",
|
|
"tests/milestone.test.cjs :: source-text-is-the-product",
|
|
"tests/model-catalog-runtime-defaults.test.cjs :: source-text-is-the-product",
|
|
"tests/next-safety-gates.test.cjs :: source-text-is-the-product",
|
|
"tests/next-up-clear-order.test.cjs :: source-text-is-the-product",
|
|
"tests/no-hardcoded-home-gsd-tools.test.cjs :: source-text-is-the-product",
|
|
"tests/opencode-permissions.test.cjs :: architectural-invariant",
|
|
"tests/orphaned-hooks.test.cjs :: structural-regression-guard",
|
|
"tests/package-legitimacy-gate.test.cjs :: source-text-is-the-product",
|
|
"tests/parallel-dependent-plans.test.cjs :: source-text-is-the-product",
|
|
"tests/path-replacement.test.cjs :: source-text-is-the-product",
|
|
"tests/phase.test.cjs :: source-text-is-the-product",
|
|
"tests/phase6-capability-docs.test.cjs :: source-text-is-the-product",
|
|
"tests/phase6-capstone-conformance.test.cjs :: source-text-is-the-product",
|
|
"tests/phase6-planning-capabilities.test.cjs :: source-text-is-the-product",
|
|
"tests/plan-bounce.test.cjs :: source-text-is-the-product",
|
|
"tests/plan-phase-drift-guard.test.cjs :: source-text-is-the-product",
|
|
"tests/plan-phase-ui-redirect.test.cjs :: source-text-is-the-product",
|
|
"tests/plan-review-convergence.test.cjs :: source-text-is-the-product",
|
|
"tests/planner-decomposition.test.cjs :: source-text-is-the-product",
|
|
"tests/planner-language-regression.test.cjs :: source-text-is-the-product",
|
|
"tests/playwright-ui-verify.test.cjs :: source-text-is-the-product",
|
|
"tests/policy-160-route0-resume.test.cjs :: source-text-is-the-product",
|
|
"tests/policy-release-no-npm-self-upgrade.test.cjs :: source-text-is-the-product",
|
|
"tests/product-name-purity.test.cjs :: source-text-is-the-product",
|
|
"tests/profile-output.test.cjs :: source-text-is-the-product",
|
|
"tests/progress-forensic.test.cjs :: source-text-is-the-product",
|
|
"tests/prompt-thinning.test.cjs :: source-text-is-the-product",
|
|
"tests/qwen-skills-migration.test.cjs :: source-text-is-the-product",
|
|
"tests/read-guard.test.cjs :: source-text-is-the-product",
|
|
"tests/reapply-patches.test.cjs :: source-text-is-the-product",
|
|
"tests/reapply-verify-hunks.test.cjs :: source-text-is-the-product",
|
|
"tests/release-coverage-scope.test.cjs :: source-text-is-the-product",
|
|
"tests/release-tarball-smoke-workflow.test.cjs :: source-text-is-the-product",
|
|
"tests/release-tarball-smoke.install.test.cjs :: integration-test-input",
|
|
"tests/research-agent-profiles.test.cjs :: source-text-is-the-product",
|
|
"tests/roadmap.test.cjs :: source-text-is-the-product",
|
|
"tests/runtime-launcher-parity.test.cjs :: structural-regression-guard",
|
|
"tests/runtime-name-policy.test.cjs :: source-text-is-the-product",
|
|
"tests/scan-command.test.cjs :: source-text-is-the-product",
|
|
"tests/secret-scan-lint.security.test.cjs :: source-text-is-the-product",
|
|
"tests/secure-phase.test.cjs :: source-text-is-the-product",
|
|
"tests/security-prompt-injection.security.test.cjs :: structural-regression-guard",
|
|
"tests/security-scan.security.test.cjs :: source-text-is-the-product",
|
|
"tests/seed-scan-new-milestone.test.cjs :: source-text-is-the-product",
|
|
"tests/settings-integrations.test.cjs :: source-text-is-the-product",
|
|
"tests/settings-jsonc.test.cjs :: structural-regression-guard",
|
|
"tests/skill-frontmatter-contract.test.cjs :: source-text-is-the-product",
|
|
"tests/spawn-liveness-banner.test.cjs :: source-text-is-the-product",
|
|
"tests/state.test.cjs :: source-text-is-the-product",
|
|
"tests/subagent-timeout.test.cjs :: source-text-is-the-product",
|
|
"tests/template.test.cjs :: source-text-is-the-product",
|
|
"tests/thinking-partner.test.cjs :: source-text-is-the-product",
|
|
"tests/ultraplan-phase.test.cjs :: source-text-is-the-product",
|
|
"tests/verify-health.test.cjs :: source-text-is-the-product",
|
|
"tests/verify-test-quality.test.cjs :: source-text-is-the-product",
|
|
"tests/verify-work-auto-transition.test.cjs :: source-text-is-the-product",
|
|
"tests/windows-robustness.test.cjs :: source-text-is-the-product",
|
|
"tests/workflow-compat.test.cjs :: source-text-is-the-product",
|
|
"tests/workflow-guard-registration.test.cjs :: structural-regression-guard",
|
|
"tests/workflow-maintainer-skip.test.cjs :: source-text-is-the-product",
|
|
"tests/workflow-shell-pinning.test.cjs :: source-text-is-the-product",
|
|
"tests/workflow-size-budget.test.cjs :: source-text-is-the-product",
|
|
"tests/workspace.test.cjs :: source-text-is-the-product",
|
|
"tests/worktree-cleanup.test.cjs :: source-text-is-the-product",
|
|
"tests/worktree.test.cjs :: source-text-is-the-product"
|
|
]
|