Files
msd-core/tests/plan-pre-hook-e2e.test.cjs
Tom Boucher b10e56818b feat(#1169): complete ADR-857 phase 6 — migrate features to Capabilities, revive dead gates, harden conformance gate (#1183)
* test(#1168): make phase-6 gate un-gameable — reject empty stubs + require loop shrink

The migration assertion previously checked only role==feature, so a registration-only stub (empty hooks, logic left inline) would turn the gate green while phase 6 stayed incomplete — the exact false-completion pattern this gate exists to prevent. Strengthen it: each ADR-named feature must OWN its behavior (>=1 hook, or a command family); and plan-phase.md/execute-phase.md must shrink strictly below their frozen pre-phase-6 sizes (94519/93166 LF bytes), which also defeats double-run gaming (declare a hook but keep the inline block -> file does not shrink -> red).

Gate now 5 pass / 4 fail (orphaned execute:wave:post, empty/unregistered features, config-key leaks, no shrink). Green is now reachable only by REAL migration. Refs #1168, #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* feat(#1169): migrate gap-analysis to a Capability (plan:post gate)

First real ADR-857 phase-6 migration (pattern-defining tracer). gap-analysis moves from an inline post_planning_gaps branch in plan-phase.md to a real plan:post gate Capability:

- capabilities/gap-analysis/capability.json: role:feature, plan:post gate (when=workflow.post_planning_gaps, blocking:false advisory), OWNS workflow.post_planning_gaps (federated out of central schema). - plan-phase.md: inline config-get + gsd_run gap-analysis block replaced with a plan:post render-hooks call site dispatching the gate; file shrinks 94519->93279. - src/check-command-router.cts: cmdGapAnalysisPlanPost runs the real gap analysis via gap-checker. - post_planning_gaps removed from central manifest; resolves via federated config (default true preserved). - tests/post-planning-gaps-2493: re-pointed to assert capability ownership.

Verified: gate 5 pass / 4 fail (gap-analysis cleared from migration, plan:post-orphan, config-leak, and plan-phase shrink checks); loadConfig still returns post_planning_gaps=true; check command runs real analysis; 392/392 in the config/registry/federation/router net. Refs #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* feat(#1169): migrate profile-pipeline to a command-family Capability

ADR-857 Decision 7: profile-pipeline becomes a command-family Capability (like audit/intel/graphify). capabilities/profile-pipeline/capability.json declares an 8-command family (scan-sessions, extract-messages, profile-sample, write-profile, profile-questionnaire, generate-dev-preferences, generate-claude-profile, generate-claude-md) backed by a new gsd-core/bin/lib/profile-pipeline-command-router.cjs; the inline case arms are removed from gsd-tools.cjs. Owns profile-pipeline.enabled (federated).

Verified: registry shows role:feature with commands.length=8; scan-sessions/profile-sample run live via the family; gate cleared profile-pipeline from the empty-stub failure (only tdd/schema-gate/drift remain); 296/296 registry+inventory+gsd-tools tests; lint 0 errors. Refs #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* fix(#1167): wire execute:wave:post + implement ui.safety-gate check

Revives the second dead gate from #1167: ui.gates@execute:wave:post was declared but never dispatched AND its check.query (ui.safety-gate) was unimplemented. Adds the per-wave execute:wave:post render-hooks call site in execute-phase.md (fires after each wave's merge/cleanup, before the next forks) and implements cmdUiSafetyGate (frontend + UI-SPEC aware, mirrors cmdUiPlanGate) in check-command-router. +17 regression tests.

Verified: phase-6 orphaned-points conformance test now PASSES (gate 6 pass / 3 fail); ui-safety-gate routable in dot+hyphen forms; check-ui-safety-gate 17/17, check-ui-plan-gate 18/18; lint 0 errors. Refs #1167, #1168.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* feat(#1169): migrate drift (schema + codebase) to execute:wave:post gates

Removes the inline schema_drift_gate + codebase_drift_gate steps (77 lines) from execute-phase.md; drift becomes a Capability with two execute:wave:post gates (verify.schema-drift blocking, verify.codebase-drift advisory) dispatched via the per-wave render-hooks call site. check-command-router routes verify.schema-drift / verify.codebase-drift to the real detectors. Federates workflow.drift_threshold / drift_action / schema_drift_gate out of central.

Also fixes the execute:wave:post dispatch prose to run NON-blocking (advisory) gates too — the prior version only ran blocking gates, which would have silently dropped the codebase-drift advisory after its inline step was removed. Behavior preserved.

Verified: gate 7 pass / 2 fail (drift cleared from stub + config-leak; execute-phase.md 92297 < 93166 frozen -> shrink passes); both drift checks run real detection; loadConfig defaults preserved (threshold=3, action=warn, gate=true); drift-detection 56/56 + schema-drift 34/34; lint 0 errors. Refs #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* feat(#1169): migrate tdd to a Capability (plan:pre contribution + execute:post gate)

tdd becomes a real Capability: a plan:pre contribution injects the <tdd_mode_active> planner guidance (rendered from PLAN_PRE_HOOKS_JSON like security's contribution), and an execute:post gate (tdd.review-checkpoint, advisory) runs the real end-of-phase RED/GREEN review via a new check-command handler. Inline tdd_mode reads + the inline planner block + the tdd_review_checkpoint step are removed; workflow.tdd_mode is federated out of central. The MVP+TDD per-task RED-commit gate is preserved — TDD_MODE is now derived from the execute:post hooks (capId==tdd active), not an inline config-get.

BEHAVIOR CHANGE (documented, not silent): the --tdd CLI flag now persists workflow.tdd_mode=true via config-set instead of being per-invocation. Rationale: tdd is now a config-toggled Capability, and env vars do not persist across the workflow's separate bash blocks (config does), so an ephemeral override isn't cleanly achievable; --tdd therefore enables the tdd capability, consistent with how all capabilities are toggled.

Verified: gate 7 pass / 2 fail (tdd cleared from stub + config-leak; plan-phase + execute-phase both < frozen sizes); contribution injection + execute:post gate dispatch wired; MVP+TDD gate preserved; tdd.review-checkpoint runs real review; full unit suite 556/0; lint 0 errors. Refs #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* feat(#1169): migrate schema-gate to a plan:pre contribution Capability

The plan-time schema-push detection (former plan-phase.md §5.7) becomes a schema-gate Capability: a plan:pre contribution (into:planner, when:workflow.schema_push_detection) whose fragment carries the full ORM-detection + [BLOCKING] schema-push-task injection logic, rendered into the planner via the existing plan:pre render-hooks dispatch. The inline §5.7 block is removed (plan-phase.md 94519->90445). workflow.schema_push_detection is a new capability-owned (federated) key, default true. (The execute-side schema-drift gate was migrated separately into the drift capability.)

Verified: registry inlines the fragment (len 2704) so it is actually delivered at plan:pre; gate 8 pass / 1 fail — all 5 ADR-named features now real Capabilities, only the config-leak test remains (intel/security, next unit). Refs #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* feat(#1169): close the 3 capability config-key leaks — phase-6 gate now GREEN

Removes the last inline config-get reads of capability-owned keys from plan-phase.md. security_asvs_level/security_block_on now flow through the security plan:pre contribution via a new loop-resolver configValues mechanism (resolves declared config keys with the same 4-level precedence as activation and attaches them to the rendered hook); the §5.55 banner reads them from PLAN_PRE_HOOKS_JSON. intel.enabled becomes a real intel plan:pre step (ref.command: intel api-surface) dispatched via render-hooks; the inline intel branch is gone. gen-capability-registry now validates ref.command as a third dispatch shape.

Verified: phase-6 capstone conformance gate is FULLY GREEN (9/0); 3 leaks gone (grep=0); security configValues resolve to {2,medium}/default {1,high}; intel step present only when enabled; loop-render-hooks 62/0, capability-registry 287/0, capability-state/federated-config 113/0; lint 0 errors. Closes the migration half of #1169. Refs #1139, #1167, #1168.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* fix(#1169): address adversarial review — restore schema-drift block, generic planner injection, uniform gate contract

Adversarial review caught 2 real regressions the green gate missed: (1) schema-drift no longer blocked — the execute:wave:post dispatch read GATE_RESULT.block but verify.schema-drift emitted drift_detected/blocking, and onError:skip wrongly bypassed positive blocks; (2) only tdd's plan:pre contribution was injected into the planner, dropping schema-gate's schema-push detection and security's threat-model guidance.

Fixes: (A) every gate check returns a uniform boolean 'block' under --raw (the dispatch form), with advisory gates (tdd/gap) carrying their report in 'message'; (B) gate-dispatch contract corrected at all sites — onError governs command errors only, a blocking gate's positive block always halts; (C) generic planner injection of all plan:pre contributions where into=='planner' (tdd + schema-gate + security incl configValues); (D) two new conformance assertions: planner contributions injected generically + every gate check.query returns boolean block under --raw.

Verified: gate 11/11; all 6 gate checks return boolean block under --raw; full suite 595/0; lint 0 errors. Refs #1167, #1168, #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* fix(#1169): restore MVP+TDD end-of-phase blocking escalation (2nd adversarial pass)

The migrated tdd execute:post gate is statically blocking:false, but the contract (references/execute-mvp-tdd.md + CONTEXT.md) requires the end-of-phase TDD review to ESCALATE from advisory to blocking when MVP_MODE && TDD_MODE && a TDD plan misses a RED/GREEN commit. The migration prose had downgraded this to a 'strong advisory recommendation' — silent loss of the blocking escalation. Restore it: the tdd-gate dispatch now refuses to mark the phase complete (Phase blocked message) under MVP+TDD when GATE_RESULT.block is true; advisory otherwise.

Also strengthen tests/execute-mvp-tdd-gate.test.cjs: hasBlockingEscalation previously matched any line with 'blocking'+'mvp+tdd' (so 'advisory (blocking: false) ... under MVP+TDD' was a false green); now it requires the real refusal semantics ('refuse to mark the phase complete' / 'phase blocked'). Caught by 2nd adversarial review pass.

Verified: execute-phase.md 92702 < 93166 frozen; mvp-tdd-gate + phase-6 gate 19/0; full suite green; lint 0 errors. Refs #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* fix(#1169): restore MVP+TDD proceed-block, codebase auto-remap, schema skip-flag (3rd adversarial pass)

3rd adversarial pass found 4 more silent regressions: (1) the tdd MVP+TDD 'refuse to mark complete' was nullified by a downstream 'ALWAYS proceed regardless of gate results' line — proceed is now conditional (stops on an active MVP+TDD block); (2) the test now asserts the proceed is NOT an unconditional override; (3) codebase-drift auto-remap (spawn gsd-codebase-mapper when drift_action=auto-remap) was dropped — the execute:wave:post advisory dispatch now consumes spawn_mapper/directive; (4) GSD_SKIP_SCHEMA_CHECK bypass was lost from the gate path — cmdVerifySchemaDrift now honors the env var (block:false when set).

Verified: no unconditional proceed; GSD_SKIP_SCHEMA_CHECK=true -> block:false; gate 11/11 + mvp-tdd 9/9; full suite 569/0; lint 0; execute-phase.md 93109 < 93166. Refs #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* fix(#1169): init.cts reads federated config keys from nested path (4th adversarial pass)

Config federation moved tdd_mode/research/nyquist_validation from flat config.<key> to nested config.workflow.<key>, but src/init.cts still read them flat — so init.plan-phase/init.execute-phase emitted tdd_mode:false / research_enabled:undefined / nyquist:undefined regardless of config (a public command-contract regression; the migrated loops use render-hooks so enforcement was unaffected). Read via config.workflow (type-safe Record cast). Now init reflects the same resolved values + federated defaults (research/nyquist default true) as the render-hooks path.

Verified: build clean; init.plan-phase emits tdd_mode:true/research:false/nyquist:false for set config, defaults true for empty; full suite 591/0; lint 0. Refs #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* docs(#1169): add changeset for ADR-857 phase-6 completion (PR #1183)

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* fix(#1169): complete phase-6 migration fallout — restore TEXT_MODE, fix registry .claude leak, re-point stale workflow-contract tests

The capability migration left real regressions and stale consumer tests that
the per-module unit suite missed but the full cross-platform suite caught (27
failing tests):

Real source regressions (fixed):
- execute-phase.md lost its AskUserQuestion TEXT_MODE plain-text fallback when
  the inline schema_drift_gate step was removed — non-Claude runtimes would
  stall. Restored, and the execute:post gate-dispatch prose de-duplicated to
  cite the execute:wave:post contract (loop body shrinks below the frozen
  pre-phase-6 ceiling while keeping every onError/blocking nuance).
- capabilities/tdd inline fragment hardcoded `@~/.claude/gsd-core/references/tdd.md`,
  baked verbatim into the committed capability-registry.cjs and leaked the
  install path on 11 non-Claude runtimes (registry .cjs is copied, not
  path-converted). Made the fragment path-free; regenerated the registry. The
  phase-6 conformance gate now guards this (no ~/.claude install path in any
  capability source or the generated registry).
- plan-phase.md: removed a §5.7 stub re-added in error and routed Branch 2 to
  step 6 (schema-gate is a plan:pre capability, §5.7 is gone).

Stale workflow-contract tests re-pointed to the capability dispatch they now
must assert (behavior verified preserved in source first, assertions kept
equal-or-stronger): bug-621 + bug-2851 (gap-analysis via gsd_run render-hooks
plan:post + registry binding), feat-2527 (tdd_mode federated out of central),
phase6-planning + plan-phase-ui-redirect (§5.6 bounded by ## 6.),
plan-phase-drift-guard (intel when:intel.enabled skip branch).

profile-pipeline-command-router.cjs un-ignored from eslint (hand-written, no
TS source) + stale disable comments removed. Size baseline regenerated.

Verified: full suite 15140 tests / 0 fail; lint 0 errors; conformance gate green
legitimately. Refs #1139, #1167, #1168, #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* test(#1169): add ADR-857 E2E content-test coverage for the 12 loop points + capability deliverables

Grounds the capability engine in behavioral E2E tests (drive the real
render-hooks/check CLI + the real registry, assert typed result content — no
source-grep), structured around what ADR-857 says to deliver. 207 tests; each
genuineness-checked (flip the expectation, confirm it fails).

Per-loop-point dispatch (7 files): empty-point negative-space across the 6
no-hook points; verify:post 3-step resolution+ordering+onError; plan:pre
contribution/configValues + ui.plan-gate + intel; plan:post gap-analysis;
execute:wave:post drift+ui gates via the check route (schema-drift block/skip,
codebase-drift threshold BVA, auto-remap); execute:post tdd.review-checkpoint
RED/GREEN; ship:pre security gate resolution + frontmatter-get predicate pieces.

ADR-deliverable coverage (4 files): predicate boundary held (edge/prohibition
probes stay core, not off-by-default Feature Capabilities — phase-6 exception);
core loop runs with zero capabilities (all 12 points empty, init bundles
resolve); contribution merge (multiple ordered <contribution from=> blocks);
federated-config key removal on uninstall.

federated-config allowlisted for its 3-file split (unit + integration +
lifecycle). Refs #1139, #1167, #1168, #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* fix(#1169): remove dead drifted converter dups + address adversarial review

Lint cleanup (root-caused, not waved off): src/runtime-artifact-conversion.cts
carried 11 agent-converter functions (+5 orphaned consts/helpers) that were
never exported, never called, and had silently DRIFTED from the live
hand-authored copies in bin/install.js (one even referenced an undefined
`claudeToCopilotTools`). Deleted the dead duplicates; install.js's live copies
are untouched (it never imported these). Lint now 0 errors / 0 warnings.

Adversarial-review (Codex) findings fixed:
- HIGH: execute-phase.md TDD_MODE used `jq ... || echo false`, silently
  disabling the MVP+TDD blocking gate on jq-less runtimes. Reverted to the
  `node -e` form (node is guaranteed; matches the file's other node-e usages) so
  a missing optional tool can no longer fail-open a blocking safety path.
- MEDIUM: federated-config-key-removal orphan-key test was vacuous (it skipped
  the orphan assertion). Now asserts the removed capability's key is genuinely
  not surfaced/validated after uninstall.
- LOW: phase-6 conformance leak regex broadened to catch absolute-home and
  Windows-backslash `.claude/(gsd-core|commands|agents|hooks)` paths, not only
  `~`/`$HOME` forward-slash forms.
- LOW: bug-2851 plan:post dispatch assertion now requires `--raw` (matched its
  stated contract).
- nit: plan-pre intel-step test duplicate assertion replaced with a distinct
  structured-output check.

Size baseline regenerated (execute-phase.md 93089 < 93166 frozen). Refs #1167, #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* test(#1169): make runtime-homes-descriptor-drive titles environment-independent

The descriptor-equivalence test embedded the absolute golden config path
(`os.homedir()`-derived) directly in each `test(...)` title, so titles differed
between macOS (`/Users/x/.claude`) and Docker (`/home/gsdtest/.claude`). Every
test PASSES on both platforms (15885/0 leaf tests each), but gsd-test-summary
compares results by title and reported 29+29 false "only in Mac / only in
Docker" discrepancies for tests that actually pass everywhere.

Move the golden path out of the title and into the assertion message (still
shown on failure); titles are now byte-identical across platforms so the
cross-platform comparator matches them. No assertion logic or golden values
changed. Refs #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* fix(#1169): derive TDD_MODE via gsd_run --active-cap, not node -e (fix prompt-injection CI gate)

The prior fix reverted execute-phase.md:181 from jq to `node -e` to close a
Codex HIGH (jq||echo-false silently disabling the MVP+TDD blocking gate on
jq-less runtimes) — but the CI prompt-injection scanner BLOCKS new `node -e` in
workflow markdown (inline code-exec = injection vector), turning the security
gate red. Both forms were wrong: node -e fails the scanner; jq fail-opens a
blocking safety gate; `config-get workflow.tdd_mode` is forbidden by the
conformance leak gate (tdd_mode is capability-owned).

Correct fix (what Codex recommended): a gsd_run-native boolean. Add an
`--active-cap <capId>` flag to `loop render-hooks <point>` that resolves hooks
the normal way and prints exactly `true`/`false` for whether a capId is active
— scanner-safe (canonical launcher, no inline code), node-reliable (no optional
jq to fail-open), and leak-free (render-hooks resolution, not config-get).
execute-phase.md:181 now `TDD_MODE=$(gsd_run loop render-hooks execute:post
--active-cap tdd)`. +5 behavioral tests for the flag.

Verified: prompt-injection-scan --diff origin/next → 0 findings; conformance
gate 13/13 (execute-phase.md 92934 < 93166); execute-mvp-tdd + tdd-mode +
loop-render-hooks 87/0; lint 0/0. Refs #1167, #1169.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-13 21:07:55 -04:00

556 lines
23 KiB
JavaScript

'use strict';
/**
* plan-pre-hook-e2e.test.cjs — E2E content tests for plan:pre hook resolution.
*
* ADR-857 phase 6 capstone conformance — gap-backlog: plan:pre
* All tests drive real CLI subprocess or real resolver with real registry.
* No source-grep — RULESET.TESTS.no-source-grep.
*
* Covers:
* 1. intel.enabled=true → step ref.command='intel api-surface', rendered contains 'intel api-surface'
* 2. tdd_mode=true → tdd contribution fragment contains '<tdd_mode_active>'
* 3. security_enforcement=true + explicit asvs/block_on → configValues resolved from config
* 4. BVA: security defaults (asvs_level=1, block_on='high') when only enforcement=true
* 5. All plan:pre when-keys false → empty activeHooks + placeholder rendered
* 6. check ui.plan-gate: frontend + no-spec → block:true, exit 0
* 7. check ui.plan-gate: frontend + spec present → block:false, exit 0
* 8. check ui.plan-gate: missing phase arg → exit 1, clear error message
* 9. BVA: check ui.plan-gate phase=99 (nonexistent) → phaseLookupFailed:true, block:false
* 10. BVA: intel api-surface symbolCount=0 → stale:true + Incomplete banner
* 11. BVA: intel api-surface symbolCount=1 fresh → stale:false + symbol in file
* 12. ui cluster disabled via surface + tdd + intel on → no ui hooks, intel+tdd present
*/
const { describe, test, before, after } = require('node:test');
const assert = require('node:assert/strict');
const fs = require('node:fs');
const os = require('node:os');
const path = require('node:path');
const { spawnSync } = require('node:child_process');
const { cleanup } = require('./helpers.cjs');
const GSD_TOOLS = path.join(__dirname, '..', 'gsd-core', 'bin', 'gsd-tools.cjs');
// ─── Subprocess helper (isolated env, no ambient GSD_ vars) ───────────────────
const CLEAN_ENV = {
GSD_SESSION_KEY: '',
CODEX_THREAD_ID: '',
CLAUDE_SESSION_ID: '',
CLAUDE_CODE_SSE_PORT: '',
OPENCODE_SESSION_ID: '',
GEMINI_SESSION_ID: '',
CURSOR_SESSION_ID: '',
WINDSURF_SESSION_ID: '',
TERM_SESSION_ID: '',
WT_SESSION: '',
TMUX_PANE: '',
ZELLIJ_SESSION_NAME: '',
TTY: '',
SSH_TTY: '',
GSD_WORKSTREAM: '',
GSD_PROJECT: '',
};
/**
* Run gsd-tools via spawnSync. Returns { status, stdout, stderr }.
* Passes env overrides merged on top of process.env + CLEAN_ENV.
*/
function runTools(args, cwd, envOverrides = {}) {
return spawnSync(
process.execPath,
[GSD_TOOLS, ...args],
{
cwd: cwd || process.cwd(),
encoding: 'utf8',
timeout: 30000,
env: { ...process.env, ...CLEAN_ENV, ...envOverrides },
},
);
}
/**
* Parse JSON stdout from runTools result — throws with diagnostic on failure.
*/
function parseEnvelope(result, label = '') {
try {
return JSON.parse(result.stdout.trim());
} catch (e) {
throw new Error(
`${label}: JSON.parse failed.\n` +
`stdout=${result.stdout?.slice(0, 300)}\n` +
`stderr=${result.stderr?.slice(0, 300)}\n` +
`status=${result.status}`
);
}
}
// ─── Fixture factory helpers ──────────────────────────────────────────────────
function makePlanningDir(tmpDir, configObj = null) {
fs.mkdirSync(path.join(tmpDir, '.planning', 'phases'), { recursive: true });
if (configObj !== null) {
fs.writeFileSync(
path.join(tmpDir, '.planning', 'config.json'),
JSON.stringify(configObj),
'utf8',
);
}
}
function makeProject(configObj = null) {
const tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-e2e-'));
makePlanningDir(tmpDir, configObj);
return tmpDir;
}
// ─── 1. intel.enabled=true emits step with ref.command and rendered text ──────
describe('plan:pre intel step — ref.command and rendered text', () => {
let tmpDir;
before(() => {
tmpDir = makeProject({ intel: { enabled: true } });
});
after(() => cleanup(tmpDir));
test('[happy] intel.enabled=true: activeHooks has intel step with ref.command="intel api-surface"', () => {
const result = runTools(['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--raw'], tmpDir);
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
const envelope = parseEnvelope(result, 'intel-step');
assert.strictEqual(envelope.point, 'plan:pre');
assert.ok(Array.isArray(envelope.activeHooks), 'activeHooks must be array');
const intelHook = envelope.activeHooks.find(h => h.capId === 'intel');
assert.ok(intelHook !== undefined, 'intel hook must be present when intel.enabled=true');
assert.strictEqual(intelHook.kind, 'step', 'intel hook kind must be step');
assert.deepEqual(intelHook.ref, { command: 'intel api-surface' },
'ref must be {command:"intel api-surface"} not a JSON blob');
// Rendered text: check it contains "intel api-surface" (as part of the JSON or label)
assert.ok(
envelope.rendered.includes('intel api-surface'),
`rendered must contain 'intel api-surface'. Got: ${envelope.rendered.slice(0, 200)}`,
);
// Rendered must be structured step text, not a bare JSON object dump.
// A structured render includes human-readable step metadata (- produces:, - when:).
assert.ok(
envelope.rendered.includes('- produces:') && envelope.rendered.includes('- when:'),
'intel step must render as a structured step (with produces/when labels), not an opaque blob',
);
// Also assert the produces path appears
assert.ok(
envelope.rendered.includes('.planning/intel/API-SURFACE.md'),
'rendered must include the produced file path',
);
});
});
// ─── 2. tdd_mode=true emits tdd contribution with <tdd_mode_active> ───────────
describe('plan:pre tdd contribution — fragment.inline contains <tdd_mode_active>', () => {
let tmpDir;
before(() => {
tmpDir = makeProject({ workflow: { tdd_mode: true } });
});
after(() => cleanup(tmpDir));
test('[happy] tdd_mode=true: tdd contribution fragment.inline contains <tdd_mode_active>', () => {
const result = runTools(['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--raw'], tmpDir);
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
const envelope = parseEnvelope(result, 'tdd-contribution');
const tddHook = envelope.activeHooks.find(h => h.capId === 'tdd');
assert.ok(tddHook !== undefined, 'tdd hook must be present when tdd_mode=true');
assert.strictEqual(tddHook.kind, 'contribution', 'tdd hook kind must be contribution');
assert.ok(
tddHook.fragment && typeof tddHook.fragment.inline === 'string',
'tdd hook must have fragment.inline string',
);
assert.ok(
tddHook.fragment.inline.includes('<tdd_mode_active>'),
`fragment.inline must contain '<tdd_mode_active>'. Got: ${tddHook.fragment.inline.slice(0, 200)}`,
);
// Rendered text must also contain the tag
assert.ok(
envelope.rendered.includes('<tdd_mode_active>'),
`rendered must contain '<tdd_mode_active>'. Got: ${envelope.rendered.slice(0, 200)}`,
);
});
});
// ─── 3. security contribution emits configValues from explicit config ──────────
describe('plan:pre security contribution — configValues from explicit config', () => {
let tmpDir;
before(() => {
tmpDir = makeProject({
workflow: {
security_enforcement: true,
security_asvs_level: 3,
security_block_on: 'critical',
},
});
});
after(() => cleanup(tmpDir));
test('[happy] security_enforcement=true + explicit asvs=3 + block_on=critical: configValues match config', () => {
const result = runTools(['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--raw'], tmpDir);
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
const envelope = parseEnvelope(result, 'security-configValues-explicit');
const secHook = envelope.activeHooks.find(h => h.capId === 'security');
assert.ok(secHook !== undefined, 'security hook must be present when security_enforcement=true');
assert.strictEqual(secHook.kind, 'contribution', 'security hook kind must be contribution');
assert.ok(secHook.configValues !== undefined, 'security hook must have configValues');
assert.strictEqual(secHook.configValues.security_asvs_level, 3,
'security_asvs_level must be 3 (from config, not default 1)');
assert.strictEqual(secHook.configValues.security_block_on, 'critical',
'security_block_on must be critical (from config, not default high)');
});
});
// ─── 4. BVA: security defaults when enforcement=true but levels not set ────────
describe('plan:pre security contribution — BVA: default configValues', () => {
let tmpDir;
before(() => {
tmpDir = makeProject({ workflow: { security_enforcement: true } });
});
after(() => cleanup(tmpDir));
test('[bva] security_enforcement=true only: configValues use schema defaults (asvs=1, block_on=high)', () => {
const result = runTools(['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--raw'], tmpDir);
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
const envelope = parseEnvelope(result, 'security-configValues-defaults');
const secHook = envelope.activeHooks.find(h => h.capId === 'security');
assert.ok(secHook !== undefined, 'security hook must be present');
assert.ok(secHook.configValues !== undefined, 'security hook must have configValues');
// BVA: schema defaults — must be 1 and 'high', NOT 3 or 'critical'
assert.strictEqual(secHook.configValues.security_asvs_level, 1,
'default asvs_level must be 1 when not set in config');
assert.strictEqual(secHook.configValues.security_block_on, 'high',
'default block_on must be high when not set in config');
});
});
// ─── 5. All plan:pre when-keys false → empty activeHooks + placeholder ─────────
describe('plan:pre all-off — empty resolution', () => {
let tmpDir;
before(() => {
tmpDir = makeProject({
workflow: {
ai_integration_phase: false,
tdd_mode: false,
security_enforcement: false,
ui_phase: false,
ui_safety_gate: false,
research: false,
pattern_mapper: false,
schema_push_detection: false,
},
intel: { enabled: false },
});
});
after(() => cleanup(tmpDir));
test('[negative] all plan:pre when-keys false: activeHooks empty, rendered is placeholder', () => {
const result = runTools(['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--raw'], tmpDir);
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
const envelope = parseEnvelope(result, 'all-off');
assert.deepEqual(envelope.activeHooks, [],
`activeHooks must be empty when all flags false. Got: ${JSON.stringify(envelope.activeHooks.map(h=>h.capId))}`);
assert.strictEqual(envelope.rendered, '_No active hooks at plan:pre._',
'rendered must be placeholder when no active hooks');
});
});
// ─── 6. check ui.plan-gate: frontend + no-spec → block:true ──────────────────
describe('check ui.plan-gate — frontend phase, no UI-SPEC', () => {
let tmpDir;
before(() => {
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-ui-gate-'));
const planningDir = path.join(tmpDir, '.planning');
fs.mkdirSync(path.join(planningDir, 'phases', '01-dashboard'), { recursive: true });
fs.writeFileSync(path.join(planningDir, 'config.json'), '{}', 'utf8');
fs.writeFileSync(
path.join(planningDir, 'ROADMAP.md'),
[
'# Project Roadmap',
'',
'## Phase 1: Dashboard',
'',
'Build the user interface and frontend dashboard components.',
'',
].join('\n'),
'utf8',
);
// No UI-SPEC.md in phase dir
});
after(() => cleanup(tmpDir));
test('[happy] frontend phase + no UI-SPEC: block:true, frontend:true, hasUiSpec:false, exit 0', () => {
const result = runTools(['check', 'ui.plan-gate', '1', '--raw'], tmpDir);
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
const out = parseEnvelope(result, 'ui-plan-gate-no-spec');
assert.strictEqual(out.frontend, true, 'frontend must be true for frontend-keyword phase');
assert.strictEqual(out.hasUiSpec, false, 'hasUiSpec must be false when no spec file exists');
assert.strictEqual(out.block, true, 'block must be true (frontend && !hasUiSpec)');
assert.strictEqual(out.uiSpecPath, null, 'uiSpecPath must be null when spec absent');
});
});
// ─── 7. check ui.plan-gate: frontend + spec present → block:false ─────────────
describe('check ui.plan-gate — frontend phase, UI-SPEC present', () => {
let tmpDir;
before(() => {
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-ui-gate-spec-'));
const planningDir = path.join(tmpDir, '.planning');
fs.mkdirSync(path.join(planningDir, 'phases', '01-dashboard'), { recursive: true });
fs.writeFileSync(path.join(planningDir, 'config.json'), '{}', 'utf8');
fs.writeFileSync(
path.join(planningDir, 'ROADMAP.md'),
[
'# Project Roadmap',
'',
'## Phase 1: Dashboard',
'',
'Build the frontend React dashboard with UI forms.',
'',
].join('\n'),
'utf8',
);
// Add a UI-SPEC.md
fs.writeFileSync(
path.join(planningDir, 'phases', '01-dashboard', '01-UI-SPEC.md'),
'# UI Design Contract\n',
'utf8',
);
});
after(() => cleanup(tmpDir));
test('[happy] frontend phase + UI-SPEC present: block:false, hasUiSpec:true, uiSpecPath ends with -UI-SPEC.md', () => {
const result = runTools(['check', 'ui.plan-gate', '1', '--raw'], tmpDir);
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
const out = parseEnvelope(result, 'ui-plan-gate-with-spec');
assert.strictEqual(out.frontend, true, 'frontend must be true');
assert.strictEqual(out.hasUiSpec, true, 'hasUiSpec must be true when spec file exists');
assert.strictEqual(out.block, false, 'block must be false (spec present)');
assert.ok(
typeof out.uiSpecPath === 'string' && out.uiSpecPath.endsWith('-UI-SPEC.md'),
`uiSpecPath must end with -UI-SPEC.md. Got: ${out.uiSpecPath}`,
);
});
});
// ─── 8. check ui.plan-gate: missing phase arg → exit 1 + error message ────────
describe('check ui.plan-gate — missing phase argument', () => {
test('[negative] missing phase arg: exit code 1, stderr contains ui-plan-gate requires a phase argument', () => {
const result = runTools(['check', 'ui.plan-gate', '--raw']);
assert.strictEqual(result.exitCode ?? result.status, 1,
`exit code must be 1. Got: ${result.status}. stderr=${result.stderr?.slice(0, 300)}`);
assert.ok(
(result.stderr || '').includes('ui-plan-gate requires a phase argument'),
`stderr must include 'ui-plan-gate requires a phase argument'. Got: ${result.stderr?.slice(0, 300)}`,
);
});
});
// ─── 9. BVA: check ui.plan-gate phase=99 → phaseLookupFailed:true ─────────────
describe('check ui.plan-gate — BVA: non-existent phase 99', () => {
let tmpDir;
before(() => {
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-ui-gate-99-'));
const planningDir = path.join(tmpDir, '.planning');
fs.mkdirSync(path.join(planningDir, 'phases', '01-dashboard'), { recursive: true });
fs.writeFileSync(path.join(planningDir, 'config.json'), '{}', 'utf8');
fs.writeFileSync(
path.join(planningDir, 'ROADMAP.md'),
[
'# Project Roadmap',
'',
'## Phase 1: Dashboard',
'',
'Build the frontend dashboard.',
'',
].join('\n'),
'utf8',
);
});
after(() => cleanup(tmpDir));
test('[bva] phase=99 (nonexistent in ROADMAP.md with only Phase 1): phaseLookupFailed:true, block:false', () => {
const result = runTools(['check', 'ui.plan-gate', '99', '--raw'], tmpDir);
assert.strictEqual(result.status, 0, `exit must be 0. stderr=${result.stderr?.slice(0, 300)}`);
const out = parseEnvelope(result, 'ui-plan-gate-phase-99');
assert.strictEqual(out.phaseLookupFailed, true,
'phaseLookupFailed must be true for a phase not found in ROADMAP.md');
// When phase lookup fails, frontend defaults to false and block must be false
assert.strictEqual(out.frontend, false,
'frontend must be false when phase lookup fails (not silently block:false)');
assert.strictEqual(out.block, false,
'block must be false when phase not found — phaseLookupFailed distinguishes this from a clean pass');
});
});
// ─── 10. BVA: intel api-surface symbolCount=0 → stale:true + Incomplete ──────
describe('intel api-surface — BVA: symbolCount=0 (empty entries)', () => {
let tmpDir;
before(() => {
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-intel-empty-'));
const planningDir = path.join(tmpDir, '.planning');
fs.mkdirSync(path.join(planningDir, 'intel'), { recursive: true });
fs.writeFileSync(path.join(planningDir, 'config.json'), JSON.stringify({ intel: { enabled: true } }), 'utf8');
// api-map.json with empty object entries
fs.writeFileSync(
path.join(planningDir, 'intel', 'api-map.json'),
JSON.stringify({ entries: {} }),
'utf8',
);
});
after(() => cleanup(tmpDir));
test('[bva] symbolCount=0: exit 0, stale:true, symbolCount:0, written file contains Incomplete banner', () => {
const result = runTools(['intel', 'api-surface', '--raw'], tmpDir);
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
const out = parseEnvelope(result, 'intel-api-surface-empty');
assert.strictEqual(out.symbolCount, 0, 'symbolCount must be 0 for empty entries');
assert.strictEqual(out.stale, true, 'stale must be true when no _meta.updated_at');
assert.ok(typeof out.written === 'string' && out.written.endsWith('API-SURFACE.md'),
`written must be a path ending in API-SURFACE.md. Got: ${out.written}`);
// Content check — the written file must contain the Incomplete banner
const content = fs.readFileSync(out.written, 'utf8');
assert.ok(
content.includes('Incomplete'),
`API-SURFACE.md must contain 'Incomplete' banner when symbolCount=0. Got: ${content.slice(0, 300)}`,
);
});
});
// ─── 11. BVA: intel api-surface symbolCount=1 fresh → stale:false ─────────────
describe('intel api-surface — BVA: symbolCount=1, fresh _meta', () => {
let tmpDir;
before(() => {
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-intel-one-'));
const planningDir = path.join(tmpDir, '.planning');
fs.mkdirSync(path.join(planningDir, 'intel'), { recursive: true });
fs.writeFileSync(path.join(planningDir, 'config.json'), JSON.stringify({ intel: { enabled: true } }), 'utf8');
// api-map.json with one entry object and fresh _meta
fs.writeFileSync(
path.join(planningDir, 'intel', 'api-map.json'),
JSON.stringify({
entries: {
getUserById: {
file: 'src/api/users.ts',
kind: 'function',
signature: 'getUserById(id: string): Promise<User>',
},
},
_meta: { updated_at: new Date().toISOString() },
}),
'utf8',
);
});
after(() => cleanup(tmpDir));
test('[bva] symbolCount=1 with fresh _meta.updated_at: exit 0, stale:false, symbolCount:1', () => {
const result = runTools(['intel', 'api-surface', '--raw'], tmpDir);
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
const out = parseEnvelope(result, 'intel-api-surface-one-entry');
assert.strictEqual(out.symbolCount, 1, 'symbolCount must be 1 for one entry');
assert.strictEqual(out.stale, false, 'stale must be false when _meta.updated_at is fresh (<24h)');
assert.ok(typeof out.written === 'string' && out.written.endsWith('API-SURFACE.md'),
`written must be API-SURFACE.md path. Got: ${out.written}`);
// Content check — symbol must appear in the file
const content = fs.readFileSync(out.written, 'utf8');
assert.ok(
content.includes('getUserById'),
`API-SURFACE.md must contain 'getUserById' symbol. Got: ${content.slice(0, 300)}`,
);
});
});
// ─── 12. ui cluster disabled + tdd + intel on → no ui hooks, intel+tdd present ─
describe('plan:pre surface cluster filter — ui disabled, tdd+intel active', () => {
let tmpDir;
before(() => {
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-surface-'));
const planningDir = path.join(tmpDir, '.planning');
fs.mkdirSync(planningDir, { recursive: true });
// Enable intel, tdd, and also ui things in project config
fs.writeFileSync(
path.join(planningDir, 'config.json'),
JSON.stringify({
intel: { enabled: true },
workflow: {
tdd_mode: true,
ui_phase: true,
ui_safety_gate: true,
security_enforcement: false,
research: false,
pattern_mapper: false,
schema_push_detection: false,
ai_integration_phase: false,
},
}),
'utf8',
);
// .gsd-surface.json disabling UI cluster in same dir (config-dir = tmpDir)
fs.writeFileSync(
path.join(tmpDir, '.gsd-surface.json'),
JSON.stringify({
baseProfile: 'full',
disabledClusters: ['ui'],
explicitAdds: [],
explicitRemoves: [],
}),
'utf8',
);
});
after(() => cleanup(tmpDir));
test('[empty-resolution/surface] ui cluster disabled: no ui hooks; intel and tdd hooks present', () => {
const result = runTools(
['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--config-dir', tmpDir, '--raw'],
tmpDir,
);
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
const envelope = parseEnvelope(result, 'ui-cluster-disabled');
// No ui hooks — specific assertion on the differing field
const uiHooks = envelope.activeHooks.filter(h => h.capId === 'ui');
assert.strictEqual(uiHooks.length, 0,
`ui cluster disabled must suppress all ui hooks. Got ui hooks: ${JSON.stringify(uiHooks)}`);
// intel hook must be present (not suppressed by ui cluster disable)
const intelHooks = envelope.activeHooks.filter(h => h.capId === 'intel');
assert.strictEqual(intelHooks.length, 1,
`intel hook must be present. Got: ${JSON.stringify(envelope.activeHooks.map(h => h.capId))}`);
// tdd hook must be present
const tddHooks = envelope.activeHooks.filter(h => h.capId === 'tdd');
assert.strictEqual(tddHooks.length, 1,
`tdd hook must be present. Got: ${JSON.stringify(envelope.activeHooks.map(h => h.capId))}`);
});
});