* test(#1168): make phase-6 gate un-gameable — reject empty stubs + require loop shrink The migration assertion previously checked only role==feature, so a registration-only stub (empty hooks, logic left inline) would turn the gate green while phase 6 stayed incomplete — the exact false-completion pattern this gate exists to prevent. Strengthen it: each ADR-named feature must OWN its behavior (>=1 hook, or a command family); and plan-phase.md/execute-phase.md must shrink strictly below their frozen pre-phase-6 sizes (94519/93166 LF bytes), which also defeats double-run gaming (declare a hook but keep the inline block -> file does not shrink -> red). Gate now 5 pass / 4 fail (orphaned execute:wave:post, empty/unregistered features, config-key leaks, no shrink). Green is now reachable only by REAL migration. Refs #1168, #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * feat(#1169): migrate gap-analysis to a Capability (plan:post gate) First real ADR-857 phase-6 migration (pattern-defining tracer). gap-analysis moves from an inline post_planning_gaps branch in plan-phase.md to a real plan:post gate Capability: - capabilities/gap-analysis/capability.json: role:feature, plan:post gate (when=workflow.post_planning_gaps, blocking:false advisory), OWNS workflow.post_planning_gaps (federated out of central schema). - plan-phase.md: inline config-get + gsd_run gap-analysis block replaced with a plan:post render-hooks call site dispatching the gate; file shrinks 94519->93279. - src/check-command-router.cts: cmdGapAnalysisPlanPost runs the real gap analysis via gap-checker. - post_planning_gaps removed from central manifest; resolves via federated config (default true preserved). - tests/post-planning-gaps-2493: re-pointed to assert capability ownership. Verified: gate 5 pass / 4 fail (gap-analysis cleared from migration, plan:post-orphan, config-leak, and plan-phase shrink checks); loadConfig still returns post_planning_gaps=true; check command runs real analysis; 392/392 in the config/registry/federation/router net. Refs #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * feat(#1169): migrate profile-pipeline to a command-family Capability ADR-857 Decision 7: profile-pipeline becomes a command-family Capability (like audit/intel/graphify). capabilities/profile-pipeline/capability.json declares an 8-command family (scan-sessions, extract-messages, profile-sample, write-profile, profile-questionnaire, generate-dev-preferences, generate-claude-profile, generate-claude-md) backed by a new gsd-core/bin/lib/profile-pipeline-command-router.cjs; the inline case arms are removed from gsd-tools.cjs. Owns profile-pipeline.enabled (federated). Verified: registry shows role:feature with commands.length=8; scan-sessions/profile-sample run live via the family; gate cleared profile-pipeline from the empty-stub failure (only tdd/schema-gate/drift remain); 296/296 registry+inventory+gsd-tools tests; lint 0 errors. Refs #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * fix(#1167): wire execute:wave:post + implement ui.safety-gate check Revives the second dead gate from #1167: ui.gates@execute:wave:post was declared but never dispatched AND its check.query (ui.safety-gate) was unimplemented. Adds the per-wave execute:wave:post render-hooks call site in execute-phase.md (fires after each wave's merge/cleanup, before the next forks) and implements cmdUiSafetyGate (frontend + UI-SPEC aware, mirrors cmdUiPlanGate) in check-command-router. +17 regression tests. Verified: phase-6 orphaned-points conformance test now PASSES (gate 6 pass / 3 fail); ui-safety-gate routable in dot+hyphen forms; check-ui-safety-gate 17/17, check-ui-plan-gate 18/18; lint 0 errors. Refs #1167, #1168. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * feat(#1169): migrate drift (schema + codebase) to execute:wave:post gates Removes the inline schema_drift_gate + codebase_drift_gate steps (77 lines) from execute-phase.md; drift becomes a Capability with two execute:wave:post gates (verify.schema-drift blocking, verify.codebase-drift advisory) dispatched via the per-wave render-hooks call site. check-command-router routes verify.schema-drift / verify.codebase-drift to the real detectors. Federates workflow.drift_threshold / drift_action / schema_drift_gate out of central. Also fixes the execute:wave:post dispatch prose to run NON-blocking (advisory) gates too — the prior version only ran blocking gates, which would have silently dropped the codebase-drift advisory after its inline step was removed. Behavior preserved. Verified: gate 7 pass / 2 fail (drift cleared from stub + config-leak; execute-phase.md 92297 < 93166 frozen -> shrink passes); both drift checks run real detection; loadConfig defaults preserved (threshold=3, action=warn, gate=true); drift-detection 56/56 + schema-drift 34/34; lint 0 errors. Refs #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * feat(#1169): migrate tdd to a Capability (plan:pre contribution + execute:post gate) tdd becomes a real Capability: a plan:pre contribution injects the <tdd_mode_active> planner guidance (rendered from PLAN_PRE_HOOKS_JSON like security's contribution), and an execute:post gate (tdd.review-checkpoint, advisory) runs the real end-of-phase RED/GREEN review via a new check-command handler. Inline tdd_mode reads + the inline planner block + the tdd_review_checkpoint step are removed; workflow.tdd_mode is federated out of central. The MVP+TDD per-task RED-commit gate is preserved — TDD_MODE is now derived from the execute:post hooks (capId==tdd active), not an inline config-get. BEHAVIOR CHANGE (documented, not silent): the --tdd CLI flag now persists workflow.tdd_mode=true via config-set instead of being per-invocation. Rationale: tdd is now a config-toggled Capability, and env vars do not persist across the workflow's separate bash blocks (config does), so an ephemeral override isn't cleanly achievable; --tdd therefore enables the tdd capability, consistent with how all capabilities are toggled. Verified: gate 7 pass / 2 fail (tdd cleared from stub + config-leak; plan-phase + execute-phase both < frozen sizes); contribution injection + execute:post gate dispatch wired; MVP+TDD gate preserved; tdd.review-checkpoint runs real review; full unit suite 556/0; lint 0 errors. Refs #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * feat(#1169): migrate schema-gate to a plan:pre contribution Capability The plan-time schema-push detection (former plan-phase.md §5.7) becomes a schema-gate Capability: a plan:pre contribution (into:planner, when:workflow.schema_push_detection) whose fragment carries the full ORM-detection + [BLOCKING] schema-push-task injection logic, rendered into the planner via the existing plan:pre render-hooks dispatch. The inline §5.7 block is removed (plan-phase.md 94519->90445). workflow.schema_push_detection is a new capability-owned (federated) key, default true. (The execute-side schema-drift gate was migrated separately into the drift capability.) Verified: registry inlines the fragment (len 2704) so it is actually delivered at plan:pre; gate 8 pass / 1 fail — all 5 ADR-named features now real Capabilities, only the config-leak test remains (intel/security, next unit). Refs #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * feat(#1169): close the 3 capability config-key leaks — phase-6 gate now GREEN Removes the last inline config-get reads of capability-owned keys from plan-phase.md. security_asvs_level/security_block_on now flow through the security plan:pre contribution via a new loop-resolver configValues mechanism (resolves declared config keys with the same 4-level precedence as activation and attaches them to the rendered hook); the §5.55 banner reads them from PLAN_PRE_HOOKS_JSON. intel.enabled becomes a real intel plan:pre step (ref.command: intel api-surface) dispatched via render-hooks; the inline intel branch is gone. gen-capability-registry now validates ref.command as a third dispatch shape. Verified: phase-6 capstone conformance gate is FULLY GREEN (9/0); 3 leaks gone (grep=0); security configValues resolve to {2,medium}/default {1,high}; intel step present only when enabled; loop-render-hooks 62/0, capability-registry 287/0, capability-state/federated-config 113/0; lint 0 errors. Closes the migration half of #1169. Refs #1139, #1167, #1168. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * fix(#1169): address adversarial review — restore schema-drift block, generic planner injection, uniform gate contract Adversarial review caught 2 real regressions the green gate missed: (1) schema-drift no longer blocked — the execute:wave:post dispatch read GATE_RESULT.block but verify.schema-drift emitted drift_detected/blocking, and onError:skip wrongly bypassed positive blocks; (2) only tdd's plan:pre contribution was injected into the planner, dropping schema-gate's schema-push detection and security's threat-model guidance. Fixes: (A) every gate check returns a uniform boolean 'block' under --raw (the dispatch form), with advisory gates (tdd/gap) carrying their report in 'message'; (B) gate-dispatch contract corrected at all sites — onError governs command errors only, a blocking gate's positive block always halts; (C) generic planner injection of all plan:pre contributions where into=='planner' (tdd + schema-gate + security incl configValues); (D) two new conformance assertions: planner contributions injected generically + every gate check.query returns boolean block under --raw. Verified: gate 11/11; all 6 gate checks return boolean block under --raw; full suite 595/0; lint 0 errors. Refs #1167, #1168, #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * fix(#1169): restore MVP+TDD end-of-phase blocking escalation (2nd adversarial pass) The migrated tdd execute:post gate is statically blocking:false, but the contract (references/execute-mvp-tdd.md + CONTEXT.md) requires the end-of-phase TDD review to ESCALATE from advisory to blocking when MVP_MODE && TDD_MODE && a TDD plan misses a RED/GREEN commit. The migration prose had downgraded this to a 'strong advisory recommendation' — silent loss of the blocking escalation. Restore it: the tdd-gate dispatch now refuses to mark the phase complete (Phase blocked message) under MVP+TDD when GATE_RESULT.block is true; advisory otherwise. Also strengthen tests/execute-mvp-tdd-gate.test.cjs: hasBlockingEscalation previously matched any line with 'blocking'+'mvp+tdd' (so 'advisory (blocking: false) ... under MVP+TDD' was a false green); now it requires the real refusal semantics ('refuse to mark the phase complete' / 'phase blocked'). Caught by 2nd adversarial review pass. Verified: execute-phase.md 92702 < 93166 frozen; mvp-tdd-gate + phase-6 gate 19/0; full suite green; lint 0 errors. Refs #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * fix(#1169): restore MVP+TDD proceed-block, codebase auto-remap, schema skip-flag (3rd adversarial pass) 3rd adversarial pass found 4 more silent regressions: (1) the tdd MVP+TDD 'refuse to mark complete' was nullified by a downstream 'ALWAYS proceed regardless of gate results' line — proceed is now conditional (stops on an active MVP+TDD block); (2) the test now asserts the proceed is NOT an unconditional override; (3) codebase-drift auto-remap (spawn gsd-codebase-mapper when drift_action=auto-remap) was dropped — the execute:wave:post advisory dispatch now consumes spawn_mapper/directive; (4) GSD_SKIP_SCHEMA_CHECK bypass was lost from the gate path — cmdVerifySchemaDrift now honors the env var (block:false when set). Verified: no unconditional proceed; GSD_SKIP_SCHEMA_CHECK=true -> block:false; gate 11/11 + mvp-tdd 9/9; full suite 569/0; lint 0; execute-phase.md 93109 < 93166. Refs #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * fix(#1169): init.cts reads federated config keys from nested path (4th adversarial pass) Config federation moved tdd_mode/research/nyquist_validation from flat config.<key> to nested config.workflow.<key>, but src/init.cts still read them flat — so init.plan-phase/init.execute-phase emitted tdd_mode:false / research_enabled:undefined / nyquist:undefined regardless of config (a public command-contract regression; the migrated loops use render-hooks so enforcement was unaffected). Read via config.workflow (type-safe Record cast). Now init reflects the same resolved values + federated defaults (research/nyquist default true) as the render-hooks path. Verified: build clean; init.plan-phase emits tdd_mode:true/research:false/nyquist:false for set config, defaults true for empty; full suite 591/0; lint 0. Refs #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * docs(#1169): add changeset for ADR-857 phase-6 completion (PR #1183) Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * fix(#1169): complete phase-6 migration fallout — restore TEXT_MODE, fix registry .claude leak, re-point stale workflow-contract tests The capability migration left real regressions and stale consumer tests that the per-module unit suite missed but the full cross-platform suite caught (27 failing tests): Real source regressions (fixed): - execute-phase.md lost its AskUserQuestion TEXT_MODE plain-text fallback when the inline schema_drift_gate step was removed — non-Claude runtimes would stall. Restored, and the execute:post gate-dispatch prose de-duplicated to cite the execute:wave:post contract (loop body shrinks below the frozen pre-phase-6 ceiling while keeping every onError/blocking nuance). - capabilities/tdd inline fragment hardcoded `@~/.claude/gsd-core/references/tdd.md`, baked verbatim into the committed capability-registry.cjs and leaked the install path on 11 non-Claude runtimes (registry .cjs is copied, not path-converted). Made the fragment path-free; regenerated the registry. The phase-6 conformance gate now guards this (no ~/.claude install path in any capability source or the generated registry). - plan-phase.md: removed a §5.7 stub re-added in error and routed Branch 2 to step 6 (schema-gate is a plan:pre capability, §5.7 is gone). Stale workflow-contract tests re-pointed to the capability dispatch they now must assert (behavior verified preserved in source first, assertions kept equal-or-stronger): bug-621 + bug-2851 (gap-analysis via gsd_run render-hooks plan:post + registry binding), feat-2527 (tdd_mode federated out of central), phase6-planning + plan-phase-ui-redirect (§5.6 bounded by ## 6.), plan-phase-drift-guard (intel when:intel.enabled skip branch). profile-pipeline-command-router.cjs un-ignored from eslint (hand-written, no TS source) + stale disable comments removed. Size baseline regenerated. Verified: full suite 15140 tests / 0 fail; lint 0 errors; conformance gate green legitimately. Refs #1139, #1167, #1168, #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * test(#1169): add ADR-857 E2E content-test coverage for the 12 loop points + capability deliverables Grounds the capability engine in behavioral E2E tests (drive the real render-hooks/check CLI + the real registry, assert typed result content — no source-grep), structured around what ADR-857 says to deliver. 207 tests; each genuineness-checked (flip the expectation, confirm it fails). Per-loop-point dispatch (7 files): empty-point negative-space across the 6 no-hook points; verify:post 3-step resolution+ordering+onError; plan:pre contribution/configValues + ui.plan-gate + intel; plan:post gap-analysis; execute:wave:post drift+ui gates via the check route (schema-drift block/skip, codebase-drift threshold BVA, auto-remap); execute:post tdd.review-checkpoint RED/GREEN; ship:pre security gate resolution + frontmatter-get predicate pieces. ADR-deliverable coverage (4 files): predicate boundary held (edge/prohibition probes stay core, not off-by-default Feature Capabilities — phase-6 exception); core loop runs with zero capabilities (all 12 points empty, init bundles resolve); contribution merge (multiple ordered <contribution from=> blocks); federated-config key removal on uninstall. federated-config allowlisted for its 3-file split (unit + integration + lifecycle). Refs #1139, #1167, #1168, #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * fix(#1169): remove dead drifted converter dups + address adversarial review Lint cleanup (root-caused, not waved off): src/runtime-artifact-conversion.cts carried 11 agent-converter functions (+5 orphaned consts/helpers) that were never exported, never called, and had silently DRIFTED from the live hand-authored copies in bin/install.js (one even referenced an undefined `claudeToCopilotTools`). Deleted the dead duplicates; install.js's live copies are untouched (it never imported these). Lint now 0 errors / 0 warnings. Adversarial-review (Codex) findings fixed: - HIGH: execute-phase.md TDD_MODE used `jq ... || echo false`, silently disabling the MVP+TDD blocking gate on jq-less runtimes. Reverted to the `node -e` form (node is guaranteed; matches the file's other node-e usages) so a missing optional tool can no longer fail-open a blocking safety path. - MEDIUM: federated-config-key-removal orphan-key test was vacuous (it skipped the orphan assertion). Now asserts the removed capability's key is genuinely not surfaced/validated after uninstall. - LOW: phase-6 conformance leak regex broadened to catch absolute-home and Windows-backslash `.claude/(gsd-core|commands|agents|hooks)` paths, not only `~`/`$HOME` forward-slash forms. - LOW: bug-2851 plan:post dispatch assertion now requires `--raw` (matched its stated contract). - nit: plan-pre intel-step test duplicate assertion replaced with a distinct structured-output check. Size baseline regenerated (execute-phase.md 93089 < 93166 frozen). Refs #1167, #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * test(#1169): make runtime-homes-descriptor-drive titles environment-independent The descriptor-equivalence test embedded the absolute golden config path (`os.homedir()`-derived) directly in each `test(...)` title, so titles differed between macOS (`/Users/x/.claude`) and Docker (`/home/gsdtest/.claude`). Every test PASSES on both platforms (15885/0 leaf tests each), but gsd-test-summary compares results by title and reported 29+29 false "only in Mac / only in Docker" discrepancies for tests that actually pass everywhere. Move the golden path out of the title and into the assertion message (still shown on failure); titles are now byte-identical across platforms so the cross-platform comparator matches them. No assertion logic or golden values changed. Refs #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> * fix(#1169): derive TDD_MODE via gsd_run --active-cap, not node -e (fix prompt-injection CI gate) The prior fix reverted execute-phase.md:181 from jq to `node -e` to close a Codex HIGH (jq||echo-false silently disabling the MVP+TDD blocking gate on jq-less runtimes) — but the CI prompt-injection scanner BLOCKS new `node -e` in workflow markdown (inline code-exec = injection vector), turning the security gate red. Both forms were wrong: node -e fails the scanner; jq fail-opens a blocking safety gate; `config-get workflow.tdd_mode` is forbidden by the conformance leak gate (tdd_mode is capability-owned). Correct fix (what Codex recommended): a gsd_run-native boolean. Add an `--active-cap <capId>` flag to `loop render-hooks <point>` that resolves hooks the normal way and prints exactly `true`/`false` for whether a capId is active — scanner-safe (canonical launcher, no inline code), node-reliable (no optional jq to fail-open), and leak-free (render-hooks resolution, not config-get). execute-phase.md:181 now `TDD_MODE=$(gsd_run loop render-hooks execute:post --active-cap tdd)`. +5 behavioral tests for the flag. Verified: prompt-injection-scan --diff origin/next → 0 findings; conformance gate 13/13 (execute-phase.md 92934 < 93166); execute-mvp-tdd + tdd-mode + loop-render-hooks 87/0; lint 0/0. Refs #1167, #1169. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
556 lines
23 KiB
JavaScript
556 lines
23 KiB
JavaScript
'use strict';
|
|
|
|
/**
|
|
* plan-pre-hook-e2e.test.cjs — E2E content tests for plan:pre hook resolution.
|
|
*
|
|
* ADR-857 phase 6 capstone conformance — gap-backlog: plan:pre
|
|
* All tests drive real CLI subprocess or real resolver with real registry.
|
|
* No source-grep — RULESET.TESTS.no-source-grep.
|
|
*
|
|
* Covers:
|
|
* 1. intel.enabled=true → step ref.command='intel api-surface', rendered contains 'intel api-surface'
|
|
* 2. tdd_mode=true → tdd contribution fragment contains '<tdd_mode_active>'
|
|
* 3. security_enforcement=true + explicit asvs/block_on → configValues resolved from config
|
|
* 4. BVA: security defaults (asvs_level=1, block_on='high') when only enforcement=true
|
|
* 5. All plan:pre when-keys false → empty activeHooks + placeholder rendered
|
|
* 6. check ui.plan-gate: frontend + no-spec → block:true, exit 0
|
|
* 7. check ui.plan-gate: frontend + spec present → block:false, exit 0
|
|
* 8. check ui.plan-gate: missing phase arg → exit 1, clear error message
|
|
* 9. BVA: check ui.plan-gate phase=99 (nonexistent) → phaseLookupFailed:true, block:false
|
|
* 10. BVA: intel api-surface symbolCount=0 → stale:true + Incomplete banner
|
|
* 11. BVA: intel api-surface symbolCount=1 fresh → stale:false + symbol in file
|
|
* 12. ui cluster disabled via surface + tdd + intel on → no ui hooks, intel+tdd present
|
|
*/
|
|
|
|
const { describe, test, before, after } = require('node:test');
|
|
const assert = require('node:assert/strict');
|
|
const fs = require('node:fs');
|
|
const os = require('node:os');
|
|
const path = require('node:path');
|
|
const { spawnSync } = require('node:child_process');
|
|
|
|
const { cleanup } = require('./helpers.cjs');
|
|
|
|
const GSD_TOOLS = path.join(__dirname, '..', 'gsd-core', 'bin', 'gsd-tools.cjs');
|
|
|
|
// ─── Subprocess helper (isolated env, no ambient GSD_ vars) ───────────────────
|
|
|
|
const CLEAN_ENV = {
|
|
GSD_SESSION_KEY: '',
|
|
CODEX_THREAD_ID: '',
|
|
CLAUDE_SESSION_ID: '',
|
|
CLAUDE_CODE_SSE_PORT: '',
|
|
OPENCODE_SESSION_ID: '',
|
|
GEMINI_SESSION_ID: '',
|
|
CURSOR_SESSION_ID: '',
|
|
WINDSURF_SESSION_ID: '',
|
|
TERM_SESSION_ID: '',
|
|
WT_SESSION: '',
|
|
TMUX_PANE: '',
|
|
ZELLIJ_SESSION_NAME: '',
|
|
TTY: '',
|
|
SSH_TTY: '',
|
|
GSD_WORKSTREAM: '',
|
|
GSD_PROJECT: '',
|
|
};
|
|
|
|
/**
|
|
* Run gsd-tools via spawnSync. Returns { status, stdout, stderr }.
|
|
* Passes env overrides merged on top of process.env + CLEAN_ENV.
|
|
*/
|
|
function runTools(args, cwd, envOverrides = {}) {
|
|
return spawnSync(
|
|
process.execPath,
|
|
[GSD_TOOLS, ...args],
|
|
{
|
|
cwd: cwd || process.cwd(),
|
|
encoding: 'utf8',
|
|
timeout: 30000,
|
|
env: { ...process.env, ...CLEAN_ENV, ...envOverrides },
|
|
},
|
|
);
|
|
}
|
|
|
|
/**
|
|
* Parse JSON stdout from runTools result — throws with diagnostic on failure.
|
|
*/
|
|
function parseEnvelope(result, label = '') {
|
|
try {
|
|
return JSON.parse(result.stdout.trim());
|
|
} catch (e) {
|
|
throw new Error(
|
|
`${label}: JSON.parse failed.\n` +
|
|
`stdout=${result.stdout?.slice(0, 300)}\n` +
|
|
`stderr=${result.stderr?.slice(0, 300)}\n` +
|
|
`status=${result.status}`
|
|
);
|
|
}
|
|
}
|
|
|
|
// ─── Fixture factory helpers ──────────────────────────────────────────────────
|
|
|
|
function makePlanningDir(tmpDir, configObj = null) {
|
|
fs.mkdirSync(path.join(tmpDir, '.planning', 'phases'), { recursive: true });
|
|
if (configObj !== null) {
|
|
fs.writeFileSync(
|
|
path.join(tmpDir, '.planning', 'config.json'),
|
|
JSON.stringify(configObj),
|
|
'utf8',
|
|
);
|
|
}
|
|
}
|
|
|
|
function makeProject(configObj = null) {
|
|
const tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-e2e-'));
|
|
makePlanningDir(tmpDir, configObj);
|
|
return tmpDir;
|
|
}
|
|
|
|
// ─── 1. intel.enabled=true emits step with ref.command and rendered text ──────
|
|
|
|
describe('plan:pre intel step — ref.command and rendered text', () => {
|
|
let tmpDir;
|
|
before(() => {
|
|
tmpDir = makeProject({ intel: { enabled: true } });
|
|
});
|
|
after(() => cleanup(tmpDir));
|
|
|
|
test('[happy] intel.enabled=true: activeHooks has intel step with ref.command="intel api-surface"', () => {
|
|
const result = runTools(['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--raw'], tmpDir);
|
|
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
|
|
const envelope = parseEnvelope(result, 'intel-step');
|
|
|
|
assert.strictEqual(envelope.point, 'plan:pre');
|
|
assert.ok(Array.isArray(envelope.activeHooks), 'activeHooks must be array');
|
|
|
|
const intelHook = envelope.activeHooks.find(h => h.capId === 'intel');
|
|
assert.ok(intelHook !== undefined, 'intel hook must be present when intel.enabled=true');
|
|
assert.strictEqual(intelHook.kind, 'step', 'intel hook kind must be step');
|
|
assert.deepEqual(intelHook.ref, { command: 'intel api-surface' },
|
|
'ref must be {command:"intel api-surface"} not a JSON blob');
|
|
|
|
// Rendered text: check it contains "intel api-surface" (as part of the JSON or label)
|
|
assert.ok(
|
|
envelope.rendered.includes('intel api-surface'),
|
|
`rendered must contain 'intel api-surface'. Got: ${envelope.rendered.slice(0, 200)}`,
|
|
);
|
|
// Rendered must be structured step text, not a bare JSON object dump.
|
|
// A structured render includes human-readable step metadata (- produces:, - when:).
|
|
assert.ok(
|
|
envelope.rendered.includes('- produces:') && envelope.rendered.includes('- when:'),
|
|
'intel step must render as a structured step (with produces/when labels), not an opaque blob',
|
|
);
|
|
// Also assert the produces path appears
|
|
assert.ok(
|
|
envelope.rendered.includes('.planning/intel/API-SURFACE.md'),
|
|
'rendered must include the produced file path',
|
|
);
|
|
});
|
|
});
|
|
|
|
// ─── 2. tdd_mode=true emits tdd contribution with <tdd_mode_active> ───────────
|
|
|
|
describe('plan:pre tdd contribution — fragment.inline contains <tdd_mode_active>', () => {
|
|
let tmpDir;
|
|
before(() => {
|
|
tmpDir = makeProject({ workflow: { tdd_mode: true } });
|
|
});
|
|
after(() => cleanup(tmpDir));
|
|
|
|
test('[happy] tdd_mode=true: tdd contribution fragment.inline contains <tdd_mode_active>', () => {
|
|
const result = runTools(['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--raw'], tmpDir);
|
|
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
|
|
const envelope = parseEnvelope(result, 'tdd-contribution');
|
|
|
|
const tddHook = envelope.activeHooks.find(h => h.capId === 'tdd');
|
|
assert.ok(tddHook !== undefined, 'tdd hook must be present when tdd_mode=true');
|
|
assert.strictEqual(tddHook.kind, 'contribution', 'tdd hook kind must be contribution');
|
|
assert.ok(
|
|
tddHook.fragment && typeof tddHook.fragment.inline === 'string',
|
|
'tdd hook must have fragment.inline string',
|
|
);
|
|
assert.ok(
|
|
tddHook.fragment.inline.includes('<tdd_mode_active>'),
|
|
`fragment.inline must contain '<tdd_mode_active>'. Got: ${tddHook.fragment.inline.slice(0, 200)}`,
|
|
);
|
|
|
|
// Rendered text must also contain the tag
|
|
assert.ok(
|
|
envelope.rendered.includes('<tdd_mode_active>'),
|
|
`rendered must contain '<tdd_mode_active>'. Got: ${envelope.rendered.slice(0, 200)}`,
|
|
);
|
|
});
|
|
});
|
|
|
|
// ─── 3. security contribution emits configValues from explicit config ──────────
|
|
|
|
describe('plan:pre security contribution — configValues from explicit config', () => {
|
|
let tmpDir;
|
|
before(() => {
|
|
tmpDir = makeProject({
|
|
workflow: {
|
|
security_enforcement: true,
|
|
security_asvs_level: 3,
|
|
security_block_on: 'critical',
|
|
},
|
|
});
|
|
});
|
|
after(() => cleanup(tmpDir));
|
|
|
|
test('[happy] security_enforcement=true + explicit asvs=3 + block_on=critical: configValues match config', () => {
|
|
const result = runTools(['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--raw'], tmpDir);
|
|
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
|
|
const envelope = parseEnvelope(result, 'security-configValues-explicit');
|
|
|
|
const secHook = envelope.activeHooks.find(h => h.capId === 'security');
|
|
assert.ok(secHook !== undefined, 'security hook must be present when security_enforcement=true');
|
|
assert.strictEqual(secHook.kind, 'contribution', 'security hook kind must be contribution');
|
|
assert.ok(secHook.configValues !== undefined, 'security hook must have configValues');
|
|
assert.strictEqual(secHook.configValues.security_asvs_level, 3,
|
|
'security_asvs_level must be 3 (from config, not default 1)');
|
|
assert.strictEqual(secHook.configValues.security_block_on, 'critical',
|
|
'security_block_on must be critical (from config, not default high)');
|
|
});
|
|
});
|
|
|
|
// ─── 4. BVA: security defaults when enforcement=true but levels not set ────────
|
|
|
|
describe('plan:pre security contribution — BVA: default configValues', () => {
|
|
let tmpDir;
|
|
before(() => {
|
|
tmpDir = makeProject({ workflow: { security_enforcement: true } });
|
|
});
|
|
after(() => cleanup(tmpDir));
|
|
|
|
test('[bva] security_enforcement=true only: configValues use schema defaults (asvs=1, block_on=high)', () => {
|
|
const result = runTools(['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--raw'], tmpDir);
|
|
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
|
|
const envelope = parseEnvelope(result, 'security-configValues-defaults');
|
|
|
|
const secHook = envelope.activeHooks.find(h => h.capId === 'security');
|
|
assert.ok(secHook !== undefined, 'security hook must be present');
|
|
assert.ok(secHook.configValues !== undefined, 'security hook must have configValues');
|
|
// BVA: schema defaults — must be 1 and 'high', NOT 3 or 'critical'
|
|
assert.strictEqual(secHook.configValues.security_asvs_level, 1,
|
|
'default asvs_level must be 1 when not set in config');
|
|
assert.strictEqual(secHook.configValues.security_block_on, 'high',
|
|
'default block_on must be high when not set in config');
|
|
});
|
|
});
|
|
|
|
// ─── 5. All plan:pre when-keys false → empty activeHooks + placeholder ─────────
|
|
|
|
describe('plan:pre all-off — empty resolution', () => {
|
|
let tmpDir;
|
|
before(() => {
|
|
tmpDir = makeProject({
|
|
workflow: {
|
|
ai_integration_phase: false,
|
|
tdd_mode: false,
|
|
security_enforcement: false,
|
|
ui_phase: false,
|
|
ui_safety_gate: false,
|
|
research: false,
|
|
pattern_mapper: false,
|
|
schema_push_detection: false,
|
|
},
|
|
intel: { enabled: false },
|
|
});
|
|
});
|
|
after(() => cleanup(tmpDir));
|
|
|
|
test('[negative] all plan:pre when-keys false: activeHooks empty, rendered is placeholder', () => {
|
|
const result = runTools(['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--raw'], tmpDir);
|
|
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
|
|
const envelope = parseEnvelope(result, 'all-off');
|
|
|
|
assert.deepEqual(envelope.activeHooks, [],
|
|
`activeHooks must be empty when all flags false. Got: ${JSON.stringify(envelope.activeHooks.map(h=>h.capId))}`);
|
|
assert.strictEqual(envelope.rendered, '_No active hooks at plan:pre._',
|
|
'rendered must be placeholder when no active hooks');
|
|
});
|
|
});
|
|
|
|
// ─── 6. check ui.plan-gate: frontend + no-spec → block:true ──────────────────
|
|
|
|
describe('check ui.plan-gate — frontend phase, no UI-SPEC', () => {
|
|
let tmpDir;
|
|
before(() => {
|
|
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-ui-gate-'));
|
|
const planningDir = path.join(tmpDir, '.planning');
|
|
fs.mkdirSync(path.join(planningDir, 'phases', '01-dashboard'), { recursive: true });
|
|
fs.writeFileSync(path.join(planningDir, 'config.json'), '{}', 'utf8');
|
|
fs.writeFileSync(
|
|
path.join(planningDir, 'ROADMAP.md'),
|
|
[
|
|
'# Project Roadmap',
|
|
'',
|
|
'## Phase 1: Dashboard',
|
|
'',
|
|
'Build the user interface and frontend dashboard components.',
|
|
'',
|
|
].join('\n'),
|
|
'utf8',
|
|
);
|
|
// No UI-SPEC.md in phase dir
|
|
});
|
|
after(() => cleanup(tmpDir));
|
|
|
|
test('[happy] frontend phase + no UI-SPEC: block:true, frontend:true, hasUiSpec:false, exit 0', () => {
|
|
const result = runTools(['check', 'ui.plan-gate', '1', '--raw'], tmpDir);
|
|
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
|
|
const out = parseEnvelope(result, 'ui-plan-gate-no-spec');
|
|
|
|
assert.strictEqual(out.frontend, true, 'frontend must be true for frontend-keyword phase');
|
|
assert.strictEqual(out.hasUiSpec, false, 'hasUiSpec must be false when no spec file exists');
|
|
assert.strictEqual(out.block, true, 'block must be true (frontend && !hasUiSpec)');
|
|
assert.strictEqual(out.uiSpecPath, null, 'uiSpecPath must be null when spec absent');
|
|
});
|
|
});
|
|
|
|
// ─── 7. check ui.plan-gate: frontend + spec present → block:false ─────────────
|
|
|
|
describe('check ui.plan-gate — frontend phase, UI-SPEC present', () => {
|
|
let tmpDir;
|
|
before(() => {
|
|
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-ui-gate-spec-'));
|
|
const planningDir = path.join(tmpDir, '.planning');
|
|
fs.mkdirSync(path.join(planningDir, 'phases', '01-dashboard'), { recursive: true });
|
|
fs.writeFileSync(path.join(planningDir, 'config.json'), '{}', 'utf8');
|
|
fs.writeFileSync(
|
|
path.join(planningDir, 'ROADMAP.md'),
|
|
[
|
|
'# Project Roadmap',
|
|
'',
|
|
'## Phase 1: Dashboard',
|
|
'',
|
|
'Build the frontend React dashboard with UI forms.',
|
|
'',
|
|
].join('\n'),
|
|
'utf8',
|
|
);
|
|
// Add a UI-SPEC.md
|
|
fs.writeFileSync(
|
|
path.join(planningDir, 'phases', '01-dashboard', '01-UI-SPEC.md'),
|
|
'# UI Design Contract\n',
|
|
'utf8',
|
|
);
|
|
});
|
|
after(() => cleanup(tmpDir));
|
|
|
|
test('[happy] frontend phase + UI-SPEC present: block:false, hasUiSpec:true, uiSpecPath ends with -UI-SPEC.md', () => {
|
|
const result = runTools(['check', 'ui.plan-gate', '1', '--raw'], tmpDir);
|
|
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
|
|
const out = parseEnvelope(result, 'ui-plan-gate-with-spec');
|
|
|
|
assert.strictEqual(out.frontend, true, 'frontend must be true');
|
|
assert.strictEqual(out.hasUiSpec, true, 'hasUiSpec must be true when spec file exists');
|
|
assert.strictEqual(out.block, false, 'block must be false (spec present)');
|
|
assert.ok(
|
|
typeof out.uiSpecPath === 'string' && out.uiSpecPath.endsWith('-UI-SPEC.md'),
|
|
`uiSpecPath must end with -UI-SPEC.md. Got: ${out.uiSpecPath}`,
|
|
);
|
|
});
|
|
});
|
|
|
|
// ─── 8. check ui.plan-gate: missing phase arg → exit 1 + error message ────────
|
|
|
|
describe('check ui.plan-gate — missing phase argument', () => {
|
|
test('[negative] missing phase arg: exit code 1, stderr contains ui-plan-gate requires a phase argument', () => {
|
|
const result = runTools(['check', 'ui.plan-gate', '--raw']);
|
|
assert.strictEqual(result.exitCode ?? result.status, 1,
|
|
`exit code must be 1. Got: ${result.status}. stderr=${result.stderr?.slice(0, 300)}`);
|
|
assert.ok(
|
|
(result.stderr || '').includes('ui-plan-gate requires a phase argument'),
|
|
`stderr must include 'ui-plan-gate requires a phase argument'. Got: ${result.stderr?.slice(0, 300)}`,
|
|
);
|
|
});
|
|
});
|
|
|
|
// ─── 9. BVA: check ui.plan-gate phase=99 → phaseLookupFailed:true ─────────────
|
|
|
|
describe('check ui.plan-gate — BVA: non-existent phase 99', () => {
|
|
let tmpDir;
|
|
before(() => {
|
|
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-ui-gate-99-'));
|
|
const planningDir = path.join(tmpDir, '.planning');
|
|
fs.mkdirSync(path.join(planningDir, 'phases', '01-dashboard'), { recursive: true });
|
|
fs.writeFileSync(path.join(planningDir, 'config.json'), '{}', 'utf8');
|
|
fs.writeFileSync(
|
|
path.join(planningDir, 'ROADMAP.md'),
|
|
[
|
|
'# Project Roadmap',
|
|
'',
|
|
'## Phase 1: Dashboard',
|
|
'',
|
|
'Build the frontend dashboard.',
|
|
'',
|
|
].join('\n'),
|
|
'utf8',
|
|
);
|
|
});
|
|
after(() => cleanup(tmpDir));
|
|
|
|
test('[bva] phase=99 (nonexistent in ROADMAP.md with only Phase 1): phaseLookupFailed:true, block:false', () => {
|
|
const result = runTools(['check', 'ui.plan-gate', '99', '--raw'], tmpDir);
|
|
assert.strictEqual(result.status, 0, `exit must be 0. stderr=${result.stderr?.slice(0, 300)}`);
|
|
const out = parseEnvelope(result, 'ui-plan-gate-phase-99');
|
|
|
|
assert.strictEqual(out.phaseLookupFailed, true,
|
|
'phaseLookupFailed must be true for a phase not found in ROADMAP.md');
|
|
// When phase lookup fails, frontend defaults to false and block must be false
|
|
assert.strictEqual(out.frontend, false,
|
|
'frontend must be false when phase lookup fails (not silently block:false)');
|
|
assert.strictEqual(out.block, false,
|
|
'block must be false when phase not found — phaseLookupFailed distinguishes this from a clean pass');
|
|
});
|
|
});
|
|
|
|
// ─── 10. BVA: intel api-surface symbolCount=0 → stale:true + Incomplete ──────
|
|
|
|
describe('intel api-surface — BVA: symbolCount=0 (empty entries)', () => {
|
|
let tmpDir;
|
|
before(() => {
|
|
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-intel-empty-'));
|
|
const planningDir = path.join(tmpDir, '.planning');
|
|
fs.mkdirSync(path.join(planningDir, 'intel'), { recursive: true });
|
|
fs.writeFileSync(path.join(planningDir, 'config.json'), JSON.stringify({ intel: { enabled: true } }), 'utf8');
|
|
// api-map.json with empty object entries
|
|
fs.writeFileSync(
|
|
path.join(planningDir, 'intel', 'api-map.json'),
|
|
JSON.stringify({ entries: {} }),
|
|
'utf8',
|
|
);
|
|
});
|
|
after(() => cleanup(tmpDir));
|
|
|
|
test('[bva] symbolCount=0: exit 0, stale:true, symbolCount:0, written file contains Incomplete banner', () => {
|
|
const result = runTools(['intel', 'api-surface', '--raw'], tmpDir);
|
|
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
|
|
const out = parseEnvelope(result, 'intel-api-surface-empty');
|
|
|
|
assert.strictEqual(out.symbolCount, 0, 'symbolCount must be 0 for empty entries');
|
|
assert.strictEqual(out.stale, true, 'stale must be true when no _meta.updated_at');
|
|
assert.ok(typeof out.written === 'string' && out.written.endsWith('API-SURFACE.md'),
|
|
`written must be a path ending in API-SURFACE.md. Got: ${out.written}`);
|
|
|
|
// Content check — the written file must contain the Incomplete banner
|
|
const content = fs.readFileSync(out.written, 'utf8');
|
|
assert.ok(
|
|
content.includes('Incomplete'),
|
|
`API-SURFACE.md must contain 'Incomplete' banner when symbolCount=0. Got: ${content.slice(0, 300)}`,
|
|
);
|
|
});
|
|
});
|
|
|
|
// ─── 11. BVA: intel api-surface symbolCount=1 fresh → stale:false ─────────────
|
|
|
|
describe('intel api-surface — BVA: symbolCount=1, fresh _meta', () => {
|
|
let tmpDir;
|
|
before(() => {
|
|
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-intel-one-'));
|
|
const planningDir = path.join(tmpDir, '.planning');
|
|
fs.mkdirSync(path.join(planningDir, 'intel'), { recursive: true });
|
|
fs.writeFileSync(path.join(planningDir, 'config.json'), JSON.stringify({ intel: { enabled: true } }), 'utf8');
|
|
// api-map.json with one entry object and fresh _meta
|
|
fs.writeFileSync(
|
|
path.join(planningDir, 'intel', 'api-map.json'),
|
|
JSON.stringify({
|
|
entries: {
|
|
getUserById: {
|
|
file: 'src/api/users.ts',
|
|
kind: 'function',
|
|
signature: 'getUserById(id: string): Promise<User>',
|
|
},
|
|
},
|
|
_meta: { updated_at: new Date().toISOString() },
|
|
}),
|
|
'utf8',
|
|
);
|
|
});
|
|
after(() => cleanup(tmpDir));
|
|
|
|
test('[bva] symbolCount=1 with fresh _meta.updated_at: exit 0, stale:false, symbolCount:1', () => {
|
|
const result = runTools(['intel', 'api-surface', '--raw'], tmpDir);
|
|
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
|
|
const out = parseEnvelope(result, 'intel-api-surface-one-entry');
|
|
|
|
assert.strictEqual(out.symbolCount, 1, 'symbolCount must be 1 for one entry');
|
|
assert.strictEqual(out.stale, false, 'stale must be false when _meta.updated_at is fresh (<24h)');
|
|
assert.ok(typeof out.written === 'string' && out.written.endsWith('API-SURFACE.md'),
|
|
`written must be API-SURFACE.md path. Got: ${out.written}`);
|
|
|
|
// Content check — symbol must appear in the file
|
|
const content = fs.readFileSync(out.written, 'utf8');
|
|
assert.ok(
|
|
content.includes('getUserById'),
|
|
`API-SURFACE.md must contain 'getUserById' symbol. Got: ${content.slice(0, 300)}`,
|
|
);
|
|
});
|
|
});
|
|
|
|
// ─── 12. ui cluster disabled + tdd + intel on → no ui hooks, intel+tdd present ─
|
|
|
|
describe('plan:pre surface cluster filter — ui disabled, tdd+intel active', () => {
|
|
let tmpDir;
|
|
before(() => {
|
|
tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'plan-pre-surface-'));
|
|
const planningDir = path.join(tmpDir, '.planning');
|
|
fs.mkdirSync(planningDir, { recursive: true });
|
|
// Enable intel, tdd, and also ui things in project config
|
|
fs.writeFileSync(
|
|
path.join(planningDir, 'config.json'),
|
|
JSON.stringify({
|
|
intel: { enabled: true },
|
|
workflow: {
|
|
tdd_mode: true,
|
|
ui_phase: true,
|
|
ui_safety_gate: true,
|
|
security_enforcement: false,
|
|
research: false,
|
|
pattern_mapper: false,
|
|
schema_push_detection: false,
|
|
ai_integration_phase: false,
|
|
},
|
|
}),
|
|
'utf8',
|
|
);
|
|
// .gsd-surface.json disabling UI cluster in same dir (config-dir = tmpDir)
|
|
fs.writeFileSync(
|
|
path.join(tmpDir, '.gsd-surface.json'),
|
|
JSON.stringify({
|
|
baseProfile: 'full',
|
|
disabledClusters: ['ui'],
|
|
explicitAdds: [],
|
|
explicitRemoves: [],
|
|
}),
|
|
'utf8',
|
|
);
|
|
});
|
|
after(() => cleanup(tmpDir));
|
|
|
|
test('[empty-resolution/surface] ui cluster disabled: no ui hooks; intel and tdd hooks present', () => {
|
|
const result = runTools(
|
|
['loop', 'render-hooks', 'plan:pre', '--cwd', tmpDir, '--config-dir', tmpDir, '--raw'],
|
|
tmpDir,
|
|
);
|
|
assert.strictEqual(result.status, 0, `exit non-zero. stderr=${result.stderr?.slice(0, 300)}`);
|
|
const envelope = parseEnvelope(result, 'ui-cluster-disabled');
|
|
|
|
// No ui hooks — specific assertion on the differing field
|
|
const uiHooks = envelope.activeHooks.filter(h => h.capId === 'ui');
|
|
assert.strictEqual(uiHooks.length, 0,
|
|
`ui cluster disabled must suppress all ui hooks. Got ui hooks: ${JSON.stringify(uiHooks)}`);
|
|
|
|
// intel hook must be present (not suppressed by ui cluster disable)
|
|
const intelHooks = envelope.activeHooks.filter(h => h.capId === 'intel');
|
|
assert.strictEqual(intelHooks.length, 1,
|
|
`intel hook must be present. Got: ${JSON.stringify(envelope.activeHooks.map(h => h.capId))}`);
|
|
|
|
// tdd hook must be present
|
|
const tddHooks = envelope.activeHooks.filter(h => h.capId === 'tdd');
|
|
assert.strictEqual(tddHooks.length, 1,
|
|
`tdd hook must be present. Got: ${JSON.stringify(envelope.activeHooks.map(h => h.capId))}`);
|
|
});
|
|
});
|