Files
msd-core/tests/lint-frontmatter-scalar-broad-grep.test.cjs
Tom Boucher 941b62249e enhance(#3906): two terminators over one registry, with a versioned exit projection (#3924)
* feat(#3906): two terminators over one registry, with a versioned projection

Adds terminateNow (write-then-terminate, for callers that cannot wait for the event loop) beside runMain (drain-then-exit), both projecting through one shared function so they cannot disagree - the parity the ADR makes mandatory. A failed write does not change the exit code: letting it propagate would fail a hook open, which is what the fail-closed branches exist to prevent.

The projection is versioned. v1 reproduces today's integers, including keeping a payload-carried degraded result at exit 0 - ADR-2980 ratified that across 60 sites and declined normalizing it on measured blast radius. v2 applies the registry. --exit-contract=v2 or GSD_EXIT_CONTRACT=v2 selects it; an unrecognized version throws rather than silently defaulting.

The registry is now emitted beside both copies of the exit module, so it resolves as a sibling in the built tree and in the committed scripts/ copy that must load on an unbuilt clone.

* fix(#3906): actually restrict code 2 to terminateNow, and generate the registry's type

The claim that terminateNow is the only place 2 can be produced was false: runMain's outcome arm applied no guard, so runMain(()=>'HOOK_DENY') set exitCode 2 through the drain path - and the parity matrix demonstrated it while calling it parity. runMain now refuses any outcome projecting to the hook-protocol code, gated on the code rather than the name so an alias cannot slip past, and the matrix asserts the restriction instead of contradicting it.

The ambient type for the generated registry was hand-written with no gate against the generator's actual output - the declared-surface-diverges-from-runtime defect class this epic exists to close, reintroduced inside it. It is now a third generated artifact covered by the same --check. Also converts every test-body try/finally to t.after().

* test(#3906): derive the glossary fixture's dependencies instead of hand-listing them

Adding a require to scripts/lib/cli-exit.cjs broke 31 tests in one suite that built its fixture from a hand-written dependency list, so the new sibling was absent and the copied script could not load. copyScriptWithDeps walks the require graph and exists for exactly this class - #3412 paid the same bill when one new require broke 82 tests across two suites. Migrating rather than adding another copyFileSync line keeps the class closed. The other nine suites referencing that path were triaged; none copies-and-spawns, so none needed migrating.

* fix(#3906): enumerate the new shipped file, drop a vendor name from shipped data, and fix three test defects

install: scripts/lib/exit-code-registry.cjs was missing from GSD_SCRIPTS_LIB_FILES, so it shipped to every install and orphaned on uninstall.

The registry gave HOOK_DENY a meaning naming one harness, and that string ships into every runtime's tree - a guard correctly caught it leaking into the hermes and qwen installs. The registry is runtime-neutral infrastructure; the vendor name belongs in the ADR, not in shipped data.

Two more fixture harnesses built their trees from hand-listed dependencies and broke on the new require; both migrated to the derived helper, and all 23 copy-and-spawn candidates were enumerated so the class is closed rather than patched. One generator test used a fixture code that collided with a real allocation, so the generator correctly reported a duplicate where the test expected drift. The large-payload test embedded a 256KB literal in the child's argv, exceeding Linux's 128KiB MAX_ARG_STRLEN so the child never started - it now builds the payload inside the child.

* chore(#3906): backfill changeset pr number

* docs(#3906): document the exit-code contract selector

P2 is the first phase of this epic with a user-invocable surface, so the flag and env var owe a reference entry. Records what actually differs between v1 and v2 today (one outcome), that an unrecognized value is rejected rather than silently defaulted, and the fail-safe property that makes switching safe.

---------

Co-authored-by: sim <sim@local>
2026-08-27 03:31:02 -04:00

175 lines
6.8 KiB
JavaScript

'use strict';
process.env.GSD_TEST_MODE = '1';
/**
* Frontmatter-scalar-broad-grep lint (DEFECT.FRONTMATTER-SCALAR-BROAD-GREP,
* CONTEXT.md).
*
* scripts/lint-frontmatter-scalar-broad-grep.cjs flags a `grep "^key:"` over
* a whole markdown report (not scoped to the frontmatter block, no -m1/
* `head -1` single-match guard) whose result feeds an exact-token comparison
* — the #586/#651 bug class where a body line beginning `key:` concatenates
* onto the intended frontmatter value and misroutes a valid state.
*/
const { test, describe } = require('node:test');
const assert = require('node:assert/strict');
const fs = require('node:fs');
const os = require('node:os');
const path = require('node:path');
const ROOT = path.join(__dirname, '..');
const LINT_SCRIPT = path.join(ROOT, 'scripts', 'lint-frontmatter-scalar-broad-grep.cjs');
const { findBroadGrepsInBlock, extractBashBlocks, scan } = require(LINT_SCRIPT);
const { cleanup } = require('./helpers.cjs');
const { runNode } = require('./helpers/process-seam.cjs');
const { copyScriptWithDeps } = require('./helpers/copy-script-fixture.cjs');
const LINT_SCRIPT_REL = path.join('scripts', 'lint-frontmatter-scalar-broad-grep.cjs');
describe('frontmatter-scalar-broad-grep lint: findBroadGrepsInBlock (pure)', () => {
test('the real #586/#651 defect shape IS flagged: whole-file grep, no scope, no -m1, piped to cut|tr', () => {
const lines = [
'grep "^status:" "${QUICK_DIR}/${quick_id}-VERIFICATION.md" | cut -d: -f2 | tr -d \' \'',
];
const findings = findBroadGrepsInBlock(lines);
assert.equal(findings.length, 1);
assert.equal(findings[0].key, 'status');
});
test('a variable captured from a broad grep and later compared with == is also flagged', () => {
const lines = [
'STATUS=$(grep "^status:" "$FILE")',
'if [ "$STATUS" == "passed" ]; then echo ok; fi',
];
const findings = findBroadGrepsInBlock(lines);
assert.equal(findings.length, 1);
});
test('LOOKALIKE: sed-scoped to the frontmatter block is NOT flagged', () => {
const lines = [
'sed -n \'/^---$/,/^---$/p\' "$f" | grep -m1 "^status:" | cut -d: -f2 | tr -d \' \'',
];
assert.deepEqual(findBroadGrepsInBlock(lines), []);
});
test('LOOKALIKE: -m1 on the grep itself is NOT flagged even without a preceding scope', () => {
const lines = [
'grep -m1 "^status:" "$FILE" | cut -d: -f2 | tr -d \' \'',
];
assert.deepEqual(findBroadGrepsInBlock(lines), []);
});
test('LOOKALIKE: piped to `head -1` immediately after grep is NOT flagged (frontmatter is always first)', () => {
const lines = [
'AUDIT_STATUS=$(grep "^status:" "${AUDIT_FILE}" 2>/dev/null | head -1 | cut -d: -f2 | tr -d \' \')',
];
assert.deepEqual(findBroadGrepsInBlock(lines), []);
});
test('LOOKALIKE: a frontmatter block already extracted into a variable (JS regex idiom), then multiple keys parsed from it', () => {
const lines = [
'FRONTMATTER=$(node -e "',
' const m = content.match(/^---\\n([\\s\\S]*?)\\n---/);',
' if (m) process.stdout.write(m[1]);',
'")',
'STATUS=$(echo "$FRONTMATTER" | grep "^status:" | cut -d: -f2 | xargs)',
'FILES_REVIEWED=$(echo "$FRONTMATTER" | grep "^files_reviewed:" | cut -d: -f2 | xargs)',
];
assert.deepEqual(findBroadGrepsInBlock(lines), []);
});
test('LOOKALIKE: an explicit `# lint-allow:` suppression comment silences the finding', () => {
const lines = [
'# lint-allow: frontmatter-scalar-broad-grep — intentional multi-file scan, not a single report',
'grep "^status:" reports/*.md | cut -d: -f2 | tr -d \' \'',
];
assert.deepEqual(findBroadGrepsInBlock(lines), []);
});
test('a grep not piped to cut/tr and never compared is NOT flagged (not a token-comparison use)', () => {
const lines = ['grep -c "^status:" "$FILE"'];
assert.deepEqual(findBroadGrepsInBlock(lines), []);
});
});
describe('frontmatter-scalar-broad-grep lint: extractBashBlocks (pure)', () => {
test('extracts a fenced ```bash block and reports its 1-indexed start line', () => {
const text = [
'intro',
'```bash',
'echo hi',
'```',
'outro',
].join('\n');
const blocks = extractBashBlocks(text);
assert.equal(blocks.length, 1);
assert.equal(blocks[0].startLine, 3);
assert.deepEqual(blocks[0].lines, ['echo hi']);
});
test('a non-bash fenced block (e.g. ```json) is ignored', () => {
const text = ['```json', '{"a":1}', '```'].join('\n');
assert.deepEqual(extractBashBlocks(text), []);
});
});
describe('frontmatter-scalar-broad-grep lint: the live repo is clean', () => {
test('scan() finds zero offenders in the real workflow/agent/command markdown', () => {
const offenders = scan();
assert.deepEqual(
offenders,
[],
'un-scoped frontmatter-scalar grep(s) found:\n' + offenders.map((o) => ` ${o.file}:${o.line} ${o.snippet}`).join('\n'),
);
});
});
describe('frontmatter-scalar-broad-grep lint: main() end-to-end wiring', () => {
test('exit 0 on the real repo tree', () => {
const result = runNode([LINT_SCRIPT], { cwd: ROOT });
assert.equal(result.exitCode, 0, `expected exit 0, got ${result.exitCode}: ${result.stderr}`);
});
test('exit 1 on a fixture reproducing the real defect shape', (t) => {
const tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'gsd-frontmatter-grep-lint-e2e-'));
t.after(() => cleanup(tmpDir));
const workflowsDir = path.join(tmpDir, 'gsd-core', 'workflows');
fs.mkdirSync(workflowsDir, { recursive: true });
fs.writeFileSync(
path.join(workflowsDir, 'quick.md'),
[
'# Quick',
'```bash',
'grep "^status:" "${QUICK_DIR}/${quick_id}-VERIFICATION.md" | cut -d: -f2 | tr -d \' \'',
'```',
].join('\n'),
);
const scriptCopy = copyScriptWithDeps(ROOT, tmpDir, LINT_SCRIPT_REL);
const result = runNode([scriptCopy]);
assert.equal(result.exitCode, 1, `expected exit 1, got ${result.exitCode}`);
assert.match(result.stderr, /FRONTMATTER-SCALAR-BROAD-GREP/);
});
test('exit 0 on a fixture that is properly scoped (no false positive)', (t) => {
const tmpDir = fs.mkdtempSync(path.join(os.tmpdir(), 'gsd-frontmatter-grep-lint-e2e-clean-'));
t.after(() => cleanup(tmpDir));
const workflowsDir = path.join(tmpDir, 'gsd-core', 'workflows');
fs.mkdirSync(workflowsDir, { recursive: true });
fs.writeFileSync(
path.join(workflowsDir, 'quick.md'),
[
'# Quick',
'```bash',
'sed -n \'/^---$/,/^---$/p\' "$f" | grep -m1 "^status:" | cut -d: -f2 | tr -d \' \'',
'```',
].join('\n'),
);
const scriptCopy = copyScriptWithDeps(ROOT, tmpDir, LINT_SCRIPT_REL);
const result = runNode([scriptCopy]);
assert.equal(result.exitCode, 0, `expected exit 0, got ${result.exitCode}: ${result.stderr}`);
});
});