Files
msd-core/tests/affected-tests-lib.test.cjs
Tom Boucher 5fa4dcd78c fix: recover silently-excluded test dirs + test-architecture audit hardening (#1195)
* fix: recurse test discovery so subdir test suites actually run

scripts/run-tests.cjs discovered tests with a flat readdirSync(testDir),
silently excluding tests/observability/ (4 files), tests/dispatch/ (1) and
tests/installer-migrations/ (1) — 94 passing tests — from `npm test` and all
CI lanes. Walk the tree recursively (relative subpaths preserved), classify
suites by basename, and add a fail-on-zero-executed guard for suite/default
runs (escape hatch GSD_ALLOW_EMPTY_SUITE=1) while preserving the empty
--files/--files-from path the CI inert lane relies on.

Unit suite 735 -> 741 files; surfaces ADR-227's observability/dispatch seam.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* test: retire 5 verified-worthless tests

Adversarial verification confirmed these 5 prove nothing — their coverage is
provided more strictly elsewhere:
- enh-2790 'has a name: field' spot-checks (command-contract enforces /^gsd[:-]/)
- command-routing-hub duplicate construct + duplicate ERROR_KINDS assertions
- no-cjs-sdk-handsync-tooling (guarded files that never existed on main; bug-190
  covers the real retired SDK artifacts)
- runtime-artifact-layout cline edge case (subsumed by the explicit-global test
  and bug-782-cline-skills-emission)

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* test: add ADR-218 release version-validation coverage

ADR-218 (reject leading-zero versions like 1.01.0; npm duplicate pre-check) had
zero tests — the logic lived only in release.yml bash. Add a test that extracts
the actual rejection regexes from the workflow and exercises them against a
boundary table (leading-zero/malformed rejected, valid accepted) plus structural
wiring assertions. Goes red if the regex is reverted to [0-9]+.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* test: redesign weak tests into behavioral, deterministic assertions

Per the ADR test audit, rewrite 27 weak test files (test-only, no source
changes) so each can go red for the defect it guards:
- kill pass-always assert.ok(true) placeholders (research-cli, worktree-baseref,
  bug-260 security guard, eslint-rules x24, clusters '|| true')
- replace source-text grep with behavioral calls (install Kilo, sh-hook-paths,
  plan-review-convergence) and add a repo-layout governance test
- de-flake real-clock/Math.random coupling (phase last_updated, bug-3707 mtime,
  context-utilization property, feat-3594)
- fix independence/shared-state violations (bug-492 singleton, issue-844 tmpRoot,
  core reapStaleTempFiles, active-workstream TTY, feat-488 GSD_HOME)
- strengthen property/shape-only tests (research-provider/store classification +
  collision) and unconditional plugin.json schema validation (issue-766)

Verified: all 28 files run together 1220 pass / 0 fail / 1 skip.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* chore: add no-tautological-assert lint rule, error in test suite

New custom ESLint rule (eslint-rules/no-tautological-assert.cjs) bans asserts
that can never fail: assert(true)/assert.ok(<always-truthy literal>),
'cond || true' inside an assert, and equality asserts comparing two identical
literals. Wired as error on tests/**; full sweep confirmed zero existing
violations so the suite stays green. Prevents the placeholder-assert regressions
the audit redesigns just removed. RuleTester coverage added (6 valid, 8 invalid).

Note: no-only-tests was already enforced via eslint-plugin-no-only-tests, so no
duplicate rule was added.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* chore: gate new allow-test-rule exemptions to require an issue ref

ADR-456 requires any allow-test-rule exemption added after the ADR to carry a
tracking issue number, but nothing enforced it. New ratchet gate
(scripts/lint-allow-test-rule-refs.cjs, wired into lint:ci) fails when a NEW
allow-test-rule comment lacks a #NNN/URL reference; the 323 existing untracked
exemptions are grandfathered in an allowlist that ratchets down as they gain
refs. Red-green verified (novel untracked offender fails; compliant passes).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* docs: add ADR test-audit evidence report (#1192)

Full risk-first qa-test-architect audit of the ADR portfolio (37 ADRs + 4
platform lenses, adversarial verification of retire verdicts) that drove the
P0 discovery fix, ADR-218 coverage, 5 retires, 27 redesigns, and the two new
lint gates. Filed as point-in-time evidence under docs/issueevidence/, named
for tracking issue #1192.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* test: replace pre-existing raw NUL byte with escape in feat-3594 fixture

feat-3594's null-byte parser fixture contained a literal NUL byte (pre-existing
on next at b10e5681 — confirmed: base blob has 1 NUL, this fix has 0), which
made git treat the file as binary and would break grep/editors. Switch to the
\x00 escape; the runtime string value (a real NUL in the parser input) is
unchanged.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* test: address adversarial-review findings

Codex adversarial pass over the branch:
- capability-registry drift test no longer mutates the committed generated
  capability-registry.cjs in place (concurrency hazard) — uses in-memory
  checkPipeline comparison instead.
- allow-test-rule ratchet now detects exemptions in ALL comment forms (block
  /* */ too, matching no-source-grep) so a block comment can't bypass it;
  one newly-surfaced pre-existing offender grandfathered (323->324).
- install.test Kilo case asserts on what install(false,'kilo') actually writes
  rather than manually calling configureKiloPermissions (masked the call site).
- issue-766 drops the undeclared transitive ajv dep for explicit structural
  assertions from the schema fixture.
- adr-218 test notes the hotfix leading-zero gap is tracked in #1186.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* fix: address code-review findings (subdir discovery, rule + test gaps)

xhigh code review surfaced 15 confirmed issues, all fixed:
- run-tests.cjs --files now resolves subdir tests by bare basename + handles
  Windows backslash paths (ambiguous basenames error clearly).
- affected-tests-lib.cjs listTestFiles made recursive — the targeted CI lane was
  silently dropping changed subdir tests (same false-green class the audit fixed).
- no-tautological-assert now catches 'true || cond' and empty []/{}  equality.
- verify-test-quality: restore provenance-classification coverage, tighten the
  writeFile circular-detection check, guard the module-level file read.
- sh-hook-paths: cover the global-install .sh delegation branch (#2045 guard).
- active-workstream null-guard runs deterministically (no longer skipped on TTY).
- adr-218 structural guards tightened (major/minor leading-zero; needs: membership).
- repo-layout AGENTS.md guard no longer false-alarms on equivalent refactors.
- cross-ai ordering guard fails red when the step is missing.
- issue-766 parses required fields from the schema fixture (auto-enforced).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* test: stub USERPROFILE alongside HOME in feat-488 (Windows parity)

The feat-488 redesign stubbed process.env.HOME but not USERPROFILE; os.homedir()
resolves from USERPROFILE on Windows, so the home stub was not hermetic there —
caught by windows-test-parity-guard (stubsHomeNoUserProfile). Save/set/restore
USERPROFILE symmetrically with HOME (delete-if-originally-undefined).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* chore: reconcile allow-test-rule allowlist after rebase onto next

Rebasing onto current next pulled in merged PR #1170, which added
inventory-headings-countfree.test.cjs (a baseline allow-test-rule exemption) and
deleted inventory-counts.test.cjs. Grandfather the former and prune the latter so
the ratchet matches the merged tree. No new debt from this PR.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-13 23:35:08 -04:00

736 lines
29 KiB
JavaScript

'use strict';
const test = require('node:test');
const assert = require('node:assert/strict');
const path = require('node:path');
const fs = require('node:fs');
const os = require('node:os');
const {
listTestFiles,
parseRelativeSpecifiers,
pickAffectedTests,
resolveRunPlan,
shouldRunFullSuite,
resolveBaseRef,
PR_EXCLUDED_SUITES,
PR_FULL_SUITES,
buildTransitiveReverseIndex,
resolveRelativeDependency,
} = require('../scripts/affected-tests-lib.cjs');
const { cleanup } = require('./helpers.cjs');
// ---------------------------------------------------------------------------
// Helpers
// ---------------------------------------------------------------------------
/** Create a temp repo with given files (keys = relative paths, values = content). */
function makeFixture(files) {
const dir = fs.mkdtempSync(path.join(os.tmpdir(), 'gsd-test-'));
for (const [rel, content] of Object.entries(files)) {
const abs = path.join(dir, rel);
fs.mkdirSync(path.dirname(abs), { recursive: true });
fs.writeFileSync(abs, content, 'utf8');
}
return dir;
}
// ---------------------------------------------------------------------------
// Original tests (kept green)
// ---------------------------------------------------------------------------
test('parseRelativeSpecifiers captures local require/import paths', () => {
const source = `
const a = require('./alpha.cjs');
const b = require("node:assert/strict");
import c from "../beta.js";
import d from "external-lib";
`;
const out = parseRelativeSpecifiers(source);
assert.deepEqual(out, ['./alpha.cjs', '../beta.js']);
});
test('shouldRunFullSuite true when critical paths change', () => {
assert.equal(shouldRunFullSuite(['package-lock.json']), true);
assert.equal(shouldRunFullSuite(['.github/workflows/test.yml']), true);
assert.equal(shouldRunFullSuite(['tests/foo.test.cjs']), false);
});
test('pickAffectedTests includes direct test changes and reverse-index matches, excluding install suite', () => {
const allTests = [
'tests/alpha.test.cjs',
'tests/install.test.cjs',
'tests/tarball.install.test.cjs',
];
const reverse = new Map([
['bin/install.js', new Set(['tests/install.test.cjs'])],
]);
const selected = pickAffectedTests(
['tests/alpha.test.cjs', 'bin/install.js'],
allTests,
reverse,
);
// tests/install.test.cjs is a plain unit test (no install suite marker) so it is included.
// tests/tarball.install.test.cjs is install suite — excluded.
assert.deepEqual(selected, [
'tests/alpha.test.cjs',
'tests/install.test.cjs',
]);
});
test('pickAffectedTests falls back to smoke test when no matches found', () => {
const allTests = ['tests/release-tarball-smoke.install.test.cjs'];
const selected = pickAffectedTests(
['docs/README.md'],
allTests,
new Map(),
);
// New contract: install files are excluded; empty selection returns empty array.
assert.deepEqual(selected, []);
});
test('pickAffectedTests excludes a directly-changed install test file', () => {
// Even if the changed file IS an install test, it must be excluded from PR selection.
const allTests = [
'tests/foo.install.test.cjs',
'tests/bar.test.cjs',
];
const selected = pickAffectedTests(
['tests/foo.install.test.cjs'],
allTests,
new Map(),
);
assert.ok(!selected.includes('tests/foo.install.test.cjs'), 'install test must be excluded');
assert.deepEqual(selected, []);
});
test('pickAffectedTests excludes install/slow pulled in by stem match', () => {
// A changed source file whose stem matches an install or slow test file.
const allTests = [
'tests/release-tarball.install.test.cjs',
'tests/perf-check.slow.test.cjs',
'tests/release-tarball.test.cjs',
];
const selected = pickAffectedTests(
['src/release-tarball.cjs'],
allTests,
new Map(),
);
assert.ok(!selected.includes('tests/release-tarball.install.test.cjs'), 'install suite must be excluded via stem match');
assert.ok(!selected.includes('tests/perf-check.slow.test.cjs'), 'slow suite must be excluded');
// The plain unit test matched by stem is still included.
assert.ok(selected.includes('tests/release-tarball.test.cjs'), 'unit test matched by stem should be included');
});
test('pickAffectedTests returns empty (no install smoke) when nothing maps', () => {
const allTests = [
'tests/release-tarball-smoke.install.test.cjs',
'tests/some-unit.test.cjs',
];
// Changed file has no match and no stem match with unit tests.
const selected = pickAffectedTests(
['docs/CONTRIBUTING.md'],
allTests,
new Map(),
);
assert.ok(
!selected.includes('tests/release-tarball-smoke.install.test.cjs'),
'install smoke test must not be injected as fallback',
);
assert.deepEqual(selected, []);
});
test('PR_EXCLUDED_SUITES contains install and slow; PR_FULL_SUITES excludes them', () => {
assert.ok(PR_EXCLUDED_SUITES instanceof Set, 'PR_EXCLUDED_SUITES must be a Set');
assert.ok(PR_EXCLUDED_SUITES.has('install'), 'install must be in PR_EXCLUDED_SUITES');
assert.ok(PR_EXCLUDED_SUITES.has('slow'), 'slow must be in PR_EXCLUDED_SUITES');
assert.ok(Array.isArray(PR_FULL_SUITES), 'PR_FULL_SUITES must be an array');
assert.ok(PR_FULL_SUITES.includes('unit'), 'unit must be in PR_FULL_SUITES');
assert.ok(PR_FULL_SUITES.includes('integration'), 'integration must be in PR_FULL_SUITES');
assert.ok(PR_FULL_SUITES.includes('security'), 'security must be in PR_FULL_SUITES');
assert.ok(!PR_FULL_SUITES.includes('install'), 'install must NOT be in PR_FULL_SUITES');
assert.ok(!PR_FULL_SUITES.includes('slow'), 'slow must NOT be in PR_FULL_SUITES');
});
test('resolveBaseRef prefers explicit env override', () => {
const original = {
GSD_AFFECTED_BASE: process.env.GSD_AFFECTED_BASE,
GITHUB_BASE_REF: process.env.GITHUB_BASE_REF,
};
try {
process.env.GSD_AFFECTED_BASE = 'origin/next';
process.env.GITHUB_BASE_REF = 'main';
assert.equal(resolveBaseRef(), 'origin/next');
delete process.env.GSD_AFFECTED_BASE;
process.env.GITHUB_BASE_REF = 'next';
assert.equal(resolveBaseRef(), 'origin/next');
delete process.env.GSD_AFFECTED_BASE;
delete process.env.GITHUB_BASE_REF;
assert.equal(resolveBaseRef(), 'origin/main');
} finally {
if (original.GSD_AFFECTED_BASE === undefined) delete process.env.GSD_AFFECTED_BASE;
else process.env.GSD_AFFECTED_BASE = original.GSD_AFFECTED_BASE;
if (original.GITHUB_BASE_REF === undefined) delete process.env.GITHUB_BASE_REF;
else process.env.GITHUB_BASE_REF = original.GITHUB_BASE_REF;
}
});
// ---------------------------------------------------------------------------
// NEW: Transitive test (RED against old code)
// Fixture: tests/t.test.cjs -> ../gsd-core/bin/lib/depA.cjs -> ./depB.cjs
// Changed: gsd-core/bin/lib/depB.cjs
// Expected: tests/t.test.cjs is selected
// ---------------------------------------------------------------------------
test('transitive: changing a deep dependency selects the test that depends on it', (t) => {
const dir = makeFixture({
'gsd-core/bin/lib/depB.cjs': `'use strict';\nmodule.exports = { b: 1 };\n`,
'gsd-core/bin/lib/depA.cjs': `'use strict';\nconst depB = require('./depB.cjs');\nmodule.exports = { a: depB };\n`,
'tests/t.test.cjs': `'use strict';\nconst depA = require('../gsd-core/bin/lib/depA.cjs');\n`,
});
t.after(() => cleanup(dir));
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/t.test.cjs']);
const selected = pickAffectedTests(
['gsd-core/bin/lib/depB.cjs'],
['tests/t.test.cjs'],
reverseIndex,
);
assert.ok(
selected.includes('tests/t.test.cjs'),
`Expected tests/t.test.cjs in selection, got: ${JSON.stringify(selected)}`,
);
});
// ---------------------------------------------------------------------------
// Adversarial matrix
// ---------------------------------------------------------------------------
test('adversarial(a): cycle depA<->depB — changing depA selects test, no hang', (t) => {
const dir = makeFixture({
'gsd-core/bin/lib/depA.cjs': `'use strict';\nconst depB = require('./depB.cjs');\nmodule.exports = {};\n`,
'gsd-core/bin/lib/depB.cjs': `'use strict';\nconst depA = require('./depA.cjs');\nmodule.exports = {};\n`,
'tests/cycle.test.cjs': `'use strict';\nconst depA = require('../gsd-core/bin/lib/depA.cjs');\n`,
});
t.after(() => cleanup(dir));
// Must complete without hanging
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/cycle.test.cjs']);
const selected = pickAffectedTests(
['gsd-core/bin/lib/depA.cjs'],
['tests/cycle.test.cjs'],
reverseIndex,
);
assert.ok(
selected.includes('tests/cycle.test.cjs'),
`Expected cycle.test.cjs selected, got: ${JSON.stringify(selected)}`,
);
});
test('adversarial(b): missing require (gone file) — null resolve, no crash', (t) => {
const dir = makeFixture({
// Requires a file that does not exist
'tests/missing.test.cjs': `'use strict';\nconst x = require('../gsd-core/bin/lib/gone.cjs');\n`,
});
t.after(() => cleanup(dir));
// Should not throw
let reverseIndex;
assert.doesNotThrow(() => {
reverseIndex = buildTransitiveReverseIndex(dir, ['tests/missing.test.cjs']);
});
// Changing the missing file produces no selection (it doesn't exist, so no dependents)
const selected = pickAffectedTests(
['gsd-core/bin/lib/gone.cjs'],
['tests/missing.test.cjs'],
reverseIndex,
);
// gone.cjs is not in the graph (null resolve), so no test selected via index
// stem match may or may not fire; either way, no crash is the key assertion
assert.ok(Array.isArray(selected), 'result must be an array');
});
test('adversarial(c): .json dependency — changing data.json selects the test', (t) => {
const dir = makeFixture({
'gsd-core/bin/lib/data.json': `{"key":"value"}`,
'tests/json.test.cjs': `'use strict';\nconst data = require('../gsd-core/bin/lib/data.json');\n`,
});
t.after(() => cleanup(dir));
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/json.test.cjs']);
const selected = pickAffectedTests(
['gsd-core/bin/lib/data.json'],
['tests/json.test.cjs'],
reverseIndex,
);
assert.ok(
selected.includes('tests/json.test.cjs'),
`Expected json.test.cjs selected for data.json change, got: ${JSON.stringify(selected)}`,
);
});
test('adversarial(d): re-export chain — changing depB selects the test that requires the re-exporter', (t) => {
const dir = makeFixture({
'gsd-core/bin/lib/depB.cjs': `'use strict';\nmodule.exports = { deep: true };\n`,
'gsd-core/bin/lib/reexporter.cjs': `'use strict';\nmodule.exports = require('./depB.cjs');\n`,
'tests/reexport.test.cjs': `'use strict';\nconst x = require('../gsd-core/bin/lib/reexporter.cjs');\n`,
});
t.after(() => cleanup(dir));
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/reexport.test.cjs']);
const selected = pickAffectedTests(
['gsd-core/bin/lib/depB.cjs'],
['tests/reexport.test.cjs'],
reverseIndex,
);
assert.ok(
selected.includes('tests/reexport.test.cjs'),
`Expected reexport.test.cjs selected when depB changes, got: ${JSON.stringify(selected)}`,
);
});
test('adversarial(e): bare and node: specifiers are ignored', () => {
const source = `
const a = require('node:fs');
const b = require('external-package');
import c from 'node:path';
import d from 'lodash';
const e = require('./local.cjs');
`;
const out = parseRelativeSpecifiers(source);
// Only the relative specifier survives
assert.deepEqual(out, ['./local.cjs']);
});
test('adversarial(f): WIDEN — changing a src file with no test dependents widens to unit/all', (t) => {
// orphan.cjs is a source file no test file requires (statically)
const dir = makeFixture({
'gsd-core/bin/lib/orphan.cjs': `'use strict';\nmodule.exports = {};\n`,
'tests/unrelated.test.cjs': `'use strict';\n// requires nothing\n`,
});
t.after(() => cleanup(dir));
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/unrelated.test.cjs']);
// Verify orphan.cjs has no dependents in the index
const dependents = reverseIndex.get('gsd-core/bin/lib/orphan.cjs');
assert.ok(
!dependents || dependents.size === 0,
'orphan.cjs must have no transitive test dependents',
);
// The widen backstop is tested via the WIDEN_SIGNAL attached to pickAffectedTests result
const selected = pickAffectedTests(
['gsd-core/bin/lib/orphan.cjs'],
['tests/unrelated.test.cjs'],
reverseIndex,
{ detectWiden: true },
);
assert.ok(
selected._widenRequired === true,
`Expected _widenRequired=true for orphan src file with no test dependents, got: ${JSON.stringify(selected._widenRequired)}`,
);
});
test('adversarial(g): dynamic require in changed file with no static dependents — widen backstop catches it', (t) => {
// dynamic.cjs uses a template literal require — not statically parseable
// No test requires dynamic.cjs statically
const dir = makeFixture({
'gsd-core/bin/lib/dynamic.cjs': `'use strict';\nconst x = 'foo';\nconst m = require(\`./\${x}\`);\nmodule.exports = {};\n`,
'tests/unrelated.test.cjs': `'use strict';\n// does not require dynamic.cjs\n`,
});
t.after(() => cleanup(dir));
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/unrelated.test.cjs']);
const selected = pickAffectedTests(
['gsd-core/bin/lib/dynamic.cjs'],
['tests/unrelated.test.cjs'],
reverseIndex,
{ detectWiden: true },
);
assert.ok(
selected._widenRequired === true,
`Expected _widenRequired=true for dynamic-require src file with no static dependents, got: ${JSON.stringify(selected._widenRequired)}`,
);
});
test('resolveRelativeDependency resolves .ts, .json extensions', (t) => {
const dir = makeFixture({
'src/helper.ts': `export const x = 1;\n`,
'src/data.json': `{"k":1}`,
});
t.after(() => cleanup(dir));
const fromAbs = path.join(dir, 'tests/consumer.cjs');
const tsResult = resolveRelativeDependency(dir, fromAbs, '../src/helper');
assert.equal(tsResult, 'src/helper.ts', `Expected src/helper.ts, got: ${tsResult}`);
const jsonResult = resolveRelativeDependency(dir, fromAbs, '../src/data.json');
assert.equal(jsonResult, 'src/data.json', `Expected src/data.json, got: ${jsonResult}`);
});
// ---------------------------------------------------------------------------
// resolveRunPlan — pure unit tests
// ---------------------------------------------------------------------------
test('resolveRunPlan: noChanges → mode:suite unit', () => {
// Arrange
const plan = resolveRunPlan({ changedFiles: [], selected: [], widenRequired: false, criticalPath: false, noChanges: true });
// Assert
assert.deepEqual(plan, { mode: 'suite', suite: 'unit' });
});
test('resolveRunPlan: criticalPath → mode:suites PR_FULL_SUITES', () => {
// Arrange
const plan = resolveRunPlan({ changedFiles: ['package.json'], selected: [], widenRequired: false, criticalPath: true, noChanges: false });
// Assert
assert.deepEqual(plan, { mode: 'suites', suites: PR_FULL_SUITES });
});
test('resolveRunPlan: widenRequired → mode:suites PR_FULL_SUITES (not unit-only)', () => {
// Arrange: orphan source file, no static dependents → widen signal
const selected = [];
selected._widenRequired = true;
const plan = resolveRunPlan({ changedFiles: ['bin/orphan.cjs'], selected, widenRequired: true, criticalPath: false, noChanges: false });
// Assert — must be suites covering all three PR suites, NOT unit-only
assert.equal(plan.mode, 'suites', 'widen must produce mode:suites, not mode:suite');
assert.deepEqual(plan.suites, PR_FULL_SUITES);
assert.ok(plan.suites.includes('integration'), 'integration must be in widen plan');
assert.ok(plan.suites.includes('security'), 'security must be in widen plan');
assert.ok(plan.suites.includes('unit'), 'unit must be in widen plan');
});
test('resolveRunPlan: empty selection (no widen) → mode:suite unit smoke', () => {
// Arrange
const plan = resolveRunPlan({ changedFiles: ['docs/README.md'], selected: [], widenRequired: false, criticalPath: false, noChanges: false });
// Assert
assert.deepEqual(plan, { mode: 'suite', suite: 'unit' });
});
test('resolveRunPlan: concrete selection without widen → mode:files', () => {
// Arrange
const files = ['tests/foo.test.cjs', 'tests/bar.integration.test.cjs'];
const plan = resolveRunPlan({ changedFiles: ['bin/foo.cjs'], selected: files, widenRequired: false, criticalPath: false, noChanges: false });
// Assert
assert.deepEqual(plan, { mode: 'files', files });
});
// ---------------------------------------------------------------------------
// Mixed-diff regression: widen must be a SUPERSET, never drop concrete matches
// ---------------------------------------------------------------------------
test('regression(mixed-diff): widen plan covers integration suite; concrete match not dropped', (t) => {
// Arrange: two changed files in one diff.
// - bin/lib/server.cjs → has a concrete dependent: tests/server.integration.test.cjs
// - bin/lib/orphan.cjs → has NO test dependents (triggers widen)
// Under the OLD (buggy) code, widenRequired caused an early-return to
// runSuite(root,'unit'), which excludes integration-marked tests, so the
// concrete integration match was silently dropped.
// Under the NEW code, widen must resolve to mode:suites with PR_FULL_SUITES,
// which covers unit + integration + security — a strict superset of selected.
const dir = makeFixture({
'bin/lib/server.cjs': `'use strict';\nmodule.exports = { serve: true };\n`,
'bin/lib/orphan.cjs': `'use strict';\nmodule.exports = {};\n`,
'tests/server.integration.test.cjs': `'use strict';\nconst s = require('../bin/lib/server.cjs');\n`,
'tests/unrelated.test.cjs': `'use strict';\n// requires nothing\n`,
});
t.after(() => cleanup(dir));
// Act: build graph over both test files
const allTests = [
'tests/server.integration.test.cjs',
'tests/unrelated.test.cjs',
];
const reverseIndex = buildTransitiveReverseIndex(dir, allTests);
// Verify the fixture: server.cjs DOES have a concrete dependent
const serverDependents = reverseIndex.get('bin/lib/server.cjs');
assert.ok(
serverDependents && serverDependents.has('tests/server.integration.test.cjs'),
'fixture: bin/lib/server.cjs must map to tests/server.integration.test.cjs in the reverse index',
);
// Verify the fixture: orphan.cjs has NO dependents
const orphanDependents = reverseIndex.get('bin/lib/orphan.cjs');
assert.ok(
!orphanDependents || orphanDependents.size === 0,
'fixture: bin/lib/orphan.cjs must have zero test dependents',
);
// pickAffectedTests with detectWiden=true on the mixed diff
const changedFiles = ['bin/lib/server.cjs', 'bin/lib/orphan.cjs'];
const selected = pickAffectedTests(changedFiles, allTests, reverseIndex, { detectWiden: true });
// The concrete match must still be in selected (widen doesn't strip it)
assert.ok(
selected.includes('tests/server.integration.test.cjs'),
`Concrete integration match must survive pickAffectedTests even when widen fires; selected=${JSON.stringify(selected)}`,
);
// widenRequired must be set because orphan.cjs has no static dependents
assert.ok(
selected._widenRequired === true,
`_widenRequired must be true when any source file has no static dependents; got ${JSON.stringify(selected._widenRequired)}`,
);
// resolveRunPlan must return mode:suites covering integration (not unit-only)
const plan = resolveRunPlan({
changedFiles,
selected,
widenRequired: selected._widenRequired === true,
criticalPath: false,
noChanges: false,
});
assert.equal(
plan.mode,
'suites',
`widen plan must be mode:suites (not mode:suite/mode:files); got mode:${plan.mode} — OLD behaviour would have been mode:suite/unit, dropping the integration test`,
);
assert.ok(
plan.suites.includes('integration'),
`widen plan must include integration suite to cover the concrete match; suites=${JSON.stringify(plan.suites)}`,
);
assert.ok(
plan.suites.includes('security'),
`widen plan must include security suite; suites=${JSON.stringify(plan.suites)}`,
);
assert.ok(
plan.suites.includes('unit'),
`widen plan must include unit suite; suites=${JSON.stringify(plan.suites)}`,
);
// Prove the old behaviour would have FAILED this test:
// Old code: widenRequired → runSuite(root,'unit') only.
// 'unit' suite selects only files with NO suite marker (suiteOf === null).
// tests/server.integration.test.cjs has marker 'integration', so it would be
// excluded from the unit suite run → the concrete match is silently dropped.
// The assertion above catches this because old plan would have been
// { mode: 'suite', suite: 'unit' } which does NOT include 'integration'.
});
// ---------------------------------------------------------------------------
// Regression: delete-only diffs
// ---------------------------------------------------------------------------
test('regression(delete-only-source): deleting a source file triggers widen, never unit-smoke', (t) => {
// Arrange: fixture has an unrelated test but does NOT contain gone.cjs.
// The deletion-only diff (changedFiles includes gone.cjs which is absent on disk)
// must trigger the widen backstop — gone.cjs has no static dependents because
// it was never built into the forward graph (it doesn't exist).
const dir = makeFixture({
'gsd-core/bin/lib/other.cjs': `'use strict';\nmodule.exports = {};\n`,
'tests/unrelated.test.cjs': `'use strict';\n// requires nothing from gone.cjs\n`,
});
t.after(() => cleanup(dir));
// Act
const allTests = ['tests/unrelated.test.cjs'];
const reverseIndex = buildTransitiveReverseIndex(dir, allTests);
// gone.cjs does not exist in the fixture — simulates a delete-only PR.
const changedFiles = ['gsd-core/bin/lib/gone.cjs'];
const selected = pickAffectedTests(changedFiles, allTests, reverseIndex, { detectWiden: true });
// Assert: widen must be signalled (deleted source file has no static dependents)
assert.ok(
selected._widenRequired === true,
`Expected _widenRequired=true for deleted source file, got: ${JSON.stringify(selected._widenRequired)}`,
);
const plan = resolveRunPlan({
changedFiles,
selected,
widenRequired: selected._widenRequired === true,
criticalPath: false,
noChanges: false,
});
// The plan must be mode:suites (widen), NOT mode:suite/unit and NOT empty.
assert.equal(
plan.mode,
'suites',
`Delete-only source diff must resolve to mode:suites, got mode:${plan.mode} — old ACMR filter would have produced empty changedFiles → mode:suite/unit (smoke only), silently skipping integration/security`,
);
assert.deepEqual(
plan.suites,
PR_FULL_SUITES,
`Delete-only widen plan must cover all PR_FULL_SUITES, got: ${JSON.stringify(plan.suites)}`,
);
});
// ---------------------------------------------------------------------------
// Regression: rename-stale-old-path
// ---------------------------------------------------------------------------
test('regression(rename-stale-old-path): deleted old path triggers widen, protecting stale importers', (t) => {
// Arrange: simulate the DELETE side of a rename.
// oldname.cjs is absent from disk (renamed away); newname.cjs is present with
// a concrete test dependent. A stale importer still requiring oldname.cjs
// would break at runtime, but static analysis cannot see it (the stale importer
// is not in this fixture). The correct safe behaviour is to widen, not to
// select only newname.cjs's dependents — which would silently skip the stale
// importer's tests.
//
// With --no-renames, git emits Delete(oldname.cjs) + Add(newname.cjs).
// oldname.cjs is absent on disk → not in the forward graph → zero static
// dependents → widen backstop fires → mode:suites (PR_FULL_SUITES).
const dir = makeFixture({
// newname.cjs exists; oldname.cjs intentionally absent (it was renamed away)
'gsd-core/bin/lib/newname.cjs': `'use strict';\nmodule.exports = { v: 2 };\n`,
'tests/newname.test.cjs': `'use strict';\nconst x = require('../gsd-core/bin/lib/newname.cjs');\n`,
'tests/unrelated.test.cjs': `'use strict';\n// no dependency on oldname or newname\n`,
});
t.after(() => cleanup(dir));
// Act
const allTests = ['tests/newname.test.cjs', 'tests/unrelated.test.cjs'];
const reverseIndex = buildTransitiveReverseIndex(dir, allTests);
// changedFiles mirrors what --no-renames git diff emits for a rename:
// Delete(old) + Add(new)
const changedFiles = [
'gsd-core/bin/lib/oldname.cjs', // deleted old path — absent from disk
'gsd-core/bin/lib/newname.cjs', // added new path — present on disk
];
// Assert: oldname.cjs must have zero static dependents (not in graph)
const oldDependents = reverseIndex.get('gsd-core/bin/lib/oldname.cjs');
assert.ok(
!oldDependents || oldDependents.size === 0,
`oldname.cjs must have no static dependents (absent from disk), got: ${JSON.stringify(oldDependents && [...oldDependents])}`,
);
const selected = pickAffectedTests(changedFiles, allTests, reverseIndex, { detectWiden: true });
// Widen must be signalled because oldname.cjs has no static dependents
assert.ok(
selected._widenRequired === true,
`Expected _widenRequired=true because deleted old path has no static dependents; got: ${JSON.stringify(selected._widenRequired)}`,
);
const plan = resolveRunPlan({
changedFiles,
selected,
widenRequired: selected._widenRequired === true,
criticalPath: false,
noChanges: false,
});
// Plan must be mode:suites — conservative widen covers any stale importer
assert.equal(
plan.mode,
'suites',
`Rename (old-path delete) must resolve to mode:suites, got mode:${plan.mode}`,
);
assert.deepEqual(
plan.suites,
PR_FULL_SUITES,
`Rename widen plan must cover all PR_FULL_SUITES, got: ${JSON.stringify(plan.suites)}`,
);
});
test('regression(delete-only-test): deleting a test file does not trigger widen and does not select the absent test', (t) => {
// Arrange: fixture has one surviving test; tests/gone.test.cjs is NOT on disk.
const dir = makeFixture({
'tests/surviving.test.cjs': `'use strict';\n// a plain surviving unit test\n`,
});
t.after(() => cleanup(dir));
// Act
// allTests comes from the fixture's tests/ directory — gone.test.cjs is absent.
const allTests = ['tests/surviving.test.cjs'];
const reverseIndex = buildTransitiveReverseIndex(dir, allTests);
const changedFiles = ['tests/gone.test.cjs'];
const selected = pickAffectedTests(changedFiles, allTests, reverseIndex, { detectWiden: true });
// Assert: the deleted test file must NOT appear in selected (can't run it).
assert.ok(
!selected.includes('tests/gone.test.cjs'),
`Deleted test file must not appear in selection, got: ${JSON.stringify(selected)}`,
);
// Assert: widen must NOT be triggered (a deleted test is not impactful for selection).
assert.ok(
selected._widenRequired !== true,
`Deleted test file must not trigger widen, got _widenRequired=${JSON.stringify(selected._widenRequired)}`,
);
const plan = resolveRunPlan({
changedFiles,
selected,
widenRequired: selected._widenRequired === true,
criticalPath: false,
noChanges: false,
});
// A delete-only test-file diff with no surviving selection → unit smoke (not widen).
assert.equal(
plan.mode,
'suite',
`Delete-only test-file diff must resolve to mode:suite (smoke), got mode:${plan.mode}`,
);
assert.equal(
plan.suite,
'unit',
`Delete-only test-file diff must run unit smoke, got suite:${plan.suite}`,
);
});
// ---------------------------------------------------------------------------
// listTestFiles — recurse into subdirectories (finding #2)
// ---------------------------------------------------------------------------
test('listTestFiles: subdir test files are included and selectable by pickAffectedTests', (t) => {
// Arrange: fixture with a root-level test AND a subdirectory test (mirrors
// tests/dispatch/, tests/observability/, tests/installer-migrations/).
const dir = makeFixture({
'tests/root.test.cjs': `'use strict';\n// root level test\n`,
'tests/dispatch/agent-dispatch.test.cjs': `'use strict';\nconst lib = require('../../gsd-core/bin/lib/dispatch.cjs');\n`,
'gsd-core/bin/lib/dispatch.cjs': `'use strict';\nmodule.exports = { dispatch: true };\n`,
});
t.after(() => cleanup(dir));
// Act: listTestFiles must recurse and return the subdir test with forward slashes
const files = listTestFiles(dir);
assert.ok(
files.includes('tests/dispatch/agent-dispatch.test.cjs'),
`Expected tests/dispatch/agent-dispatch.test.cjs in listTestFiles output, got: ${JSON.stringify(files)}`,
);
assert.ok(
files.includes('tests/root.test.cjs'),
`Expected tests/root.test.cjs in listTestFiles output, got: ${JSON.stringify(files)}`,
);
// The set membership check that allTestsSet.has('tests/dispatch/...') must succeed
// so that a directly-changed subdir test is not silently dropped.
const reverseIndex = buildTransitiveReverseIndex(dir, files);
const selected = pickAffectedTests(
['tests/dispatch/agent-dispatch.test.cjs'],
files,
reverseIndex,
);
assert.ok(
selected.includes('tests/dispatch/agent-dispatch.test.cjs'),
`Directly-changed subdir test must be selected; got: ${JSON.stringify(selected)}`,
);
});