* fix: recurse test discovery so subdir test suites actually run
scripts/run-tests.cjs discovered tests with a flat readdirSync(testDir),
silently excluding tests/observability/ (4 files), tests/dispatch/ (1) and
tests/installer-migrations/ (1) — 94 passing tests — from `npm test` and all
CI lanes. Walk the tree recursively (relative subpaths preserved), classify
suites by basename, and add a fail-on-zero-executed guard for suite/default
runs (escape hatch GSD_ALLOW_EMPTY_SUITE=1) while preserving the empty
--files/--files-from path the CI inert lane relies on.
Unit suite 735 -> 741 files; surfaces ADR-227's observability/dispatch seam.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: retire 5 verified-worthless tests
Adversarial verification confirmed these 5 prove nothing — their coverage is
provided more strictly elsewhere:
- enh-2790 'has a name: field' spot-checks (command-contract enforces /^gsd[:-]/)
- command-routing-hub duplicate construct + duplicate ERROR_KINDS assertions
- no-cjs-sdk-handsync-tooling (guarded files that never existed on main; bug-190
covers the real retired SDK artifacts)
- runtime-artifact-layout cline edge case (subsumed by the explicit-global test
and bug-782-cline-skills-emission)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: add ADR-218 release version-validation coverage
ADR-218 (reject leading-zero versions like 1.01.0; npm duplicate pre-check) had
zero tests — the logic lived only in release.yml bash. Add a test that extracts
the actual rejection regexes from the workflow and exercises them against a
boundary table (leading-zero/malformed rejected, valid accepted) plus structural
wiring assertions. Goes red if the regex is reverted to [0-9]+.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: redesign weak tests into behavioral, deterministic assertions
Per the ADR test audit, rewrite 27 weak test files (test-only, no source
changes) so each can go red for the defect it guards:
- kill pass-always assert.ok(true) placeholders (research-cli, worktree-baseref,
bug-260 security guard, eslint-rules x24, clusters '|| true')
- replace source-text grep with behavioral calls (install Kilo, sh-hook-paths,
plan-review-convergence) and add a repo-layout governance test
- de-flake real-clock/Math.random coupling (phase last_updated, bug-3707 mtime,
context-utilization property, feat-3594)
- fix independence/shared-state violations (bug-492 singleton, issue-844 tmpRoot,
core reapStaleTempFiles, active-workstream TTY, feat-488 GSD_HOME)
- strengthen property/shape-only tests (research-provider/store classification +
collision) and unconditional plugin.json schema validation (issue-766)
Verified: all 28 files run together 1220 pass / 0 fail / 1 skip.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* chore: add no-tautological-assert lint rule, error in test suite
New custom ESLint rule (eslint-rules/no-tautological-assert.cjs) bans asserts
that can never fail: assert(true)/assert.ok(<always-truthy literal>),
'cond || true' inside an assert, and equality asserts comparing two identical
literals. Wired as error on tests/**; full sweep confirmed zero existing
violations so the suite stays green. Prevents the placeholder-assert regressions
the audit redesigns just removed. RuleTester coverage added (6 valid, 8 invalid).
Note: no-only-tests was already enforced via eslint-plugin-no-only-tests, so no
duplicate rule was added.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* chore: gate new allow-test-rule exemptions to require an issue ref
ADR-456 requires any allow-test-rule exemption added after the ADR to carry a
tracking issue number, but nothing enforced it. New ratchet gate
(scripts/lint-allow-test-rule-refs.cjs, wired into lint:ci) fails when a NEW
allow-test-rule comment lacks a #NNN/URL reference; the 323 existing untracked
exemptions are grandfathered in an allowlist that ratchets down as they gain
refs. Red-green verified (novel untracked offender fails; compliant passes).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* docs: add ADR test-audit evidence report (#1192)
Full risk-first qa-test-architect audit of the ADR portfolio (37 ADRs + 4
platform lenses, adversarial verification of retire verdicts) that drove the
P0 discovery fix, ADR-218 coverage, 5 retires, 27 redesigns, and the two new
lint gates. Filed as point-in-time evidence under docs/issueevidence/, named
for tracking issue #1192.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: replace pre-existing raw NUL byte with escape in feat-3594 fixture
feat-3594's null-byte parser fixture contained a literal NUL byte (pre-existing
on next at b10e5681 — confirmed: base blob has 1 NUL, this fix has 0), which
made git treat the file as binary and would break grep/editors. Switch to the
\x00 escape; the runtime string value (a real NUL in the parser input) is
unchanged.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: address adversarial-review findings
Codex adversarial pass over the branch:
- capability-registry drift test no longer mutates the committed generated
capability-registry.cjs in place (concurrency hazard) — uses in-memory
checkPipeline comparison instead.
- allow-test-rule ratchet now detects exemptions in ALL comment forms (block
/* */ too, matching no-source-grep) so a block comment can't bypass it;
one newly-surfaced pre-existing offender grandfathered (323->324).
- install.test Kilo case asserts on what install(false,'kilo') actually writes
rather than manually calling configureKiloPermissions (masked the call site).
- issue-766 drops the undeclared transitive ajv dep for explicit structural
assertions from the schema fixture.
- adr-218 test notes the hotfix leading-zero gap is tracked in #1186.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix: address code-review findings (subdir discovery, rule + test gaps)
xhigh code review surfaced 15 confirmed issues, all fixed:
- run-tests.cjs --files now resolves subdir tests by bare basename + handles
Windows backslash paths (ambiguous basenames error clearly).
- affected-tests-lib.cjs listTestFiles made recursive — the targeted CI lane was
silently dropping changed subdir tests (same false-green class the audit fixed).
- no-tautological-assert now catches 'true || cond' and empty []/{} equality.
- verify-test-quality: restore provenance-classification coverage, tighten the
writeFile circular-detection check, guard the module-level file read.
- sh-hook-paths: cover the global-install .sh delegation branch (#2045 guard).
- active-workstream null-guard runs deterministically (no longer skipped on TTY).
- adr-218 structural guards tightened (major/minor leading-zero; needs: membership).
- repo-layout AGENTS.md guard no longer false-alarms on equivalent refactors.
- cross-ai ordering guard fails red when the step is missing.
- issue-766 parses required fields from the schema fixture (auto-enforced).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: stub USERPROFILE alongside HOME in feat-488 (Windows parity)
The feat-488 redesign stubbed process.env.HOME but not USERPROFILE; os.homedir()
resolves from USERPROFILE on Windows, so the home stub was not hermetic there —
caught by windows-test-parity-guard (stubsHomeNoUserProfile). Save/set/restore
USERPROFILE symmetrically with HOME (delete-if-originally-undefined).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* chore: reconcile allow-test-rule allowlist after rebase onto next
Rebasing onto current next pulled in merged PR #1170, which added
inventory-headings-countfree.test.cjs (a baseline allow-test-rule exemption) and
deleted inventory-counts.test.cjs. Grandfather the former and prune the latter so
the ratchet matches the merged tree. No new debt from this PR.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
736 lines
29 KiB
JavaScript
736 lines
29 KiB
JavaScript
'use strict';
|
|
|
|
const test = require('node:test');
|
|
const assert = require('node:assert/strict');
|
|
const path = require('node:path');
|
|
const fs = require('node:fs');
|
|
const os = require('node:os');
|
|
|
|
const {
|
|
listTestFiles,
|
|
parseRelativeSpecifiers,
|
|
pickAffectedTests,
|
|
resolveRunPlan,
|
|
shouldRunFullSuite,
|
|
resolveBaseRef,
|
|
PR_EXCLUDED_SUITES,
|
|
PR_FULL_SUITES,
|
|
buildTransitiveReverseIndex,
|
|
resolveRelativeDependency,
|
|
} = require('../scripts/affected-tests-lib.cjs');
|
|
|
|
const { cleanup } = require('./helpers.cjs');
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// Helpers
|
|
// ---------------------------------------------------------------------------
|
|
|
|
/** Create a temp repo with given files (keys = relative paths, values = content). */
|
|
function makeFixture(files) {
|
|
const dir = fs.mkdtempSync(path.join(os.tmpdir(), 'gsd-test-'));
|
|
for (const [rel, content] of Object.entries(files)) {
|
|
const abs = path.join(dir, rel);
|
|
fs.mkdirSync(path.dirname(abs), { recursive: true });
|
|
fs.writeFileSync(abs, content, 'utf8');
|
|
}
|
|
return dir;
|
|
}
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// Original tests (kept green)
|
|
// ---------------------------------------------------------------------------
|
|
|
|
test('parseRelativeSpecifiers captures local require/import paths', () => {
|
|
const source = `
|
|
const a = require('./alpha.cjs');
|
|
const b = require("node:assert/strict");
|
|
import c from "../beta.js";
|
|
import d from "external-lib";
|
|
`;
|
|
const out = parseRelativeSpecifiers(source);
|
|
assert.deepEqual(out, ['./alpha.cjs', '../beta.js']);
|
|
});
|
|
|
|
test('shouldRunFullSuite true when critical paths change', () => {
|
|
assert.equal(shouldRunFullSuite(['package-lock.json']), true);
|
|
assert.equal(shouldRunFullSuite(['.github/workflows/test.yml']), true);
|
|
assert.equal(shouldRunFullSuite(['tests/foo.test.cjs']), false);
|
|
});
|
|
|
|
test('pickAffectedTests includes direct test changes and reverse-index matches, excluding install suite', () => {
|
|
const allTests = [
|
|
'tests/alpha.test.cjs',
|
|
'tests/install.test.cjs',
|
|
'tests/tarball.install.test.cjs',
|
|
];
|
|
const reverse = new Map([
|
|
['bin/install.js', new Set(['tests/install.test.cjs'])],
|
|
]);
|
|
const selected = pickAffectedTests(
|
|
['tests/alpha.test.cjs', 'bin/install.js'],
|
|
allTests,
|
|
reverse,
|
|
);
|
|
// tests/install.test.cjs is a plain unit test (no install suite marker) so it is included.
|
|
// tests/tarball.install.test.cjs is install suite — excluded.
|
|
assert.deepEqual(selected, [
|
|
'tests/alpha.test.cjs',
|
|
'tests/install.test.cjs',
|
|
]);
|
|
});
|
|
|
|
test('pickAffectedTests falls back to smoke test when no matches found', () => {
|
|
const allTests = ['tests/release-tarball-smoke.install.test.cjs'];
|
|
const selected = pickAffectedTests(
|
|
['docs/README.md'],
|
|
allTests,
|
|
new Map(),
|
|
);
|
|
// New contract: install files are excluded; empty selection returns empty array.
|
|
assert.deepEqual(selected, []);
|
|
});
|
|
|
|
test('pickAffectedTests excludes a directly-changed install test file', () => {
|
|
// Even if the changed file IS an install test, it must be excluded from PR selection.
|
|
const allTests = [
|
|
'tests/foo.install.test.cjs',
|
|
'tests/bar.test.cjs',
|
|
];
|
|
const selected = pickAffectedTests(
|
|
['tests/foo.install.test.cjs'],
|
|
allTests,
|
|
new Map(),
|
|
);
|
|
assert.ok(!selected.includes('tests/foo.install.test.cjs'), 'install test must be excluded');
|
|
assert.deepEqual(selected, []);
|
|
});
|
|
|
|
test('pickAffectedTests excludes install/slow pulled in by stem match', () => {
|
|
// A changed source file whose stem matches an install or slow test file.
|
|
const allTests = [
|
|
'tests/release-tarball.install.test.cjs',
|
|
'tests/perf-check.slow.test.cjs',
|
|
'tests/release-tarball.test.cjs',
|
|
];
|
|
const selected = pickAffectedTests(
|
|
['src/release-tarball.cjs'],
|
|
allTests,
|
|
new Map(),
|
|
);
|
|
assert.ok(!selected.includes('tests/release-tarball.install.test.cjs'), 'install suite must be excluded via stem match');
|
|
assert.ok(!selected.includes('tests/perf-check.slow.test.cjs'), 'slow suite must be excluded');
|
|
// The plain unit test matched by stem is still included.
|
|
assert.ok(selected.includes('tests/release-tarball.test.cjs'), 'unit test matched by stem should be included');
|
|
});
|
|
|
|
test('pickAffectedTests returns empty (no install smoke) when nothing maps', () => {
|
|
const allTests = [
|
|
'tests/release-tarball-smoke.install.test.cjs',
|
|
'tests/some-unit.test.cjs',
|
|
];
|
|
// Changed file has no match and no stem match with unit tests.
|
|
const selected = pickAffectedTests(
|
|
['docs/CONTRIBUTING.md'],
|
|
allTests,
|
|
new Map(),
|
|
);
|
|
assert.ok(
|
|
!selected.includes('tests/release-tarball-smoke.install.test.cjs'),
|
|
'install smoke test must not be injected as fallback',
|
|
);
|
|
assert.deepEqual(selected, []);
|
|
});
|
|
|
|
test('PR_EXCLUDED_SUITES contains install and slow; PR_FULL_SUITES excludes them', () => {
|
|
assert.ok(PR_EXCLUDED_SUITES instanceof Set, 'PR_EXCLUDED_SUITES must be a Set');
|
|
assert.ok(PR_EXCLUDED_SUITES.has('install'), 'install must be in PR_EXCLUDED_SUITES');
|
|
assert.ok(PR_EXCLUDED_SUITES.has('slow'), 'slow must be in PR_EXCLUDED_SUITES');
|
|
assert.ok(Array.isArray(PR_FULL_SUITES), 'PR_FULL_SUITES must be an array');
|
|
assert.ok(PR_FULL_SUITES.includes('unit'), 'unit must be in PR_FULL_SUITES');
|
|
assert.ok(PR_FULL_SUITES.includes('integration'), 'integration must be in PR_FULL_SUITES');
|
|
assert.ok(PR_FULL_SUITES.includes('security'), 'security must be in PR_FULL_SUITES');
|
|
assert.ok(!PR_FULL_SUITES.includes('install'), 'install must NOT be in PR_FULL_SUITES');
|
|
assert.ok(!PR_FULL_SUITES.includes('slow'), 'slow must NOT be in PR_FULL_SUITES');
|
|
});
|
|
|
|
test('resolveBaseRef prefers explicit env override', () => {
|
|
const original = {
|
|
GSD_AFFECTED_BASE: process.env.GSD_AFFECTED_BASE,
|
|
GITHUB_BASE_REF: process.env.GITHUB_BASE_REF,
|
|
};
|
|
try {
|
|
process.env.GSD_AFFECTED_BASE = 'origin/next';
|
|
process.env.GITHUB_BASE_REF = 'main';
|
|
assert.equal(resolveBaseRef(), 'origin/next');
|
|
|
|
delete process.env.GSD_AFFECTED_BASE;
|
|
process.env.GITHUB_BASE_REF = 'next';
|
|
assert.equal(resolveBaseRef(), 'origin/next');
|
|
|
|
delete process.env.GSD_AFFECTED_BASE;
|
|
delete process.env.GITHUB_BASE_REF;
|
|
assert.equal(resolveBaseRef(), 'origin/main');
|
|
} finally {
|
|
if (original.GSD_AFFECTED_BASE === undefined) delete process.env.GSD_AFFECTED_BASE;
|
|
else process.env.GSD_AFFECTED_BASE = original.GSD_AFFECTED_BASE;
|
|
if (original.GITHUB_BASE_REF === undefined) delete process.env.GITHUB_BASE_REF;
|
|
else process.env.GITHUB_BASE_REF = original.GITHUB_BASE_REF;
|
|
}
|
|
});
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// NEW: Transitive test (RED against old code)
|
|
// Fixture: tests/t.test.cjs -> ../gsd-core/bin/lib/depA.cjs -> ./depB.cjs
|
|
// Changed: gsd-core/bin/lib/depB.cjs
|
|
// Expected: tests/t.test.cjs is selected
|
|
// ---------------------------------------------------------------------------
|
|
|
|
test('transitive: changing a deep dependency selects the test that depends on it', (t) => {
|
|
const dir = makeFixture({
|
|
'gsd-core/bin/lib/depB.cjs': `'use strict';\nmodule.exports = { b: 1 };\n`,
|
|
'gsd-core/bin/lib/depA.cjs': `'use strict';\nconst depB = require('./depB.cjs');\nmodule.exports = { a: depB };\n`,
|
|
'tests/t.test.cjs': `'use strict';\nconst depA = require('../gsd-core/bin/lib/depA.cjs');\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/t.test.cjs']);
|
|
const selected = pickAffectedTests(
|
|
['gsd-core/bin/lib/depB.cjs'],
|
|
['tests/t.test.cjs'],
|
|
reverseIndex,
|
|
);
|
|
|
|
assert.ok(
|
|
selected.includes('tests/t.test.cjs'),
|
|
`Expected tests/t.test.cjs in selection, got: ${JSON.stringify(selected)}`,
|
|
);
|
|
});
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// Adversarial matrix
|
|
// ---------------------------------------------------------------------------
|
|
|
|
test('adversarial(a): cycle depA<->depB — changing depA selects test, no hang', (t) => {
|
|
const dir = makeFixture({
|
|
'gsd-core/bin/lib/depA.cjs': `'use strict';\nconst depB = require('./depB.cjs');\nmodule.exports = {};\n`,
|
|
'gsd-core/bin/lib/depB.cjs': `'use strict';\nconst depA = require('./depA.cjs');\nmodule.exports = {};\n`,
|
|
'tests/cycle.test.cjs': `'use strict';\nconst depA = require('../gsd-core/bin/lib/depA.cjs');\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
// Must complete without hanging
|
|
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/cycle.test.cjs']);
|
|
const selected = pickAffectedTests(
|
|
['gsd-core/bin/lib/depA.cjs'],
|
|
['tests/cycle.test.cjs'],
|
|
reverseIndex,
|
|
);
|
|
|
|
assert.ok(
|
|
selected.includes('tests/cycle.test.cjs'),
|
|
`Expected cycle.test.cjs selected, got: ${JSON.stringify(selected)}`,
|
|
);
|
|
});
|
|
|
|
test('adversarial(b): missing require (gone file) — null resolve, no crash', (t) => {
|
|
const dir = makeFixture({
|
|
// Requires a file that does not exist
|
|
'tests/missing.test.cjs': `'use strict';\nconst x = require('../gsd-core/bin/lib/gone.cjs');\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
// Should not throw
|
|
let reverseIndex;
|
|
assert.doesNotThrow(() => {
|
|
reverseIndex = buildTransitiveReverseIndex(dir, ['tests/missing.test.cjs']);
|
|
});
|
|
|
|
// Changing the missing file produces no selection (it doesn't exist, so no dependents)
|
|
const selected = pickAffectedTests(
|
|
['gsd-core/bin/lib/gone.cjs'],
|
|
['tests/missing.test.cjs'],
|
|
reverseIndex,
|
|
);
|
|
// gone.cjs is not in the graph (null resolve), so no test selected via index
|
|
// stem match may or may not fire; either way, no crash is the key assertion
|
|
assert.ok(Array.isArray(selected), 'result must be an array');
|
|
});
|
|
|
|
test('adversarial(c): .json dependency — changing data.json selects the test', (t) => {
|
|
const dir = makeFixture({
|
|
'gsd-core/bin/lib/data.json': `{"key":"value"}`,
|
|
'tests/json.test.cjs': `'use strict';\nconst data = require('../gsd-core/bin/lib/data.json');\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/json.test.cjs']);
|
|
const selected = pickAffectedTests(
|
|
['gsd-core/bin/lib/data.json'],
|
|
['tests/json.test.cjs'],
|
|
reverseIndex,
|
|
);
|
|
|
|
assert.ok(
|
|
selected.includes('tests/json.test.cjs'),
|
|
`Expected json.test.cjs selected for data.json change, got: ${JSON.stringify(selected)}`,
|
|
);
|
|
});
|
|
|
|
test('adversarial(d): re-export chain — changing depB selects the test that requires the re-exporter', (t) => {
|
|
const dir = makeFixture({
|
|
'gsd-core/bin/lib/depB.cjs': `'use strict';\nmodule.exports = { deep: true };\n`,
|
|
'gsd-core/bin/lib/reexporter.cjs': `'use strict';\nmodule.exports = require('./depB.cjs');\n`,
|
|
'tests/reexport.test.cjs': `'use strict';\nconst x = require('../gsd-core/bin/lib/reexporter.cjs');\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/reexport.test.cjs']);
|
|
const selected = pickAffectedTests(
|
|
['gsd-core/bin/lib/depB.cjs'],
|
|
['tests/reexport.test.cjs'],
|
|
reverseIndex,
|
|
);
|
|
|
|
assert.ok(
|
|
selected.includes('tests/reexport.test.cjs'),
|
|
`Expected reexport.test.cjs selected when depB changes, got: ${JSON.stringify(selected)}`,
|
|
);
|
|
});
|
|
|
|
test('adversarial(e): bare and node: specifiers are ignored', () => {
|
|
const source = `
|
|
const a = require('node:fs');
|
|
const b = require('external-package');
|
|
import c from 'node:path';
|
|
import d from 'lodash';
|
|
const e = require('./local.cjs');
|
|
`;
|
|
const out = parseRelativeSpecifiers(source);
|
|
// Only the relative specifier survives
|
|
assert.deepEqual(out, ['./local.cjs']);
|
|
});
|
|
|
|
test('adversarial(f): WIDEN — changing a src file with no test dependents widens to unit/all', (t) => {
|
|
// orphan.cjs is a source file no test file requires (statically)
|
|
const dir = makeFixture({
|
|
'gsd-core/bin/lib/orphan.cjs': `'use strict';\nmodule.exports = {};\n`,
|
|
'tests/unrelated.test.cjs': `'use strict';\n// requires nothing\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/unrelated.test.cjs']);
|
|
|
|
// Verify orphan.cjs has no dependents in the index
|
|
const dependents = reverseIndex.get('gsd-core/bin/lib/orphan.cjs');
|
|
assert.ok(
|
|
!dependents || dependents.size === 0,
|
|
'orphan.cjs must have no transitive test dependents',
|
|
);
|
|
|
|
// The widen backstop is tested via the WIDEN_SIGNAL attached to pickAffectedTests result
|
|
const selected = pickAffectedTests(
|
|
['gsd-core/bin/lib/orphan.cjs'],
|
|
['tests/unrelated.test.cjs'],
|
|
reverseIndex,
|
|
{ detectWiden: true },
|
|
);
|
|
|
|
assert.ok(
|
|
selected._widenRequired === true,
|
|
`Expected _widenRequired=true for orphan src file with no test dependents, got: ${JSON.stringify(selected._widenRequired)}`,
|
|
);
|
|
});
|
|
|
|
test('adversarial(g): dynamic require in changed file with no static dependents — widen backstop catches it', (t) => {
|
|
// dynamic.cjs uses a template literal require — not statically parseable
|
|
// No test requires dynamic.cjs statically
|
|
const dir = makeFixture({
|
|
'gsd-core/bin/lib/dynamic.cjs': `'use strict';\nconst x = 'foo';\nconst m = require(\`./\${x}\`);\nmodule.exports = {};\n`,
|
|
'tests/unrelated.test.cjs': `'use strict';\n// does not require dynamic.cjs\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
const reverseIndex = buildTransitiveReverseIndex(dir, ['tests/unrelated.test.cjs']);
|
|
|
|
const selected = pickAffectedTests(
|
|
['gsd-core/bin/lib/dynamic.cjs'],
|
|
['tests/unrelated.test.cjs'],
|
|
reverseIndex,
|
|
{ detectWiden: true },
|
|
);
|
|
|
|
assert.ok(
|
|
selected._widenRequired === true,
|
|
`Expected _widenRequired=true for dynamic-require src file with no static dependents, got: ${JSON.stringify(selected._widenRequired)}`,
|
|
);
|
|
});
|
|
|
|
test('resolveRelativeDependency resolves .ts, .json extensions', (t) => {
|
|
const dir = makeFixture({
|
|
'src/helper.ts': `export const x = 1;\n`,
|
|
'src/data.json': `{"k":1}`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
const fromAbs = path.join(dir, 'tests/consumer.cjs');
|
|
|
|
const tsResult = resolveRelativeDependency(dir, fromAbs, '../src/helper');
|
|
assert.equal(tsResult, 'src/helper.ts', `Expected src/helper.ts, got: ${tsResult}`);
|
|
|
|
const jsonResult = resolveRelativeDependency(dir, fromAbs, '../src/data.json');
|
|
assert.equal(jsonResult, 'src/data.json', `Expected src/data.json, got: ${jsonResult}`);
|
|
});
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// resolveRunPlan — pure unit tests
|
|
// ---------------------------------------------------------------------------
|
|
|
|
test('resolveRunPlan: noChanges → mode:suite unit', () => {
|
|
// Arrange
|
|
const plan = resolveRunPlan({ changedFiles: [], selected: [], widenRequired: false, criticalPath: false, noChanges: true });
|
|
// Assert
|
|
assert.deepEqual(plan, { mode: 'suite', suite: 'unit' });
|
|
});
|
|
|
|
test('resolveRunPlan: criticalPath → mode:suites PR_FULL_SUITES', () => {
|
|
// Arrange
|
|
const plan = resolveRunPlan({ changedFiles: ['package.json'], selected: [], widenRequired: false, criticalPath: true, noChanges: false });
|
|
// Assert
|
|
assert.deepEqual(plan, { mode: 'suites', suites: PR_FULL_SUITES });
|
|
});
|
|
|
|
test('resolveRunPlan: widenRequired → mode:suites PR_FULL_SUITES (not unit-only)', () => {
|
|
// Arrange: orphan source file, no static dependents → widen signal
|
|
const selected = [];
|
|
selected._widenRequired = true;
|
|
const plan = resolveRunPlan({ changedFiles: ['bin/orphan.cjs'], selected, widenRequired: true, criticalPath: false, noChanges: false });
|
|
// Assert — must be suites covering all three PR suites, NOT unit-only
|
|
assert.equal(plan.mode, 'suites', 'widen must produce mode:suites, not mode:suite');
|
|
assert.deepEqual(plan.suites, PR_FULL_SUITES);
|
|
assert.ok(plan.suites.includes('integration'), 'integration must be in widen plan');
|
|
assert.ok(plan.suites.includes('security'), 'security must be in widen plan');
|
|
assert.ok(plan.suites.includes('unit'), 'unit must be in widen plan');
|
|
});
|
|
|
|
test('resolveRunPlan: empty selection (no widen) → mode:suite unit smoke', () => {
|
|
// Arrange
|
|
const plan = resolveRunPlan({ changedFiles: ['docs/README.md'], selected: [], widenRequired: false, criticalPath: false, noChanges: false });
|
|
// Assert
|
|
assert.deepEqual(plan, { mode: 'suite', suite: 'unit' });
|
|
});
|
|
|
|
test('resolveRunPlan: concrete selection without widen → mode:files', () => {
|
|
// Arrange
|
|
const files = ['tests/foo.test.cjs', 'tests/bar.integration.test.cjs'];
|
|
const plan = resolveRunPlan({ changedFiles: ['bin/foo.cjs'], selected: files, widenRequired: false, criticalPath: false, noChanges: false });
|
|
// Assert
|
|
assert.deepEqual(plan, { mode: 'files', files });
|
|
});
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// Mixed-diff regression: widen must be a SUPERSET, never drop concrete matches
|
|
// ---------------------------------------------------------------------------
|
|
|
|
test('regression(mixed-diff): widen plan covers integration suite; concrete match not dropped', (t) => {
|
|
// Arrange: two changed files in one diff.
|
|
// - bin/lib/server.cjs → has a concrete dependent: tests/server.integration.test.cjs
|
|
// - bin/lib/orphan.cjs → has NO test dependents (triggers widen)
|
|
// Under the OLD (buggy) code, widenRequired caused an early-return to
|
|
// runSuite(root,'unit'), which excludes integration-marked tests, so the
|
|
// concrete integration match was silently dropped.
|
|
// Under the NEW code, widen must resolve to mode:suites with PR_FULL_SUITES,
|
|
// which covers unit + integration + security — a strict superset of selected.
|
|
|
|
const dir = makeFixture({
|
|
'bin/lib/server.cjs': `'use strict';\nmodule.exports = { serve: true };\n`,
|
|
'bin/lib/orphan.cjs': `'use strict';\nmodule.exports = {};\n`,
|
|
'tests/server.integration.test.cjs': `'use strict';\nconst s = require('../bin/lib/server.cjs');\n`,
|
|
'tests/unrelated.test.cjs': `'use strict';\n// requires nothing\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
// Act: build graph over both test files
|
|
const allTests = [
|
|
'tests/server.integration.test.cjs',
|
|
'tests/unrelated.test.cjs',
|
|
];
|
|
const reverseIndex = buildTransitiveReverseIndex(dir, allTests);
|
|
|
|
// Verify the fixture: server.cjs DOES have a concrete dependent
|
|
const serverDependents = reverseIndex.get('bin/lib/server.cjs');
|
|
assert.ok(
|
|
serverDependents && serverDependents.has('tests/server.integration.test.cjs'),
|
|
'fixture: bin/lib/server.cjs must map to tests/server.integration.test.cjs in the reverse index',
|
|
);
|
|
|
|
// Verify the fixture: orphan.cjs has NO dependents
|
|
const orphanDependents = reverseIndex.get('bin/lib/orphan.cjs');
|
|
assert.ok(
|
|
!orphanDependents || orphanDependents.size === 0,
|
|
'fixture: bin/lib/orphan.cjs must have zero test dependents',
|
|
);
|
|
|
|
// pickAffectedTests with detectWiden=true on the mixed diff
|
|
const changedFiles = ['bin/lib/server.cjs', 'bin/lib/orphan.cjs'];
|
|
const selected = pickAffectedTests(changedFiles, allTests, reverseIndex, { detectWiden: true });
|
|
|
|
// The concrete match must still be in selected (widen doesn't strip it)
|
|
assert.ok(
|
|
selected.includes('tests/server.integration.test.cjs'),
|
|
`Concrete integration match must survive pickAffectedTests even when widen fires; selected=${JSON.stringify(selected)}`,
|
|
);
|
|
|
|
// widenRequired must be set because orphan.cjs has no static dependents
|
|
assert.ok(
|
|
selected._widenRequired === true,
|
|
`_widenRequired must be true when any source file has no static dependents; got ${JSON.stringify(selected._widenRequired)}`,
|
|
);
|
|
|
|
// resolveRunPlan must return mode:suites covering integration (not unit-only)
|
|
const plan = resolveRunPlan({
|
|
changedFiles,
|
|
selected,
|
|
widenRequired: selected._widenRequired === true,
|
|
criticalPath: false,
|
|
noChanges: false,
|
|
});
|
|
|
|
assert.equal(
|
|
plan.mode,
|
|
'suites',
|
|
`widen plan must be mode:suites (not mode:suite/mode:files); got mode:${plan.mode} — OLD behaviour would have been mode:suite/unit, dropping the integration test`,
|
|
);
|
|
assert.ok(
|
|
plan.suites.includes('integration'),
|
|
`widen plan must include integration suite to cover the concrete match; suites=${JSON.stringify(plan.suites)}`,
|
|
);
|
|
assert.ok(
|
|
plan.suites.includes('security'),
|
|
`widen plan must include security suite; suites=${JSON.stringify(plan.suites)}`,
|
|
);
|
|
assert.ok(
|
|
plan.suites.includes('unit'),
|
|
`widen plan must include unit suite; suites=${JSON.stringify(plan.suites)}`,
|
|
);
|
|
|
|
// Prove the old behaviour would have FAILED this test:
|
|
// Old code: widenRequired → runSuite(root,'unit') only.
|
|
// 'unit' suite selects only files with NO suite marker (suiteOf === null).
|
|
// tests/server.integration.test.cjs has marker 'integration', so it would be
|
|
// excluded from the unit suite run → the concrete match is silently dropped.
|
|
// The assertion above catches this because old plan would have been
|
|
// { mode: 'suite', suite: 'unit' } which does NOT include 'integration'.
|
|
});
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// Regression: delete-only diffs
|
|
// ---------------------------------------------------------------------------
|
|
|
|
test('regression(delete-only-source): deleting a source file triggers widen, never unit-smoke', (t) => {
|
|
// Arrange: fixture has an unrelated test but does NOT contain gone.cjs.
|
|
// The deletion-only diff (changedFiles includes gone.cjs which is absent on disk)
|
|
// must trigger the widen backstop — gone.cjs has no static dependents because
|
|
// it was never built into the forward graph (it doesn't exist).
|
|
const dir = makeFixture({
|
|
'gsd-core/bin/lib/other.cjs': `'use strict';\nmodule.exports = {};\n`,
|
|
'tests/unrelated.test.cjs': `'use strict';\n// requires nothing from gone.cjs\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
// Act
|
|
const allTests = ['tests/unrelated.test.cjs'];
|
|
const reverseIndex = buildTransitiveReverseIndex(dir, allTests);
|
|
|
|
// gone.cjs does not exist in the fixture — simulates a delete-only PR.
|
|
const changedFiles = ['gsd-core/bin/lib/gone.cjs'];
|
|
|
|
const selected = pickAffectedTests(changedFiles, allTests, reverseIndex, { detectWiden: true });
|
|
|
|
// Assert: widen must be signalled (deleted source file has no static dependents)
|
|
assert.ok(
|
|
selected._widenRequired === true,
|
|
`Expected _widenRequired=true for deleted source file, got: ${JSON.stringify(selected._widenRequired)}`,
|
|
);
|
|
|
|
const plan = resolveRunPlan({
|
|
changedFiles,
|
|
selected,
|
|
widenRequired: selected._widenRequired === true,
|
|
criticalPath: false,
|
|
noChanges: false,
|
|
});
|
|
|
|
// The plan must be mode:suites (widen), NOT mode:suite/unit and NOT empty.
|
|
assert.equal(
|
|
plan.mode,
|
|
'suites',
|
|
`Delete-only source diff must resolve to mode:suites, got mode:${plan.mode} — old ACMR filter would have produced empty changedFiles → mode:suite/unit (smoke only), silently skipping integration/security`,
|
|
);
|
|
assert.deepEqual(
|
|
plan.suites,
|
|
PR_FULL_SUITES,
|
|
`Delete-only widen plan must cover all PR_FULL_SUITES, got: ${JSON.stringify(plan.suites)}`,
|
|
);
|
|
});
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// Regression: rename-stale-old-path
|
|
// ---------------------------------------------------------------------------
|
|
|
|
test('regression(rename-stale-old-path): deleted old path triggers widen, protecting stale importers', (t) => {
|
|
// Arrange: simulate the DELETE side of a rename.
|
|
// oldname.cjs is absent from disk (renamed away); newname.cjs is present with
|
|
// a concrete test dependent. A stale importer still requiring oldname.cjs
|
|
// would break at runtime, but static analysis cannot see it (the stale importer
|
|
// is not in this fixture). The correct safe behaviour is to widen, not to
|
|
// select only newname.cjs's dependents — which would silently skip the stale
|
|
// importer's tests.
|
|
//
|
|
// With --no-renames, git emits Delete(oldname.cjs) + Add(newname.cjs).
|
|
// oldname.cjs is absent on disk → not in the forward graph → zero static
|
|
// dependents → widen backstop fires → mode:suites (PR_FULL_SUITES).
|
|
const dir = makeFixture({
|
|
// newname.cjs exists; oldname.cjs intentionally absent (it was renamed away)
|
|
'gsd-core/bin/lib/newname.cjs': `'use strict';\nmodule.exports = { v: 2 };\n`,
|
|
'tests/newname.test.cjs': `'use strict';\nconst x = require('../gsd-core/bin/lib/newname.cjs');\n`,
|
|
'tests/unrelated.test.cjs': `'use strict';\n// no dependency on oldname or newname\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
// Act
|
|
const allTests = ['tests/newname.test.cjs', 'tests/unrelated.test.cjs'];
|
|
const reverseIndex = buildTransitiveReverseIndex(dir, allTests);
|
|
|
|
// changedFiles mirrors what --no-renames git diff emits for a rename:
|
|
// Delete(old) + Add(new)
|
|
const changedFiles = [
|
|
'gsd-core/bin/lib/oldname.cjs', // deleted old path — absent from disk
|
|
'gsd-core/bin/lib/newname.cjs', // added new path — present on disk
|
|
];
|
|
|
|
// Assert: oldname.cjs must have zero static dependents (not in graph)
|
|
const oldDependents = reverseIndex.get('gsd-core/bin/lib/oldname.cjs');
|
|
assert.ok(
|
|
!oldDependents || oldDependents.size === 0,
|
|
`oldname.cjs must have no static dependents (absent from disk), got: ${JSON.stringify(oldDependents && [...oldDependents])}`,
|
|
);
|
|
|
|
const selected = pickAffectedTests(changedFiles, allTests, reverseIndex, { detectWiden: true });
|
|
|
|
// Widen must be signalled because oldname.cjs has no static dependents
|
|
assert.ok(
|
|
selected._widenRequired === true,
|
|
`Expected _widenRequired=true because deleted old path has no static dependents; got: ${JSON.stringify(selected._widenRequired)}`,
|
|
);
|
|
|
|
const plan = resolveRunPlan({
|
|
changedFiles,
|
|
selected,
|
|
widenRequired: selected._widenRequired === true,
|
|
criticalPath: false,
|
|
noChanges: false,
|
|
});
|
|
|
|
// Plan must be mode:suites — conservative widen covers any stale importer
|
|
assert.equal(
|
|
plan.mode,
|
|
'suites',
|
|
`Rename (old-path delete) must resolve to mode:suites, got mode:${plan.mode}`,
|
|
);
|
|
assert.deepEqual(
|
|
plan.suites,
|
|
PR_FULL_SUITES,
|
|
`Rename widen plan must cover all PR_FULL_SUITES, got: ${JSON.stringify(plan.suites)}`,
|
|
);
|
|
});
|
|
|
|
test('regression(delete-only-test): deleting a test file does not trigger widen and does not select the absent test', (t) => {
|
|
// Arrange: fixture has one surviving test; tests/gone.test.cjs is NOT on disk.
|
|
const dir = makeFixture({
|
|
'tests/surviving.test.cjs': `'use strict';\n// a plain surviving unit test\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
// Act
|
|
// allTests comes from the fixture's tests/ directory — gone.test.cjs is absent.
|
|
const allTests = ['tests/surviving.test.cjs'];
|
|
const reverseIndex = buildTransitiveReverseIndex(dir, allTests);
|
|
|
|
const changedFiles = ['tests/gone.test.cjs'];
|
|
|
|
const selected = pickAffectedTests(changedFiles, allTests, reverseIndex, { detectWiden: true });
|
|
|
|
// Assert: the deleted test file must NOT appear in selected (can't run it).
|
|
assert.ok(
|
|
!selected.includes('tests/gone.test.cjs'),
|
|
`Deleted test file must not appear in selection, got: ${JSON.stringify(selected)}`,
|
|
);
|
|
|
|
// Assert: widen must NOT be triggered (a deleted test is not impactful for selection).
|
|
assert.ok(
|
|
selected._widenRequired !== true,
|
|
`Deleted test file must not trigger widen, got _widenRequired=${JSON.stringify(selected._widenRequired)}`,
|
|
);
|
|
|
|
const plan = resolveRunPlan({
|
|
changedFiles,
|
|
selected,
|
|
widenRequired: selected._widenRequired === true,
|
|
criticalPath: false,
|
|
noChanges: false,
|
|
});
|
|
|
|
// A delete-only test-file diff with no surviving selection → unit smoke (not widen).
|
|
assert.equal(
|
|
plan.mode,
|
|
'suite',
|
|
`Delete-only test-file diff must resolve to mode:suite (smoke), got mode:${plan.mode}`,
|
|
);
|
|
assert.equal(
|
|
plan.suite,
|
|
'unit',
|
|
`Delete-only test-file diff must run unit smoke, got suite:${plan.suite}`,
|
|
);
|
|
});
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// listTestFiles — recurse into subdirectories (finding #2)
|
|
// ---------------------------------------------------------------------------
|
|
|
|
test('listTestFiles: subdir test files are included and selectable by pickAffectedTests', (t) => {
|
|
// Arrange: fixture with a root-level test AND a subdirectory test (mirrors
|
|
// tests/dispatch/, tests/observability/, tests/installer-migrations/).
|
|
const dir = makeFixture({
|
|
'tests/root.test.cjs': `'use strict';\n// root level test\n`,
|
|
'tests/dispatch/agent-dispatch.test.cjs': `'use strict';\nconst lib = require('../../gsd-core/bin/lib/dispatch.cjs');\n`,
|
|
'gsd-core/bin/lib/dispatch.cjs': `'use strict';\nmodule.exports = { dispatch: true };\n`,
|
|
});
|
|
t.after(() => cleanup(dir));
|
|
|
|
// Act: listTestFiles must recurse and return the subdir test with forward slashes
|
|
const files = listTestFiles(dir);
|
|
|
|
assert.ok(
|
|
files.includes('tests/dispatch/agent-dispatch.test.cjs'),
|
|
`Expected tests/dispatch/agent-dispatch.test.cjs in listTestFiles output, got: ${JSON.stringify(files)}`,
|
|
);
|
|
assert.ok(
|
|
files.includes('tests/root.test.cjs'),
|
|
`Expected tests/root.test.cjs in listTestFiles output, got: ${JSON.stringify(files)}`,
|
|
);
|
|
|
|
// The set membership check that allTestsSet.has('tests/dispatch/...') must succeed
|
|
// so that a directly-changed subdir test is not silently dropped.
|
|
const reverseIndex = buildTransitiveReverseIndex(dir, files);
|
|
const selected = pickAffectedTests(
|
|
['tests/dispatch/agent-dispatch.test.cjs'],
|
|
files,
|
|
reverseIndex,
|
|
);
|
|
|
|
assert.ok(
|
|
selected.includes('tests/dispatch/agent-dispatch.test.cjs'),
|
|
`Directly-changed subdir test must be selected; got: ${JSON.stringify(selected)}`,
|
|
);
|
|
});
|