fix: recover silently-excluded test dirs + test-architecture audit hardening (#1195)
* fix: recurse test discovery so subdir test suites actually run
scripts/run-tests.cjs discovered tests with a flat readdirSync(testDir),
silently excluding tests/observability/ (4 files), tests/dispatch/ (1) and
tests/installer-migrations/ (1) — 94 passing tests — from `npm test` and all
CI lanes. Walk the tree recursively (relative subpaths preserved), classify
suites by basename, and add a fail-on-zero-executed guard for suite/default
runs (escape hatch GSD_ALLOW_EMPTY_SUITE=1) while preserving the empty
--files/--files-from path the CI inert lane relies on.
Unit suite 735 -> 741 files; surfaces ADR-227's observability/dispatch seam.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: retire 5 verified-worthless tests
Adversarial verification confirmed these 5 prove nothing — their coverage is
provided more strictly elsewhere:
- enh-2790 'has a name: field' spot-checks (command-contract enforces /^gsd[:-]/)
- command-routing-hub duplicate construct + duplicate ERROR_KINDS assertions
- no-cjs-sdk-handsync-tooling (guarded files that never existed on main; bug-190
covers the real retired SDK artifacts)
- runtime-artifact-layout cline edge case (subsumed by the explicit-global test
and bug-782-cline-skills-emission)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: add ADR-218 release version-validation coverage
ADR-218 (reject leading-zero versions like 1.01.0; npm duplicate pre-check) had
zero tests — the logic lived only in release.yml bash. Add a test that extracts
the actual rejection regexes from the workflow and exercises them against a
boundary table (leading-zero/malformed rejected, valid accepted) plus structural
wiring assertions. Goes red if the regex is reverted to [0-9]+.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: redesign weak tests into behavioral, deterministic assertions
Per the ADR test audit, rewrite 27 weak test files (test-only, no source
changes) so each can go red for the defect it guards:
- kill pass-always assert.ok(true) placeholders (research-cli, worktree-baseref,
bug-260 security guard, eslint-rules x24, clusters '|| true')
- replace source-text grep with behavioral calls (install Kilo, sh-hook-paths,
plan-review-convergence) and add a repo-layout governance test
- de-flake real-clock/Math.random coupling (phase last_updated, bug-3707 mtime,
context-utilization property, feat-3594)
- fix independence/shared-state violations (bug-492 singleton, issue-844 tmpRoot,
core reapStaleTempFiles, active-workstream TTY, feat-488 GSD_HOME)
- strengthen property/shape-only tests (research-provider/store classification +
collision) and unconditional plugin.json schema validation (issue-766)
Verified: all 28 files run together 1220 pass / 0 fail / 1 skip.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* chore: add no-tautological-assert lint rule, error in test suite
New custom ESLint rule (eslint-rules/no-tautological-assert.cjs) bans asserts
that can never fail: assert(true)/assert.ok(<always-truthy literal>),
'cond || true' inside an assert, and equality asserts comparing two identical
literals. Wired as error on tests/**; full sweep confirmed zero existing
violations so the suite stays green. Prevents the placeholder-assert regressions
the audit redesigns just removed. RuleTester coverage added (6 valid, 8 invalid).
Note: no-only-tests was already enforced via eslint-plugin-no-only-tests, so no
duplicate rule was added.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* chore: gate new allow-test-rule exemptions to require an issue ref
ADR-456 requires any allow-test-rule exemption added after the ADR to carry a
tracking issue number, but nothing enforced it. New ratchet gate
(scripts/lint-allow-test-rule-refs.cjs, wired into lint:ci) fails when a NEW
allow-test-rule comment lacks a #NNN/URL reference; the 323 existing untracked
exemptions are grandfathered in an allowlist that ratchets down as they gain
refs. Red-green verified (novel untracked offender fails; compliant passes).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* docs: add ADR test-audit evidence report (#1192)
Full risk-first qa-test-architect audit of the ADR portfolio (37 ADRs + 4
platform lenses, adversarial verification of retire verdicts) that drove the
P0 discovery fix, ADR-218 coverage, 5 retires, 27 redesigns, and the two new
lint gates. Filed as point-in-time evidence under docs/issueevidence/, named
for tracking issue #1192.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: replace pre-existing raw NUL byte with escape in feat-3594 fixture
feat-3594's null-byte parser fixture contained a literal NUL byte (pre-existing
on next at b10e5681 — confirmed: base blob has 1 NUL, this fix has 0), which
made git treat the file as binary and would break grep/editors. Switch to the
\x00 escape; the runtime string value (a real NUL in the parser input) is
unchanged.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: address adversarial-review findings
Codex adversarial pass over the branch:
- capability-registry drift test no longer mutates the committed generated
capability-registry.cjs in place (concurrency hazard) — uses in-memory
checkPipeline comparison instead.
- allow-test-rule ratchet now detects exemptions in ALL comment forms (block
/* */ too, matching no-source-grep) so a block comment can't bypass it;
one newly-surfaced pre-existing offender grandfathered (323->324).
- install.test Kilo case asserts on what install(false,'kilo') actually writes
rather than manually calling configureKiloPermissions (masked the call site).
- issue-766 drops the undeclared transitive ajv dep for explicit structural
assertions from the schema fixture.
- adr-218 test notes the hotfix leading-zero gap is tracked in #1186.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix: address code-review findings (subdir discovery, rule + test gaps)
xhigh code review surfaced 15 confirmed issues, all fixed:
- run-tests.cjs --files now resolves subdir tests by bare basename + handles
Windows backslash paths (ambiguous basenames error clearly).
- affected-tests-lib.cjs listTestFiles made recursive — the targeted CI lane was
silently dropping changed subdir tests (same false-green class the audit fixed).
- no-tautological-assert now catches 'true || cond' and empty []/{} equality.
- verify-test-quality: restore provenance-classification coverage, tighten the
writeFile circular-detection check, guard the module-level file read.
- sh-hook-paths: cover the global-install .sh delegation branch (#2045 guard).
- active-workstream null-guard runs deterministically (no longer skipped on TTY).
- adr-218 structural guards tightened (major/minor leading-zero; needs: membership).
- repo-layout AGENTS.md guard no longer false-alarms on equivalent refactors.
- cross-ai ordering guard fails red when the step is missing.
- issue-766 parses required fields from the schema fixture (auto-enforced).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test: stub USERPROFILE alongside HOME in feat-488 (Windows parity)
The feat-488 redesign stubbed process.env.HOME but not USERPROFILE; os.homedir()
resolves from USERPROFILE on Windows, so the home stub was not hermetic there —
caught by windows-test-parity-guard (stubsHomeNoUserProfile). Save/set/restore
USERPROFILE symmetrically with HOME (delete-if-originally-undefined).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* chore: reconcile allow-test-rule allowlist after rebase onto next
Rebasing onto current next pulled in merged PR #1170, which added
inventory-headings-countfree.test.cjs (a baseline allow-test-rule exemption) and
deleted inventory-counts.test.cjs. Grandfather the former and prune the latter so
the ratchet matches the merged tree. No new debt from this PR.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
@@ -19,6 +19,34 @@ const {
|
||||
reapOrphanWorktrees,
|
||||
} = require('../gsd-core/bin/lib/worktree-safety.cjs');
|
||||
|
||||
// ─── Fixed timestamps for deterministic stale-lock boundary ──────────────────
|
||||
//
|
||||
// ADR-456 clock-seam mandate: tests must not read the live clock to compute
|
||||
// fixture mtimes. The SUT compares `Date.now() - lockMtime.getTime()` against
|
||||
// REAP_MTIME_GUARD_MS (5 minutes). Because `reapOrphanWorktrees` accepts a
|
||||
// `deps.mtimeSafe` injection, we can supply fixed Date objects that sit
|
||||
// unconditionally on the "stale" or "fresh" side of the boundary regardless of
|
||||
// when the test runs, without touching the real filesystem mtime at all.
|
||||
//
|
||||
// STALE_MTIME → Unix epoch (1970-01-01T00:00:00Z). At any point in time
|
||||
// after that epoch `Date.now() - 0` is orders of magnitude
|
||||
// larger than any staleness threshold.
|
||||
//
|
||||
// FRESH_MTIME → Far-future sentinel (year 9999 + large offset).
|
||||
// `Date.now() - FRESH_MTIME.getTime()` is always negative,
|
||||
// which is always < REAP_MTIME_GUARD_MS.
|
||||
//
|
||||
// Tests that need stale behaviour pass `{ mtimeSafe: () => STALE_MTIME }` in
|
||||
// deps. Tests that need fresh behaviour pass `{ mtimeSafe: () => FRESH_MTIME }`.
|
||||
// No `fs.utimesSync` calls are needed and no live `Date.now()` reads appear in
|
||||
// fixture setup.
|
||||
|
||||
/** Always older than any staleness threshold. */
|
||||
const STALE_MTIME = new Date(0); // 1970-01-01T00:00:00.000Z
|
||||
|
||||
/** Always newer than the current time, so always treated as "fresh". */
|
||||
const FRESH_MTIME = new Date(8640000000000000); // max safe JS Date (year ~275760)
|
||||
|
||||
// ─── PID helpers ──────────────────────────────────────────────────────────────
|
||||
|
||||
/**
|
||||
@@ -242,9 +270,10 @@ describe('bug-3707: reapOrphanWorktrees', () => {
|
||||
const lockedFile = path.join(metaDir, 'locked');
|
||||
fs.writeFileSync(lockedFile, String(deadPid()));
|
||||
|
||||
// Back-date mtime so the stale-lock guard passes (> 5 minutes old)
|
||||
const staleTime = new Date(Date.now() - 10 * 60 * 1000);
|
||||
fs.utimesSync(lockedFile, staleTime, staleTime);
|
||||
// Inject a fixed stale mtime (STALE_MTIME = Unix epoch) so the staleness
|
||||
// check is deterministic and does not depend on the real clock or utimesSync.
|
||||
// STALE_MTIME is always older than REAP_MTIME_GUARD_MS (5 min) regardless
|
||||
// of when this test runs. No fs.utimesSync call is needed.
|
||||
|
||||
// Pre-compute canonical path BEFORE reaping — the directory will be gone
|
||||
// afterward, so fs.realpathSync.native will fail and canonicalPath falls
|
||||
@@ -254,7 +283,7 @@ describe('bug-3707: reapOrphanWorktrees', () => {
|
||||
// canonical before removal ensures we compare the resolved forms.
|
||||
const wtDirCanonical = canonicalPath(wtDir);
|
||||
|
||||
const result = reapOrphanWorktrees(repoDir);
|
||||
const result = reapOrphanWorktrees(repoDir, { mtimeSafe: () => STALE_MTIME });
|
||||
|
||||
assert.ok(Array.isArray(result), 'reapOrphanWorktrees should return an array');
|
||||
const reaped = result.find((r) => canonicalPath(r.path) === wtDirCanonical);
|
||||
@@ -279,10 +308,10 @@ describe('bug-3707: reapOrphanWorktrees', () => {
|
||||
const metaDir = worktreeMeta(repoDir, wtDir);
|
||||
const lockedFile = path.join(metaDir, 'locked');
|
||||
fs.writeFileSync(lockedFile, String(process.pid));
|
||||
const staleTime = new Date(Date.now() - 10 * 60 * 1000);
|
||||
fs.utimesSync(lockedFile, staleTime, staleTime);
|
||||
|
||||
const result = reapOrphanWorktrees(repoDir);
|
||||
// Inject STALE_MTIME so the staleness guard passes deterministically,
|
||||
// ensuring the live-PID check is the only reason the entry is skipped.
|
||||
const result = reapOrphanWorktrees(repoDir, { mtimeSafe: () => STALE_MTIME });
|
||||
|
||||
const skipped = result.find((r) => canonicalPath(r.path) === canonicalPath(wtDir));
|
||||
if (skipped) {
|
||||
@@ -305,10 +334,10 @@ describe('bug-3707: reapOrphanWorktrees', () => {
|
||||
const metaDir = worktreeMeta(repoDir, wtDir);
|
||||
const lockedFile = path.join(metaDir, 'locked');
|
||||
fs.writeFileSync(lockedFile, String(deadPid()));
|
||||
const staleTime = new Date(Date.now() - 10 * 60 * 1000);
|
||||
fs.utimesSync(lockedFile, staleTime, staleTime);
|
||||
|
||||
const result = reapOrphanWorktrees(repoDir);
|
||||
// Inject STALE_MTIME so the staleness guard passes deterministically,
|
||||
// ensuring the unmerged-branch check is the only reason the entry is skipped.
|
||||
const result = reapOrphanWorktrees(repoDir, { mtimeSafe: () => STALE_MTIME });
|
||||
|
||||
const entry = result.find((r) => canonicalPath(r.path) === canonicalPath(wtDir));
|
||||
if (entry) {
|
||||
@@ -331,9 +360,13 @@ describe('bug-3707: reapOrphanWorktrees', () => {
|
||||
const metaDir = worktreeMeta(repoDir, wtDir);
|
||||
const lockedFile = path.join(metaDir, 'locked');
|
||||
fs.writeFileSync(lockedFile, String(deadPid()));
|
||||
// Fresh mtime: within the race-guard window (< 5 minutes old); no utimes needed
|
||||
|
||||
const result = reapOrphanWorktrees(repoDir);
|
||||
// Inject FRESH_MTIME (far future) so the staleness boundary is crossed
|
||||
// deterministically: Date.now() - FRESH_MTIME.getTime() is always negative,
|
||||
// which is always less than REAP_MTIME_GUARD_MS. No utimesSync needed.
|
||||
// Previously, this test relied on the file being just-created (real clock
|
||||
// within 5 minutes) which is fragile on heavily-loaded CI hosts.
|
||||
const result = reapOrphanWorktrees(repoDir, { mtimeSafe: () => FRESH_MTIME });
|
||||
|
||||
const entry = result.find((r) => canonicalPath(r.path) === canonicalPath(wtDir));
|
||||
if (entry) {
|
||||
@@ -356,15 +389,16 @@ describe('bug-3707: reapOrphanWorktrees', () => {
|
||||
const metaDir = worktreeMeta(repoDir, wtDir);
|
||||
const lockedFile = path.join(metaDir, 'locked');
|
||||
fs.writeFileSync(lockedFile, String(deadPid()));
|
||||
const staleTime = new Date(Date.now() - 10 * 60 * 1000);
|
||||
fs.utimesSync(lockedFile, staleTime, staleTime);
|
||||
|
||||
const result1 = reapOrphanWorktrees(repoDir);
|
||||
// Inject STALE_MTIME so the staleness guard is deterministically satisfied.
|
||||
const staleDeps = { mtimeSafe: () => STALE_MTIME };
|
||||
|
||||
const result1 = reapOrphanWorktrees(repoDir, staleDeps);
|
||||
const reaped1 = result1.filter((r) => r.status === 'reaped');
|
||||
assert.equal(reaped1.length, 1, 'first invocation should reap exactly one entry');
|
||||
|
||||
// Second invocation: nothing left to reap
|
||||
const result2 = reapOrphanWorktrees(repoDir);
|
||||
const result2 = reapOrphanWorktrees(repoDir, staleDeps);
|
||||
const reaped2 = result2.filter((r) => r.status === 'reaped');
|
||||
assert.equal(reaped2.length, 0, 'second invocation should reap nothing (idempotent)');
|
||||
});
|
||||
@@ -446,11 +480,9 @@ describe('bug-3707: reapOrphanWorktrees — adversarial edge cases', () => {
|
||||
// Write the real Claude Code lock format (non-numeric)
|
||||
fs.writeFileSync(lockedFile, 'Locked by claude-code agent-a1b2c3d4e5f6');
|
||||
|
||||
// Back-date mtime so the stale-lock guard passes
|
||||
const staleTime = new Date(Date.now() - 10 * 60 * 1000);
|
||||
fs.utimesSync(lockedFile, staleTime, staleTime);
|
||||
|
||||
const result = reapOrphanWorktrees(repoDir);
|
||||
// Inject STALE_MTIME so the staleness guard passes deterministically,
|
||||
// ensuring the non-numeric content check is the only reason the entry is skipped.
|
||||
const result = reapOrphanWorktrees(repoDir, { mtimeSafe: () => STALE_MTIME });
|
||||
|
||||
const entry = result.find((r) => canonicalPath(r.path) === canonicalPath(wtDir));
|
||||
if (entry) {
|
||||
@@ -481,17 +513,19 @@ describe('bug-3707: reapOrphanWorktrees — adversarial edge cases', () => {
|
||||
const metaDir = worktreeMeta(repoDir, wtDir);
|
||||
const lockedFile = path.join(metaDir, 'locked');
|
||||
fs.writeFileSync(lockedFile, String(deadPid()));
|
||||
const staleTime = new Date(Date.now() - 10 * 60 * 1000);
|
||||
fs.utimesSync(lockedFile, staleTime, staleTime);
|
||||
|
||||
// Inject an isPidAlive that always throws EPERM — simulates Windows cross-user scenario
|
||||
// Inject an isPidAlive that always throws EPERM — simulates Windows cross-user scenario.
|
||||
// Also inject STALE_MTIME so the staleness guard is deterministically satisfied.
|
||||
const epermIsPidAlive = (_pid) => {
|
||||
const err = new Error('EPERM: operation not permitted');
|
||||
err.code = 'EPERM';
|
||||
throw err;
|
||||
};
|
||||
|
||||
const result = reapOrphanWorktrees(repoDir, { isPidAlive: epermIsPidAlive });
|
||||
const result = reapOrphanWorktrees(repoDir, {
|
||||
isPidAlive: epermIsPidAlive,
|
||||
mtimeSafe: () => STALE_MTIME,
|
||||
});
|
||||
|
||||
const entry = result.find((r) => canonicalPath(r.path) === canonicalPath(wtDir));
|
||||
if (entry) {
|
||||
@@ -532,17 +566,16 @@ describe('bug-3707: reapOrphanWorktrees — adversarial edge cases', () => {
|
||||
const metaDir = worktreeMeta(repoDir, wtDir);
|
||||
const lockedFile = path.join(metaDir, 'locked');
|
||||
fs.writeFileSync(lockedFile, String(deadPid()));
|
||||
const staleTime = new Date(Date.now() - 10 * 60 * 1000);
|
||||
fs.utimesSync(lockedFile, staleTime, staleTime);
|
||||
|
||||
// Pre-compute canonical before reaping (symlink resolution may fail post-removal)
|
||||
// Inject STALE_MTIME so the staleness guard is deterministically satisfied.
|
||||
// Pre-compute canonical before reaping (symlink resolution may fail post-removal).
|
||||
const wtDirCanonical = canonicalPath(wtDir);
|
||||
|
||||
const result = reapOrphanWorktrees(repoDir);
|
||||
const result = reapOrphanWorktrees(repoDir, { mtimeSafe: () => STALE_MTIME });
|
||||
|
||||
// The reaper must either reap the worktree (using trunk as the default branch)
|
||||
// OR skip it for a safe reason — it must NOT return an empty result (which
|
||||
// would mean it bailed out entirely, silently skipping orphan detection).
|
||||
// would mean it bailed out entirely, silently skipping all orphan detection).
|
||||
assert.ok(Array.isArray(result), 'reapOrphanWorktrees must return an array');
|
||||
assert.ok(result.length > 0, 'reaper must not bail out entirely for trunk-default repos — must inspect the worktree');
|
||||
const entry = result.find((r) => canonicalPath(r.path) === wtDirCanonical);
|
||||
|
||||
Reference in New Issue
Block a user