Files
msd-core/tests/bug-3019-help-passthrough.test.cjs
Tom Boucher e3b64b39f8 fix(#3019): query --help reaches handler instead of short-circuiting (#3026)
* fix(#3019): query --help reaches handler instead of short-circuiting to top-level usage

The query argv parser in sdk/src/cli.ts harvested -h/--help as a global
flag and main() short-circuited dispatch when args.help was true. Net
effect: every `gsd-sdk query <anything> --help` printed top-level USAGE
instead of contextual subcommand help. There was no path for users to
discover what arguments a query subcommand accepts — they had to trigger
"required" errors by trial and error.

Two-layer fix:

1. sdk/src/cli.ts (parseCliArgsQueryPermissive)
   - Push -h / --help onto queryArgv instead of consuming them silently,
     so the registered handler / gsd-tools.cjs fallback gets to interpret
     the flag and render contextual help.
   - Only honor the global help flag when there is NO real subcommand to
     dispatch to (i.e. queryArgv contains only help flags). Preserves
     `gsd-sdk query --help` → top-level USAGE while letting
     `gsd-sdk query phase add --help` reach the handler.

2. get-shit-done/bin/gsd-tools.cjs
   - Render top-level usage on --help / -h / -? / --usage instead of
     erroring with "Unknown flag". The discovery hint in the usage text
     points users at the working method (run without args → error names
     required arguments) and references #3019 for tracking subcommand-
     level help printers.
   - --version remains rejected (no discovery use-case).

#1818 anti-hallucination invariant preserved: the destructive command
NEVER executes when --help is present. The new shape returns success:true
+ usage on stdout instead of the old success:false + error on stderr —
both satisfy "destructive command did not run", and the new shape also
restores discoverability.

Tests:
- sdk/src/cli.test.ts: 4 new vitest cases covering #3019 — query argv
  parser keeps --help with subcommand, parses -h short flag, preserves
  bare `query --help` top-level behavior, preserves --help position when
  intermixed with other query flags.
- tests/bug-3019-help-passthrough.test.cjs: 5 node:test cases on the
  fallback — bare gsd-tools (no args) errors with usage; --help renders
  usage on stdout exit 0; -h same; subcommand --help renders usage; usage
  hint mentions discovery method (without prose substring matching —
  parses into typed sections).
- tests/bug-1818-unknown-flags.test.cjs: rewritten to assert the new
  invariant ("destructive command did not run" + "usage was rendered")
  instead of the old shape ("--help is rejected with non-zero exit").
  Each destructive test seeds a sentinel artifact (phase dir, slug
  output) and asserts it survives.

Verification:
- 47/47 vitest pass on sdk/src/cli.test.ts
- 5/5 pass on tests/bug-3019-help-passthrough.test.cjs
- 8/8 pass on tests/bug-1818-unknown-flags.test.cjs (rewritten)
- 6763/6763 pass on full node:test suite
- lint-no-source-grep clean (0 violations)

Closes #3019

* fix(#3019): SDK fallback forwards plain-text help, broader usage list (CR)

CodeRabbit on PR #3026 (4 findings — 1 Major outside-diff, 2 inline,
1 nitpick):

1. **Major outside-diff** — sdk/src/cli.ts:442-454. The fallback path
   that delegates to gsd-tools.cjs called parseCliQueryJsonOutput
   (JSON.parse) on stdout. Now that gsd-tools renders plain-text usage
   on --help, JSON.parse threw "Unexpected token 'U'". Wrapped the
   parse in try/catch — on parse failure, forward the plain stdout
   verbatim so subcommand help reaches the user. Regression test:
   tests/bug-3019-help-passthrough.test.cjs spawns the built SDK and
   asserts `gsd-sdk query phase --help` exits 0, stdout contains the
   gsd-tools usage, and stderr does NOT contain a JSON-parse error.

2. .changeset/help-passthrough.md:3 — `pr: TBD` → `pr: 3026`.

3. gsd-tools.cjs:346 (TOP_LEVEL_USAGE):
   - Removed self-referencing `#3019` link (immediately stale after
     this PR merges).
   - Expanded Commands list from 17 → all 47 dispatcher cases:
     agent-skills, audit-open, audit-uat, check-commit, commit, …
     phase, phases, roadmap, milestone, validate, progress, intel,
     graphify, learnings, etc. — the bulk of the surface that was
     previously unreachable via --help discovery.

4. Nitpick: `isUsageOutput` was duplicated in bug-1818 and
   bug-3019-help-passthrough tests. Moved to tests/helpers.cjs with
   structural-comment, removed both duplicates.

Verification: 47/47 vitest pass, 14/14 regression tests pass,
6764/6764 full suite, lint clean.

* test(#3019): use t.skip() instead of bare return when SDK not built (CR)

CodeRabbit follow-up on PR #3026:

The integration test guarded against missing sdk/dist/cli.js with a
bare `return;` — node:test counts that as a passing test (0 assertions
exercised, 0 failures). On a CI checkout that hasn't run the SDK build,
the #3026 regression test silently green-lit and no signal ever
surfaced that the integration check was skipped.

Switched to `t.skip(...)` via the test context parameter so the
omission shows up in the test report. The unit-level fix
(sdk/src/cli.ts) is still covered by vitest, so the skip only affects
the end-to-end spawn-built-SDK check.

Verification: 6/6 pass when SDK is built; 5 pass + 1 skip when not.
2026-05-02 11:45:33 -04:00

121 lines
5.8 KiB
JavaScript

/**
* Regression test for bug #3019.
*
* `gsd-sdk query <subcommand> --help` returned the top-level SDK USAGE
* instead of contextual help for the subcommand. The query argv parser
* harvested --help as a global flag and main() short-circuited dispatch
* before the registry handler / gsd-tools.cjs fallback could render
* useful help.
*
* Two-layer fix:
* 1. sdk/src/cli.ts — leave --help in queryArgv so it travels to the
* handler/fallback. Only honor the global help flag when there is
* no subcommand to dispatch to.
* 2. get-shit-done/bin/gsd-tools.cjs — render the top-level usage on
* --help instead of erroring. Anti-hallucination invariant from
* #1818 is preserved (the destructive command never executes).
*
* Tests the integration: invoke gsd-tools.cjs the same way the SDK
* dispatcher does and assert structured-IR (success flag + usage shape)
* rather than raw substring matches.
*/
'use strict';
const { describe, test } = require('node:test');
const assert = require('node:assert/strict');
const { runGsdTools, isUsageOutput } = require('./helpers.cjs');
// #3026 CR (Major outside-diff): the SDK fallback wraps gsd-tools.cjs.
// When gsd-tools emits plain-text help (exit 0), the SDK previously
// JSON.parsed stdout and threw "Unexpected token 'U'". Verify the fix
// by invoking the built SDK end-to-end and asserting:
// - exit 0
// - stdout contains the gsd-tools usage
// - stderr does NOT contain a JSON parse error
const path = require('node:path');
const { spawnSync } = require('node:child_process');
const SDK_CLI = path.join(__dirname, '..', 'sdk', 'dist', 'cli.js');
const fs = require('node:fs');
describe('bug #3026 (CR Major outside-diff): SDK forwards plain-text help from gsd-tools fallback', () => {
test('gsd-sdk query phase --help (fallback path) returns usage, not a JSON parse error', (t) => {
if (!fs.existsSync(SDK_CLI)) {
// CR feedback (#3026): a bare `return` here silent-passes the test
// when sdk/dist/cli.js is absent (CI checkouts that haven't run
// `npm run build`), giving no signal that the integration check
// was skipped. Use t.skip() so the omission is visible in the
// test report. The unit-level fix is covered by vitest on
// sdk/src/cli.ts; this integration test only runs when the
// built SDK is on disk.
t.skip('sdk/dist/cli.js not built — run `npm run build` in sdk/ to enable this integration test');
return;
}
// `query phase --help` (no further subcommand) is NOT in the native
// registry, so it routes through the gsd-tools.cjs fallback. That is
// the path that JSON.parsed the help text and threw before this fix.
const result = spawnSync(process.execPath, [SDK_CLI, 'query', 'phase', '--help'], {
encoding: 'utf8',
stdio: ['ignore', 'pipe', 'pipe'],
timeout: 10000,
});
// The fallback gsd-tools.cjs emits exit 0 with usage on stdout.
assert.strictEqual(result.status, 0,
`must exit 0 — got ${result.status}\nstdout: ${result.stdout}\nstderr: ${result.stderr}`);
// Negative: must NOT see the JSON parse error that was the regression.
assert.ok(!/Unexpected token|not valid JSON/i.test(result.stderr),
`must NOT JSON.parse the help text (stderr): ${result.stderr}`);
// Positive: the usage should reach the user via stdout.
assert.ok(/Usage:\s*gsd-tools/.test(result.stdout) && /Commands:/.test(result.stdout),
`usage must reach stdout: ${result.stdout}`);
});
});
describe('bug #3019: gsd-tools renders usage on --help instead of erroring', () => {
test('bare gsd-tools (no args) renders usage', () => {
const result = runGsdTools([]);
// No args path: error() helper emits to stderr and exits non-zero,
// but the message body is the usage.
assert.strictEqual(result.success, false);
assert.ok(/Usage:\s*gsd-tools/.test(result.error));
assert.ok(/Commands:/.test(result.error));
});
test('gsd-tools --help renders usage on stdout, exits 0', () => {
const result = runGsdTools(['--help']);
assert.strictEqual(result.success, true, '--help should not be an error');
assert.ok(isUsageOutput(result.output), `expected usage on stdout, got: ${result.output}`);
});
test('gsd-tools -h renders usage on stdout, exits 0', () => {
const result = runGsdTools(['-h']);
assert.strictEqual(result.success, true);
assert.ok(isUsageOutput(result.output));
});
test('gsd-tools <subcommand> --help renders usage (does not run subcommand)', () => {
// The classic #3019 surface: the user types a subcommand expecting
// contextual help. We render the top-level usage — strictly better
// than the previous unhelpful "Unknown flag --help" error.
const result = runGsdTools(['phase', 'add', '--help']);
assert.strictEqual(result.success, true);
assert.ok(isUsageOutput(result.output));
});
test('usage hint mentions how to discover argument requirements', () => {
// The usage now points users at the discovery method that actually works
// (run without args → error message names required arguments). Asserting
// on the parsed shape of the usage rather than substring-matching prose:
const result = runGsdTools(['--help']);
assert.strictEqual(result.success, true);
// Structural check: split into sections.
const lines = result.output.split('\n');
const hasUsageLine = lines.some((l) => l.startsWith('Usage:'));
const hasCommandsLine = lines.some((l) => l.startsWith('Commands:'));
const hasDiscoveryHint = lines.some((l) => /argument requirements|without args|invoke the command/i.test(l));
assert.ok(hasUsageLine, 'first section: Usage');
assert.ok(hasCommandsLine, 'second section: Commands');
assert.ok(hasDiscoveryHint, 'third section: how to discover per-command args');
});
});