Files
msd-core/scripts/changeset/lint.cjs
Tom Boucher b2961c3f69 fix(#2070): accept adaptive model_profile in validate health; warn on invalid models tiers (W022) (#2336)
* test(#2070): fail-first tests for adaptive model_profile and models tier validation

Encodes the three acceptance criteria from #2070 plus the boundary cases the
resolver silently ignores today (non-string values, empty string, mistyped
phase-type key), and pins VALID_TIERS to a catalog-derived set.

Red phase: these fail against current src/ by design.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA

* fix(#2070): accept adaptive model_profile in validate health; warn on invalid models tiers (W022)

W004 sourced its profile list from a hand-maintained literal that predated the
adaptive profile, so `"model_profile": "adaptive"` was false-flagged. It now
reads VALID_PROFILES, which model-catalog.cts derives from model-catalog.json.

models.<phase_type> was validated nowhere: the resolver's tier gate silently
drops unknown values, so a typo like `"planning": "opuss"` was an undiagnosable
no-op. A new W022 flags unknown phase-type keys and invalid tier values
(including non-string values, which the same gate also drops).

VALID_TIERS moves from a function-local literal in model-resolver.cts to a
catalog-derived export, so health and the resolver cannot disagree by
construction rather than by parity test. Object.values(adaptiveTierMap) is
['opus','sonnet','haiku'] plus 'inherit' — identical to the previous literal,
so resolution behavior is unchanged.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA

* docs(#2070): changeset for validate health adaptive profile + W022

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA

* fix(#2070): close review findings — malformed models, tier-list duplication, changeset gate

Review of the initial fix surfaced three real defects, folded in per the
no-defer rule:

1. verify.cts: the W022 guard skipped a top-level `models` that is present but
   not a plain object (`[]`, `"opus"`, `5`, `true`). The resolver ignores those
   identically, so they were the same undiagnosable no-op #2070 targets — just
   one level up. They now warn; absent/null/{} stay silent.

2. config-loader.cts: RUNTIME_OVERRIDE_TIERS was a second hardcoded copy of the
   tier vocabulary this change had just de-hardcoded elsewhere. It now derives
   from the catalog via ADAPTIVE_TIER_VALUES (no 'inherit' — runtime overrides
   resolve to a concrete tier). Byte-equivalent to the old literal.

3. scripts/changeset/lint.cjs: USER_FACING_PREFIXES omitted `src/`. Post-ADR-457
   the product source is src/*.cts compiled to a gitignored gsd-core/bin/lib,
   so the `gsd-core/` prefix is dead coverage for library code and a src/-only
   PR could merge with no release note — including this one. Adding `src/`
   closes the gate; tests/ stays non-user-facing.

Also corrects a false docstring in the VALID_TIERS test: value-equality cannot
detect a re-hardcoded literal, so the test no longer claims it does.

Two review findings were rejected with evidence rather than actioned:
- W021 double-allocation is governed by ADR-612 ("W021 renumber -> void ...
  kept, message-disambiguated"), not a defect.
- Global-defaults validation would be a false-positive generator: config-loader
  reads ~/.gsd/defaults.json only on the "no .planning/" branch, and health
  early-returns E001 without .planning/, so those values provably never affect
  resolution in any context health can run.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA

* test(#2070): regenerate install goldens for the changeset-lint change

scripts/ ships as an installed artifact, so scripts/changeset/lint.cjs's content
hash is pinned in all 18 runtime golden fixtures. Adding 'src/' to
USER_FACING_PREFIXES changed that hash and tripped every golden parity check.
Regenerated via `npm run gen:golden`; the only delta is the lint.cjs hash.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA

* docs(#2070): backfill PR number 2336 into changeset

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA

---------

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-17 06:48:04 -04:00

149 lines
5.6 KiB
JavaScript
Executable File

#!/usr/bin/env node
'use strict';
/**
* Changeset-fragment lint (#2975).
*
* Pure verdict function evaluateLint({ changedFiles, labels }) returns
* { ok, reason } using the LINT_REASON enum. The CLI wrapper calls it with
* the PR diff (via `git diff --name-only origin/main...HEAD` or the GitHub
* Actions event payload) and the labels list (via the GitHub event).
*
* Tests assert on the typed verdict, never on free text.
*/
const LINT_REASON = Object.freeze({
OK_FRAGMENT_PRESENT: 'ok_fragment_present',
OK_OPT_OUT_LABEL: 'ok_opt_out_label',
OK_NO_USER_FACING_CHANGES: 'ok_no_user_facing_changes',
FAIL_MISSING_FRAGMENT: 'fail_missing_fragment',
FAIL_INVALID_FRAGMENT: 'fail_invalid_fragment',
});
const OPT_OUT_LABEL = 'no-changelog';
// Files counted as "user-facing" — touching any of these requires either a
// fragment or an explicit opt-out label. Test/CI/docs/lock files do not.
const USER_FACING_PREFIXES = [
'bin/',
'gsd-core/',
'src/',
'agents/',
'commands/',
'hooks/',
'sdk/src/',
'sdk/prompts/',
];
// Exact-match user-facing files. Any direct edit to one of these without a
// fragment also fails the lint — closes the bypass where a contributor edits
// CHANGELOG.md directly to sneak past the new workflow.
const USER_FACING_FILES = new Set(['CHANGELOG.md']);
function isUserFacing(file) {
if (USER_FACING_FILES.has(file)) return true;
return USER_FACING_PREFIXES.some((p) => file.startsWith(p));
}
function isFragment(file) {
return /^\.changeset\/[^/]+\.md$/.test(file) && !file.endsWith('/README.md');
}
function evaluateLint({ changedFiles, labels, fragmentFailures = [] }) {
if (fragmentFailures.length > 0) {
return { ok: false, reason: LINT_REASON.FAIL_INVALID_FRAGMENT, failures: fragmentFailures };
}
if (changedFiles.some(isFragment)) {
return { ok: true, reason: LINT_REASON.OK_FRAGMENT_PRESENT };
}
if (labels.includes(OPT_OUT_LABEL)) {
return { ok: true, reason: LINT_REASON.OK_OPT_OUT_LABEL };
}
if (!changedFiles.some(isUserFacing)) {
return { ok: true, reason: LINT_REASON.OK_NO_USER_FACING_CHANGES };
}
return { ok: false, reason: LINT_REASON.FAIL_MISSING_FRAGMENT };
}
const { ExitError, runMain } = require('../lib/cli-exit.cjs');
const { parseFragment } = require('./parse.cjs');
function main() {
const fs = require('node:fs');
const cp = require('node:child_process');
// GitHub Actions event payload path
const eventPath = process.env.GITHUB_EVENT_PATH;
let labels = [];
if (eventPath && fs.existsSync(eventPath)) {
try {
const event = JSON.parse(fs.readFileSync(eventPath, 'utf8'));
labels = (event.pull_request?.labels || []).map((l) => l.name);
} catch { /* fall through */ }
}
const base = process.env.GITHUB_BASE_REF || 'main';
let changedFiles = [];
try {
// Use execFileSync with an argv array — the base ref is interpolated
// into a refspec argument, but execFileSync does not invoke a shell, so
// even a malicious GITHUB_BASE_REF cannot inject shell syntax. The
// refspec-bound metacharacters that git itself rejects (e.g. spaces in
// ref names) are caught by git's own arg parser.
const out = cp.execFileSync(
'git',
['diff', '--name-only', `origin/${base}...HEAD`],
{ encoding: 'utf8' },
);
changedFiles = out.split('\n').filter(Boolean);
} catch (e) {
throw new ExitError(2, `could not compute diff: ${e.message}`);
}
// Validate the content of every changed fragment file.
const fragmentFailures = [];
for (const file of changedFiles) {
if (!isFragment(file)) continue;
// A fragment path in the diff that no longer exists on disk was deleted in
// this PR — a deletion can't be malformed, so skip it.
if (!fs.existsSync(file)) continue;
let src;
try {
src = fs.readFileSync(file, 'utf8');
} catch (e) {
// Present in the diff but unreadable (broken symlink, permissions). A
// changed fragment we cannot read is suspect — fail closed rather than
// letting it slip through to the release-time CHANGELOG render.
fragmentFailures.push({ file, reason: 'unreadable', detail: e.code || 'read_error' });
continue;
}
const result = parseFragment(src);
if (!result.ok) {
fragmentFailures.push({ file, reason: result.reason, detail: result.detail });
}
}
const verdict = evaluateLint({ changedFiles, labels, fragmentFailures });
if (process.argv.includes('--json')) {
process.stdout.write(JSON.stringify({ ...verdict, changedFiles, labels }, null, 2) + '\n');
} else if (verdict.ok) {
process.stdout.write(`ok changeset-lint: ${verdict.reason}\n`);
} else if (verdict.reason === LINT_REASON.FAIL_INVALID_FRAGMENT) {
process.stderr.write(`\nERROR changeset-lint: ${verdict.reason}\n`);
process.stderr.write(`The following .changeset fragment(s) failed content validation:\n`);
for (const f of verdict.failures) {
const detail = f.detail !== undefined ? ` (${f.detail})` : '';
process.stderr.write(` ${f.file}: ${f.reason}${detail}\n`);
}
process.stderr.write(`Fix the fragment(s) above before merging.\n`);
} else {
process.stderr.write(`\nERROR changeset-lint: ${verdict.reason}\n`);
process.stderr.write(`PR touches user-facing files but does not include a .changeset/*.md fragment.\n`);
process.stderr.write(`Run \`npm run changeset\` to create one, or add the \`${OPT_OUT_LABEL}\` label\n`);
process.stderr.write(`if this PR genuinely has no user-facing impact (test refactor, CI tweak, etc.).\n`);
}
return verdict.ok ? 0 : 1;
}
if (require.main === module) runMain(main);
module.exports = { evaluateLint, LINT_REASON, OPT_OUT_LABEL, isUserFacing, isFragment };