* test(#2070): fail-first tests for adaptive model_profile and models tier validation Encodes the three acceptance criteria from #2070 plus the boundary cases the resolver silently ignores today (non-string values, empty string, mistyped phase-type key), and pins VALID_TIERS to a catalog-derived set. Red phase: these fail against current src/ by design. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA * fix(#2070): accept adaptive model_profile in validate health; warn on invalid models tiers (W022) W004 sourced its profile list from a hand-maintained literal that predated the adaptive profile, so `"model_profile": "adaptive"` was false-flagged. It now reads VALID_PROFILES, which model-catalog.cts derives from model-catalog.json. models.<phase_type> was validated nowhere: the resolver's tier gate silently drops unknown values, so a typo like `"planning": "opuss"` was an undiagnosable no-op. A new W022 flags unknown phase-type keys and invalid tier values (including non-string values, which the same gate also drops). VALID_TIERS moves from a function-local literal in model-resolver.cts to a catalog-derived export, so health and the resolver cannot disagree by construction rather than by parity test. Object.values(adaptiveTierMap) is ['opus','sonnet','haiku'] plus 'inherit' — identical to the previous literal, so resolution behavior is unchanged. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA * docs(#2070): changeset for validate health adaptive profile + W022 Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA * fix(#2070): close review findings — malformed models, tier-list duplication, changeset gate Review of the initial fix surfaced three real defects, folded in per the no-defer rule: 1. verify.cts: the W022 guard skipped a top-level `models` that is present but not a plain object (`[]`, `"opus"`, `5`, `true`). The resolver ignores those identically, so they were the same undiagnosable no-op #2070 targets — just one level up. They now warn; absent/null/{} stay silent. 2. config-loader.cts: RUNTIME_OVERRIDE_TIERS was a second hardcoded copy of the tier vocabulary this change had just de-hardcoded elsewhere. It now derives from the catalog via ADAPTIVE_TIER_VALUES (no 'inherit' — runtime overrides resolve to a concrete tier). Byte-equivalent to the old literal. 3. scripts/changeset/lint.cjs: USER_FACING_PREFIXES omitted `src/`. Post-ADR-457 the product source is src/*.cts compiled to a gitignored gsd-core/bin/lib, so the `gsd-core/` prefix is dead coverage for library code and a src/-only PR could merge with no release note — including this one. Adding `src/` closes the gate; tests/ stays non-user-facing. Also corrects a false docstring in the VALID_TIERS test: value-equality cannot detect a re-hardcoded literal, so the test no longer claims it does. Two review findings were rejected with evidence rather than actioned: - W021 double-allocation is governed by ADR-612 ("W021 renumber -> void ... kept, message-disambiguated"), not a defect. - Global-defaults validation would be a false-positive generator: config-loader reads ~/.gsd/defaults.json only on the "no .planning/" branch, and health early-returns E001 without .planning/, so those values provably never affect resolution in any context health can run. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA * test(#2070): regenerate install goldens for the changeset-lint change scripts/ ships as an installed artifact, so scripts/changeset/lint.cjs's content hash is pinned in all 18 runtime golden fixtures. Adding 'src/' to USER_FACING_PREFIXES changed that hash and tripped every golden parity check. Regenerated via `npm run gen:golden`; the only delta is the lint.cjs hash. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA * docs(#2070): backfill PR number 2336 into changeset Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01SLufH5sDuqA1AiEGu45cuA --------- Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
149 lines
5.6 KiB
JavaScript
Executable File
149 lines
5.6 KiB
JavaScript
Executable File
#!/usr/bin/env node
|
|
'use strict';
|
|
|
|
/**
|
|
* Changeset-fragment lint (#2975).
|
|
*
|
|
* Pure verdict function evaluateLint({ changedFiles, labels }) returns
|
|
* { ok, reason } using the LINT_REASON enum. The CLI wrapper calls it with
|
|
* the PR diff (via `git diff --name-only origin/main...HEAD` or the GitHub
|
|
* Actions event payload) and the labels list (via the GitHub event).
|
|
*
|
|
* Tests assert on the typed verdict, never on free text.
|
|
*/
|
|
|
|
const LINT_REASON = Object.freeze({
|
|
OK_FRAGMENT_PRESENT: 'ok_fragment_present',
|
|
OK_OPT_OUT_LABEL: 'ok_opt_out_label',
|
|
OK_NO_USER_FACING_CHANGES: 'ok_no_user_facing_changes',
|
|
FAIL_MISSING_FRAGMENT: 'fail_missing_fragment',
|
|
FAIL_INVALID_FRAGMENT: 'fail_invalid_fragment',
|
|
});
|
|
|
|
const OPT_OUT_LABEL = 'no-changelog';
|
|
|
|
// Files counted as "user-facing" — touching any of these requires either a
|
|
// fragment or an explicit opt-out label. Test/CI/docs/lock files do not.
|
|
const USER_FACING_PREFIXES = [
|
|
'bin/',
|
|
'gsd-core/',
|
|
'src/',
|
|
'agents/',
|
|
'commands/',
|
|
'hooks/',
|
|
'sdk/src/',
|
|
'sdk/prompts/',
|
|
];
|
|
|
|
// Exact-match user-facing files. Any direct edit to one of these without a
|
|
// fragment also fails the lint — closes the bypass where a contributor edits
|
|
// CHANGELOG.md directly to sneak past the new workflow.
|
|
const USER_FACING_FILES = new Set(['CHANGELOG.md']);
|
|
|
|
function isUserFacing(file) {
|
|
if (USER_FACING_FILES.has(file)) return true;
|
|
return USER_FACING_PREFIXES.some((p) => file.startsWith(p));
|
|
}
|
|
|
|
function isFragment(file) {
|
|
return /^\.changeset\/[^/]+\.md$/.test(file) && !file.endsWith('/README.md');
|
|
}
|
|
|
|
function evaluateLint({ changedFiles, labels, fragmentFailures = [] }) {
|
|
if (fragmentFailures.length > 0) {
|
|
return { ok: false, reason: LINT_REASON.FAIL_INVALID_FRAGMENT, failures: fragmentFailures };
|
|
}
|
|
if (changedFiles.some(isFragment)) {
|
|
return { ok: true, reason: LINT_REASON.OK_FRAGMENT_PRESENT };
|
|
}
|
|
if (labels.includes(OPT_OUT_LABEL)) {
|
|
return { ok: true, reason: LINT_REASON.OK_OPT_OUT_LABEL };
|
|
}
|
|
if (!changedFiles.some(isUserFacing)) {
|
|
return { ok: true, reason: LINT_REASON.OK_NO_USER_FACING_CHANGES };
|
|
}
|
|
return { ok: false, reason: LINT_REASON.FAIL_MISSING_FRAGMENT };
|
|
}
|
|
|
|
const { ExitError, runMain } = require('../lib/cli-exit.cjs');
|
|
const { parseFragment } = require('./parse.cjs');
|
|
|
|
function main() {
|
|
const fs = require('node:fs');
|
|
const cp = require('node:child_process');
|
|
// GitHub Actions event payload path
|
|
const eventPath = process.env.GITHUB_EVENT_PATH;
|
|
let labels = [];
|
|
if (eventPath && fs.existsSync(eventPath)) {
|
|
try {
|
|
const event = JSON.parse(fs.readFileSync(eventPath, 'utf8'));
|
|
labels = (event.pull_request?.labels || []).map((l) => l.name);
|
|
} catch { /* fall through */ }
|
|
}
|
|
const base = process.env.GITHUB_BASE_REF || 'main';
|
|
let changedFiles = [];
|
|
try {
|
|
// Use execFileSync with an argv array — the base ref is interpolated
|
|
// into a refspec argument, but execFileSync does not invoke a shell, so
|
|
// even a malicious GITHUB_BASE_REF cannot inject shell syntax. The
|
|
// refspec-bound metacharacters that git itself rejects (e.g. spaces in
|
|
// ref names) are caught by git's own arg parser.
|
|
const out = cp.execFileSync(
|
|
'git',
|
|
['diff', '--name-only', `origin/${base}...HEAD`],
|
|
{ encoding: 'utf8' },
|
|
);
|
|
changedFiles = out.split('\n').filter(Boolean);
|
|
} catch (e) {
|
|
throw new ExitError(2, `could not compute diff: ${e.message}`);
|
|
}
|
|
|
|
// Validate the content of every changed fragment file.
|
|
const fragmentFailures = [];
|
|
for (const file of changedFiles) {
|
|
if (!isFragment(file)) continue;
|
|
// A fragment path in the diff that no longer exists on disk was deleted in
|
|
// this PR — a deletion can't be malformed, so skip it.
|
|
if (!fs.existsSync(file)) continue;
|
|
let src;
|
|
try {
|
|
src = fs.readFileSync(file, 'utf8');
|
|
} catch (e) {
|
|
// Present in the diff but unreadable (broken symlink, permissions). A
|
|
// changed fragment we cannot read is suspect — fail closed rather than
|
|
// letting it slip through to the release-time CHANGELOG render.
|
|
fragmentFailures.push({ file, reason: 'unreadable', detail: e.code || 'read_error' });
|
|
continue;
|
|
}
|
|
const result = parseFragment(src);
|
|
if (!result.ok) {
|
|
fragmentFailures.push({ file, reason: result.reason, detail: result.detail });
|
|
}
|
|
}
|
|
|
|
const verdict = evaluateLint({ changedFiles, labels, fragmentFailures });
|
|
if (process.argv.includes('--json')) {
|
|
process.stdout.write(JSON.stringify({ ...verdict, changedFiles, labels }, null, 2) + '\n');
|
|
} else if (verdict.ok) {
|
|
process.stdout.write(`ok changeset-lint: ${verdict.reason}\n`);
|
|
} else if (verdict.reason === LINT_REASON.FAIL_INVALID_FRAGMENT) {
|
|
process.stderr.write(`\nERROR changeset-lint: ${verdict.reason}\n`);
|
|
process.stderr.write(`The following .changeset fragment(s) failed content validation:\n`);
|
|
for (const f of verdict.failures) {
|
|
const detail = f.detail !== undefined ? ` (${f.detail})` : '';
|
|
process.stderr.write(` ${f.file}: ${f.reason}${detail}\n`);
|
|
}
|
|
process.stderr.write(`Fix the fragment(s) above before merging.\n`);
|
|
} else {
|
|
process.stderr.write(`\nERROR changeset-lint: ${verdict.reason}\n`);
|
|
process.stderr.write(`PR touches user-facing files but does not include a .changeset/*.md fragment.\n`);
|
|
process.stderr.write(`Run \`npm run changeset\` to create one, or add the \`${OPT_OUT_LABEL}\` label\n`);
|
|
process.stderr.write(`if this PR genuinely has no user-facing impact (test refactor, CI tweak, etc.).\n`);
|
|
}
|
|
return verdict.ok ? 0 : 1;
|
|
}
|
|
|
|
if (require.main === module) runMain(main);
|
|
|
|
module.exports = { evaluateLint, LINT_REASON, OPT_OUT_LABEL, isUserFacing, isFragment };
|