* test(#443): RED unified effort + fast_mode + resolve-execution All 68 tests failing as expected — no implementation yet. Covers: effort cascade (tier defaults, overrides, invalid fallthrough), fast_mode cascade (boolean-only, tier defaults), resolveEffortForTier escalation, renderEffortForRuntime clamping, resolve-execution CLI, config schema new keys, QA hostile-input matrix. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(#443): unified cross-provider effort + fast_mode knobs and resolve-execution query Adds config-driven effort control (universal ladder: minimal<low<medium<high<xhigh<max) and fast_mode propagation knobs, with per-runtime rendering that clamps the unique tail values (max=Anthropic-only clamps to xhigh on Codex; minimal=Codex-only clamps to low on Claude). Key changes: - config-schema.manifest.json: add effort.default, fast_mode.enabled as validKeys; add 4 dynamicKeyPatterns for effort.routing_tier_defaults, effort.agent_overrides, fast_mode.routing_tier_defaults, fast_mode.agent_overrides; fix stale _comment - config-defaults.manifest.json: add effort and fast_mode blocks with tier defaults - model-catalog.cjs: add EFFORT_RENDERING map, renderEffortForRuntime(), RUNTIMES_WITH_FAST_MODE - model-profiles.cjs: re-export new catalog exports - core.cjs: add resolveEffortInternal, resolveFastModeInternal, resolveEffortForTier, VALID_EFFORTS, EFFORT_SET, nextEffort; pass effort/fast_mode through loadConfig - commands.cjs: replace reasoning_effort in cmdResolveModel with unified effort; add cmdResolveExecution (superset command with effort_rendered, effort_param, effort_propagation, fast_mode, fast_mode_supported) - gsd-tools.cjs: add resolve-execution case with --effort/--fast-mode/--attempt flags - tests/feat-443: 69 tests covering cascade, rendering, escalation, CLI, schema, QA matrix - tests/commands.test.cjs: convert 3 reasoning_effort assertions to unified effort - docs/CONFIGURATION.md: document effort + fast_mode + resolve-execution sections - settings-advanced.md: list new effort/fast_mode keys in confirmation table Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * refactor(#443): remove dead catalog effort lane; unify codex effort through renderEffortForRuntime - Remove resolveReasoningEffortInternal (catalog-driven effort function) from core.cjs and its export; remove from commands.cjs destructure import - Convert tests/issue-2517-runtime-aware-profiles.test.cjs: all 11 effort assertions now use resolveEffortInternal + renderEffortForRuntime; Claude effort is first-class (output_config.effort); unknown runtimes assert param===null - Convert tests/feat-3023-model-phase-types.test.cjs: replace the entire resolveReasoningEffortInternal describe with unified effort assertions; effort derives from AGENT_DEFAULT_TIERS routing tier, not phase-type tier Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * docs(#443): ADR for unified cross-provider effort + fast-mode routing Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> * test(#443): architecture-level QA invariants + test-strategy doc Add 48-test integration suite (feat-443-effort-fast-mode.integration.test.cjs) covering 8 architectural invariants: cross-provider validity (never emit a value the real API would 400 on), param/channel contract stability, resolve-execution JSON contract (all 8 keys + correct types), totality across the full 33-agent registry, fast-mode honesty (claude always fast_mode_supported=false), precedence first-valid-wins matrix for both effort and fast_mode cascades, dynamic-routing composition (effort escalation independent of model tier), and config-set round-trip for all new effort/* and fast_mode/* key namespaces. Append test-strategy section with invariant rationale and E2E gap documentation to docs/TESTING-SUITES.md. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * test(#443): add failing install-wiring tests for effort per-runtime injection (RED) TDD RED: 10 failing tests covering: - Claude .md gets effort: injected per tier (planner=xhigh, mapper=low, executor=high) - Gemini .md does NOT get effort: (already passing — Gemini-safe) - Codex .toml gets model_reasoning_effort via unified resolver - Config-driven: effort.agent_overrides drives both Claude .md and Codex .toml - Source purity: agents/*.md have no effort: key (already passing) Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(#443): wire effort per-runtime at install (Claude .md frontmatter + Codex .toml unified) - Import AGENT_DEFAULT_TIERS and renderEffortForRuntime from model-catalog.cjs - Add readGsdEffectiveEffortConfig(targetDir): reads merged effort config from .planning/config.json (per-project wins) + ~/.gsd/defaults.json (global fallback), same probe pattern as readGsdRuntimeProfileResolver - Add resolveInstallTimeEffort(effortCfg, agentName): pure function matching resolveEffortInternal() precedence (agent_overrides > routing_tier_defaults > default > 'high') without loadConfig side-effects (no sub-repo detection, no migration writes) - Claude agent copy loop: inject `effort: <value>` into frontmatter ONLY for runtime === 'claude'; all other .md runtimes (Gemini, Qwen, Hermes, etc.) stay effort-free (Gemini-safe source contract preserved in agents/*.md) - generateCodexAgentToml: add effortCfg param; emit model_reasoning_effort from unified resolver (replaces old catalog entry.reasoning_effort); Codex clamps max → xhigh via renderEffortForRuntime('codex', ...) - installCodexConfig: pass readGsdEffectiveEffortConfig(targetDir) to generateCodexAgentToml so per-project config wins for Codex .toml too - Update failing tests to GREEN: 12/12 pass; all 17 install tests pass; 2847/2848 unit tests pass (1 pre-existing failure: policy-shell-pinning) Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * refactor(#443): source install effort defaults from manifest (kill drift) + guard test Replace hardcoded _GSD_EFFORT_MANIFEST_TIER_DEFAULTS and the 'high' fallback in resolveInstallTimeEffort with values read from config-defaults.manifest.json at module init, using the same __dirname-relative path install.js already uses for all shared manifests. Add feat-443-effort-defaults-drift.test.cjs to assert equality between install.js's runtime constants and the manifest on every CI run. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix(#443): reconcile Codex TOML tests with unified effort design The #443 unified effort resolver makes generateCodexAgentToml always emit model_reasoning_effort (driven by resolveInstallTimeEffort, not model_profile_overrides). The test 'generated TOML omits reasoning_effort when runtime has none' had an obsolete premise — model_profile_overrides.reasoning_effort:'' no longer suppresses unified effort. Convert it to assert the new invariant: Codex TOML always carries a valid model_reasoning_effort from the agent's routing tier (xhigh for gsd-planner, a heavy-tier agent), while model_profile_overrides model override is still respected. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix(#443): make install.js effort resolution lazy (no load-time side effects breaking launcher-parity) Replace module-load-time IIFE + hard throw (config-defaults.manifest.json read) and top-level require of model-catalog.cjs with a lazy _getGsdEffortCatalog() getter that initialises on first call from resolveInstallTimeEffort / generateCodexAgentToml / Claude .md effort injection. Requiring install.js in unrelated test contexts (e.g. runtime-launcher-parity) no longer triggers manifest IO or throws, eliminating the load-time side effect that changed subprocess exit codes / stderr on the bench. Drift-guard exports (_GSD_EFFORT_MANIFEST_TIER_DEFAULTS / _GSD_EFFORT_MANIFEST_DEFAULT) preserved as lazy getter properties on module.exports so feat-443-effort-defaults-drift still validates them without forcing eager load. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix(#443): isolate install-wiring test HOME to stop \$HOME/.claude pollution breaking launcher-parity runGlobalInstall() now redirects HOME to a per-call isolated tmpdir in addition to the existing runtime-specific env-var redirects (CLAUDE_CONFIG_DIR, GEMINI_CONFIG_DIR, CODEX_HOME). This ensures install.js code that uses os.homedir() directly — including the ~/.cache/gsd update-check deletion, ~/.gsd/defaults.json reads, and any HOME-relative npm subprocess writes — never touches the real \$HOME during the test. Without the HOME isolation the install test (which is new to this branch and is now picked up by Docker's raw \`tests/*.test.cjs\` glob) could write or delete files under the real \$HOME, causing runtime-launcher-parity test (D) to fail: (D) asserts a loud non-zero exit when \$RUNTIME_DIR/gsd-tools.cjs is absent and gsd-tools is not on PATH, but the launcher's \$HOME/.claude fallback arm succeeds if \$HOME/.claude/get-shit-done/bin/gsd-tools.cjs exists. Also sets GSD_SKIP_STALE_SDK_CHECK=1 to suppress the \`npm ls -g\` subprocess that the global installer spawns — irrelevant to effort-wiring assertions, slow, and potentially writes to ~/.npm cache. All 12 feat-443 install-wiring assertions preserved. Drift-guard 5/5. Unit suite 2848/2850 (pre-existing policy-shell-pinning.test.cjs failure on next). Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * chore(#443): add changeset fragment for effort + fast-mode routing Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> * fix(#443): set GSD_TEST_MODE before requiring install.js in drift-guard test to prevent HOME leak Without GSD_TEST_MODE=1, require('bin/install.js') runs the module's main install block (guarded by !GSD_TEST_MODE), performing a real global Claude install into $HOME/.claude/. On CI ubuntu where node is on standard PATH, the launcher's $HOME/.claude fallback arm then finds gsd-tools.cjs, causing runtime-launcher-parity test (D) to exit zero when it must exit non-zero. Root cause: feat-443-effort-defaults-drift.test.cjs (unit suite) runs alphabetically before runtime-launcher-parity.test.cjs in the same node --test invocation. Each runs in a separate worker process but shares the same HOME. The drift test's install leaks gsd-tools.cjs into that HOME, then the launcher test's bash subprocess finds it via the $HOME/.claude arm. Fix: add process.env.GSD_TEST_MODE = '1' at the top of the drift-guard test, before the require(installPath) call. This matches the pattern used by feat-443-effort-fast-mode.test.cjs and feat-443-effort-install-wiring .install.test.cjs. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix(#443): deterministic resolve-execution arg parsing + validate install-time effort (Codex adversarial findings) Finding 1: resolve-execution --effort low gsd-planner misrouted 'low' as the agent. Replace find(non-dash) with a proper flag-consuming loop that collects a single positional; validate missing/extra positionals and malformed --attempt values. Finding 2: resolveInstallTimeEffort returned unvalidated effort strings (e.g. "ultra") verbatim. Each precedence layer now checks GSD_EFFORT_SET (imported once from core.cjs) before accepting a value, mirroring resolveEffortInternal exactly. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix(#443): newline-agnostic effort frontmatter injection (Windows CRLF) + CRLF-safe assertions Extracts injectEffortFrontmatter(content, effortValue) pure helper that detects EOL (LF vs CRLF) from the opening '---' line and inserts 'effort: <value>' before the closing '---' delimiter using the same EOL as the surrounding frontmatter. Regex now uses /^---\r?\n([\s\S]*?)^---\r?$/m instead of the LF-only /^(---\n[\s\S]*?)(---)(\n|$)/ that silently skipped CRLF files on Windows (git core.autocrlf=true checkout). Also adds 7 unit tests covering LF, CRLF, idempotency, no-frontmatter, and complex frontmatter cases. Exports injectEffortFrontmatter from module.exports. Fixes 6 CI failures in tests/feat-443-effort-install-wiring.install.test.cjs on windows-latest runners (lines 138, 145, 152, 261, 345, 356). Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> --------- Co-authored-by: CI Rebase Check <ci@gsd-redux> Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
213 lines
7.9 KiB
JavaScript
213 lines
7.9 KiB
JavaScript
'use strict';
|
|
|
|
const path = require('node:path');
|
|
|
|
// Resolve model-catalog.json via a prioritised candidate list so the module
|
|
// works in every layout:
|
|
//
|
|
// 1. Co-located install path — get-shit-done/bin/shared/model-catalog.json
|
|
// Written by bin/install.js (#3288 fix). This is the canonical post-install
|
|
// location across all runtimes (Claude Code, Codex, OpenCode, etc.).
|
|
//
|
|
// 2. Source-repo dev path — sdk/shared/model-catalog.json
|
|
// Three levels up from bin/lib/: works when running directly from the
|
|
// open-gsd/get-shit-done-redux clone (the original path introduced by #3230).
|
|
//
|
|
// 3. GSD_MODEL_CATALOG env override — allows test harnesses and custom
|
|
// deployments to point at an arbitrary catalog file.
|
|
//
|
|
// Throws with a diagnostic message that lists all candidates when none resolve,
|
|
// so MODULE_NOT_FOUND surfaces as a clear actionable error (PRED.k301).
|
|
const _catalogCandidates = [
|
|
path.resolve(__dirname, '..', 'shared', 'model-catalog.json'),
|
|
path.resolve(__dirname, '..', '..', '..', 'sdk', 'shared', 'model-catalog.json'),
|
|
process.env.GSD_MODEL_CATALOG ? path.resolve(process.env.GSD_MODEL_CATALOG) : null,
|
|
].filter(Boolean);
|
|
|
|
let catalog = null;
|
|
let _catalogLastErr = null;
|
|
for (const _p of _catalogCandidates) {
|
|
try {
|
|
catalog = require(_p);
|
|
break;
|
|
} catch (e) {
|
|
// Only treat missing-file errors as recoverable — rethrow parse errors,
|
|
// permission errors, and any other real failures so they surface clearly
|
|
// instead of being silently swallowed (CR finding, PR #3293).
|
|
const isMissingCandidate =
|
|
(e && e.code === 'MODULE_NOT_FOUND' && String(e.message || '').includes(_p)) ||
|
|
(e && e.code === 'ENOENT');
|
|
if (!isMissingCandidate) throw e;
|
|
_catalogLastErr = e;
|
|
}
|
|
}
|
|
if (!catalog) {
|
|
throw new Error(
|
|
`model-catalog.json not found. Tried:\n${_catalogCandidates.map((p) => ` ${p}`).join('\n')}\nLast error: ${_catalogLastErr?.message}`
|
|
);
|
|
}
|
|
|
|
const VALID_PROFILES = [...catalog.profiles];
|
|
const VALID_PHASE_TYPES = new Set(catalog.phaseTypes);
|
|
const VALID_AGENT_TIERS = new Set(Object.keys(catalog.adaptiveTierMap));
|
|
|
|
const MODEL_PROFILES = Object.fromEntries(
|
|
Object.entries(catalog.agents).map(([agent, meta]) => [agent, {
|
|
quality: meta.golden,
|
|
balanced: meta.balanced,
|
|
budget: meta.budget,
|
|
adaptive: catalog.adaptiveTierMap[meta.routingTier],
|
|
}])
|
|
);
|
|
|
|
const AGENT_TO_PHASE_TYPE = Object.fromEntries(
|
|
Object.entries(catalog.agents).map(([agent, meta]) => [agent, meta.phaseType])
|
|
);
|
|
|
|
const AGENT_DEFAULT_TIERS = Object.fromEntries(
|
|
Object.entries(catalog.agents).map(([agent, meta]) => [agent, meta.routingTier])
|
|
);
|
|
|
|
const MODEL_ALIAS_MAP = Object.fromEntries(
|
|
Object.entries(catalog.runtimeTierDefaults.claude).map(([tier, entry]) => [tier, entry?.model])
|
|
);
|
|
|
|
const RUNTIME_PROFILE_MAP = Object.fromEntries(
|
|
Object.entries(catalog.runtimeTierDefaults)
|
|
.map(([runtime, tiers]) => [
|
|
runtime,
|
|
Object.fromEntries(
|
|
Object.entries(tiers).filter(([, entry]) => entry).map(([tier, entry]) => [tier, entry])
|
|
),
|
|
])
|
|
.filter(([, tiers]) => Object.keys(tiers).length > 0)
|
|
);
|
|
|
|
const KNOWN_RUNTIMES = new Set(Object.keys(catalog.runtimeTierDefaults));
|
|
const RUNTIMES_WITH_REASONING_EFFORT = new Set(
|
|
Object.entries(catalog.runtimeTierDefaults)
|
|
.filter(([, tiers]) => Object.values(tiers).some((entry) => entry && entry.reasoning_effort))
|
|
.map(([runtime]) => runtime)
|
|
);
|
|
|
|
function nextTier(currentTier) {
|
|
const order = ['light', 'standard', 'heavy'];
|
|
const idx = order.indexOf(String(currentTier));
|
|
if (idx === -1) return null;
|
|
return order[Math.min(idx + 1, order.length - 1)];
|
|
}
|
|
|
|
function formatAgentToModelMapAsTable(agentToModelMap) {
|
|
const agentWidth = Math.max('Agent'.length, ...Object.keys(agentToModelMap).map((a) => a.length));
|
|
const modelWidth = Math.max('Model'.length, ...Object.values(agentToModelMap).map((m) => m.length));
|
|
const sep = '─'.repeat(agentWidth + 2) + '┼' + '─'.repeat(modelWidth + 2);
|
|
const header = ` ${'Agent'.padEnd(agentWidth)} │ ${'Model'.padEnd(modelWidth)}`;
|
|
let out = `${header}\n${sep}\n`;
|
|
for (const [agent, model] of Object.entries(agentToModelMap)) {
|
|
out += ` ${agent.padEnd(agentWidth)} │ ${model.padEnd(modelWidth)}\n`;
|
|
}
|
|
return out;
|
|
}
|
|
|
|
function getAgentToModelMapForProfile(normalizedProfile) {
|
|
const profile = VALID_PROFILES.includes(normalizedProfile) ? normalizedProfile : 'balanced';
|
|
const out = {};
|
|
for (const [agent, profiles] of Object.entries(MODEL_PROFILES)) {
|
|
out[agent] = profile === 'inherit' ? 'inherit' : (profiles[profile] ?? profiles.balanced);
|
|
}
|
|
return out;
|
|
}
|
|
|
|
// ─── Effort rendering ────────────────────────────────────────────────────────
|
|
//
|
|
// Universal effort ladder: minimal < low < medium < high < xhigh < max
|
|
//
|
|
// Each runtime supports a subset. The unique tails must be clamped when emitting
|
|
// to a runtime that does not support them:
|
|
// - 'max' is Anthropic-only: Codex does not support it -> clamp to 'xhigh'
|
|
// - 'minimal' is Codex-only: Claude does not support it -> clamp to 'low'
|
|
//
|
|
// Rendering maps the universal effort string to the runtime's native parameter.
|
|
|
|
const EFFORT_RENDERING = {
|
|
// Claude Code subagent effort: output_config.effort frontmatter key /
|
|
// CLAUDE_CODE_EFFORT_LEVEL env. Supports: low, medium, high, xhigh, max.
|
|
// Does NOT support 'minimal' (Codex-only) -> clamp to 'low'.
|
|
claude: {
|
|
param: 'output_config.effort',
|
|
channel: 'frontmatter',
|
|
supported: new Set(['low', 'medium', 'high', 'xhigh', 'max']),
|
|
clamp(level) {
|
|
if (level === 'minimal') return 'low';
|
|
return level;
|
|
},
|
|
},
|
|
// Codex Responses API reasoning.effort. Supports: minimal, low, medium, high, xhigh.
|
|
// Does NOT support 'max' (Anthropic-only) -> clamp to 'xhigh'.
|
|
codex: {
|
|
param: 'model_reasoning_effort',
|
|
channel: 'api',
|
|
supported: new Set(['minimal', 'low', 'medium', 'high', 'xhigh']),
|
|
clamp(level) {
|
|
if (level === 'max') return 'xhigh';
|
|
return level;
|
|
},
|
|
},
|
|
};
|
|
|
|
/**
|
|
* Render a universal effort string for a specific runtime.
|
|
*
|
|
* Returns { value (clamped), param, channel } where:
|
|
* - value: the clamped effort string safe to pass to the runtime
|
|
* - param: the native parameter name (e.g. 'output_config.effort')
|
|
* - channel: how the value is propagated ('frontmatter', 'api', null)
|
|
*
|
|
* Unknown runtimes return { value: universalEffort, param: null, channel: null }
|
|
* so callers can always read .value safely.
|
|
*/
|
|
function renderEffortForRuntime(runtime, universalEffort) {
|
|
const spec = EFFORT_RENDERING[runtime];
|
|
if (!spec) {
|
|
return { value: universalEffort, param: null, channel: null };
|
|
}
|
|
return {
|
|
value: spec.clamp(universalEffort),
|
|
param: spec.param,
|
|
channel: spec.channel,
|
|
};
|
|
}
|
|
|
|
// ─── Fast mode propagation ───────────────────────────────────────────────────
|
|
//
|
|
// RUNTIMES_WITH_FAST_MODE is the set of runtimes where fast_mode=true can be
|
|
// propagated to a SPAWNED SUBAGENT via a native mechanism.
|
|
//
|
|
// Claude Code has NO per-subagent fast-mode mechanism — /fast is a session-level
|
|
// toggle only. Emitting a `fast_mode: true` frontmatter key on a Claude subagent
|
|
// would be a SILENT NO-OP, which is why 'claude' is deliberately excluded here.
|
|
//
|
|
// Only API-direct runtimes ('api') accept a speed:"fast" field in the request.
|
|
// Codex and other runtimes do not expose per-call fast_mode either.
|
|
const RUNTIMES_WITH_FAST_MODE = new Set(['api']);
|
|
|
|
module.exports = {
|
|
catalog,
|
|
MODEL_PROFILES,
|
|
VALID_PROFILES,
|
|
AGENT_TO_PHASE_TYPE,
|
|
VALID_PHASE_TYPES,
|
|
AGENT_DEFAULT_TIERS,
|
|
VALID_AGENT_TIERS,
|
|
MODEL_ALIAS_MAP,
|
|
RUNTIME_PROFILE_MAP,
|
|
KNOWN_RUNTIMES,
|
|
RUNTIMES_WITH_REASONING_EFFORT,
|
|
nextTier,
|
|
formatAgentToModelMapAsTable,
|
|
getAgentToModelMapForProfile,
|
|
EFFORT_RENDERING,
|
|
renderEffortForRuntime,
|
|
RUNTIMES_WITH_FAST_MODE,
|
|
};
|