* enhance(#2483): env-guard the claude reviewer leg against CLAUDE.md injection
The claude reviewer in workflows/review.md was a bare headless `claude -p`
spawn run from the project cwd, so it inherited the invoking user's global
CLAUDE.md, the project CLAUDE.md, and Claude Code auto-memory.
That made it the only reviewer leg seeing anything beyond the prompt file.
gather_context assembles PROJECT.md, the roadmap section, every PLAN file,
CONTEXT.md, RESEARCH.md and REQUIREMENTS.md into the prompt before any
reviewer runs; the gemini leg receives only that prompt and the codex leg
runs --ephemeral. Beyond the measured ~4k tokens/spawn, the asymmetry cuts
at the workflow's own premise: "independent review" meant something
different for the claude leg than for the other two.
Guard both dispatch lines with a per-invocation
`env CLAUDE_CODE_DISABLE_CLAUDE_MDS=1`. `env`, never `export` — the flag
must not leak into the orchestrating session (which may itself be Claude
Code on the SELF_CLI="auto" path) or into any later spawn.
review.md is the only claude -p call site in the installed tree, so this is
two lines on one surface. The self-skip logic is untouched.
* enhance(#2483): fix CRLF-fragile split and regenerate workflow baselines
Two CI failures from the first push, both mine:
1. lint-tests: the new regression test split readFileSync content on a
literal "\n". On a Windows git-autocrlf checkout that leaves a trailing
"\r" on every line (local/no-crlf-fragile-split). Use .split(/\r?\n/).
2. golden-install-parity / workflow-size-budget / workflow-compat: editing
gsd-core/workflows/review.md changes its content hash and byte size, and
both are pinned in committed baselines. Regenerated via the repo's own
generators (npm run size:baseline, npm run gen:golden).
The regenerated diffs are review.md-only: exactly one hash line per
golden-install-parity fixture and one size entry in workflow-size-baseline
— no unrelated drift swept in.
Full suite now green locally: 2113 pass, 0 fail, 3 skipped (run with HOME
and CLAUDE_CONFIG_DIR overridden to throwaway dirs; live profile verified
untouched afterward).
* enhance(#2483): adapt guard-test matcher to the effort-args dispatch reshape
The effortSurface wiring (#2481) reshaped the bare-model dispatch to
`claude $CLAUDE_EFFORT_ARGS -p -`; the invocation matcher's dash-first
form could no longer see it, and the count assertion failed exactly as
designed. The matcher now tolerates variable expansions between `claude`
and its first literal flag. Negative-controlled both ways: a stripped
guard and a deleted dispatch line each still fail.
* enhance(#2483): also guard the claude leg against auto-memory injection
CLAUDE_CODE_DISABLE_CLAUDE_MDS suppresses CLAUDE.md file loading;
auto-memory is an independently-toggled mechanism with its own flag.
Add CLAUDE_CODE_DISABLE_AUTO_MEMORY=1 to both dispatch lines, correct
the docs/COMMANDS.md and changeset claims that credited the first flag
with covering auto-memory, and extend the regression test to require
both flags on every claude invocation (negative-controlled: 2/4
assertions fail with the new flag removed).
* enhance(#2483): match the claude binary in command position, not argument position
The line-oriented invocation matcher counted any line where the token
`claude` was followed by a flag. #2589 (landed on next as 920a5f3f)
reshaped the effort-args lookup from
--host claude 2>/dev/null | jq -r '.effort_argv_string // ""'
to
--host claude --pick effort_argv_string
which put a flag immediately after `claude` and made the config query
read as a third claude dispatch, failing the count assertion.
The defect class is a binary name in *argument* position being read as a
command. Fixed at the class rather than the instance: tokenise the line
and skip any `claude` whose preceding token is a flag. That also covers
the latent sibling one line away in review.md (`command -v claude`),
which escaped today only because its next token is a redirect.
Negative-controlled four ways: stripping CLAUDE_CODE_DISABLE_AUTO_MEMORY=1
fails, stripping the whole env guard fails, adding a genuine third
unguarded dispatch (`timeout 900 claude --output-format text -p -`) still
fails — so the narrowing did not blind the matcher to reshapes, which is
the property the count assertion exists for — and the pre-#2589 jq form of
the lookup still passes, so the matcher is not pinned to today's base.
* enhance(#2483): carry the claude reviewer's memory guard as declared lane data
ADR-2782 Phase 5b replaced the hand-authored per-CLI dispatch legs in
review.md with the declared lane table, so the two `env`-prefixed shell
lines this PR previously added no longer have a surface to live on. The
guard is reimplemented where the lane contract now lives.
`SpawnInvoke` gains an optional `env`, the claude lane declares the pair,
the resolver folds own string-valued entries into `SpawnPlan.env` (absent
or empty resolves to null, so the runner has one shape to test), and the
runner passes it to spawn. Production merges it OVER `process.env` into a
fresh object for that one child, so nothing reaches the orchestrating
session or any other lane in the run.
Declared data rather than a handler (D6): the pairs are static per lane,
which is precisely what the manifest vocabulary is for. The capability
manifest carries the same field, because the lane-fidelity test compares
manifest and descriptor over the union of `invoke`'s keys.
The regression test is rewritten against the resolver and runner rather
than review.md's text. It gains the property the source-text assertions
could only approximate: that `process.env` is never mutated.
Scope boundary, asserted rather than left in prose: `env` is not part of
the trust-disclosure surface, which is safe only while no manifest body
reaches the resolver — the registry's reviewer bodies contribute slugs to
the parity check and execution resolves from `REVIEWER_LANES`. The new
test fails first if that ever changes.
* enhance(#2483): restate the guard's mechanism in the docs and changeset
Both described the fix as two `env`-prefixed dispatch lines, which is the
surface ADR-2782 Phase 5b removed. The user-visible behaviour is
unchanged; the carrier is not, and a changeset that ships a description
of a mechanism the tree does not have is a CHANGELOG entry nobody can
verify against the code.
* enhance(#2483): cover the production spawn wiring end to end
The unit tests stop at the runner's `deps.spawn` seam — every one injects
a spy. Production supplies that seam in `gsd-core/bin/gsd-tools.cjs` as a
hand-written object no test constructs, so the chain could be correct all
the way to `SpawnPlan.env` and the merge could still be wrong or absent
with the suite green. Deleting those four lines was the one mutation that
left every other control silent.
This runs the real `spawnSync` through `gsd-tools review-lane invoke`,
with a `claude` shim on PATH that records the environment it was handed.
It asserts both halves in one test: the pair arrives, and an unrelated
inherited variable survives — a wiring that REPLACED the environment
rather than merging over it would satisfy the first and break every
lane's PATH and HOME.
POSIX-only; mediating a Windows `.cmd` shim is a separate concern the
repo already tests on its own.
Noted rather than fixed: `timeout`, `killSignal`, `maxBuffer` and
`shell: false` on that same object are equally uncovered. That is the
epic's gap, not this change's, and closing it is not in scope here.
* enhance(#2483): validate the invoke.env shape and register it as spawn-only
`env` was the one spawn-invoke field with no shape enforcement: every sibling in
`validateSpawnInvoke` is checked, and a manifest declaring `env` as an array, a
string, a number, or an object with non-string values passed validation in
silence. That matters more than an ordinary schema gap here, because
`resolveLanePlan` DROPS a non-string value rather than coercing it — so an
unvalidated manifest declares a pair that never reaches the spawn, which is the
failure a memory guard can least afford.
Two registrations, not one. `env` was also absent from
`SPAWN_ONLY_INVOKE_FIELDS`, which is the list the openai-http arm rejects
against — so `invoke.env` was accepted on a transport that issues an HTTP POST
and has no child environment at all. It was the only spawn-shaped field accepted
there; the other six each produce two errors. Self-found while sweeping the
class, not raised in review.
Keys are held to the portable POSIX environment-name grammar. That is a policy,
not a claim about what an environment can hold: measured, only NUL is actually
rejected by `spawnSync`, while `=`, a leading digit, a dash and a space are all
carried through to the child (an `A=B` key arrives as the raw entry `A=B=value`).
They are refused because a name outside the grammar is not portably addressable
by the program meant to read it.
`__proto__` is refused for a different and concrete reason. It passes that
grammar and is a real own key once a manifest is JSON-parsed, but assigning it
onto a plain accumulator goes through the inherited `__proto__` setter rather
than creating an own property — and for the string values this field permits the
setter is a no-op that does not even change the prototype. The pair would
validate and then simply vanish before the spawn. (An environment CAN carry a
literal `__proto__` entry; this is about the resolver's accumulator, and the
error message says so.)
Deliberately narrower than the sibling reserved-name guards in this file, which
also reject `constructor`/`prototype`: those guard bracket lookups that resolve
prototype members, whereas this reads via `Object.keys` plus an own-value read,
where `constructor` assigns as an ordinary key the spawn could carry.
`effortChannel` is deliberately left in neither field list: ADR-2782 D2 defines
it for both transports, so it is shared rather than spawn-only.
Reversion-controlled, three mutations, all three fire a named test: dropping
`env` from the discriminator fails `httpTransportRejectsEnv`; removing the
`__proto__` arm fails `envRejectsProtoKeyThatWouldSilentlyVanish`; disabling
the block fails four.
(#2483)
* enhance(#2483): amend ADR-2782 D2 for the invoke.env vocabulary widening
D2 records the spawn `invoke` shape as a closed vocabulary, and its Amendments
section carries a dated entry for every prior widening (Phase 1 #2794, Phase 2
corrections #2795, Phase 5b #2799). This change extended that vocabulary in code
without touching the ADR governing it, so the ADR contradicted the
implementation — and the repo's own convention, recorded in CONTEXT.md, is that
the ADR is amended in the same PR precisely because the prior widenings did it
correctly.
Adds the `invoke.env` row to the D2 table and a dated Amendments entry.
The entry also corrects the authority this change cited. The source comment
pointed at D6, which governs the closed `handler` enum — imperative behavior
admitted first-party — and says nothing about the `invoke` field vocabulary.
That is D2's territory, so the citation never covered the gap.
Two claims are corrected rather than restated, both about the trust boundary
that justifies leaving `env` out of the D5 disclosure signature:
- The regression test does not enforce that boundary. On one forged lane it
shows the resolver folds whatever it is handed, so a future path feeding it
manifest lanes would not make any assertion in that test fail. Its comment
claimed it "will fail first"; that was wrong, and both the comment and the
ADR now say the boundary is a property of the production call chain instead.
- The ADR is internally inconsistent on whether third-party manifest lanes
execute at all: Consequences says adding a reviewer needs "no core patch",
while `gsd-tools.cjs` rejects every slug absent from the first-party
REVIEWER_LANES map. CONTEXT.md, `workflows/review.md` and the resolver's own
header take the first view. #2483 did not create that inconsistency and does
not resolve it; the entry records it rather than settling it in its own favour.
(#2483)
* enhance(#2483): document invoke.env in the capability-manifest reference
ADR-2782 points capability and plugin authors at
`docs/reference/capability-manifest.md` as where the lane vocabulary must be
visible, and its `invoke` row enumerates the spawn sub-shape field by field.
`env` was absent from that table while being part of the real shape, so the one
document a third-party capability author would actually consult to learn the
field exists did not mention it.
Squarely Diataxis reference material — a field-by-field schema description — so
it goes here rather than in the user-facing prose, which was already updated.
States the constraints a manifest author can actually trip, and is explicit that
the name grammar is a portability policy rather than an OS limit, so a reader
does not take it for a claim about what an environment can hold.
(#2483)
* enhance(#2483): disclose and sign the reviewer lane's env and residual invoke fields
`invoke.env` was undisclosed at install time. That was defensible while manifest
lanes could not execute — the premise this PR's own ADR amendment recorded — and
#2927/#3062 retired it: `routeReviewLane` now merges installed overlay `reviewer`
bodies into its lane map via `mergeReviewerLanes`, which is a field-identical merge
by ADR-2782 D1 and deliberately does not deep-validate. An overlay's whole `invoke`
therefore reaches `resolveLanePlan`, and `env` reaches the spawned child. A consented
third-party capability could set `NODE_OPTIONS=--require ./evil.js` on a reviewer lane
with no install-time disclosure and no re-consent.
The same file already decided what `env` means in a manifest: MCP servers fold it into
the disclosure signature and render each key and value in the consent prompt, with an
inline rationale naming this exact shape. Reviewer lanes get the identical treatment.
`env` was the ninth unsigned invoke field, not the first. `defaultHost` (the manifest's
OWN fallback egress host, used whenever the config key resolves to nothing),
`path`, `outputChannel`/`outputArg`, `modelArg`, `effortChannel` and `modelDiscovery`
all reach `resolveLanePlan` and none was bound. Enumerating a ninth name leaves the
tenth open, so the lane signature carries a RESIDUAL of every other declared `invoke`
key — the completeness backstop `rawConfig` already gives the MCP line (#1459 finding 5),
and the "sign the whole object" remedy the recorded decision on this class prefers.
`defaultHost` is also rendered: `resolvedHost` comes from user config, so a lane whose
key is unset displayed "(unresolved …)" — which reads as "no destination" — while the
runtime egresses the plan and review text to the address the manifest picked.
D4.5 is preserved one level down: the extra element is appended ONLY when the lane
declares something beyond the eight already-bound fields, so an env-free lane's
signature stays byte-identical and no already-consented capability is re-prompted for
a field it does not use. A lane that does declare one re-consents, which is the point.
Execution-primitive env names are FLAGGED in the prompt, not refused in the validator.
A denylist cannot be the boundary here: `PATH` alone is a complete execution primitive
for a spawn lane and can never be refused, the child is an arbitrary third-party binary
so the true set spans every interpreter's injection vars, and the MCP `env` this mirrors
refuses nothing and discloses everything. Missing a name costs a quieter line, never a
boundary.
Refs #2483.
* enhance(#2483): exercise the real overlay merge path in the guard test
The test named for the manifest/first-party boundary did not test it. It built a
forged lane locally, handed it straight to `resolveLanePlan`, and asserted that
`REVIEWER_LANES` did not contain it — so no assertion in it depended on the claim its
name made, and a code path that fed manifest lanes to the resolver would not have made
it fail. Its own comment said as much, and named the production chain as the real
carrier of the guarantee: "gsd-tools.cjs builds its lane map solely from REVIEWER_LANES".
That sentence is now false. #3062 merged overlay reviewer bodies into that map, so the
test's premise and its subject both moved.
The replacement routes through `mergeReviewerLanes` — the real helper the production
path calls — and asserts the overlay lane is admitted, resolves, and carries its `env`
into `SpawnPlan.env`. That makes the security property falsifiable instead of narrated.
It then asserts what now backs it: the env is disclosed on the surface, rendered key
and value in the consent prompt, flagged when the name is an execution primitive, and
bound to the signature so a value change, an addition, or a removal each force
re-consent.
Three further cases, because the finding's generative half is what stops it recurring:
the residual backstop is asserted against five fields including one that does not exist
(`aFieldThatDoesNotExistYet`), so a future vocabulary widening cannot silently re-open
this; a fully-enumerated lane is pinned to its original 8-tuple, which is what keeps the
fix from re-prompting every consented capability; and an http lane's manifest-declared
`defaultHost` is asserted to reach both the prompt and the signature.
Reversion-controlled, seven mutations, all seven fail a named test: env dropped from the
surface, the prompt's env line removed, the execution-primitive warning removed, the
signature's extra element never appended, the residual emptied, the defaultHost line
removed, and the declares-something test un-widened. The last of those was SILENT on its
first run and its test was written in response, then the control re-run.
Refs #2483.
* enhance(#2483): correct the ADR amendment's manifest-lane premise
The amendment argued `env` needed no D5 disclosure because a manifest's `invoke`
fields never reach `resolveLanePlan`. That was true when written and #3062 retired it
22 hours after this branch's last commit: `routeReviewLane` now builds its lane map
from `mergeReviewerLanes(REVIEWER_LANES, loadRegistry({includeInstalled: true}))`, and
D1's no-translation-layer rule makes that a field-identical merge, so an overlay's
whole `invoke` reaches the resolver and executes.
The entry had named this exact trigger — "were manifest lanes ever made executable,
`env` must join the disclosed surface in that change, and nothing here will trip if it
does not." Nothing tripped. The premise is rewritten to current truth rather than
annotated, because an ADR is read in fragments and a superseded paragraph left standing
reads as live reasoning to the next author; a one-line dated tombstone points at git for
the withdrawn text.
The rewritten entry records four things the first draft could not: that the enumeration
itself was the defect (`env` was the ninth unbound `invoke` field, and `defaultHost` and
`path` are egress-relevant on their own), that the residual is what closes the class,
that D4.5's byte-identical-signature property is preserved by appending the residual only
when a lane declares something beyond the eight bound fields, and that consent — not
shape validation — is the boundary, since no honest env denylist can exclude `PATH`.
It also closes the internal inconsistency the previous entry could only record. This ADR,
`CONTEXT.md`, `gsd-core/workflows/review.md` and `resolveLanePlan`'s own header all said
overlay lanes reach the resolver while the runtime said otherwise; #3062 resolved that in
the documents' favour, which is what makes the disclosure mandatory rather than defensive.
Refs #2483.
* enhance(#2483): record in the manifest reference that invoke fields are consent-bound
`docs/reference/capability-manifest.md` is the field table ADR-2782 points capability
authors at, and it described `invoke` purely as a schema. A third-party author reading it
could not learn that everything they declare there is shown to the user at install and
bound to the consent signature — which is exactly what they need to know now that an
overlay reviewer lane executes (#2927/#3062).
States the two things the schema alone cannot: that `env` and `defaultHost` are named in
the consent prompt and the rest is covered by a residual, so any change to a declared
`invoke` field forces re-consent; and that `env`'s validation is a portability policy
rather than a safety boundary, since `PATH` is a complete execution primitive and cannot
be refused. Names that are execution primitives are highlighted in the prompt instead.
Refs #2483.
* enhance(#2483): add a Security changeset for the reviewer-lane disclosure
The existing fragment describes the enhancement this PR was opened for and stays as it
is. The disclosure fix is a separate user-visible change of a different type: a
capability declaring `invoke.env` or `invoke.defaultHost` will ask for consent once
more, and users are entitled to read why in the changelog rather than discover it as an
unexplained prompt.
Type is `Security` rather than `Changed` because the entry describes a closed
code-execution disclosure gap, not a behaviour adjustment.
Refs #2483.
* enhance(#2483): correct this round's own claim about who gets re-prompted
Self-found while auditing the round's claims before publishing them. The changeset and
the ADR entry both stated that a capability declaring `invoke.env` or `defaultHost`
"will ask for consent once more". That is wrong, and it overstated the cost of the fix
in the one direction a maintainer would have had to take on trust.
A code change to `disclosureSignature` re-prompts nobody. `hasProjectConsent` matches on
the recomputed bundle `contentHash` — the signature has not been the security binding
since #1459 CB-1/CB-2 — and the upgrade path's `executableSetChanged(old, new)` compares
two disclosures both computed by the CURRENT code, so widening the signature moves both
sides of that comparison equally. First-party capabilities never reach the path at all:
the install flow blocks a first-party id before trust evaluation.
What the widening actually buys is forward-looking, and is the real argument for it: an
upgrade whose manifest edits a declared `invoke` field now registers as an
executable-surface change and re-consents, where before it could change what the lane
runs in silence.
Also measured and recorded, because the D4.5 property was stated more strongly than it
deserved: of the twelve first-party reviewer capabilities, ZERO are in the
byte-identical-signature class — every real lane declares at least `effortChannel`. The
property is a guarantee about minimal lanes, not a description of the fleet, and the ADR
now says so.
Refs #2483.
* enhance(#2483): sign and disclose the probe binary and the lane's outer fields
Found by this round's own adversarial review, and it is the same defect one level out:
the `invoke` residual cannot reach the lane body's OUTER fields, and `probeLane` SPAWNS
`probe.binary` with `--help` before dispatch (`review-lane-runner.cts`, the
`command-exists`/`command-capability` arms). An overlay naming an arbitrary probe binary
therefore executes it — unsigned and undisclosed, exactly as `invoke.env` was, and
reachable on the same #3062 path.
The lane element now carries a second residual over the outer fields, and the probe
binary is shown in the consent prompt when it differs from the dispatch binary — it is a
program that runs, and the user is entitled to see it.
TWO fields stay excluded, and that is a decision rather than an omission:
`reviewsSection` and `timeoutFloorMs` are ADR-2782's cosmetic carve-outs (matrix
A10/A13), where re-consenting would present a prompt carrying no security information.
A test pins that they remain excluded, so a later widening cannot quietly reverse D4.5
while claiming to complete this fix.
Also corrects a miscount introduced by the previous commit: the source comment said the
enumeration had fallen behind by "seven fields" and omitted `fallbackModel`, while
asserting `env` was the ninth. `resolveLanePlan` reads twelve `inv.*` fields and four
were bound, so the number is eight. The comment now states the derivation rather than
just the total.
Reversion-controlled: emptying the outer residual fails "repointing the probe binary must
force re-consent"; removing the render line fails its own named assertion.
Refs #2483.
* enhance(#2483): refuse execution-primitive env names as defence in depth
Adopts the review's B5 after this round's own adversarial pass refuted my reason for
declining it. I had argued a denylist was worthless because `PATH` can never be refused.
That was wrong on the facts: no shipped reviewer manifest declares `PATH`, so it can be
refused, and it is the most complete primitive in the set — repoint it at a directory
holding a fake binary and the declared `invoke.binary` is irrelevant. A list that cannot
be exhaustive can still close the highest-confidence, lowest-legitimacy routes.
So the validator now rejects `PATH`, `NODE_OPTIONS`, `LD_PRELOAD`, `DYLD_INSERT_LIBRARIES`,
`BASH_ENV`, `PYTHONPATH`, `PERL5OPT`, `RUBYOPT`, `GIT_SSH_COMMAND`, `JAVA_TOOL_OPTIONS`
and their siblings on a reviewer lane. A lane needing a specific executable declares an
absolute `invoke.binary` instead of reshaping the child's environment.
The comment states plainly that this is defence in depth and NOT the boundary — the
boundary is install-time consent, which discloses every declared pair and binds it to the
signature, so an unlisted name is still SEEN before it runs. That framing is load-bearing:
a future reader who mistakes the denylist for the control will under-invest in the one
that is, which is the failure mode I was trying to avoid by declining it outright.
Two tests: the rejection itself across ten names, and a guard asserting no shipped
reviewer capability declares a denied key — so if the list ever outgrows its evidence,
that surfaces as a decision rather than a silent removal.
Refs #2483.
* enhance(#2483): fix two stale D5 enumerations elsewhere in the ADR
The previous commit rewrote the amendment's premise but swept only the amendment. Two
normative passages earlier in the same ADR still enumerated the old closed field list and
now contradicted it: the `executableSetChanged` trigger list, and the split-binding note
asserting the seven manifest-derived fields were "everything that is SHA-pinned".
That is the failure the rewrite-don't-annotate rule exists to prevent, one section over —
an ADR is read in fragments, and a fragment carries no supersession marker, so a reader
landing on either passage would have taken the superseded enumeration as current.
Both now name the residual as the mechanism rather than restating a list, which is also
what stops them going stale the next time the vocabulary widens.
Found by this round's adversarial review, which grepped the whole document rather than
the section under edit.
Refs #2483.
* enhance(#2483): stop the probe disclosure claiming a spawn that does not happen
The probe line added one commit ago rendered "probes by running: <binary> --help" for
every lane. That is false for `kind: "command-exists"`, which only calls `hasBinary` — a
PATH/filesystem scan that starts no process. Only `command-capability` spawns.
A false statement in a consent prompt is worse than a missing one: the prompt is the
surface a user is asked to trust, and this one overstated what a lane does. Worse, the
test I wrote to prove the fix used `command-exists` — the kind that does NOT spawn — so
it pinned the wrong claim and would have kept the error green forever.
The surface now carries `probeKind` and the two kinds render differently: a spawn is
described as a spawn, a presence check as a presence check. The test exercises both, and
asserts the `command-exists` path never emits the spawn wording.
Also corrects the field-count parenthetical to state its derivation unambiguously —
`resolveLanePlan` reads thirteen `inv.*` fields including `env` (twelve before this PR),
four were bound, so eight were unbound before `env` and nine including it. The bare
"twelve" was true only of the pre-PR tree and read as a claim about the current one.
And retires two comments that argued AGAINST the validator denylist this round then
shipped. Leaving them would have handed the next reader the reasoning for removing it.
Reversion-controlled: conflating the two probe kinds fails a named test.
Refs #2483.
* enhance(#2483): match the reviewer-lane env denylist case-insensitively
The denylist added one commit ago compared exact case, so `Path`, `path`, `node_options`
and `Node_Options` all passed it. Windows environment lookup is case-insensitive, so
those reach the child as `PATH` and `NODE_OPTIONS` — the exact inputs the list names.
An exactly-cased denylist is worse than none: it reads as a control while admitting the
input it was written to refuse, and the next reader has no reason to doubt it. Members
are stored uppercase and the key is folded before lookup; the name grammar already
constrains keys to ASCII, so a plain fold is sufficient.
Reversion-controlled: restoring the exact-case compare fails `envDenylistIsCaseInsensitive`
on `Path`.
Refs #2483.
* enhance(#2483): correct the docs that still described the denylist as absent
Both the ADR and the manifest reference still said `env` carries no denylist and that
`PATH` "can never be refused" — written when that was this round's position, and left
standing after the round reversed it. A reader landing on either passage would have taken
the superseded argument as current, which is precisely the failure the rewrite-don't-
annotate rule exists to prevent.
Both now describe the denylist, name `PATH`'s inclusion and the case-insensitive match,
and keep the limit explicit: the list cannot be complete against an arbitrary child and
disclosure runs before validation, so consent remains the boundary.
The ADR's byte-identical-signature claim is also corrected rather than softened. With the
outer residual in place, a lane producing no residual is one the validator rejects — it
declares no `flags`, `probe`, `emptyOutput`, `evidenceClass`, `requiresBinaries` or
`promptBudgetKey`. So the property is about the ENCODING, not a claim that any real
signature is unchanged, and it is not the argument for the change being safe. That
argument is that consent binds to the bundle contentHash and no existing consent is
invalidated at all.
Refs #2483.
* test(#2483): cover the three new lane disclosure fields in the injection-safety parity guard
The PARITY test in section N exists to catch a renderer field that skips
`renderValueForPrompt` (#3248). Its payload manifest is hand-maintained, so it
covers the fields that existed when it was written — slug, binary, args,
hostConfigKey, handler — and none of the fields this PR adds.
This PR renders three further manifest-supplied values into consent-prompt
lines: `invoke.env` (keys and values), `invoke.defaultHost` and `probe.binary`.
The gap was silent rather than theoretical: with the lane env line reverted to
the pre-#3248 raw form, the whole 948-test lane/capability/trust-disclosure
suite stayed green.
Two manifests, because the shapes render disjoint lines — `defaultHost` only on
the openai-http branch, `env`/`probe` only where declared, and the probe line
only when the probe binary differs from the dispatch binary.
Non-vacuity is asserted on the typed disclosure object and on structural line
counts, not by substring-matching rendered prose: CONTRIBUTING.md forbids raw
text matching on test output, and this section's own header promises structural
assertions only, so a prose match here would have made that promise false.
Negative-controlled three ways against the merged tree, each producing exactly
one named failure: env rendered raw, defaultHost rendered raw, probe binary
rendered raw.
* docs(#2483): extend the #3248 render-site comment to the fields this PR adds
The comment enumerates every manifest-supplied value that must pass through
`renderValueForPrompt`, and it stopped at `handler` — the reviewer-lane fields
that existed when #3248 landed. This PR renders three more (`defaultHost`, the
probe binary, and the env keys and values), so the list understated its own
contract in the one place a future author would check before adding a fourth.
A comment enumerating a closed set is a set that can silently fall behind the
code it describes; the parity test added alongside is what makes the omission
fail loudly rather than read as deliberate.
---------
Co-authored-by: Tom Boucher <trekkie@nomorestars.com>
980 lines
47 KiB
JavaScript
980 lines
47 KiB
JavaScript
'use strict';
|
||
process.env.GSD_TEST_MODE = '1';
|
||
|
||
/**
|
||
* instruction-surface-disclosure.security.test.cjs — behavioral tests for a FIFTH disclosed
|
||
* class inside the capability trust gate (ADR-2363 D5, #3248): `instructionSurfaces` — the
|
||
* skill stems a capability manifest declares — added to `discloseExecutableSurfaces`.
|
||
*
|
||
* Instruction surfaces are SKILLS ONLY (`InstructionSurface.kind` is the literal `'skill'`).
|
||
* ADR-2363 D3's class table names "skills, agents", but a declared `agents[]` is deliberately
|
||
* NOT collected: third-party `agents[]` are never staged into the agent's instruction context
|
||
* (there is no registry-aware agent staging path, unlike `readInstalledCapabilitySkill` for
|
||
* skills), so disclosing them would be a false claim in a consent prompt. Tests below that used
|
||
* to assert agent disclosure now assert the NEGATIVE — that a declared `agents` array yields no
|
||
* instruction surface at all.
|
||
*
|
||
* Implements every row carrying a Test name in
|
||
* `.gsd/phase/feat-3248-disclose-instruction-surfaces/50-test-matrix.md`, derived from
|
||
* `40-design.md`'s behavior table. Rows 18-20 and 23-25 are the load-bearing ones: they encode
|
||
* ADR-2363 D4 — instruction surfaces must never perturb `disclosureSignature`/`hasExecutable`, and
|
||
* no pre-existing consent record may be disturbed by a manifest gaining a `skills`/`agents` array.
|
||
*
|
||
* FAILING-FIRST: at the time this file was written, `Disclosure.instructionSurfaces` does not
|
||
* exist. `discloseExecutableSurfaces` is called directly (the cheapest unit that proves the
|
||
* behavior), matching `tests/reviewer-trust-disclosure.test.cjs`'s own established idiom.
|
||
*
|
||
* Suite: `security` (filename `.security.` infix) — this is a trust-gate surface.
|
||
*/
|
||
|
||
const { test, describe } = require('node:test');
|
||
const assert = require('node:assert/strict');
|
||
const fs = require('node:fs');
|
||
const os = require('node:os');
|
||
const path = require('node:path');
|
||
const fc = require('fast-check');
|
||
|
||
const { cleanup } = require('./helpers.cjs');
|
||
|
||
const trust = require('../gsd-core/bin/lib/capability-trust.cjs');
|
||
|
||
// ─── Fixture builders ──────────────────────────────────────────────────────
|
||
// House convention (tests/reviewer-manifest-body.test.cjs, tests/reviewer-trust-disclosure.test.cjs):
|
||
// builder functions return a VALID fixture; an optional `mutator` callback is applied to the FRESH
|
||
// object before it is returned. Every call builds a brand-new object — no shared mutable state.
|
||
|
||
/**
|
||
* A minimal, valid capability manifest declaring both skills and agents. Kept declaring BOTH
|
||
* deliberately — it is now valuable precisely because it proves `agents` is ignored: every
|
||
* assertion against this fixture's `instructionSurfaces` must show the skills only, never the
|
||
* declared agent name.
|
||
*/
|
||
function skillsAndAgentsManifest(mutator) {
|
||
const manifest = {
|
||
id: 'test-cap',
|
||
role: 'feature',
|
||
title: 'Test Capability',
|
||
description: 'A test capability for the instruction-surface disclosure test suite.',
|
||
tier: 'standard',
|
||
requires: [],
|
||
version: '1.0.0',
|
||
skills: ['ui-phase', 'ui-review'],
|
||
agents: ['gsd-ui-checker'],
|
||
};
|
||
if (mutator) mutator(manifest);
|
||
return manifest;
|
||
}
|
||
|
||
/** A manifest carrying one hook, one command module, and one mcpServer — no skills/agents/reviewer. */
|
||
function executableSurfaceManifest(mutator) {
|
||
const manifest = {
|
||
id: 'x',
|
||
hooks: [{ event: 'PostToolUse', script: 'hooks/x.js' }],
|
||
commands: [{ family: 'demo', module: 'demo.cjs', router: 'run' }],
|
||
mcpServers: { srv: { command: 'node', args: ['s.js'], env: { A: '1' } } },
|
||
};
|
||
if (mutator) mutator(manifest);
|
||
return manifest;
|
||
}
|
||
|
||
// ─── A. Happy path (rows 1-3) ───────────────────────────────────────────────
|
||
|
||
describe('A. Happy path', () => {
|
||
test('discloses declared skill stems in order', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: ['a', 'b'] });
|
||
assert.deepEqual(d.instructionSurfaces, [
|
||
{ kind: 'skill', name: 'a' },
|
||
{ kind: 'skill', name: 'b' },
|
||
]);
|
||
});
|
||
|
||
// A declared `agents` array is classified as an instruction surface by ADR-2363 D3's class
|
||
// table, but is deliberately NOT staged into the instruction context for third-party
|
||
// capabilities (no registry-aware agent staging path — see the module header on
|
||
// src/capability-trust.cts). Disclosing it would name a surface that does not exist, so it
|
||
// must yield NO instruction surfaces at all.
|
||
test('declared agent names yield no instruction surfaces', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', agents: ['gsd-ui-checker'] });
|
||
assert.deepEqual(d.instructionSurfaces, []);
|
||
});
|
||
|
||
test('a manifest declaring both skills and agents discloses only its skills', () => {
|
||
const d = trust.discloseExecutableSurfaces(skillsAndAgentsManifest());
|
||
assert.deepEqual(d.instructionSurfaces, [
|
||
{ kind: 'skill', name: 'ui-phase' },
|
||
{ kind: 'skill', name: 'ui-review' },
|
||
]);
|
||
});
|
||
});
|
||
|
||
// ─── B. Boundary (rows 4-7) ─────────────────────────────────────────────────
|
||
|
||
describe('B. Boundary', () => {
|
||
test('absent skills yields an empty instruction surface list', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x' });
|
||
assert.deepEqual(d.instructionSurfaces, []);
|
||
});
|
||
|
||
test('empty skills array yields empty list', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: [] });
|
||
assert.deepEqual(d.instructionSurfaces, []);
|
||
});
|
||
|
||
test('single skill', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: ['only'] });
|
||
assert.deepEqual(d.instructionSurfaces, [{ kind: 'skill', name: 'only' }]);
|
||
});
|
||
|
||
test('many skills are not truncated', () => {
|
||
const stems = Array.from({ length: 64 }, (_, i) => `skill-${i}`);
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: stems });
|
||
assert.deepEqual(
|
||
d.instructionSurfaces,
|
||
stems.map((name) => ({ kind: 'skill', name })),
|
||
);
|
||
});
|
||
});
|
||
|
||
// ─── C. Negative / malformed (rows 8-11, 15) ────────────────────────────────
|
||
|
||
describe('C. Negative / malformed', () => {
|
||
test('non-array skills yields empty list', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: 'a' });
|
||
assert.deepEqual(d.instructionSurfaces, []);
|
||
});
|
||
|
||
test('object skills yields empty list', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: { 0: 'a' } });
|
||
assert.deepEqual(d.instructionSurfaces, []);
|
||
});
|
||
|
||
test('non-string and empty stems are dropped individually', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: ['ok', 42, null, {}, '', true] });
|
||
assert.deepEqual(d.instructionSurfaces, [{ kind: 'skill', name: 'ok' }]);
|
||
});
|
||
|
||
test('whitespace-only stem is dropped', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: [' '] });
|
||
assert.deepEqual(d.instructionSurfaces, []);
|
||
});
|
||
|
||
test('non-object manifest is total', () => {
|
||
for (const manifest of [null, 42, []]) {
|
||
assert.doesNotThrow(() => trust.discloseExecutableSurfaces(manifest));
|
||
const d = trust.discloseExecutableSurfaces(manifest);
|
||
assert.deepEqual(d.instructionSurfaces, [], `manifest=${JSON.stringify(manifest)} must disclose no instruction surfaces`);
|
||
assert.deepEqual(d.hooks, []);
|
||
assert.deepEqual(d.commandModules, []);
|
||
assert.deepEqual(d.mcpServers, []);
|
||
assert.deepEqual(d.reviewerLanes, []);
|
||
assert.equal(d.hasExecutable, false);
|
||
}
|
||
});
|
||
});
|
||
|
||
// ─── D. Hostile (rows 12-14, 16) ─────────────────────────────────────────────
|
||
|
||
describe('D. Hostile', () => {
|
||
test('a throwing skills getter degrades only its own class', () => {
|
||
const manifest = executableSurfaceManifest();
|
||
Object.defineProperty(manifest, 'skills', {
|
||
enumerable: true,
|
||
get() {
|
||
throw new Error('boom: throwing skills getter');
|
||
},
|
||
});
|
||
assert.doesNotThrow(() => trust.discloseExecutableSurfaces(manifest));
|
||
const d = trust.discloseExecutableSurfaces(manifest);
|
||
assert.deepEqual(d.instructionSurfaces, [], 'a throwing skills getter must degrade to no instruction surfaces');
|
||
assert.deepEqual(d.hooks, [{ event: 'PostToolUse', script: 'hooks/x.js' }], 'hooks must still populate');
|
||
assert.deepEqual(
|
||
d.commandModules,
|
||
[{ family: 'demo', module: 'demo.cjs', router: 'run' }],
|
||
'command modules must still populate',
|
||
);
|
||
assert.equal(d.mcpServers.length, 1, 'mcp servers must still populate');
|
||
assert.deepEqual(d.reviewerLanes, [], 'lane-free manifest still discloses no lane (unaffected either way)');
|
||
assert.equal(d.hasExecutable, true, 'the other three classes still set hasExecutable');
|
||
});
|
||
|
||
test('a hostile Proxy manifest never throws', () => {
|
||
const proxyManifest = new Proxy(
|
||
{},
|
||
{
|
||
get() {
|
||
throw new Error('boom: get trap');
|
||
},
|
||
has() {
|
||
throw new Error('boom: has trap');
|
||
},
|
||
ownKeys() {
|
||
throw new Error('boom: ownKeys trap');
|
||
},
|
||
},
|
||
);
|
||
assert.doesNotThrow(() => trust.discloseExecutableSurfaces(proxyManifest));
|
||
const d = trust.discloseExecutableSurfaces(proxyManifest);
|
||
assert.equal(d.hasExecutable, false);
|
||
assert.deepEqual(d.instructionSurfaces, []);
|
||
assert.deepEqual(d.hooks, []);
|
||
assert.deepEqual(d.commandModules, []);
|
||
assert.deepEqual(d.mcpServers, []);
|
||
assert.deepEqual(d.reviewerLanes, []);
|
||
});
|
||
|
||
test('prototype-polluting stem names do not mutate Object.prototype', () => {
|
||
const beforeProps = Object.getOwnPropertyNames(Object.prototype).sort();
|
||
const d = trust.discloseExecutableSurfaces({
|
||
id: 'x',
|
||
skills: ['__proto__', 'constructor', 'prototype'],
|
||
});
|
||
assert.deepEqual(d.instructionSurfaces, [
|
||
{ kind: 'skill', name: '__proto__' },
|
||
{ kind: 'skill', name: 'constructor' },
|
||
{ kind: 'skill', name: 'prototype' },
|
||
], 'the literal names are disclosed, not interpreted as prototype keys');
|
||
const afterProps = Object.getOwnPropertyNames(Object.prototype).sort();
|
||
assert.deepEqual(afterProps, beforeProps, 'Object.prototype must be unchanged');
|
||
assert.equal(({}).polluted, undefined, 'a fresh plain object must carry no polluted property');
|
||
});
|
||
|
||
test('adversarial stem contents survive disclosure intact', () => {
|
||
const huge = 'x'.repeat(10000);
|
||
const stems = ['a\nb', 'x\0y', '日本語スキル', huge];
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: stems });
|
||
assert.deepEqual(
|
||
d.instructionSurfaces,
|
||
stems.map((name) => ({ kind: 'skill', name })),
|
||
'every adversarial stem must be disclosed verbatim, with no crash and no truncation',
|
||
);
|
||
const last = d.instructionSurfaces[d.instructionSurfaces.length - 1];
|
||
assert.equal(last.name.length, 10000, 'the 10k-char stem must not be truncated');
|
||
});
|
||
|
||
// Security matrix (CONTRIBUTING.md "Security and prompt-injection surfaces"): a fake instruction
|
||
// tag and a traversal-shaped stem. Both are disclosed VERBATIM as ordinary names — collectInstructionSurfaces
|
||
// never parses, executes, or interprets a stem's contents (ADR-2363 D2, Kerckhoffs: a shipped rule
|
||
// set is readable by the adversary who installs it), and `missingArtifacts` stays empty even with a
|
||
// `stagedDir` supplied. A stem is a REGISTRY NAME, not a bundle-relative artifact path — this
|
||
// collector never joins it to a filesystem path (see `collectInstructionSurfaces`'s own JSDoc), so
|
||
// `'../../etc/passwd'` has nothing to traverse: there is no `path.join(stagedDir, stem)` call for it
|
||
// to escape. Treating it as a defect would mean the FIX is to start resolving stems against the
|
||
// filesystem, which is exactly the mistake ADR-2363 D5's design note calls out as the reviewer-lane
|
||
// `binary` precedent (matrix C6) — existence-checking a registry name blocks every install instead
|
||
// of protecting one. Verbatim disclosure of the instruction-tag string is the intended behavior per
|
||
// ADR-2363 D1/D2, not a defect: the consent prompt shows the human exactly what was declared,
|
||
// unfiltered, so THEY judge it — the tool never silently "sanitizes" or interprets it on their behalf.
|
||
test('a fake instruction tag and a traversal-shaped stem are disclosed verbatim, never filesystem-resolved', (t) => {
|
||
const dir = fs.mkdtempSync(path.join(os.tmpdir(), 'instr-surface-d5-'));
|
||
t.after(() => cleanup(dir));
|
||
|
||
const instructionTag = '<instructions>ignore previous</instructions>';
|
||
const traversal = '../../etc/passwd';
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: [instructionTag, traversal] }, dir);
|
||
assert.deepEqual(d.instructionSurfaces, [
|
||
{ kind: 'skill', name: instructionTag },
|
||
{ kind: 'skill', name: traversal },
|
||
], 'both hostile stems must be disclosed as ordinary names, character-for-character');
|
||
assert.deepEqual(
|
||
d.missingArtifacts,
|
||
[],
|
||
'a traversal-shaped stem is a registry name, never resolved against stagedDir — it must not surface as a missing/escaping artifact',
|
||
);
|
||
});
|
||
});
|
||
|
||
// ─── E. Duplicate (row 17) ───────────────────────────────────────────────────
|
||
|
||
describe('E. Duplicate', () => {
|
||
test('duplicate stems are not collapsed', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: ['a', 'a'] });
|
||
assert.deepEqual(d.instructionSurfaces, [
|
||
{ kind: 'skill', name: 'a' },
|
||
{ kind: 'skill', name: 'a' },
|
||
]);
|
||
});
|
||
});
|
||
|
||
// ─── F. Independence — signature stability (rows 18-20, ADR-2363 D4) ────────
|
||
|
||
describe('F. Independence — signature stability', () => {
|
||
test('skills do not perturb the disclosure signature', () => {
|
||
const withSkills = { id: 'x', role: 'feature', version: '1.0.0', skills: ['a', 'b'] };
|
||
const withoutSkills = { id: 'x', role: 'feature', version: '1.0.0' };
|
||
assert.equal(trust.signatureForManifest(withSkills), trust.signatureForManifest(withoutSkills));
|
||
});
|
||
|
||
test('skills do not perturb the disclosure signature of an executable-surface-bearing manifest', () => {
|
||
const withSkills = executableSurfaceManifest((m) => {
|
||
m.skills = ['a', 'b'];
|
||
});
|
||
const withoutSkills = executableSurfaceManifest();
|
||
assert.equal(trust.signatureForManifest(withSkills), trust.signatureForManifest(withoutSkills));
|
||
});
|
||
|
||
// These two `agents` signature tests still assert a true and useful property — agents never
|
||
// perturb the signature — but are now TRIVIALLY true, since `agents` is not collected into
|
||
// `instructionSurfaces` at all (it never reaches `collectInstructionSurfaces`'s per-field
|
||
// loop). Kept so they guard the NARROWING (agents dropped entirely) rather than D4
|
||
// specifically — a regression that made `agents` collected again would still need a separate
|
||
// D4 test to catch a signature perturbation.
|
||
test('agents do not perturb the disclosure signature', () => {
|
||
const withAgents = { id: 'x', role: 'feature', version: '1.0.0', agents: ['gsd-ui-checker'] };
|
||
const withoutAgents = { id: 'x', role: 'feature', version: '1.0.0' };
|
||
assert.equal(trust.signatureForManifest(withAgents), trust.signatureForManifest(withoutAgents));
|
||
});
|
||
|
||
test('agents do not perturb the disclosure signature of an executable-surface-bearing manifest', () => {
|
||
const withAgents = executableSurfaceManifest((m) => {
|
||
m.agents = ['gsd-ui-checker'];
|
||
});
|
||
const withoutAgents = executableSurfaceManifest();
|
||
assert.equal(trust.signatureForManifest(withAgents), trust.signatureForManifest(withoutAgents));
|
||
});
|
||
|
||
// A JS re-implementation of the PRE-#3248 (and pre-#2796-lane) discloseExecutableSurfaces
|
||
// (hooks/commands/mcpServers ONLY) + disclosureSignature + stableJson — copied verbatim from
|
||
// `tests/reviewer-trust-disclosure.test.cjs`'s own `refDiscloseExecutableSurfaces` /
|
||
// `refStableJson` oracle (itself copied from src/capability-trust.cts as it stood before ADR-2782
|
||
// Phase 3), which satisfies the fixture-provenance rule (#2371): it was written by a source that
|
||
// does not know the `skills`/`agents`/`instructionSurfaces` class exists at all.
|
||
function refAsString(v) {
|
||
return typeof v === 'string' ? v : '';
|
||
}
|
||
|
||
function refStableJson(value) {
|
||
if (value === null || typeof value !== 'object') return JSON.stringify(value) ?? 'null';
|
||
if (Array.isArray(value)) return `[${value.map(refStableJson).join(',')}]`;
|
||
const keys = Object.keys(value).sort();
|
||
return `{${keys.map((k) => `${JSON.stringify(k)}:${refStableJson(value[k])}`).join(',')}}`;
|
||
}
|
||
|
||
function refDiscloseExecutableSurfaces(manifest) {
|
||
const hooks = [];
|
||
const commandModules = [];
|
||
const mcpServers = [];
|
||
|
||
if (Array.isArray(manifest.hooks)) {
|
||
for (const h of manifest.hooks) {
|
||
if (typeof h !== 'object' || h === null) continue;
|
||
const script = refAsString(h['script']);
|
||
const event = refAsString(h['event']);
|
||
if (script) hooks.push({ event, script });
|
||
}
|
||
}
|
||
|
||
if (Array.isArray(manifest.commands)) {
|
||
for (const c of manifest.commands) {
|
||
if (typeof c !== 'object' || c === null) continue;
|
||
const moduleName = refAsString(c['module']);
|
||
const family = refAsString(c['family']);
|
||
const router = refAsString(c['router']);
|
||
if (moduleName) commandModules.push({ family, module: moduleName, router });
|
||
}
|
||
}
|
||
|
||
if (manifest.mcpServers && typeof manifest.mcpServers === 'object') {
|
||
const pushServer = (name, config) => {
|
||
if (!name) return;
|
||
const cfg = typeof config === 'object' && config !== null ? config : {};
|
||
const command = refAsString(cfg['command']);
|
||
const rawArgs = Array.isArray(cfg['args']) ? cfg['args'] : [];
|
||
const argv = rawArgs.filter((a) => typeof a === 'string');
|
||
const transport = refAsString(cfg['type']) || refAsString(cfg['transport']);
|
||
const url = refAsString(cfg['url']);
|
||
const headers = {};
|
||
const rawHeaders = cfg['headers'];
|
||
if (rawHeaders && typeof rawHeaders === 'object' && !Array.isArray(rawHeaders)) {
|
||
for (const [k, v] of Object.entries(rawHeaders)) {
|
||
if (k === '__proto__' || k === 'constructor' || k === 'prototype') continue;
|
||
if (typeof v === 'string') headers[k] = v;
|
||
}
|
||
}
|
||
const env = {};
|
||
const rawEnv = cfg['env'];
|
||
if (rawEnv && typeof rawEnv === 'object' && !Array.isArray(rawEnv)) {
|
||
for (const [k, v] of Object.entries(rawEnv)) {
|
||
if (k === '__proto__' || k === 'constructor' || k === 'prototype') continue;
|
||
if (typeof v === 'string') env[k] = v;
|
||
}
|
||
}
|
||
const cwd = refAsString(cfg['cwd']);
|
||
const rawConfig = {};
|
||
for (const [k, v] of Object.entries(cfg)) {
|
||
if (k === '__proto__' || k === 'constructor' || k === 'prototype') continue;
|
||
rawConfig[k] = v;
|
||
}
|
||
const surface = { name, transport, command, argv, rawArgs, url, headers, env, rawConfig };
|
||
if (cwd) surface.cwd = cwd;
|
||
mcpServers.push(surface);
|
||
};
|
||
if (Array.isArray(manifest.mcpServers)) {
|
||
for (const s of manifest.mcpServers) {
|
||
if (typeof s === 'object' && s !== null) pushServer(refAsString(s['name']), s['config'] ?? s);
|
||
}
|
||
} else {
|
||
for (const [name, config] of Object.entries(manifest.mcpServers)) pushServer(name, config);
|
||
}
|
||
}
|
||
|
||
return { hooks, commandModules, mcpServers };
|
||
}
|
||
|
||
function refDisclosureSignature(d) {
|
||
const hooks = d.hooks.map((h) => refStableJson(['hook', h.event, h.script])).sort();
|
||
const mods = d.commandModules.map((m) => refStableJson(['mod', m.family, m.module, m.router || ''])).sort();
|
||
const mcp = d.mcpServers
|
||
.map((s) =>
|
||
refStableJson([
|
||
'mcp',
|
||
s.name,
|
||
s.transport || '',
|
||
s.command,
|
||
s.rawArgs || [],
|
||
s.url || '',
|
||
s.headers || {},
|
||
s.env || {},
|
||
s.cwd || '',
|
||
s.rawConfig || {},
|
||
]),
|
||
)
|
||
.sort();
|
||
return JSON.stringify([hooks, mods, mcp]);
|
||
}
|
||
|
||
function referenceLaneFreeSignature(manifest) {
|
||
return refDisclosureSignature(refDiscloseExecutableSurfaces(manifest));
|
||
}
|
||
|
||
test('signature matches the pre-change oracle for a skill-bearing manifest', () => {
|
||
const manifestWithSkills = executableSurfaceManifest((m) => {
|
||
m.skills = ['ui-phase', 'ui-review'];
|
||
m.agents = ['gsd-ui-checker'];
|
||
});
|
||
// The oracle does not know `skills`/`agents`/`reviewer` exist at all — it only ever reads
|
||
// hooks/commands/mcpServers — so its output for the skill-bearing manifest IS the reference
|
||
// "sans skills" signature the matrix asks for.
|
||
assert.equal(trust.signatureForManifest(manifestWithSkills), referenceLaneFreeSignature(manifestWithSkills));
|
||
});
|
||
});
|
||
|
||
// ─── G. Independence — hasExecutable (rows 21-22) ───────────────────────────
|
||
|
||
describe('G. Independence — hasExecutable', () => {
|
||
test('an instruction surface alone does not set hasExecutable', () => {
|
||
const d = trust.discloseExecutableSurfaces(skillsAndAgentsManifest());
|
||
assert.equal(d.hasExecutable, false);
|
||
});
|
||
|
||
test('hasExecutable still reflects executable surfaces only', () => {
|
||
const manifest = skillsAndAgentsManifest((m) => {
|
||
m.hooks = [{ event: 'PostToolUse', script: 'hooks/x.js' }];
|
||
});
|
||
const d = trust.discloseExecutableSurfaces(manifest);
|
||
assert.equal(d.hasExecutable, true, 'the hook, not the instruction surfaces, sets hasExecutable');
|
||
assert.equal(d.hooks.length, 1);
|
||
// Skills-only count: `skillsAndAgentsManifest` declares 2 skills + 1 agent, but agents are
|
||
// not collected (see the module-header comment above), so only the 2 skills disclose.
|
||
assert.equal(d.instructionSurfaces.length, 2, 'instruction surfaces still disclosed alongside the hook');
|
||
});
|
||
});
|
||
|
||
// ─── H. Independence — executableSetChanged (row 23) ────────────────────────
|
||
|
||
describe('H. Independence — executableSetChanged', () => {
|
||
test('adding a skill is not an executable-set change', () => {
|
||
const before = trust.discloseExecutableSurfaces({ id: 'x' });
|
||
const after = trust.discloseExecutableSurfaces({ id: 'x', skills: ['a'] });
|
||
assert.equal(trust.executableSetChanged(before, after), false);
|
||
});
|
||
});
|
||
|
||
// ─── I. Regression — pre-existing consent record (row 24) ───────────────────
|
||
|
||
describe('I. Regression — pre-existing consent record', () => {
|
||
const LOCAL_SPEC = { kind: 'local', raw: '.', target: '.' };
|
||
|
||
test('a pre-existing consent record survives instruction-surface disclosure', () => {
|
||
// Simulates a consent record written BEFORE this phase (a manifest with no skills/agents),
|
||
// then the capability being upgraded to a version that adds a skill — the stored signature
|
||
// must still match, so no re-consent prompt fires.
|
||
const preChangeManifest = { id: 'x', role: 'feature', version: '1.0.0' };
|
||
const v1 = trust.evaluateInstallTrust({ parsed: LOCAL_SPEC, manifest: preChangeManifest, hostVersion: '1.0.0' });
|
||
const storedSignature = trust.disclosureSignature(v1.disclosure);
|
||
|
||
const upgradedManifest = { id: 'x', role: 'feature', version: '1.1.0', skills: ['ui-phase'] };
|
||
const v2 = trust.evaluateInstallTrust({ parsed: LOCAL_SPEC, manifest: upgradedManifest, hostVersion: '1.0.0' });
|
||
const upgradedSignature = trust.disclosureSignature(v2.disclosure);
|
||
|
||
assert.equal(upgradedSignature, storedSignature, 'the stored consent signature must still match after the upgrade');
|
||
assert.equal(
|
||
trust.executableSetChanged(v1.disclosure, v2.disclosure),
|
||
false,
|
||
'gaining a skill must not force a re-consent prompt',
|
||
);
|
||
assert.equal(v2.requiresConsent, false, 'a skill-only capability requires no consent at all');
|
||
});
|
||
});
|
||
|
||
// ─── J. Independence — missingArtifacts (row 25) ────────────────────────────
|
||
|
||
describe('J. Independence — missingArtifacts', () => {
|
||
test('skill stems are never existence-checked against stagedDir', (t) => {
|
||
const dir = fs.mkdtempSync(path.join(os.tmpdir(), 'instr-surface-j1-'));
|
||
t.after(() => cleanup(dir));
|
||
|
||
const manifest = { id: 'x', skills: ['nonexistent-skill-stem', 'another-missing-one'] };
|
||
const d = trust.discloseExecutableSurfaces(manifest, dir);
|
||
assert.deepEqual(
|
||
d.missingArtifacts,
|
||
[],
|
||
'skill stems are registry names, not bundle-relative artifact paths — they must never contribute to missingArtifacts',
|
||
);
|
||
assert.equal(d.instructionSurfaces.length, 2, 'the skills must still be disclosed');
|
||
});
|
||
});
|
||
|
||
// ─── K. Consent prompt (rows 26-27) ──────────────────────────────────────────
|
||
//
|
||
// `summarizeInstructionSurfaces(disclosure)` is the typed surface the implementation added for
|
||
// exactly this: CONTRIBUTING's "Prohibited: Raw Text Matching on Test Outputs" forbids regex-matching
|
||
// `summarizeDisclosure`'s rendered prose, so these rows assert on that function's structured output
|
||
// (its length against the declared surface count) and on ARRAY CONTAINMENT between the two
|
||
// renderers — never on the wording of a line.
|
||
|
||
describe('K. Consent prompt', () => {
|
||
test('consent prompt names instruction surfaces separately', () => {
|
||
const manifest = { id: 'x', skills: ['ui-phase', 'ui-review'] };
|
||
const d = trust.discloseExecutableSurfaces(manifest);
|
||
assert.deepEqual(d.instructionSurfaces, [
|
||
{ kind: 'skill', name: 'ui-phase' },
|
||
{ kind: 'skill', name: 'ui-review' },
|
||
]);
|
||
assert.deepEqual(d.hooks, [], 'instruction surfaces must not be folded into an executable-surface class');
|
||
assert.equal(d.hasExecutable, false, 'a skill-only manifest never requires consent from this data');
|
||
|
||
// One header line + one line per surface + one "not content-scanned" line.
|
||
const section = trust.summarizeInstructionSurfaces(d);
|
||
assert.equal(section.length, d.instructionSurfaces.length + 2, 'every declared surface gets its own line');
|
||
});
|
||
|
||
test('consent prompt omits the section when there is nothing to disclose', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x' });
|
||
assert.deepEqual(d.instructionSurfaces, []);
|
||
assert.deepEqual(
|
||
trust.summarizeInstructionSurfaces(d),
|
||
[],
|
||
'nothing declared => no lines at all, so no empty header can render',
|
||
);
|
||
});
|
||
|
||
// Row 26a — the defect this phase is most likely to ship silently. A skill-only capability has
|
||
// hasExecutable === false and takes summarizeDisclosure's EARLY RETURN, so a section appended only
|
||
// at the end of the function would never render for precisely the capabilities that need it.
|
||
// Asserted as ARRAY CONTAINMENT of one renderer's output in the other's — a structural property,
|
||
// not a prose match.
|
||
test('a skill-only capability still renders its instruction surfaces in the consent summary', () => {
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: ['ui-phase'] });
|
||
assert.equal(d.hasExecutable, false, 'precondition: this manifest takes the early-return branch');
|
||
const section = trust.summarizeInstructionSurfaces(d);
|
||
const summary = trust.summarizeDisclosure(d);
|
||
assert.ok(section.length > 0, 'precondition: there is a section to render');
|
||
for (const line of section) {
|
||
assert.ok(summary.includes(line), 'every instruction-surface line must reach the rendered summary');
|
||
}
|
||
});
|
||
|
||
// Row 26b — the same containment property for a capability that ships BOTH, where the summary
|
||
// takes the executable branch instead.
|
||
test('a capability with both executable and instruction surfaces renders both', () => {
|
||
const manifest = executableSurfaceManifest((m) => {
|
||
m.skills = ['ui-phase'];
|
||
m.agents = ['gsd-ui-checker'];
|
||
});
|
||
const d = trust.discloseExecutableSurfaces(manifest);
|
||
assert.equal(d.hasExecutable, true, 'precondition: this manifest takes the executable branch');
|
||
const section = trust.summarizeInstructionSurfaces(d);
|
||
const summary = trust.summarizeDisclosure(d);
|
||
// Skills-only: the declared `agents` entry is not collected, so this is 1 surface (the
|
||
// skill), not 2 — header + 1 surface + the not-scanned line.
|
||
assert.equal(section.length, 3, 'header + 1 surface + the not-scanned line');
|
||
for (const line of section) {
|
||
assert.ok(summary.includes(line), 'every instruction-surface line must reach the rendered summary');
|
||
}
|
||
});
|
||
|
||
// Row 26c — the CLI edge calls `summarizeDisclosure(res.disclosure || {})`
|
||
// (gsd-core/bin/lib/capability-command-router.cjs), so a BARE `{}` carrying no arrays at all
|
||
// reaches both renderers whenever a lifecycle result has no disclosure. Reading
|
||
// `.instructionSurfaces.length` off that object unguarded would throw a TypeError at the consent
|
||
// prompt — a crash on the exact path that is supposed to inform the user.
|
||
test('a partial disclosure object from the CLI edge never throws', () => {
|
||
assert.doesNotThrow(() => trust.summarizeInstructionSurfaces({}));
|
||
assert.deepEqual(trust.summarizeInstructionSurfaces({}), []);
|
||
assert.doesNotThrow(() => trust.summarizeDisclosure({}));
|
||
assert.deepEqual(trust.summarizeDisclosure({}), ['This capability ships no executable surfaces (declarative only).']);
|
||
});
|
||
|
||
// Row 26d — a manifest may declare an unbounded number of stems. `lines.push(...section)` would
|
||
// exceed the engine's argument limit and throw RangeError here; the renderer must iterate. This
|
||
// guards a "simplification" back to spread, which no smaller fixture can catch.
|
||
test('an unbounded stem count does not break the renderer', () => {
|
||
const stems = Array.from({ length: 200000 }, (_, i) => `s${i}`);
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: stems });
|
||
assert.equal(d.instructionSurfaces.length, 200000);
|
||
let summary;
|
||
assert.doesNotThrow(() => {
|
||
summary = trust.summarizeDisclosure(d);
|
||
});
|
||
assert.equal(summary.length, 200000 + 3, 'intro line + header + one line per stem + the not-scanned line');
|
||
});
|
||
});
|
||
|
||
// ─── L. Cross-platform (row 28) ──────────────────────────────────────────────
|
||
|
||
describe('L. Cross-platform', () => {
|
||
test('CRLF in a stem does not split the entry', () => {
|
||
const stem = 'ui-phase\r\nwith-crlf';
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: [stem] });
|
||
assert.deepEqual(
|
||
d.instructionSurfaces,
|
||
[{ kind: 'skill', name: stem }],
|
||
'a CRLF inside a stem must be disclosed verbatim as ONE entry, never split into two',
|
||
);
|
||
});
|
||
});
|
||
|
||
// ─── M. Property-based (fast-check) ─────────────────────────────────────────
|
||
//
|
||
// Generalizes the hand-written A-L fixtures with an ADVERSARIAL manifest arbitrary: valid string
|
||
// stems mixed with non-strings, blanks, nested arrays, nested objects, nulls, and (via
|
||
// `instructionFieldArb`'s low-weight branch) `skills`/`agents` occasionally replaced wholesale by a
|
||
// non-array. `manifestArb` STILL GENERATES `agents` (good — hostile/adversarial input coverage),
|
||
// but `agents` is never collected into `instructionSurfaces`: only `skills` feeds
|
||
// `collectInstructionSurfaces`'s per-field loop (`INSTRUCTION_SURFACE_FIELDS` is a one-row table).
|
||
// `manifestArb` always yields a plain object (never array/null/Proxy — those totality
|
||
// cases are covered directly in section C/D) so P2/P3 can safely spread-and-delete `skills`/`agents`
|
||
// off the SAME generated manifest, matching this file's `refDiscloseExecutableSurfaces`/section D's
|
||
// established idiom of importing fast-check as `const fc = require('fast-check')` and calling
|
||
// `fc.assert(fc.property(...))` with no per-call seed/numRuns override.
|
||
|
||
describe('M. Property-based (fast-check)', () => {
|
||
const stringArb = fc.string();
|
||
const blankArb = fc.constantFrom('', ' ', '\n', '\t');
|
||
const nonStringStemArb = fc.oneof(
|
||
fc.integer(),
|
||
fc.boolean(),
|
||
fc.constant(null),
|
||
fc.constant(undefined),
|
||
fc.array(stringArb, { maxLength: 3 }),
|
||
fc.object({ maxDepth: 1 }),
|
||
);
|
||
const stemMemberArb = fc.oneof(
|
||
{ weight: 3, arbitrary: stringArb },
|
||
{ weight: 1, arbitrary: blankArb },
|
||
{ weight: 1, arbitrary: nonStringStemArb },
|
||
);
|
||
const stemsArrayArb = fc.array(stemMemberArb, { maxLength: 6 });
|
||
// Occasionally replace the whole field with a non-array (a scalar, null, or a plain object) —
|
||
// exercises `collectInstructionSurfaces`'s "a non-array field declares nothing" branch.
|
||
const instructionFieldArb = fc.oneof(
|
||
{ weight: 5, arbitrary: stemsArrayArb },
|
||
{ weight: 1, arbitrary: fc.oneof(stringArb, fc.integer(), fc.constant(null), fc.object({ maxDepth: 1 })) },
|
||
);
|
||
|
||
const hookArb = fc.record({ event: stringArb, script: stringArb }, { requiredKeys: [] });
|
||
const commandArb = fc.record({ family: stringArb, module: stringArb, router: stringArb }, { requiredKeys: [] });
|
||
const mcpConfigArb = fc.record(
|
||
{ command: stringArb, args: fc.array(fc.oneof(stringArb, fc.integer())) },
|
||
{ requiredKeys: [] },
|
||
);
|
||
|
||
// Always a plain object — P2/P3 rely on being able to spread it and delete skills/agents.
|
||
const manifestArb = fc.record(
|
||
{
|
||
id: stringArb,
|
||
hooks: fc.array(hookArb, { maxLength: 3 }),
|
||
commands: fc.array(commandArb, { maxLength: 3 }),
|
||
mcpServers: fc.dictionary(stringArb, mcpConfigArb),
|
||
skills: instructionFieldArb,
|
||
agents: instructionFieldArb,
|
||
},
|
||
{ requiredKeys: [] },
|
||
);
|
||
|
||
/** `m` with `skills`/`agents` deleted — the D4 "sans instruction surfaces" comparison object. */
|
||
function withoutInstructionFields(m) {
|
||
const m2 = { ...m };
|
||
delete m2.skills;
|
||
delete m2.agents;
|
||
return m2;
|
||
}
|
||
|
||
test('P1: discloseExecutableSurfaces is total and every instruction surface is well-shaped', () => {
|
||
fc.assert(
|
||
fc.property(manifestArb, (manifest) => {
|
||
let d;
|
||
assert.doesNotThrow(() => {
|
||
d = trust.discloseExecutableSurfaces(manifest);
|
||
}, `discloseExecutableSurfaces threw for manifest=${JSON.stringify(manifest)}`);
|
||
assert.ok(Array.isArray(d.instructionSurfaces), 'instructionSurfaces must always be an array');
|
||
for (const surface of d.instructionSurfaces) {
|
||
// Skills-only: `agents` is generated by the arbitrary but never collected, so every
|
||
// disclosed instruction surface must be a skill.
|
||
assert.equal(surface.kind, 'skill', `unexpected kind ${JSON.stringify(surface.kind)}`);
|
||
assert.equal(typeof surface.name, 'string', `name must be a string, got ${typeof surface.name}`);
|
||
assert.ok(surface.name.length > 0, 'name must be non-empty');
|
||
}
|
||
}),
|
||
);
|
||
});
|
||
|
||
test('P2: ADR-2363 D4 — instruction surfaces never perturb the disclosure signature', () => {
|
||
fc.assert(
|
||
fc.property(manifestArb, (manifest) => {
|
||
const m2 = withoutInstructionFields(manifest);
|
||
assert.equal(
|
||
trust.signatureForManifest(manifest),
|
||
trust.signatureForManifest(m2),
|
||
`signature diverged for manifest=${JSON.stringify(manifest)}`,
|
||
);
|
||
}),
|
||
);
|
||
});
|
||
|
||
test('P3: ADR-2363 D3 — instruction surfaces never perturb hasExecutable', () => {
|
||
fc.assert(
|
||
fc.property(manifestArb, (manifest) => {
|
||
const m2 = withoutInstructionFields(manifest);
|
||
assert.equal(
|
||
trust.discloseExecutableSurfaces(manifest).hasExecutable,
|
||
trust.discloseExecutableSurfaces(m2).hasExecutable,
|
||
`hasExecutable diverged for manifest=${JSON.stringify(manifest)}`,
|
||
);
|
||
}),
|
||
);
|
||
});
|
||
|
||
test('P4: summarizeInstructionSurfaces is total and its length tracks instructionSurfaces.length', () => {
|
||
fc.assert(
|
||
fc.property(manifestArb, (manifest) => {
|
||
const d = trust.discloseExecutableSurfaces(manifest);
|
||
let section;
|
||
assert.doesNotThrow(() => {
|
||
section = trust.summarizeInstructionSurfaces(d);
|
||
}, `summarizeInstructionSurfaces threw for manifest=${JSON.stringify(manifest)}`);
|
||
if (d.instructionSurfaces.length === 0) {
|
||
assert.deepEqual(section, []);
|
||
} else {
|
||
assert.equal(section.length, d.instructionSurfaces.length + 2);
|
||
}
|
||
}),
|
||
);
|
||
});
|
||
});
|
||
|
||
// ─── N. Consent-prompt injection safety ─────────────────────────────────────
|
||
//
|
||
// #3248 BLOCKER finding: `summarizeDisclosure`'s lines are joined with `\n` and written RAW to
|
||
// stderr on the needs-consent path (`capability-command-router.cjs`). An unescaped newline in a
|
||
// manifest-supplied value forged lines indistinguishable from genuine GSD disclosure text, and an
|
||
// unescaped ANSI/control sequence could rewrite already-printed terminal lines. `renderValueForPrompt`
|
||
// is the fix: every manifest-supplied value rendered into a consent-prompt line is escaped and
|
||
// length-bounded first. The DISCLOSURE OBJECT itself still carries values VERBATIM (unchanged) —
|
||
// only the RENDERED line is escaped.
|
||
//
|
||
// Assertions here are on TYPED values and STRUCTURAL properties only (array length, character-class
|
||
// absence) — CONTRIBUTING.md forbids regex-matching rendered prose. Checking a rendered line for the
|
||
// ABSENCE of specific control characters is a structural safety property, not a prose match.
|
||
|
||
describe('N. Consent-prompt injection safety', () => {
|
||
// Every character that must never survive into a rendered consent-prompt line: C0, DEL, C1, the
|
||
// bidi/isolate controls, and the line/paragraph separators. A raw newline forges a line that is
|
||
// indistinguishable from genuine GSD disclosure text; a raw ESC lets a manifest value rewrite lines
|
||
// already printed to the terminal. Defined independently of `src/capability-trust.cts`'s own
|
||
// `UNSAFE_PROMPT_CHARS` (not imported) so this test does not just echo the implementation back at
|
||
// itself — it is an independent restatement of the same forbidden-character contract.
|
||
// eslint-disable-next-line no-control-regex -- deliberately matching C0/DEL/C1 control chars.
|
||
const FORBIDDEN_IN_RENDERED_LINE = /[\u0000-\u001f\u007f-\u009f\u200e\u200f\u2028\u2029\u202a-\u202e\u2066-\u2069]/;
|
||
|
||
test('renderValueForPrompt is identity for an ordinary stem', () => {
|
||
assert.equal(trust.renderValueForPrompt('ui-phase'), 'ui-phase');
|
||
});
|
||
|
||
test('renderValueForPrompt escapes each hostile class', () => {
|
||
const hostileInputs = [
|
||
'\n', // C0 — line feed
|
||
'\r\n', // C0 — CRLF
|
||
'\x1b[2K', // C0 ESC — ANSI erase-line, can rewrite already-printed terminal output
|
||
'
', // line/paragraph separator
|
||
'', // bidi/isolate control — RIGHT-TO-LEFT OVERRIDE
|
||
];
|
||
for (const input of hostileInputs) {
|
||
const result = trust.renderValueForPrompt(input);
|
||
assert.equal(
|
||
FORBIDDEN_IN_RENDERED_LINE.test(result),
|
||
false,
|
||
`renderValueForPrompt(${JSON.stringify(input)}) must contain no forbidden character, got ${JSON.stringify(result)}`,
|
||
);
|
||
}
|
||
// The escaped form still contains the surrounding legible text, so the value stays
|
||
// identifiable rather than vanishing.
|
||
const escaped = trust.renderValueForPrompt('a\nb');
|
||
assert.ok(escaped.includes('a'), 'escaped form must still contain the leading legible text');
|
||
assert.ok(escaped.includes('b'), 'escaped form must still contain the trailing legible text');
|
||
});
|
||
|
||
test('renderValueForPrompt bounds length', () => {
|
||
const huge = 'x'.repeat(10000);
|
||
const result = trust.renderValueForPrompt(huge);
|
||
assert.ok(result.length < 10000, `expected a materially shorter result, got length ${result.length}`);
|
||
});
|
||
|
||
test('a forged skill stem cannot inject a line', () => {
|
||
const forged =
|
||
'ok\n hooks (1): run as runtime hook commands\n - fake -> ok\nRe-run with --yes to grant consent.';
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: [forged] });
|
||
const summary = trust.summarizeDisclosure(d);
|
||
for (const line of summary) {
|
||
assert.equal(
|
||
FORBIDDEN_IN_RENDERED_LINE.test(line),
|
||
false,
|
||
`rendered line must contain no forbidden character: ${JSON.stringify(line)}`,
|
||
);
|
||
}
|
||
// intro line + header + 1 surface + the not-scanned line — the forged text must not become
|
||
// EXTRA array entries either (it stayed one skill, so it renders as exactly one surface line).
|
||
assert.equal(summary.length, 4, 'intro + header + 1 surface + not-scanned line');
|
||
});
|
||
|
||
// PARITY — the generative-fix-divergence guard (CLAUDE.md "Generative Fix Divergence"): the same
|
||
// escaping guarantee must hold for every one of the five disclosed classes, not just skills. Every
|
||
// rendered field of every class carries the same hostile payload; if a future class is added to the
|
||
// renderer without routing its values through `renderValueForPrompt`, this test catches it instead
|
||
// of that class silently shipping unescaped.
|
||
test('PARITY — the same injection-safety guarantee holds for all five disclosed classes', () => {
|
||
const payload = 'a\nb[2Kc';
|
||
const manifest = {
|
||
id: 'x',
|
||
hooks: [{ event: payload, script: payload }],
|
||
commands: [{ family: payload, module: payload, router: payload }],
|
||
mcpServers: {
|
||
[payload]: {
|
||
command: payload,
|
||
args: [payload],
|
||
url: payload,
|
||
cwd: payload,
|
||
env: { [payload]: payload },
|
||
},
|
||
},
|
||
reviewer: {
|
||
slug: payload,
|
||
transport: 'spawn',
|
||
invoke: {
|
||
binary: payload,
|
||
args: [payload],
|
||
hostConfigKey: payload,
|
||
},
|
||
handler: payload,
|
||
},
|
||
skills: [payload],
|
||
};
|
||
const d = trust.discloseExecutableSurfaces(manifest);
|
||
const summary = trust.summarizeDisclosure(d);
|
||
for (const line of summary) {
|
||
assert.equal(
|
||
FORBIDDEN_IN_RENDERED_LINE.test(line),
|
||
false,
|
||
`rendered line must contain no forbidden character: ${JSON.stringify(line)}`,
|
||
);
|
||
}
|
||
});
|
||
|
||
// #2483 — the PARITY test above is hand-maintained, and that is its one structural weakness: its
|
||
// payload manifest enumerates the lane fields that existed when it was written, so a field added
|
||
// to the renderer LATER is simply absent from the payload and the guard passes over it vacuously.
|
||
// This PR adds three such fields — `invoke.env`, `invoke.defaultHost` and `probe.binary` — each
|
||
// manifest-supplied and each reaching a consent-prompt line, so each carries the same #3248
|
||
// escaping obligation as every field the block above covers.
|
||
//
|
||
// Measured before writing this: with the lane `env` line rendered RAW (the pre-#3248 form), the
|
||
// entire 948-test lane/capability/trust-disclosure suite stayed green. The escaping was real and
|
||
// completely unguarded.
|
||
//
|
||
// Two manifests are required because the two lane shapes render disjoint lines: `defaultHost` is
|
||
// emitted only on the openai-http branch, `env`/`probe` only reach a line on a lane that declares
|
||
// them. The probe binary must DIFFER from the dispatch binary or its line does not render at all.
|
||
test('PARITY — reviewer-lane env, defaultHost and probe binary are escaped too (#2483)', () => {
|
||
const payload = 'a\nb\u001b[2Kc';
|
||
const spawnManifest = {
|
||
id: 'x',
|
||
reviewer: {
|
||
slug: payload,
|
||
transport: 'spawn',
|
||
invoke: { binary: payload, args: [payload], env: { [payload]: payload } },
|
||
handler: payload,
|
||
probe: { binary: `${payload}-probe`, kind: 'command-capability' },
|
||
},
|
||
};
|
||
const httpManifest = {
|
||
id: 'x',
|
||
reviewer: {
|
||
slug: payload,
|
||
transport: 'openai-http',
|
||
invoke: { hostConfigKey: payload, defaultHost: payload },
|
||
},
|
||
};
|
||
|
||
for (const manifest of [spawnManifest, httpManifest]) {
|
||
const summary = trust.summarizeDisclosure(trust.discloseExecutableSurfaces(manifest));
|
||
for (const line of summary) {
|
||
assert.equal(
|
||
FORBIDDEN_IN_RENDERED_LINE.test(line),
|
||
false,
|
||
`rendered line must contain no forbidden character: ${JSON.stringify(line)}`,
|
||
);
|
||
}
|
||
}
|
||
|
||
// NON-VACUITY — asserted on the TYPED disclosure object and on structural line counts, never by
|
||
// substring-matching rendered prose (CONTRIBUTING.md § "Prohibited: Raw Text Matching on Test
|
||
// Outputs"; the section header above also promises structural assertions only, and a prose match
|
||
// here would make that promise false). Two legs, because they answer different halves:
|
||
// (a) the fixtures actually populate the typed fields, so the render conditions are reachable;
|
||
// (b) each field contributes exactly one line, so the sweep above had something to sweep.
|
||
const spawnLane = trust.discloseExecutableSurfaces(spawnManifest).reviewerLanes[0];
|
||
assert.equal(Object.keys(spawnLane.env).length, 1, 'fixture must populate the lane env');
|
||
assert.notEqual(
|
||
spawnLane.probeBinary,
|
||
spawnLane.binary,
|
||
'the probe line renders only when the probe binary differs from the dispatch binary',
|
||
);
|
||
const httpLane = trust.discloseExecutableSurfaces(httpManifest).reviewerLanes[0];
|
||
assert.notEqual(httpLane.defaultHost, '', 'fixture must populate defaultHost');
|
||
|
||
const lineCount = (m) => trust.summarizeDisclosure(trust.discloseExecutableSurfaces(m)).length;
|
||
const withoutEnv = structuredClone(spawnManifest);
|
||
delete withoutEnv.reviewer.invoke.env;
|
||
const withoutProbe = structuredClone(spawnManifest);
|
||
delete withoutProbe.reviewer.probe;
|
||
const withoutDefaultHost = structuredClone(httpManifest);
|
||
delete withoutDefaultHost.reviewer.invoke.defaultHost;
|
||
assert.equal(lineCount(spawnManifest) - lineCount(withoutEnv), 1, 'env contributes one line');
|
||
assert.equal(lineCount(spawnManifest) - lineCount(withoutProbe), 1, 'probe contributes one line');
|
||
assert.equal(
|
||
lineCount(httpManifest) - lineCount(withoutDefaultHost),
|
||
1,
|
||
'defaultHost contributes one line',
|
||
);
|
||
});
|
||
|
||
test('the disclosure OBJECT stays verbatim', () => {
|
||
// Escaping is a RENDERING concern only. The object must stay verbatim because
|
||
// `disclosureSignature` and any consumer reasoning about identity depend on the declared
|
||
// value, not the escaped-for-display one.
|
||
const forged = 'ok\n hooks (1): run as runtime hook commands\nRe-run with --yes to grant consent.';
|
||
const d = trust.discloseExecutableSurfaces({ id: 'x', skills: [forged] });
|
||
assert.equal(d.instructionSurfaces[0].name, forged, 'the disclosure object must carry the exact unescaped value');
|
||
});
|
||
});
|