feat: add Exa and Firecrawl MCP support for research agents
Integrate Exa (semantic search) and Firecrawl (deep web scraping) as MCP-based research tools, following the existing Brave Search pattern. - Add tool declarations to all 3 researcher agents - Add tool strategy sections with usage guidance and priority - Add config detection for FIRECRAWL_API_KEY and EXA_API_KEY env vars - Add firecrawl/exa_search config keys to core defaults and init output - Update source priority hierarchy across all researchers
This commit is contained in:
@@ -1,7 +1,7 @@
|
||||
---
|
||||
name: gsd-phase-researcher
|
||||
description: Researches how to implement a phase before planning. Produces RESEARCH.md consumed by gsd-planner. Spawned by /gsd:plan-phase orchestrator.
|
||||
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*
|
||||
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*, mcp__firecrawl__*, mcp__exa__*
|
||||
color: cyan
|
||||
# hooks:
|
||||
# PostToolUse:
|
||||
@@ -137,6 +137,31 @@ If `brave_search: false` (or not set), use built-in WebSearch tool instead.
|
||||
|
||||
Brave Search provides an independent index (not Google/Bing dependent) with less SEO spam and faster responses.
|
||||
|
||||
### Exa Semantic Search (MCP)
|
||||
|
||||
Check `exa_search` from init context. If `true`, use Exa for semantic, research-heavy queries:
|
||||
|
||||
```
|
||||
mcp__exa__web_search_exa with query: "your semantic query"
|
||||
```
|
||||
|
||||
**Best for:** Research questions where keyword search fails — "best approaches to X", finding technical/academic content, discovering niche libraries. Returns semantically relevant results.
|
||||
|
||||
If `exa_search: false` (or not set), fall back to WebSearch or Brave Search.
|
||||
|
||||
### Firecrawl Deep Scraping (MCP)
|
||||
|
||||
Check `firecrawl` from init context. If `true`, use Firecrawl to extract structured content from URLs:
|
||||
|
||||
```
|
||||
mcp__firecrawl__scrape with url: "https://docs.example.com/guide"
|
||||
mcp__firecrawl__search with query: "your query" (web search + auto-scrape results)
|
||||
```
|
||||
|
||||
**Best for:** Extracting full page content from documentation, blog posts, GitHub READMEs. Use after finding a URL from Exa, WebSearch, or known docs. Returns clean markdown.
|
||||
|
||||
If `firecrawl: false` (or not set), fall back to WebFetch.
|
||||
|
||||
## Verification Protocol
|
||||
|
||||
**WebSearch findings MUST be verified:**
|
||||
@@ -161,7 +186,7 @@ For each WebSearch finding:
|
||||
| MEDIUM | WebSearch verified with official source, multiple credible sources | State with attribution |
|
||||
| LOW | WebSearch only, single source, unverified | Flag as needing validation |
|
||||
|
||||
Priority: Context7 > Official Docs > Official GitHub > Verified WebSearch > Unverified WebSearch
|
||||
Priority: Context7 > Exa (verified) > Firecrawl (official docs) > Official GitHub > Brave/WebSearch (verified) > WebSearch (unverified)
|
||||
|
||||
</source_hierarchy>
|
||||
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
---
|
||||
name: gsd-project-researcher
|
||||
description: Researches domain ecosystem before roadmap creation. Produces files in .planning/research/ consumed during roadmap creation. Spawned by /gsd:new-project or /gsd:new-milestone orchestrators.
|
||||
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*
|
||||
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*, mcp__firecrawl__*, mcp__exa__*
|
||||
color: cyan
|
||||
# hooks:
|
||||
# PostToolUse:
|
||||
@@ -116,6 +116,31 @@ If `brave_search: false` (or not set), use built-in WebSearch tool instead.
|
||||
|
||||
Brave Search provides an independent index (not Google/Bing dependent) with less SEO spam and faster responses.
|
||||
|
||||
### Exa Semantic Search (MCP)
|
||||
|
||||
Check `exa_search` from orchestrator context. If `true`, use Exa for research-heavy, semantic queries:
|
||||
|
||||
```
|
||||
mcp__exa__web_search_exa with query: "your semantic query"
|
||||
```
|
||||
|
||||
**Best for:** Research questions where keyword search fails — "best approaches to X", finding technical/academic content, discovering niche libraries, ecosystem exploration. Returns semantically relevant results rather than keyword matches.
|
||||
|
||||
If `exa_search: false` (or not set), fall back to WebSearch or Brave Search.
|
||||
|
||||
### Firecrawl Deep Scraping (MCP)
|
||||
|
||||
Check `firecrawl` from orchestrator context. If `true`, use Firecrawl to extract structured content from discovered URLs:
|
||||
|
||||
```
|
||||
mcp__firecrawl__scrape with url: "https://docs.example.com/guide"
|
||||
mcp__firecrawl__search with query: "your query" (web search + auto-scrape results)
|
||||
```
|
||||
|
||||
**Best for:** Extracting full page content from documentation, blog posts, GitHub READMEs, comparison articles. Use after finding a relevant URL from Exa, WebSearch, or known docs. Returns clean markdown instead of raw HTML.
|
||||
|
||||
If `firecrawl: false` (or not set), fall back to WebFetch.
|
||||
|
||||
## Verification Protocol
|
||||
|
||||
**WebSearch findings must be verified:**
|
||||
@@ -138,7 +163,7 @@ Never present LOW confidence findings as authoritative.
|
||||
| MEDIUM | WebSearch verified with official source, multiple credible sources agree | State with attribution |
|
||||
| LOW | WebSearch only, single source, unverified | Flag as needing validation |
|
||||
|
||||
**Source priority:** Context7 → Official Docs → Official GitHub → WebSearch (verified) → WebSearch (unverified)
|
||||
**Source priority:** Context7 → Exa (verified) → Firecrawl (official docs) → Official GitHub → Brave/WebSearch (verified) → WebSearch (unverified)
|
||||
|
||||
</tool_strategy>
|
||||
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
---
|
||||
name: gsd-ui-researcher
|
||||
description: Produces UI-SPEC.md design contract for frontend phases. Reads upstream artifacts, detects design system state, asks only unanswered questions. Spawned by /gsd:ui-phase orchestrator.
|
||||
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*
|
||||
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*, mcp__firecrawl__*, mcp__exa__*
|
||||
color: "#E879F9"
|
||||
# hooks:
|
||||
# PostToolUse:
|
||||
@@ -89,7 +89,11 @@ Your UI-SPEC.md is consumed by:
|
||||
|----------|------|---------|-------------|
|
||||
| 1st | Codebase Grep/Glob | Existing tokens, components, styles, config files | HIGH |
|
||||
| 2nd | Context7 | Component library API docs, shadcn preset format | HIGH |
|
||||
| 3rd | WebSearch | Design pattern references, accessibility standards | Needs verification |
|
||||
| 3rd | Exa (MCP) | Design pattern references, accessibility standards, semantic research | MEDIUM (verify) |
|
||||
| 4th | Firecrawl (MCP) | Deep scrape component library docs, design system references | HIGH (content depends on source) |
|
||||
| 5th | WebSearch | Fallback keyword search for ecosystem discovery | Needs verification |
|
||||
|
||||
**Exa/Firecrawl:** Check `exa_search` and `firecrawl` from orchestrator context. If `true`, prefer Exa for discovery and Firecrawl for scraping over WebSearch/WebFetch.
|
||||
|
||||
**Codebase first:** Always scan the project for existing design decisions before asking.
|
||||
|
||||
|
||||
Reference in New Issue
Block a user