feat: add Exa and Firecrawl MCP support for research agents

Integrate Exa (semantic search) and Firecrawl (deep web scraping) as
MCP-based research tools, following the existing Brave Search pattern.

- Add tool declarations to all 3 researcher agents
- Add tool strategy sections with usage guidance and priority
- Add config detection for FIRECRAWL_API_KEY and EXA_API_KEY env vars
- Add firecrawl/exa_search config keys to core defaults and init output
- Update source priority hierarchy across all researchers
This commit is contained in:
benzntech
2026-03-20 14:53:46 +05:30
parent f12a40015e
commit b621d556f0
6 changed files with 87 additions and 7 deletions

View File

@@ -1,7 +1,7 @@
---
name: gsd-phase-researcher
description: Researches how to implement a phase before planning. Produces RESEARCH.md consumed by gsd-planner. Spawned by /gsd:plan-phase orchestrator.
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*, mcp__firecrawl__*, mcp__exa__*
color: cyan
# hooks:
# PostToolUse:
@@ -137,6 +137,31 @@ If `brave_search: false` (or not set), use built-in WebSearch tool instead.
Brave Search provides an independent index (not Google/Bing dependent) with less SEO spam and faster responses.
### Exa Semantic Search (MCP)
Check `exa_search` from init context. If `true`, use Exa for semantic, research-heavy queries:
```
mcp__exa__web_search_exa with query: "your semantic query"
```
**Best for:** Research questions where keyword search fails — "best approaches to X", finding technical/academic content, discovering niche libraries. Returns semantically relevant results.
If `exa_search: false` (or not set), fall back to WebSearch or Brave Search.
### Firecrawl Deep Scraping (MCP)
Check `firecrawl` from init context. If `true`, use Firecrawl to extract structured content from URLs:
```
mcp__firecrawl__scrape with url: "https://docs.example.com/guide"
mcp__firecrawl__search with query: "your query" (web search + auto-scrape results)
```
**Best for:** Extracting full page content from documentation, blog posts, GitHub READMEs. Use after finding a URL from Exa, WebSearch, or known docs. Returns clean markdown.
If `firecrawl: false` (or not set), fall back to WebFetch.
## Verification Protocol
**WebSearch findings MUST be verified:**
@@ -161,7 +186,7 @@ For each WebSearch finding:
| MEDIUM | WebSearch verified with official source, multiple credible sources | State with attribution |
| LOW | WebSearch only, single source, unverified | Flag as needing validation |
Priority: Context7 > Official Docs > Official GitHub > Verified WebSearch > Unverified WebSearch
Priority: Context7 > Exa (verified) > Firecrawl (official docs) > Official GitHub > Brave/WebSearch (verified) > WebSearch (unverified)
</source_hierarchy>

View File

@@ -1,7 +1,7 @@
---
name: gsd-project-researcher
description: Researches domain ecosystem before roadmap creation. Produces files in .planning/research/ consumed during roadmap creation. Spawned by /gsd:new-project or /gsd:new-milestone orchestrators.
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*, mcp__firecrawl__*, mcp__exa__*
color: cyan
# hooks:
# PostToolUse:
@@ -116,6 +116,31 @@ If `brave_search: false` (or not set), use built-in WebSearch tool instead.
Brave Search provides an independent index (not Google/Bing dependent) with less SEO spam and faster responses.
### Exa Semantic Search (MCP)
Check `exa_search` from orchestrator context. If `true`, use Exa for research-heavy, semantic queries:
```
mcp__exa__web_search_exa with query: "your semantic query"
```
**Best for:** Research questions where keyword search fails — "best approaches to X", finding technical/academic content, discovering niche libraries, ecosystem exploration. Returns semantically relevant results rather than keyword matches.
If `exa_search: false` (or not set), fall back to WebSearch or Brave Search.
### Firecrawl Deep Scraping (MCP)
Check `firecrawl` from orchestrator context. If `true`, use Firecrawl to extract structured content from discovered URLs:
```
mcp__firecrawl__scrape with url: "https://docs.example.com/guide"
mcp__firecrawl__search with query: "your query" (web search + auto-scrape results)
```
**Best for:** Extracting full page content from documentation, blog posts, GitHub READMEs, comparison articles. Use after finding a relevant URL from Exa, WebSearch, or known docs. Returns clean markdown instead of raw HTML.
If `firecrawl: false` (or not set), fall back to WebFetch.
## Verification Protocol
**WebSearch findings must be verified:**
@@ -138,7 +163,7 @@ Never present LOW confidence findings as authoritative.
| MEDIUM | WebSearch verified with official source, multiple credible sources agree | State with attribution |
| LOW | WebSearch only, single source, unverified | Flag as needing validation |
**Source priority:** Context7 → Official Docs → Official GitHub → WebSearch (verified) → WebSearch (unverified)
**Source priority:** Context7 → Exa (verified) → Firecrawl (official docs) → Official GitHub → Brave/WebSearch (verified) → WebSearch (unverified)
</tool_strategy>

View File

@@ -1,7 +1,7 @@
---
name: gsd-ui-researcher
description: Produces UI-SPEC.md design contract for frontend phases. Reads upstream artifacts, detects design system state, asks only unanswered questions. Spawned by /gsd:ui-phase orchestrator.
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*
tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*, mcp__firecrawl__*, mcp__exa__*
color: "#E879F9"
# hooks:
# PostToolUse:
@@ -89,7 +89,11 @@ Your UI-SPEC.md is consumed by:
|----------|------|---------|-------------|
| 1st | Codebase Grep/Glob | Existing tokens, components, styles, config files | HIGH |
| 2nd | Context7 | Component library API docs, shadcn preset format | HIGH |
| 3rd | WebSearch | Design pattern references, accessibility standards | Needs verification |
| 3rd | Exa (MCP) | Design pattern references, accessibility standards, semantic research | MEDIUM (verify) |
| 4th | Firecrawl (MCP) | Deep scrape component library docs, design system references | HIGH (content depends on source) |
| 5th | WebSearch | Fallback keyword search for ecosystem discovery | Needs verification |
**Exa/Firecrawl:** Check `exa_search` and `firecrawl` from orchestrator context. If `true`, prefer Exa for discovery and Firecrawl for scraping over WebSearch/WebFetch.
**Codebase first:** Always scan the project for existing design decisions before asking.