search-and-scrape

Routes web search and page fetch requests across parallel-search, Exa, Perplexity, Jina Reader, and Firecrawl.

Updated Jun 26, 2026
One-click install
npx skills add https://github.com/alectivism/organization-ai-skills --skill search-and-scrape-alectivism
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: search-and-scrape
Source: https://github.com/alectivism/organization-ai-skills/tree/main/org-research/skills/search-and-scrape
Command: npx skills add https://github.com/alectivism/organization-ai-skills --skill search-and-scrape-alectivism

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? When an AI agent needs to search the web or fetch a page, it often defaults to a single tool regardless of the task, wasting credits on expensive APIs or failing on JavaScript-heavy and anti-bot pages. This Skill provides explicit decision tables so the right search or scraping tool is chosen for each situation. ## Core Features & Use Cases - Search Routing: Directs queries to parallel-search for general lookups, Exa for semantic and find-similar discovery, and Perplexity for synthesized cited answers or deep research reports. - Fetch/Scrape Routing: Uses Jina Reader as the fast, free default for clean markdown, escalating to Firecrawl only for JS-heavy pages, anti-bot protection, structured extraction, or multi-page crawls. - Platform Deferral: Hands off LinkedIn and Reddit requests to the dedicated linkedin-scrape and reddit-scrape skills, since Jina, Firecrawl, and WebFetch are blocked on those domains. - Use Case: You ask the agent to research a competitor and pull content from their blog. The Skill routes the discovery queries to parallel-search, fetches the articles via Jina Reader, and escalates to Firecrawl only if a page renders as empty JavaScript. ## Quick Start Ask the agent to search for recent news about a company and fetch the top article, and it will pick the appropriate search and fetch tools automatically.

Frequently Asked Questions about search-and-scrape

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I choose the right web search tool for a research task?▼

Use parallel-search for general facts and finding URLs, Exa for semantic or find-similar discovery, and Perplexity when you need a synthesized answer with citations or a deep multi-source research report. Match the tool to the query type rather than defaulting to one.

Jina Reader vs Firecrawl for scraping a web page?▼

Jina Reader is the default for normal pages, returning clean markdown quickly and free. Escalate to Firecrawl only when the page is JavaScript-heavy, behind anti-bot protection, needs structured extraction, or requires a multi-page crawl.

Why does fetching a LinkedIn or Reddit page fail?▼

Jina Reader, Firecrawl, and WebFetch are all blocked from linkedin.com and reddit.com. Use the dedicated linkedin-scrape and reddit-scrape skills instead, or append .json to a Reddit URL for raw data.

When should I use Perplexity deep research instead of a normal search?▼

Reserve perplexity_research for genuine multi-source deep dives where spending 30 or more seconds is acceptable. For single factual questions, perplexity_ask or parallel-search answers cheaper and faster.

Does this search routing work in Claude Desktop or mobile?▼

No, the routing logic applies only in Claude Code, since skills do not apply in Claude Desktop or mobile. The tool tables assume access to MCP-based search and fetch tools.