What problem does it solve? Getting clean, usable content from the modern web is hard: pages rely on JavaScript rendering, sit behind anti-bot protections, and lack structured formats. This Skill wraps the Firecrawl CLI so you can scrape pages as markdown, crawl entire sites, search the web, and extract structured data without writing scraping infrastructure. ## Core Features & Use Cases - Page Scraping: Convert any URL to clean markdown, HTML, links, or screenshots, with JS-rendering waits and main-content filtering. - Site Crawling & Mapping: Discover all URLs on a site with map, then recursively crawl documentation or blog sites with depth, path, and concurrency controls. - Search & Extraction: Run web searches with time/category filters and optional full-content scraping, or extract typed JSON from pages using LLM prompts and schemas. - AI Research Agent: Launch autonomous multi-step web research jobs with credit limits and structured output. - Use Case: You need to ingest an entire documentation site into your knowledge base. Map the site to find relevant pages, then crawl only the /api/* paths with a page limit, saving results as markdown files. ## Quick Start Ask the AI to scrape a specific URL into clean markdown using Firecrawl, for example to pull the main content of a documentation page.
