firecrawl

Run firecrawl scrape followed by the quoted URL and an output flag, for example firecrawl scrape "https://example.com" -o .firecrawl/page.md. It handles both static pages and JS-rendered SPAs, returning clean markdown.

Use firecrawl search with your query, such as firecrawl search "react hooks" -o .firecrawl/results.json --json. Adding --scrape fetches full page content for each result so you avoid re-scraping those URLs later.

Search, scrape, and interact work on a keyless free tier with rate limits. Commands like crawl, map, download, agent, and monitor require an account via firecrawl login --browser or an API key from firecrawl.dev.

Use scrape when you have a specific URL, map when you need to locate a subpage within a known site, and crawl when you need bulk content from an entire site section such as all pages under /docs/.

These errors are terminal for that call and retrying yields the same result. Run firecrawl --status to verify auth state and remaining credits, then re-authenticate with firecrawl login --browser or provide a valid API key.

Yes, the monitor command schedules recurring scrapes or crawls and diffs results against snapshots for change alerts. It requires authentication and supports goals, schedules, and webhook or email notifications.