crawl4ai
CommunityWeb crawling with Crawl4AI for AI-ready outputs.
Authoralexjx
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill provides a robust web crawling pipeline that converts web pages to clean, LLM-friendly markdown for AI processing, enabling reliable extraction and downstream analysis.
Core Features & Use Cases
- Isolated Python environment: Uses uv to manage execution and dependencies, ensuring clean, reproducible runs.
- URL-to-markdown conversion: Crawls pages and outputs markdown suitable for ingestion into LLM workflows.
- Rich outputs: Generates markdown, HTML, screenshots, PDFs, and MHTML archives for downstream tasks.
Quick Start
From the skill directory, run uv run python scripts/crawl.py "https://example.com" to crawl a page and generate markdown.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: crawl4ai Download link: https://github.com/alexjx/skills/archive/main.zip#crawl4ai Please download this .zip file, extract it, and install it in the .claude/skills/ directory.